2026-02-17T20:53:15.409 INFO:root:teuthology version: 0.0.1.dev31+g5f66ecfb3 2026-02-17T20:53:15.424 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T20:53:15.505 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862 branch: wip-yuri6-testing-2026-02-17-1732-squid description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false flavor: default job_id: '53862' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri6-testing-2026-02-17-1732-squid ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: debuginfo: true flavor: default sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2026-02-17-1732-squid sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 2987 sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri6-testing-2026-02-17-1732-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 targets: trial045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMy3NDbAmRHB66y1kYnnM2aRn2XHhqj7GBvGDOLK/MqRCqQY1iiEW5L5g8mqZuhv4qPDSZdTUVnyOJKesDRQaUk= trial086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGrUuo7j8DH2/wxmBcXNaiA2+IT6d975xOi5sioHy46TAV/LQf4jHP50YeC/xAz89qwBUY4sgx0TpgCAXp4YMnE= trial092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO43lVmkaPCgv38RI3n76MgHsjnbj33CU5JMyM8Vwo4NVNrNOJvYNdKV9DulJgFLK2zXSGEjr2EXR3hnGPLeK8M= trial138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVBea1YBDNgKDpnfI4xh9Nz1LeiU35ArFO3XM8l0ezkRBC7ijCpSXlXS3SksNXK8MVclAui0okoYW9NvbnwmyI= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: reimage-ssh-down teuthology_sha1: 5f66ecfb34c0370410e78b3ee641753d19da653b timestamp: 2026-02-17_20:43:43 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T20:53:15.505 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa; will attempt to use it 2026-02-17T20:53:15.506 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks 2026-02-17T20:53:15.506 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T20:53:15.507 INFO:teuthology.task.internal:Checking packages... 2026-02-17T20:53:15.507 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1' 2026-02-17T20:53:15.507 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T20:53:15.507 INFO:teuthology.packaging:ref: None 2026-02-17T20:53:15.507 INFO:teuthology.packaging:tag: None 2026-02-17T20:53:15.507 INFO:teuthology.packaging:branch: wip-yuri6-testing-2026-02-17-1732-squid 2026-02-17T20:53:15.507 INFO:teuthology.packaging:sha1: d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T20:53:15.508 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri6-testing-2026-02-17-1732-squid 2026-02-17T20:53:15.622 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-679.gd855f53b 2026-02-17T20:53:15.623 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T20:53:15.634 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T20:53:15.635 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T20:53:15.648 INFO:teuthology.task.internal:Saving configuration 2026-02-17T20:53:15.660 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T20:53:15.672 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T20:53:15.749 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial045.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 20:49:45.257037', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMy3NDbAmRHB66y1kYnnM2aRn2XHhqj7GBvGDOLK/MqRCqQY1iiEW5L5g8mqZuhv4qPDSZdTUVnyOJKesDRQaUk='} 2026-02-17T20:53:15.804 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial086.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 20:49:45.257408', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGrUuo7j8DH2/wxmBcXNaiA2+IT6d975xOi5sioHy46TAV/LQf4jHP50YeC/xAz89qwBUY4sgx0TpgCAXp4YMnE='} 2026-02-17T20:53:15.860 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial092.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 20:49:45.256007', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO43lVmkaPCgv38RI3n76MgHsjnbj33CU5JMyM8Vwo4NVNrNOJvYNdKV9DulJgFLK2zXSGEjr2EXR3hnGPLeK8M='} 2026-02-17T20:53:15.916 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial138.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 20:49:45.256626', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVBea1YBDNgKDpnfI4xh9Nz1LeiU35ArFO3XM8l0ezkRBC7ijCpSXlXS3SksNXK8MVclAui0okoYW9NvbnwmyI='} 2026-02-17T20:53:15.916 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T20:53:15.927 INFO:teuthology.task.internal:roles: ubuntu@trial045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-17T20:53:15.927 INFO:teuthology.task.internal:roles: ubuntu@trial086.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-17T20:53:15.927 INFO:teuthology.task.internal:roles: ubuntu@trial092.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-17T20:53:15.927 INFO:teuthology.task.internal:roles: ubuntu@trial138.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-17T20:53:15.927 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T20:53:16.928 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7b1fe28fbc40>, signals=[15]) 2026-02-17T20:53:16.928 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T20:53:16.939 INFO:teuthology.task.internal:Opening connections... 2026-02-17T20:53:16.939 DEBUG:teuthology.task.internal:connecting to ubuntu@trial045.front.sepia.ceph.com 2026-02-17T20:53:16.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:53:17.002 DEBUG:teuthology.task.internal:connecting to ubuntu@trial086.front.sepia.ceph.com 2026-02-17T20:53:17.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:53:17.065 DEBUG:teuthology.task.internal:connecting to ubuntu@trial092.front.sepia.ceph.com 2026-02-17T20:53:17.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:53:17.125 DEBUG:teuthology.task.internal:connecting to ubuntu@trial138.front.sepia.ceph.com 2026-02-17T20:53:17.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:53:17.188 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T20:53:17.200 DEBUG:teuthology.orchestra.run.trial045:> uname -m 2026-02-17T20:53:17.215 INFO:teuthology.orchestra.run.trial045.stdout:x86_64 2026-02-17T20:53:17.215 DEBUG:teuthology.orchestra.run.trial045:> cat /etc/os-release 2026-02-17T20:53:17.270 INFO:teuthology.orchestra.run.trial045.stdout:NAME="CentOS Stream" 2026-02-17T20:53:17.270 INFO:teuthology.orchestra.run.trial045.stdout:VERSION="9" 2026-02-17T20:53:17.270 INFO:teuthology.orchestra.run.trial045.stdout:ID="centos" 2026-02-17T20:53:17.270 INFO:teuthology.orchestra.run.trial045.stdout:ID_LIKE="rhel fedora" 2026-02-17T20:53:17.270 INFO:teuthology.orchestra.run.trial045.stdout:VERSION_ID="9" 2026-02-17T20:53:17.270 INFO:teuthology.orchestra.run.trial045.stdout:PLATFORM_ID="platform:el9" 2026-02-17T20:53:17.270 INFO:teuthology.orchestra.run.trial045.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T20:53:17.270 INFO:teuthology.orchestra.run.trial045.stdout:ANSI_COLOR="0;31" 2026-02-17T20:53:17.271 INFO:teuthology.orchestra.run.trial045.stdout:LOGO="fedora-logo-icon" 2026-02-17T20:53:17.271 INFO:teuthology.orchestra.run.trial045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T20:53:17.271 INFO:teuthology.orchestra.run.trial045.stdout:HOME_URL="https://centos.org/" 2026-02-17T20:53:17.271 INFO:teuthology.orchestra.run.trial045.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T20:53:17.271 INFO:teuthology.orchestra.run.trial045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T20:53:17.271 INFO:teuthology.orchestra.run.trial045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T20:53:17.271 INFO:teuthology.lock.ops:Updating trial045.front.sepia.ceph.com on lock server 2026-02-17T20:53:17.353 DEBUG:teuthology.orchestra.run.trial086:> uname -m 2026-02-17T20:53:17.369 INFO:teuthology.orchestra.run.trial086.stdout:x86_64 2026-02-17T20:53:17.369 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release 2026-02-17T20:53:17.424 INFO:teuthology.orchestra.run.trial086.stdout:NAME="CentOS Stream" 2026-02-17T20:53:17.424 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="9" 2026-02-17T20:53:17.424 INFO:teuthology.orchestra.run.trial086.stdout:ID="centos" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel fedora" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="9" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el9" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;31" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://centos.org/" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T20:53:17.425 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T20:53:17.425 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server 2026-02-17T20:53:17.505 DEBUG:teuthology.orchestra.run.trial092:> uname -m 2026-02-17T20:53:17.520 INFO:teuthology.orchestra.run.trial092.stdout:x86_64 2026-02-17T20:53:17.520 DEBUG:teuthology.orchestra.run.trial092:> cat /etc/os-release 2026-02-17T20:53:17.575 INFO:teuthology.orchestra.run.trial092.stdout:NAME="CentOS Stream" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:VERSION="9" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:ID="centos" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:ID_LIKE="rhel fedora" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:VERSION_ID="9" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:PLATFORM_ID="platform:el9" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:ANSI_COLOR="0;31" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:LOGO="fedora-logo-icon" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:HOME_URL="https://centos.org/" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T20:53:17.576 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T20:53:17.577 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T20:53:17.577 INFO:teuthology.lock.ops:Updating trial092.front.sepia.ceph.com on lock server 2026-02-17T20:53:17.663 DEBUG:teuthology.orchestra.run.trial138:> uname -m 2026-02-17T20:53:17.678 INFO:teuthology.orchestra.run.trial138.stdout:x86_64 2026-02-17T20:53:17.678 DEBUG:teuthology.orchestra.run.trial138:> cat /etc/os-release 2026-02-17T20:53:17.735 INFO:teuthology.orchestra.run.trial138.stdout:NAME="CentOS Stream" 2026-02-17T20:53:17.735 INFO:teuthology.orchestra.run.trial138.stdout:VERSION="9" 2026-02-17T20:53:17.735 INFO:teuthology.orchestra.run.trial138.stdout:ID="centos" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:ID_LIKE="rhel fedora" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:VERSION_ID="9" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:PLATFORM_ID="platform:el9" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:ANSI_COLOR="0;31" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:LOGO="fedora-logo-icon" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:HOME_URL="https://centos.org/" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T20:53:17.736 INFO:teuthology.orchestra.run.trial138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T20:53:17.736 INFO:teuthology.lock.ops:Updating trial138.front.sepia.ceph.com on lock server 2026-02-17T20:53:17.818 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T20:53:17.831 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T20:53:17.843 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T20:53:17.843 DEBUG:teuthology.orchestra.run.trial045:> test '!' -e /home/ubuntu/cephtest 2026-02-17T20:53:17.844 DEBUG:teuthology.orchestra.run.trial086:> test '!' -e /home/ubuntu/cephtest 2026-02-17T20:53:17.846 DEBUG:teuthology.orchestra.run.trial092:> test '!' -e /home/ubuntu/cephtest 2026-02-17T20:53:17.848 DEBUG:teuthology.orchestra.run.trial138:> test '!' -e /home/ubuntu/cephtest 2026-02-17T20:53:17.862 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T20:53:17.873 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T20:53:17.873 DEBUG:teuthology.orchestra.run.trial045:> test -z $(ls -A /var/lib/ceph) 2026-02-17T20:53:17.900 DEBUG:teuthology.orchestra.run.trial086:> test -z $(ls -A /var/lib/ceph) 2026-02-17T20:53:17.902 DEBUG:teuthology.orchestra.run.trial092:> test -z $(ls -A /var/lib/ceph) 2026-02-17T20:53:17.904 DEBUG:teuthology.orchestra.run.trial138:> test -z $(ls -A /var/lib/ceph) 2026-02-17T20:53:17.920 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T20:53:18.190 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T20:53:18.209 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-17T20:53:18.209 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-17T20:53:18.209 DEBUG:teuthology.orchestra.run.trial045:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T20:53:18.210 DEBUG:teuthology.orchestra.run.trial086:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T20:53:18.210 DEBUG:teuthology.orchestra.run.trial092:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T20:53:18.210 DEBUG:teuthology.orchestra.run.trial138:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T20:53:18.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:53:18.224 DEBUG:teuthology.orchestra.run.trial045:> uname -r 2026-02-17T20:53:18.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:53:18.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:53:18.225 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-17T20:53:18.225 DEBUG:teuthology.orchestra.run.trial086:> uname -r 2026-02-17T20:53:18.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:53:18.225 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-17T20:53:18.279 INFO:teuthology.orchestra.run.trial086.stdout:5.14.0-645.el9.x86_64 2026-02-17T20:53:18.280 INFO:teuthology.task.kernel:Running kernel on trial086: 5.14.0-645.el9.x86_64 2026-02-17T20:53:18.280 DEBUG:teuthology.orchestra.run.trial086:> sudo yum install -y kernel 2026-02-17T20:53:18.280 INFO:teuthology.orchestra.run.trial045.stdout:5.14.0-645.el9.x86_64 2026-02-17T20:53:18.280 INFO:teuthology.task.kernel:Running kernel on trial045: 5.14.0-645.el9.x86_64 2026-02-17T20:53:18.280 DEBUG:teuthology.orchestra.run.trial045:> sudo yum install -y kernel 2026-02-17T20:53:18.280 INFO:teuthology.orchestra.run.trial092.stdout:5.14.0-645.el9.x86_64 2026-02-17T20:53:18.281 INFO:teuthology.task.kernel:Running kernel on trial092: 5.14.0-645.el9.x86_64 2026-02-17T20:53:18.281 DEBUG:teuthology.orchestra.run.trial092:> sudo yum install -y kernel 2026-02-17T20:53:18.281 INFO:teuthology.orchestra.run.trial138.stdout:5.14.0-645.el9.x86_64 2026-02-17T20:53:18.281 INFO:teuthology.task.kernel:Running kernel on trial138: 5.14.0-645.el9.x86_64 2026-02-17T20:53:18.281 DEBUG:teuthology.orchestra.run.trial138:> sudo yum install -y kernel 2026-02-17T20:53:18.982 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - BaseOS 26 MB/s | 8.9 MB 00:00 2026-02-17T20:53:19.127 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.9 MB 00:00 2026-02-17T20:53:19.522 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-17T20:53:19.987 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.9 MB 00:01 2026-02-17T20:53:21.578 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-17T20:53:21.913 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-17T20:53:22.627 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T20:53:23.193 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T20:53:25.329 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-17T20:53:25.466 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-17T20:53:26.126 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 7.8 MB 00:01 2026-02-17T20:53:26.293 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - Extras packages 197 kB/s | 20 kB 00:00 2026-02-17T20:53:26.644 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 7.8 MB 00:01 2026-02-17T20:53:27.078 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-17T20:53:27.513 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 155 kB/s | 20 kB 00:00 2026-02-17T20:53:28.018 INFO:teuthology.orchestra.run.trial045.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-17T20:53:28.106 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-17T20:53:28.553 INFO:teuthology.orchestra.run.trial092.stdout:Extra Packages for Enterprise Linux 53 MB/s | 20 MB 00:00 2026-02-17T20:53:28.555 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-17T20:53:31.216 INFO:teuthology.orchestra.run.trial045.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T20:53:31.715 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T20:53:31.750 INFO:teuthology.orchestra.run.trial092.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-17T20:53:32.145 INFO:teuthology.orchestra.run.trial138.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 20 MB 00:05 2026-02-17T20:53:32.225 INFO:teuthology.orchestra.run.trial045.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T20:53:32.247 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:53:32.248 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:53:32.248 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-17T20:53:32.248 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout:Install 4 Packages 2026-02-17T20:53:32.249 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:53:32.250 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 88 M 2026-02-17T20:53:32.250 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 135 M 2026-02-17T20:53:32.250 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:53:32.467 INFO:teuthology.orchestra.run.trial045.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 13 MB/s | 803 kB 00:00 2026-02-17T20:53:32.544 INFO:teuthology.orchestra.run.trial045.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 125 MB/s | 17 MB 00:00 2026-02-17T20:53:32.641 INFO:teuthology.orchestra.run.trial045.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 178 MB/s | 31 MB 00:00 2026-02-17T20:53:32.697 INFO:teuthology.orchestra.run.trial045.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 136 MB/s | 40 MB 00:00 2026-02-17T20:53:32.697 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:53:32.697 INFO:teuthology.orchestra.run.trial045.stdout:Total 197 MB/s | 88 MB 00:00 2026-02-17T20:53:32.725 INFO:teuthology.orchestra.run.trial086.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T20:53:32.749 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:53:32.750 INFO:teuthology.orchestra.run.trial086.stdout:Install 4 Packages 2026-02-17T20:53:32.751 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:53:32.751 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 88 M 2026-02-17T20:53:32.751 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 135 M 2026-02-17T20:53:32.751 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:53:32.758 INFO:teuthology.orchestra.run.trial092.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T20:53:32.780 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout: Package Architecture Version Repository Size 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:Install 4 Packages 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 88 M 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 135 M 2026-02-17T20:53:32.781 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:53:32.884 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:53:33.089 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:53:33.089 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:53:33.437 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:53:33.438 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:53:34.373 INFO:teuthology.orchestra.run.trial092.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 533 kB/s | 803 kB 00:01 2026-02-17T20:53:34.406 INFO:teuthology.orchestra.run.trial086.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 575 kB/s | 803 kB 00:01 2026-02-17T20:53:34.523 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:53:34.803 INFO:teuthology.orchestra.run.trial045.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:53:34.822 INFO:teuthology.orchestra.run.trial045.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:53:35.320 INFO:teuthology.orchestra.run.trial138.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-17T20:53:36.327 INFO:teuthology.orchestra.run.trial138.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T20:53:36.349 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:53:36.350 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:53:36.350 INFO:teuthology.orchestra.run.trial138.stdout: Package Architecture Version Repository Size 2026-02-17T20:53:36.350 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:53:36.350 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:53:36.350 INFO:teuthology.orchestra.run.trial138.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T20:53:36.350 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-17T20:53:36.350 INFO:teuthology.orchestra.run.trial138.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T20:53:36.350 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T20:53:36.351 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T20:53:36.351 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:53:36.351 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:53:36.351 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:53:36.351 INFO:teuthology.orchestra.run.trial138.stdout:Install 4 Packages 2026-02-17T20:53:36.351 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:53:36.351 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 88 M 2026-02-17T20:53:36.351 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 135 M 2026-02-17T20:53:36.351 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:53:36.539 INFO:teuthology.orchestra.run.trial138.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 6.1 MB/s | 803 kB 00:00 2026-02-17T20:53:36.602 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:53:36.632 INFO:teuthology.orchestra.run.trial045.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:53:36.690 INFO:teuthology.orchestra.run.trial138.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 61 MB/s | 17 MB 00:00 2026-02-17T20:53:36.829 INFO:teuthology.orchestra.run.trial138.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 107 MB/s | 31 MB 00:00 2026-02-17T20:53:37.137 INFO:teuthology.orchestra.run.trial138.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 55 MB/s | 40 MB 00:00 2026-02-17T20:53:37.137 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:53:37.137 INFO:teuthology.orchestra.run.trial138.stdout:Total 112 MB/s | 88 MB 00:00 2026-02-17T20:53:37.151 INFO:teuthology.orchestra.run.trial086.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 4.1 MB/s | 17 MB 00:04 2026-02-17T20:53:37.327 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:53:37.526 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:53:37.526 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:53:37.873 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:53:37.873 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:53:38.955 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:53:39.234 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:53:39.253 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:53:39.847 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:53:39.853 INFO:teuthology.orchestra.run.trial045.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:53:41.036 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:53:41.064 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:53:42.885 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:53:43.522 INFO:teuthology.orchestra.run.trial092.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 1.6 MB/s | 17 MB 00:10 2026-02-17T20:53:44.084 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:53:44.089 INFO:teuthology.orchestra.run.trial138.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:53:47.310 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:53:49.221 INFO:teuthology.orchestra.run.trial092.stdout:(3/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 2.4 MB/s | 40 MB 00:16 2026-02-17T20:53:50.551 INFO:teuthology.orchestra.run.trial092.stdout:(4/4): kernel-modules-core-5.14.0-681.el9.x86_6 1.9 MB/s | 31 MB 00:16 2026-02-17T20:53:50.553 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:53:50.553 INFO:teuthology.orchestra.run.trial092.stdout:Total 5.0 MB/s | 88 MB 00:17 2026-02-17T20:53:50.745 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:53:50.954 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:53:50.954 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:53:51.300 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:53:51.301 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:53:52.379 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:53:52.662 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:53:52.681 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:53:54.446 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:53:54.474 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:53:57.496 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:53:57.502 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:00.780 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:09.338 INFO:teuthology.orchestra.run.trial086.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 904 kB/s | 31 MB 00:34 2026-02-17T20:54:12.454 INFO:teuthology.orchestra.run.trial086.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 1.0 MB/s | 40 MB 00:39 2026-02-17T20:54:12.456 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:54:12.456 INFO:teuthology.orchestra.run.trial086.stdout:Total 2.2 MB/s | 88 MB 00:39 2026-02-17T20:54:12.646 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:54:12.859 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:54:12.859 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:54:13.205 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:54:13.206 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:54:13.408 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:13.429 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:13.597 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:13.597 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:54:13.597 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:54:13.598 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:54:13.649 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:13.649 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:54:13.649 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:54:13.649 INFO:teuthology.orchestra.run.trial045.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:13.649 INFO:teuthology.orchestra.run.trial045.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T20:54:13.649 INFO:teuthology.orchestra.run.trial045.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T20:54:13.650 INFO:teuthology.orchestra.run.trial045.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T20:54:13.650 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:54:13.650 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:54:13.706 DEBUG:teuthology.orchestra.run.trial045:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:54:13.732 INFO:teuthology.orchestra.run.trial045.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:13.733 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:54:13.733 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T20:54:13.733 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T20:54:13.734 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T20:54:13.734 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T20:54:13.734 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial045.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T20:54:13.734 DEBUG:teuthology.orchestra.run.trial045:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:54:13.796 INFO:teuthology.orchestra.run.trial045.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:13.797 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:54:13.797 DEBUG:teuthology.orchestra.run.trial045:> sudo rpm -qi grub2-tools 2026-02-17T20:54:13.866 INFO:teuthology.orchestra.run.trial045.stdout:Name : grub2-tools 2026-02-17T20:54:13.866 INFO:teuthology.orchestra.run.trial045.stdout:Epoch : 1 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Version : 2.06 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Release : 118.el9 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Architecture: x86_64 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Group : Unspecified 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Size : 8393909 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:License : GPLv3+ 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T20:54:13.867 INFO:teuthology.orchestra.run.trial045.stdout:Packager : builder@centos.org 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout:Vendor : CentOS 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout:Summary : Support tools for GRUB. 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout:Description : 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout:hardware devices. 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:54:13.868 INFO:teuthology.orchestra.run.trial045.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T20:54:13.870 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T20:54:13.870 INFO:teuthology.task.kernel:Updating grub on trial045 to boot 5.14.0-681.el9.x86_64 2026-02-17T20:54:13.870 DEBUG:teuthology.orchestra.run.trial045:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T20:54:13.934 INFO:teuthology.orchestra.run.trial045.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:54:13.936 DEBUG:teuthology.orchestra.run.trial045:> sudo command -v grubby && echo yes || echo no 2026-02-17T20:54:14.000 INFO:teuthology.orchestra.run.trial045.stdout:/sbin/grubby 2026-02-17T20:54:14.002 INFO:teuthology.orchestra.run.trial045.stdout:yes 2026-02-17T20:54:14.002 DEBUG:teuthology.orchestra.run.trial045:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T20:54:14.066 INFO:teuthology.orchestra.run.trial045.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:54:14.068 DEBUG:teuthology.orchestra.run.trial045:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T20:54:14.142 DEBUG:teuthology.orchestra.run.trial045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T20:54:14.299 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:54:14.350 INFO:teuthology.orchestra.run.trial045.stderr:Generating grub configuration file ... 2026-02-17T20:54:14.413 INFO:teuthology.orchestra.run.trial045.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T20:54:14.420 INFO:teuthology.orchestra.run.trial045.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T20:54:14.579 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:54:14.598 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:54:14.669 INFO:teuthology.orchestra.run.trial045.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T20:54:14.675 INFO:teuthology.orchestra.run.trial045.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T20:54:14.707 INFO:teuthology.orchestra.run.trial045.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T20:54:14.714 INFO:teuthology.orchestra.run.trial045.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T20:54:14.737 INFO:teuthology.orchestra.run.trial045.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T20:54:14.743 INFO:teuthology.orchestra.run.trial045.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T20:54:14.825 INFO:teuthology.orchestra.run.trial045.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T20:54:14.833 INFO:teuthology.orchestra.run.trial045.stderr:done 2026-02-17T20:54:14.835 DEBUG:teuthology.orchestra.run.trial045:> test -d /sys/firmware/efi 2026-02-17T20:54:14.851 DEBUG:teuthology.orchestra.run.trial045:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T20:54:14.916 INFO:teuthology.orchestra.run.trial045.stdout:/boot/efi/EFI/BOOT 2026-02-17T20:54:14.916 INFO:teuthology.orchestra.run.trial045.stdout:/boot/efi/EFI/centos 2026-02-17T20:54:14.918 DEBUG:teuthology.orchestra.run.trial045:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T20:54:14.983 INFO:teuthology.orchestra.run.trial045.stdout:no 2026-02-17T20:54:14.983 DEBUG:teuthology.orchestra.run.trial045:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T20:54:15.047 INFO:teuthology.orchestra.run.trial045.stdout:yes 2026-02-17T20:54:15.048 DEBUG:teuthology.orchestra.run.trial045:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T20:54:15.112 DEBUG:teuthology.orchestra.run.trial045:> sudo shutdown -r now 2026-02-17T20:54:15.186 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-17T20:54:16.374 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:54:16.402 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:54:17.801 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:17.821 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:17.886 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:17.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:54:17.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:54:17.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:54:17.937 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:17.938 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:54:17.938 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:54:17.938 INFO:teuthology.orchestra.run.trial138.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:17.938 INFO:teuthology.orchestra.run.trial138.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T20:54:17.938 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T20:54:17.938 INFO:teuthology.orchestra.run.trial138.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T20:54:17.938 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:54:17.938 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:54:17.996 DEBUG:teuthology.orchestra.run.trial138:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:54:18.023 INFO:teuthology.orchestra.run.trial138.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:18.023 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:54:18.023 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T20:54:18.024 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T20:54:18.024 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T20:54:18.024 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-17T20:54:18.024 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial138.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T20:54:18.024 DEBUG:teuthology.orchestra.run.trial138:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:54:18.086 INFO:teuthology.orchestra.run.trial138.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:18.087 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:54:18.088 DEBUG:teuthology.orchestra.run.trial138:> sudo rpm -qi grub2-tools 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:Name : grub2-tools 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:Epoch : 1 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:Version : 2.06 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:Release : 118.el9 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:Architecture: x86_64 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:Group : Unspecified 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:Size : 8393909 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:License : GPLv3+ 2026-02-17T20:54:18.157 INFO:teuthology.orchestra.run.trial138.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:Packager : builder@centos.org 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:Vendor : CentOS 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:Summary : Support tools for GRUB. 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:Description : 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T20:54:18.158 INFO:teuthology.orchestra.run.trial138.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T20:54:18.159 INFO:teuthology.orchestra.run.trial138.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T20:54:18.159 INFO:teuthology.orchestra.run.trial138.stdout:hardware devices. 2026-02-17T20:54:18.159 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:54:18.159 INFO:teuthology.orchestra.run.trial138.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T20:54:18.160 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T20:54:18.160 INFO:teuthology.task.kernel:Updating grub on trial138 to boot 5.14.0-681.el9.x86_64 2026-02-17T20:54:18.160 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T20:54:18.225 INFO:teuthology.orchestra.run.trial138.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:54:18.227 DEBUG:teuthology.orchestra.run.trial138:> sudo command -v grubby && echo yes || echo no 2026-02-17T20:54:18.290 INFO:teuthology.orchestra.run.trial138.stdout:/sbin/grubby 2026-02-17T20:54:18.291 INFO:teuthology.orchestra.run.trial138.stdout:yes 2026-02-17T20:54:18.292 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T20:54:18.356 INFO:teuthology.orchestra.run.trial138.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:54:18.358 DEBUG:teuthology.orchestra.run.trial138:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T20:54:18.432 DEBUG:teuthology.orchestra.run.trial138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T20:54:18.643 INFO:teuthology.orchestra.run.trial138.stderr:Generating grub configuration file ... 2026-02-17T20:54:18.710 INFO:teuthology.orchestra.run.trial138.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T20:54:18.716 INFO:teuthology.orchestra.run.trial138.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T20:54:18.964 INFO:teuthology.orchestra.run.trial138.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T20:54:18.970 INFO:teuthology.orchestra.run.trial138.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T20:54:19.001 INFO:teuthology.orchestra.run.trial138.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T20:54:19.007 INFO:teuthology.orchestra.run.trial138.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T20:54:19.030 INFO:teuthology.orchestra.run.trial138.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T20:54:19.036 INFO:teuthology.orchestra.run.trial138.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T20:54:19.120 INFO:teuthology.orchestra.run.trial138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T20:54:19.128 INFO:teuthology.orchestra.run.trial138.stderr:done 2026-02-17T20:54:19.130 DEBUG:teuthology.orchestra.run.trial138:> test -d /sys/firmware/efi 2026-02-17T20:54:19.146 DEBUG:teuthology.orchestra.run.trial138:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T20:54:19.211 INFO:teuthology.orchestra.run.trial138.stdout:/boot/efi/EFI/BOOT 2026-02-17T20:54:19.212 INFO:teuthology.orchestra.run.trial138.stdout:/boot/efi/EFI/centos 2026-02-17T20:54:19.213 DEBUG:teuthology.orchestra.run.trial138:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T20:54:19.278 INFO:teuthology.orchestra.run.trial138.stdout:no 2026-02-17T20:54:19.279 DEBUG:teuthology.orchestra.run.trial138:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T20:54:19.342 INFO:teuthology.orchestra.run.trial138.stdout:yes 2026-02-17T20:54:19.344 DEBUG:teuthology.orchestra.run.trial138:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T20:54:19.410 DEBUG:teuthology.orchestra.run.trial138:> sudo shutdown -r now 2026-02-17T20:54:19.424 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:54:19.430 INFO:teuthology.orchestra.run.trial086.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:22.468 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:31.039 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:31.060 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:31.125 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:31.125 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:54:31.125 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:54:31.125 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:54:31.177 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:31.177 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:54:31.177 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:54:31.177 INFO:teuthology.orchestra.run.trial092.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:31.177 INFO:teuthology.orchestra.run.trial092.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T20:54:31.178 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T20:54:31.178 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T20:54:31.178 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:54:31.178 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:54:31.237 DEBUG:teuthology.orchestra.run.trial092:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:54:31.262 INFO:teuthology.orchestra.run.trial092.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:31.263 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:54:31.264 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T20:54:31.264 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T20:54:31.264 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T20:54:31.264 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-17T20:54:31.264 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial092.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T20:54:31.264 DEBUG:teuthology.orchestra.run.trial092:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:54:31.326 INFO:teuthology.orchestra.run.trial092.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:31.327 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:54:31.327 DEBUG:teuthology.orchestra.run.trial092:> sudo rpm -qi grub2-tools 2026-02-17T20:54:31.395 INFO:teuthology.orchestra.run.trial092.stdout:Name : grub2-tools 2026-02-17T20:54:31.395 INFO:teuthology.orchestra.run.trial092.stdout:Epoch : 1 2026-02-17T20:54:31.395 INFO:teuthology.orchestra.run.trial092.stdout:Version : 2.06 2026-02-17T20:54:31.395 INFO:teuthology.orchestra.run.trial092.stdout:Release : 118.el9 2026-02-17T20:54:31.395 INFO:teuthology.orchestra.run.trial092.stdout:Architecture: x86_64 2026-02-17T20:54:31.395 INFO:teuthology.orchestra.run.trial092.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T20:54:31.395 INFO:teuthology.orchestra.run.trial092.stdout:Group : Unspecified 2026-02-17T20:54:31.395 INFO:teuthology.orchestra.run.trial092.stdout:Size : 8393909 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:License : GPLv3+ 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:Packager : builder@centos.org 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:Vendor : CentOS 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:Summary : Support tools for GRUB. 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:Description : 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:54:31.396 INFO:teuthology.orchestra.run.trial092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T20:54:31.397 INFO:teuthology.orchestra.run.trial092.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T20:54:31.397 INFO:teuthology.orchestra.run.trial092.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T20:54:31.397 INFO:teuthology.orchestra.run.trial092.stdout:hardware devices. 2026-02-17T20:54:31.397 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:54:31.397 INFO:teuthology.orchestra.run.trial092.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T20:54:31.398 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T20:54:31.398 INFO:teuthology.task.kernel:Updating grub on trial092 to boot 5.14.0-681.el9.x86_64 2026-02-17T20:54:31.398 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T20:54:31.463 INFO:teuthology.orchestra.run.trial092.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:54:31.465 DEBUG:teuthology.orchestra.run.trial092:> sudo command -v grubby && echo yes || echo no 2026-02-17T20:54:31.529 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/grubby 2026-02-17T20:54:31.531 INFO:teuthology.orchestra.run.trial092.stdout:yes 2026-02-17T20:54:31.531 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T20:54:31.596 INFO:teuthology.orchestra.run.trial092.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:54:31.596 DEBUG:teuthology.orchestra.run.trial092:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T20:54:31.669 DEBUG:teuthology.orchestra.run.trial092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T20:54:31.876 INFO:teuthology.orchestra.run.trial092.stderr:Generating grub configuration file ... 2026-02-17T20:54:31.940 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T20:54:31.946 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T20:54:32.197 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T20:54:32.203 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T20:54:32.234 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T20:54:32.240 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T20:54:32.263 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T20:54:32.270 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T20:54:32.352 INFO:teuthology.orchestra.run.trial092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T20:54:32.361 INFO:teuthology.orchestra.run.trial092.stderr:done 2026-02-17T20:54:32.363 DEBUG:teuthology.orchestra.run.trial092:> test -d /sys/firmware/efi 2026-02-17T20:54:32.379 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T20:54:32.444 INFO:teuthology.orchestra.run.trial092.stdout:/boot/efi/EFI/BOOT 2026-02-17T20:54:32.444 INFO:teuthology.orchestra.run.trial092.stdout:/boot/efi/EFI/centos 2026-02-17T20:54:32.445 DEBUG:teuthology.orchestra.run.trial092:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T20:54:32.510 INFO:teuthology.orchestra.run.trial092.stdout:no 2026-02-17T20:54:32.510 DEBUG:teuthology.orchestra.run.trial092:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T20:54:32.575 INFO:teuthology.orchestra.run.trial092.stdout:yes 2026-02-17T20:54:32.576 DEBUG:teuthology.orchestra.run.trial092:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T20:54:32.639 DEBUG:teuthology.orchestra.run.trial092:> sudo shutdown -r now 2026-02-17T20:54:45.156 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T20:54:45.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-17T20:54:45.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:54:49.453 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-17T20:54:49.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T20:54:49.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:54:52.900 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:52.920 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:52.984 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:52.984 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:54:52.984 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:54:52.984 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:54:53.036 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:54:53.036 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:54:53.036 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:54:53.036 INFO:teuthology.orchestra.run.trial086.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:53.037 INFO:teuthology.orchestra.run.trial086.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T20:54:53.037 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T20:54:53.037 INFO:teuthology.orchestra.run.trial086.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T20:54:53.037 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:54:53.037 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:54:53.092 DEBUG:teuthology.orchestra.run.trial086:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:54:53.119 INFO:teuthology.orchestra.run.trial086.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:53.120 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:54:53.120 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T20:54:53.121 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T20:54:53.121 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T20:54:53.121 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-17T20:54:53.121 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial086.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T20:54:53.121 DEBUG:teuthology.orchestra.run.trial086:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:54:53.183 INFO:teuthology.orchestra.run.trial086.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:54:53.184 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:54:53.184 DEBUG:teuthology.orchestra.run.trial086:> sudo rpm -qi grub2-tools 2026-02-17T20:54:53.251 INFO:teuthology.orchestra.run.trial086.stdout:Name : grub2-tools 2026-02-17T20:54:53.251 INFO:teuthology.orchestra.run.trial086.stdout:Epoch : 1 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Version : 2.06 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Release : 118.el9 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Architecture: x86_64 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Group : Unspecified 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Size : 8393909 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:License : GPLv3+ 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T20:54:53.252 INFO:teuthology.orchestra.run.trial086.stdout:Packager : builder@centos.org 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout:Vendor : CentOS 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout:Summary : Support tools for GRUB. 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout:Description : 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout:hardware devices. 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:54:53.253 INFO:teuthology.orchestra.run.trial086.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T20:54:53.254 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T20:54:53.255 INFO:teuthology.task.kernel:Updating grub on trial086 to boot 5.14.0-681.el9.x86_64 2026-02-17T20:54:53.255 DEBUG:teuthology.orchestra.run.trial086:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T20:54:53.319 INFO:teuthology.orchestra.run.trial086.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:54:53.320 DEBUG:teuthology.orchestra.run.trial086:> sudo command -v grubby && echo yes || echo no 2026-02-17T20:54:53.385 INFO:teuthology.orchestra.run.trial086.stdout:/sbin/grubby 2026-02-17T20:54:53.387 INFO:teuthology.orchestra.run.trial086.stdout:yes 2026-02-17T20:54:53.388 DEBUG:teuthology.orchestra.run.trial086:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T20:54:53.452 INFO:teuthology.orchestra.run.trial086.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:54:53.453 DEBUG:teuthology.orchestra.run.trial086:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T20:54:53.529 DEBUG:teuthology.orchestra.run.trial086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T20:54:53.743 INFO:teuthology.orchestra.run.trial086.stderr:Generating grub configuration file ... 2026-02-17T20:54:53.807 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T20:54:53.814 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T20:54:54.065 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T20:54:54.071 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T20:54:54.103 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T20:54:54.110 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T20:54:54.133 INFO:teuthology.orchestra.run.trial086.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T20:54:54.139 INFO:teuthology.orchestra.run.trial086.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T20:54:54.222 INFO:teuthology.orchestra.run.trial086.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T20:54:54.230 INFO:teuthology.orchestra.run.trial086.stderr:done 2026-02-17T20:54:54.232 DEBUG:teuthology.orchestra.run.trial086:> test -d /sys/firmware/efi 2026-02-17T20:54:54.248 DEBUG:teuthology.orchestra.run.trial086:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T20:54:54.313 INFO:teuthology.orchestra.run.trial086.stdout:/boot/efi/EFI/BOOT 2026-02-17T20:54:54.313 INFO:teuthology.orchestra.run.trial086.stdout:/boot/efi/EFI/centos 2026-02-17T20:54:54.315 DEBUG:teuthology.orchestra.run.trial086:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T20:54:54.380 INFO:teuthology.orchestra.run.trial086.stdout:no 2026-02-17T20:54:54.381 DEBUG:teuthology.orchestra.run.trial086:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T20:54:54.446 INFO:teuthology.orchestra.run.trial086.stdout:yes 2026-02-17T20:54:54.446 DEBUG:teuthology.orchestra.run.trial086:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T20:54:54.512 DEBUG:teuthology.orchestra.run.trial086:> sudo shutdown -r now 2026-02-17T20:55:02.690 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-17T20:55:02.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T20:55:02.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:55:24.576 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-17T20:55:24.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-17T20:55:24.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:55:45.180 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T20:55:49.460 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T20:55:54.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-17T20:55:54.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:55:54.323 DEBUG:teuthology.orchestra.run.trial045:> true 2026-02-17T20:55:54.483 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-17T20:55:54.483 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T20:55:54.484 DEBUG:teuthology.orchestra.run.trial045:> uname -r 2026-02-17T20:55:54.541 INFO:teuthology.orchestra.run.trial045.stdout:5.14.0-681.el9.x86_64 2026-02-17T20:55:54.541 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T20:55:54.541 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T20:55:54.541 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T20:55:55.542 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T20:55:55.543 DEBUG:teuthology.orchestra.run.trial045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T20:55:55.572 INFO:teuthology.orchestra.run.trial045.stdout:ttyS1 2026-02-17T20:55:55.597 DEBUG:teuthology.parallel:result is None 2026-02-17T20:55:58.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T20:55:58.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:55:58.601 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-17T20:55:58.763 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T20:55:58.764 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-681.el9.x86_64"... 2026-02-17T20:55:58.764 DEBUG:teuthology.orchestra.run.trial138:> uname -r 2026-02-17T20:55:58.819 INFO:teuthology.orchestra.run.trial138.stdout:5.14.0-681.el9.x86_64 2026-02-17T20:55:58.819 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T20:55:58.820 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T20:55:58.820 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T20:55:59.820 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-17T20:55:59.820 DEBUG:teuthology.orchestra.run.trial138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T20:55:59.850 INFO:teuthology.orchestra.run.trial138.stdout:ttyS1 2026-02-17T20:55:59.876 DEBUG:teuthology.parallel:result is None 2026-02-17T20:56:02.693 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T20:56:11.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T20:56:11.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:56:11.825 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-17T20:56:11.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T20:56:11.970 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-681.el9.x86_64"... 2026-02-17T20:56:11.970 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-17T20:56:12.026 INFO:teuthology.orchestra.run.trial092.stdout:5.14.0-681.el9.x86_64 2026-02-17T20:56:12.026 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T20:56:12.026 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T20:56:12.027 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T20:56:13.028 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-17T20:56:13.028 DEBUG:teuthology.orchestra.run.trial092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T20:56:13.058 INFO:teuthology.orchestra.run.trial092.stdout:ttyS1 2026-02-17T20:56:13.077 DEBUG:teuthology.parallel:result is None 2026-02-17T20:56:24.580 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T20:56:33.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-17T20:56:33.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:56:33.722 DEBUG:teuthology.orchestra.run.trial086:> true 2026-02-17T20:56:33.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-17T20:56:33.882 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T20:56:33.882 DEBUG:teuthology.orchestra.run.trial086:> uname -r 2026-02-17T20:56:33.940 INFO:teuthology.orchestra.run.trial086.stdout:5.14.0-681.el9.x86_64 2026-02-17T20:56:33.940 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T20:56:33.940 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T20:56:33.940 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T20:56:34.941 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-17T20:56:34.941 DEBUG:teuthology.orchestra.run.trial086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T20:56:34.969 INFO:teuthology.orchestra.run.trial086.stdout:ttyS1 2026-02-17T20:56:34.989 DEBUG:teuthology.parallel:result is None 2026-02-17T20:56:34.989 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T20:56:35.001 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T20:56:35.001 DEBUG:teuthology.orchestra.run.trial045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T20:56:35.004 DEBUG:teuthology.orchestra.run.trial086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T20:56:35.032 DEBUG:teuthology.orchestra.run.trial092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T20:56:35.034 DEBUG:teuthology.orchestra.run.trial138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T20:56:35.052 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T20:56:35.064 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T20:56:35.076 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T20:56:35.076 DEBUG:teuthology.orchestra.run.trial045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T20:56:35.079 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T20:56:35.089 DEBUG:teuthology.orchestra.run.trial092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T20:56:35.092 DEBUG:teuthology.orchestra.run.trial138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T20:56:35.118 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T20:56:35.130 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T20:56:35.130 DEBUG:teuthology.orchestra.run.trial045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T20:56:35.135 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T20:56:35.146 DEBUG:teuthology.orchestra.run.trial092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T20:56:35.149 DEBUG:teuthology.orchestra.run.trial138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T20:56:35.157 INFO:teuthology.orchestra.run.trial045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:56:35.166 INFO:teuthology.orchestra.run.trial045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:56:35.168 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:56:35.171 INFO:teuthology.orchestra.run.trial092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:56:35.173 INFO:teuthology.orchestra.run.trial138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:56:35.177 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:56:35.180 INFO:teuthology.orchestra.run.trial092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:56:35.182 INFO:teuthology.orchestra.run.trial138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:56:35.184 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T20:56:35.196 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T20:56:35.197 DEBUG:teuthology.orchestra.run.trial045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T20:56:35.210 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T20:56:35.221 DEBUG:teuthology.orchestra.run.trial092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T20:56:35.223 DEBUG:teuthology.orchestra.run.trial138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T20:56:35.248 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T20:56:35.263 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T20:56:35.264 DEBUG:teuthology.orchestra.run.trial045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T20:56:35.274 DEBUG:teuthology.orchestra.run.trial086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T20:56:35.284 DEBUG:teuthology.orchestra.run.trial092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T20:56:35.287 DEBUG:teuthology.orchestra.run.trial138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T20:56:35.303 DEBUG:teuthology.orchestra.run.trial045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:56:35.448 DEBUG:teuthology.orchestra.run.trial045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:56:35.473 DEBUG:teuthology.orchestra.run.trial045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:56:35.599 DEBUG:teuthology.orchestra.run.trial045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:56:35.623 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T20:56:35.624 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T20:56:35.687 DEBUG:teuthology.orchestra.run.trial086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:56:35.800 DEBUG:teuthology.orchestra.run.trial086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:56:35.825 DEBUG:teuthology.orchestra.run.trial086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:56:35.966 DEBUG:teuthology.orchestra.run.trial086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:56:35.991 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T20:56:35.991 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T20:56:36.055 DEBUG:teuthology.orchestra.run.trial092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:56:36.174 DEBUG:teuthology.orchestra.run.trial092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:56:36.199 DEBUG:teuthology.orchestra.run.trial092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:56:36.340 DEBUG:teuthology.orchestra.run.trial092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:56:36.364 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T20:56:36.365 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T20:56:36.428 DEBUG:teuthology.orchestra.run.trial138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:56:36.546 DEBUG:teuthology.orchestra.run.trial138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:56:36.571 DEBUG:teuthology.orchestra.run.trial138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:56:36.719 DEBUG:teuthology.orchestra.run.trial138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:56:36.744 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T20:56:36.744 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T20:56:36.807 DEBUG:teuthology.orchestra.run.trial045:> sudo service rsyslog restart 2026-02-17T20:56:36.810 DEBUG:teuthology.orchestra.run.trial086:> sudo service rsyslog restart 2026-02-17T20:56:36.813 DEBUG:teuthology.orchestra.run.trial092:> sudo service rsyslog restart 2026-02-17T20:56:36.816 DEBUG:teuthology.orchestra.run.trial138:> sudo service rsyslog restart 2026-02-17T20:56:36.836 INFO:teuthology.orchestra.run.trial045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T20:56:36.839 INFO:teuthology.orchestra.run.trial086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T20:56:36.843 INFO:teuthology.orchestra.run.trial092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T20:56:36.876 INFO:teuthology.orchestra.run.trial138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T20:56:37.367 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T20:56:37.385 INFO:teuthology.task.internal:Starting timer... 2026-02-17T20:56:37.385 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T20:56:37.405 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T20:56:37.423 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-17T20:56:37.424 DEBUG:teuthology.orchestra.run.trial045:> sudo service auditd rotate 2026-02-17T20:56:37.453 INFO:teuthology.orchestra.run.trial045.stdout:Rotating logs: 2026-02-17T20:56:37.455 DEBUG:teuthology.orchestra.run.trial086:> sudo service auditd rotate 2026-02-17T20:56:37.485 INFO:teuthology.orchestra.run.trial086.stdout:Rotating logs: 2026-02-17T20:56:37.487 DEBUG:teuthology.orchestra.run.trial092:> sudo service auditd rotate 2026-02-17T20:56:37.517 INFO:teuthology.orchestra.run.trial092.stdout:Rotating logs: 2026-02-17T20:56:37.520 DEBUG:teuthology.orchestra.run.trial138:> sudo service auditd rotate 2026-02-17T20:56:37.549 INFO:teuthology.orchestra.run.trial138.stdout:Rotating logs: 2026-02-17T20:56:37.551 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T20:56:37.552 DEBUG:teuthology.orchestra.run.trial045:> /usr/sbin/getenforce 2026-02-17T20:56:37.570 INFO:teuthology.orchestra.run.trial045.stdout:Permissive 2026-02-17T20:56:37.570 DEBUG:teuthology.orchestra.run.trial086:> /usr/sbin/getenforce 2026-02-17T20:56:37.588 INFO:teuthology.orchestra.run.trial086.stdout:Permissive 2026-02-17T20:56:37.588 DEBUG:teuthology.orchestra.run.trial092:> /usr/sbin/getenforce 2026-02-17T20:56:37.606 INFO:teuthology.orchestra.run.trial092.stdout:Permissive 2026-02-17T20:56:37.606 DEBUG:teuthology.orchestra.run.trial138:> /usr/sbin/getenforce 2026-02-17T20:56:37.623 INFO:teuthology.orchestra.run.trial138.stdout:Permissive 2026-02-17T20:56:37.623 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial045.front.sepia.ceph.com': 'permissive', 'ubuntu@trial086.front.sepia.ceph.com': 'permissive', 'ubuntu@trial092.front.sepia.ceph.com': 'permissive', 'ubuntu@trial138.front.sepia.ceph.com': 'permissive'} 2026-02-17T20:56:37.624 DEBUG:teuthology.orchestra.run.trial045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T20:56:37.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:56:37.648 DEBUG:teuthology.orchestra.run.trial086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T20:56:37.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:56:37.675 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T20:56:37.700 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:56:37.701 DEBUG:teuthology.orchestra.run.trial138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T20:56:37.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:56:37.727 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T20:56:37.728 DEBUG:teuthology.orchestra.run.trial045:> sudo /usr/sbin/setenforce permissive 2026-02-17T20:56:37.753 DEBUG:teuthology.orchestra.run.trial086:> sudo /usr/sbin/setenforce permissive 2026-02-17T20:56:37.779 DEBUG:teuthology.orchestra.run.trial092:> sudo /usr/sbin/setenforce permissive 2026-02-17T20:56:37.804 DEBUG:teuthology.orchestra.run.trial138:> sudo /usr/sbin/setenforce permissive 2026-02-17T20:56:37.829 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T20:56:37.844 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T20:56:37.854 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T20:56:37.855 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial045.front.sepia.ceph.com,trial086.front.sepia.ceph.com,trial092.front.sepia.ceph.com,trial138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T20:57:56.200 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial045.front.sepia.ceph.com'), Remote(name='ubuntu@trial086.front.sepia.ceph.com'), Remote(name='ubuntu@trial092.front.sepia.ceph.com'), Remote(name='ubuntu@trial138.front.sepia.ceph.com')] 2026-02-17T20:57:56.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-17T20:57:56.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:57:56.313 DEBUG:teuthology.orchestra.run.trial045:> true 2026-02-17T20:57:56.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial045.front.sepia.ceph.com' 2026-02-17T20:57:56.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-17T20:57:56.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:57:56.473 DEBUG:teuthology.orchestra.run.trial086:> true 2026-02-17T20:57:56.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-17T20:57:56.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T20:57:56.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:57:56.638 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-17T20:57:56.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T20:57:56.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T20:57:56.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:57:56.802 DEBUG:teuthology.orchestra.run.trial138:> true 2026-02-17T20:57:56.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial138.front.sepia.ceph.com' 2026-02-17T20:57:56.878 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T20:57:56.892 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T20:57:56.892 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T20:57:56.892 DEBUG:teuthology.orchestra.run.trial045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T20:57:56.894 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T20:57:56.895 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T20:57:56.896 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T20:57:56.897 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T20:57:56.898 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T20:57:56.899 DEBUG:teuthology.orchestra.run.trial138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T20:57:56.918 INFO:teuthology.orchestra.run.trial045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T20:57:56.921 INFO:teuthology.orchestra.run.trial086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T20:57:56.923 INFO:teuthology.orchestra.run.trial092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T20:57:56.930 INFO:teuthology.orchestra.run.trial045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T20:57:56.934 INFO:teuthology.orchestra.run.trial086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T20:57:56.935 INFO:teuthology.orchestra.run.trial092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T20:57:56.945 INFO:teuthology.orchestra.run.trial138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T20:57:56.950 INFO:teuthology.orchestra.run.trial045.stderr:sudo: ntpd: command not found 2026-02-17T20:57:56.954 INFO:teuthology.orchestra.run.trial086.stderr:sudo: ntpd: command not found 2026-02-17T20:57:56.955 INFO:teuthology.orchestra.run.trial092.stderr:sudo: ntpd: command not found 2026-02-17T20:57:56.957 INFO:teuthology.orchestra.run.trial138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T20:57:56.959 INFO:teuthology.orchestra.run.trial045.stdout:506 Cannot talk to daemon 2026-02-17T20:57:56.965 INFO:teuthology.orchestra.run.trial092.stdout:506 Cannot talk to daemon 2026-02-17T20:57:56.965 INFO:teuthology.orchestra.run.trial086.stdout:506 Cannot talk to daemon 2026-02-17T20:57:56.971 INFO:teuthology.orchestra.run.trial045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T20:57:56.975 INFO:teuthology.orchestra.run.trial092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T20:57:56.976 INFO:teuthology.orchestra.run.trial086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T20:57:56.978 INFO:teuthology.orchestra.run.trial138.stderr:sudo: ntpd: command not found 2026-02-17T20:57:56.982 INFO:teuthology.orchestra.run.trial045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T20:57:56.986 INFO:teuthology.orchestra.run.trial092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T20:57:56.987 INFO:teuthology.orchestra.run.trial138.stdout:506 Cannot talk to daemon 2026-02-17T20:57:56.988 INFO:teuthology.orchestra.run.trial086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T20:57:56.998 INFO:teuthology.orchestra.run.trial138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T20:57:57.009 INFO:teuthology.orchestra.run.trial138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T20:57:57.027 INFO:teuthology.orchestra.run.trial092.stderr:bash: line 1: ntpq: command not found 2026-02-17T20:57:57.029 INFO:teuthology.orchestra.run.trial045.stderr:bash: line 1: ntpq: command not found 2026-02-17T20:57:57.038 INFO:teuthology.orchestra.run.trial086.stderr:bash: line 1: ntpq: command not found 2026-02-17T20:57:57.045 INFO:teuthology.orchestra.run.trial086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T20:57:57.045 INFO:teuthology.orchestra.run.trial086.stdout:=============================================================================== 2026-02-17T20:57:57.045 INFO:teuthology.orchestra.run.trial086.stdout:^? 23.186.168.131 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.045 INFO:teuthology.orchestra.run.trial086.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.046 INFO:teuthology.orchestra.run.trial086.stdout:^? owners.kjsl.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.046 INFO:teuthology.orchestra.run.trial086.stdout:^? t1.time.gq1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.048 INFO:teuthology.orchestra.run.trial045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T20:57:57.048 INFO:teuthology.orchestra.run.trial045.stdout:=============================================================================== 2026-02-17T20:57:57.048 INFO:teuthology.orchestra.run.trial045.stdout:^? 170-187-142-180.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.048 INFO:teuthology.orchestra.run.trial045.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.049 INFO:teuthology.orchestra.run.trial045.stdout:^? owners.kjsl.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.049 INFO:teuthology.orchestra.run.trial045.stdout:^? t1.time.gq1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.049 INFO:teuthology.orchestra.run.trial092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T20:57:57.049 INFO:teuthology.orchestra.run.trial092.stdout:=============================================================================== 2026-02-17T20:57:57.049 INFO:teuthology.orchestra.run.trial092.stdout:^? 149.248.12.167.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.049 INFO:teuthology.orchestra.run.trial092.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.049 INFO:teuthology.orchestra.run.trial092.stdout:^? owners.kjsl.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.049 INFO:teuthology.orchestra.run.trial092.stdout:^? t1.time.gq1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.054 INFO:teuthology.orchestra.run.trial138.stderr:bash: line 1: ntpq: command not found 2026-02-17T20:57:57.070 INFO:teuthology.orchestra.run.trial138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T20:57:57.070 INFO:teuthology.orchestra.run.trial138.stdout:=============================================================================== 2026-02-17T20:57:57.070 INFO:teuthology.orchestra.run.trial138.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.071 INFO:teuthology.orchestra.run.trial138.stdout:^? t1.time.bf1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.071 INFO:teuthology.orchestra.run.trial138.stdout:^? tick.nowherenet.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.071 INFO:teuthology.orchestra.run.trial138.stdout:^? t1.time.gq1.yahoo.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:57:57.072 INFO:teuthology.run_tasks:Running task install... 2026-02-17T20:57:57.091 DEBUG:teuthology.task.install:project ceph 2026-02-17T20:57:57.092 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1'}} 2026-02-17T20:57:57.092 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1'} 2026-02-17T20:57:57.092 INFO:teuthology.task.install:Using flavor: default 2026-02-17T20:57:57.094 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-17T20:57:57.094 INFO:teuthology.task.install:extra packages: [] 2026-02-17T20:57:57.094 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'tag': None, 'wait_for_package': False} 2026-02-17T20:57:57.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T20:57:57.095 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'tag': None, 'wait_for_package': False} 2026-02-17T20:57:57.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T20:57:57.096 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'tag': None, 'wait_for_package': False} 2026-02-17T20:57:57.096 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T20:57:57.096 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'tag': None, 'wait_for_package': False} 2026-02-17T20:57:57.096 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T20:57:57.342 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/ 2026-02-17T20:57:57.342 INFO:teuthology.task.install.rpm:Package version is 19.2.3-679.gd855f53b 2026-02-17T20:57:57.344 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/ 2026-02-17T20:57:57.344 INFO:teuthology.task.install.rpm:Package version is 19.2.3-679.gd855f53b 2026-02-17T20:57:57.345 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/ 2026-02-17T20:57:57.345 INFO:teuthology.task.install.rpm:Package version is 19.2.3-679.gd855f53b 2026-02-17T20:57:57.352 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/ 2026-02-17T20:57:57.352 INFO:teuthology.task.install.rpm:Package version is 19.2.3-679.gd855f53b 2026-02-17T20:57:57.573 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T20:57:57.573 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T20:57:57.573 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T20:57:57.574 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T20:57:57.575 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T20:57:57.575 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T20:57:57.577 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T20:57:57.577 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T20:57:57.577 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T20:57:57.581 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2026-02-17-1732-squid/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T20:57:57.581 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T20:57:57.581 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T20:57:57.600 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T20:57:57.600 DEBUG:teuthology.orchestra.run.trial138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T20:57:57.600 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T20:57:57.600 DEBUG:teuthology.orchestra.run.trial086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T20:57:57.603 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T20:57:57.603 DEBUG:teuthology.orchestra.run.trial045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T20:57:57.606 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-17T20:57:57.606 DEBUG:teuthology.orchestra.run.trial092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d855f53b89fdcec760fd9232a5fb55ed4fb111a1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T20:57:57.664 DEBUG:teuthology.orchestra.run.trial086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T20:57:57.664 DEBUG:teuthology.orchestra.run.trial138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T20:57:57.667 DEBUG:teuthology.orchestra.run.trial045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T20:57:57.671 DEBUG:teuthology.orchestra.run.trial092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T20:57:57.737 DEBUG:teuthology.orchestra.run.trial138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T20:57:57.738 DEBUG:teuthology.orchestra.run.trial086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T20:57:57.740 DEBUG:teuthology.orchestra.run.trial045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T20:57:57.744 DEBUG:teuthology.orchestra.run.trial092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T20:57:57.802 INFO:teuthology.orchestra.run.trial086.stdout:check_obsoletes = 1 2026-02-17T20:57:57.803 DEBUG:teuthology.orchestra.run.trial086:> sudo yum clean all 2026-02-17T20:57:57.804 INFO:teuthology.orchestra.run.trial045.stdout:check_obsoletes = 1 2026-02-17T20:57:57.805 INFO:teuthology.orchestra.run.trial138.stdout:check_obsoletes = 1 2026-02-17T20:57:57.806 DEBUG:teuthology.orchestra.run.trial138:> sudo yum clean all 2026-02-17T20:57:57.807 DEBUG:teuthology.orchestra.run.trial045:> sudo yum clean all 2026-02-17T20:57:57.808 INFO:teuthology.orchestra.run.trial092.stdout:check_obsoletes = 1 2026-02-17T20:57:57.809 DEBUG:teuthology.orchestra.run.trial092:> sudo yum clean all 2026-02-17T20:57:57.953 INFO:teuthology.orchestra.run.trial086.stdout:41 files removed 2026-02-17T20:57:57.955 INFO:teuthology.orchestra.run.trial138.stdout:41 files removed 2026-02-17T20:57:57.955 INFO:teuthology.orchestra.run.trial045.stdout:41 files removed 2026-02-17T20:57:57.957 INFO:teuthology.orchestra.run.trial092.stdout:41 files removed 2026-02-17T20:57:57.967 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-radosgw 2026-02-17T20:57:57.970 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-radosgw 2026-02-17T20:57:57.970 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-radosgw 2026-02-17T20:57:57.973 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-radosgw 2026-02-17T20:57:58.238 INFO:teuthology.orchestra.run.trial086.stdout:ceph packages for x86_64 685 kB/s | 86 kB 00:00 2026-02-17T20:57:58.243 INFO:teuthology.orchestra.run.trial138.stdout:ceph packages for x86_64 674 kB/s | 86 kB 00:00 2026-02-17T20:57:58.244 INFO:teuthology.orchestra.run.trial092.stdout:ceph packages for x86_64 678 kB/s | 86 kB 00:00 2026-02-17T20:57:58.244 INFO:teuthology.orchestra.run.trial045.stdout:ceph packages for x86_64 670 kB/s | 86 kB 00:00 2026-02-17T20:57:58.367 INFO:teuthology.orchestra.run.trial086.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T20:57:58.373 INFO:teuthology.orchestra.run.trial092.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T20:57:58.374 INFO:teuthology.orchestra.run.trial045.stdout:ceph noarch packages 114 kB/s | 12 kB 00:00 2026-02-17T20:57:58.374 INFO:teuthology.orchestra.run.trial138.stdout:ceph noarch packages 115 kB/s | 12 kB 00:00 2026-02-17T20:57:58.490 INFO:teuthology.orchestra.run.trial086.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T20:57:58.498 INFO:teuthology.orchestra.run.trial092.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T20:57:58.500 INFO:teuthology.orchestra.run.trial138.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T20:57:58.501 INFO:teuthology.orchestra.run.trial045.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-17T20:57:58.752 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 37 MB/s | 8.9 MB 00:00 2026-02-17T20:57:59.545 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.9 MB 00:01 2026-02-17T20:58:02.251 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 27 MB 00:02 2026-02-17T20:58:02.725 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T20:58:06.149 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-17T20:58:06.586 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-17T20:58:07.338 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 7.8 MB 00:02 2026-02-17T20:58:07.343 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - BaseOS 1.0 MB/s | 8.9 MB 00:08 2026-02-17T20:58:07.678 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-17T20:58:08.519 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-17T20:58:08.761 INFO:teuthology.orchestra.run.trial045.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 20 kB 00:00 2026-02-17T20:58:09.769 INFO:teuthology.orchestra.run.trial045.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-17T20:58:10.354 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T20:58:10.647 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 27 MB 00:03 2026-02-17T20:58:11.726 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-17T20:58:12.935 INFO:teuthology.orchestra.run.trial045.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T20:58:12.952 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:12.953 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:12.954 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-17T20:58:12.954 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:12.954 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:12.954 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T20:58:12.954 INFO:teuthology.orchestra.run.trial086.stdout:Upgrading: 2026-02-17T20:58:12.954 INFO:teuthology.orchestra.run.trial086.stdout: librados2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.4 M 2026-02-17T20:58:12.954 INFO:teuthology.orchestra.run.trial086.stdout: librbd1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.2 M 2026-02-17T20:58:12.954 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.5 M 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 22 M 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: ceph-selinux x86_64 2:19.2.3-679.gd855f53b.el9 ceph 25 k 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.0 M 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T20:58:12.955 INFO:teuthology.orchestra.run.trial086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: libradosstriper1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 504 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: librgw2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.4 M 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-argparse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 45 k 2026-02-17T20:58:12.956 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 142 k 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs x86_64 2:19.2.3-679.gd855f53b.el9 ceph 165 k 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados x86_64 2:19.2.3-679.gd855f53b.el9 ceph 322 k 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 303 k 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 100 k 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T20:58:12.957 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T20:58:12.958 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:12.958 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:12.958 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:12.958 INFO:teuthology.orchestra.run.trial086.stdout:Install 33 Packages 2026-02-17T20:58:12.958 INFO:teuthology.orchestra.run.trial086.stdout:Upgrade 2 Packages 2026-02-17T20:58:12.958 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:12.959 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 63 M 2026-02-17T20:58:12.959 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:13.509 INFO:teuthology.orchestra.run.trial086.stdout:(1/35): ceph-base-19.2.3-679.gd855f53b.el9.x86_ 19 MB/s | 5.5 MB 00:00 2026-02-17T20:58:13.546 INFO:teuthology.orchestra.run.trial086.stdout:(2/35): ceph-selinux-19.2.3-679.gd855f53b.el9.x 685 kB/s | 25 kB 00:00 2026-02-17T20:58:13.602 INFO:teuthology.orchestra.run.trial086.stdout:(3/35): libcephfs2-19.2.3-679.gd855f53b.el9.x86 18 MB/s | 1.0 MB 00:00 2026-02-17T20:58:13.649 INFO:teuthology.orchestra.run.trial086.stdout:(4/35): libradosstriper1-19.2.3-679.gd855f53b.e 10 MB/s | 504 kB 00:00 2026-02-17T20:58:13.913 INFO:teuthology.orchestra.run.trial086.stdout:(5/35): librgw2-19.2.3-679.gd855f53b.el9.x86_64 21 MB/s | 5.4 MB 00:00 2026-02-17T20:58:13.926 INFO:teuthology.orchestra.run.trial086.stdout:(6/35): ceph-radosgw-19.2.3-679.gd855f53b.el9.x 15 MB/s | 11 MB 00:00 2026-02-17T20:58:13.931 INFO:teuthology.orchestra.run.trial086.stdout:(7/35): python3-ceph-argparse-19.2.3-679.gd855f 2.4 MB/s | 45 kB 00:00 2026-02-17T20:58:13.948 INFO:teuthology.orchestra.run.trial086.stdout:(8/35): python3-ceph-common-19.2.3-679.gd855f53 6.5 MB/s | 142 kB 00:00 2026-02-17T20:58:13.954 INFO:teuthology.orchestra.run.trial086.stdout:(9/35): python3-cephfs-19.2.3-679.gd855f53b.el9 7.3 MB/s | 165 kB 00:00 2026-02-17T20:58:13.974 INFO:teuthology.orchestra.run.trial086.stdout:(10/35): python3-rados-19.2.3-679.gd855f53b.el9 12 MB/s | 322 kB 00:00 2026-02-17T20:58:13.981 INFO:teuthology.orchestra.run.trial086.stdout:(11/35): python3-rbd-19.2.3-679.gd855f53b.el9.x 11 MB/s | 303 kB 00:00 2026-02-17T20:58:13.998 INFO:teuthology.orchestra.run.trial086.stdout:(12/35): python3-rgw-19.2.3-679.gd855f53b.el9.x 4.0 MB/s | 100 kB 00:00 2026-02-17T20:58:14.006 INFO:teuthology.orchestra.run.trial086.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 1.3 MB/s | 33 kB 00:00 2026-02-17T20:58:14.027 INFO:teuthology.orchestra.run.trial086.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 4.4 MB/s | 93 kB 00:00 2026-02-17T20:58:14.067 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 7.8 MB 00:01 2026-02-17T20:58:14.076 INFO:teuthology.orchestra.run.trial086.stdout:(15/35): nvme-cli-2.13-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2026-02-17T20:58:14.113 INFO:teuthology.orchestra.run.trial086.stdout:(16/35): ceph-common-19.2.3-679.gd855f53b.el9.x 24 MB/s | 22 MB 00:00 2026-02-17T20:58:14.165 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:58:14.166 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout:Upgrading: 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout: librados2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.4 M 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout: librbd1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.2 M 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T20:58:14.167 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.5 M 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 22 M 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: ceph-selinux x86_64 2:19.2.3-679.gd855f53b.el9 ceph 25 k 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.0 M 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T20:58:14.168 INFO:teuthology.orchestra.run.trial045.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: libradosstriper1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 504 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: librgw2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.4 M 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-argparse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 45 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 142 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs x86_64 2:19.2.3-679.gd855f53b.el9 ceph 165 k 2026-02-17T20:58:14.169 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados x86_64 2:19.2.3-679.gd855f53b.el9 ceph 322 k 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 303 k 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 100 k 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout:Installing weak dependencies: 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:14.170 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:58:14.171 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:58:14.171 INFO:teuthology.orchestra.run.trial045.stdout:Install 33 Packages 2026-02-17T20:58:14.171 INFO:teuthology.orchestra.run.trial045.stdout:Upgrade 2 Packages 2026-02-17T20:58:14.171 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:14.172 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 63 M 2026-02-17T20:58:14.172 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:58:14.434 INFO:teuthology.orchestra.run.trial086.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 256 kB/s | 104 kB 00:00 2026-02-17T20:58:14.531 INFO:teuthology.orchestra.run.trial086.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 361 kB/s | 164 kB 00:00 2026-02-17T20:58:14.535 INFO:teuthology.orchestra.run.trial086.stdout:(19/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 449 kB/s | 45 kB 00:00 2026-02-17T20:58:14.559 INFO:teuthology.orchestra.run.trial086.stdout:(20/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 359 kB/s | 160 kB 00:00 2026-02-17T20:58:14.735 INFO:teuthology.orchestra.run.trial086.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 1.3 MB/s | 240 kB 00:00 2026-02-17T20:58:14.759 INFO:teuthology.orchestra.run.trial086.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2026-02-17T20:58:14.800 INFO:teuthology.orchestra.run.trial086.stdout:(23/35): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2026-02-17T20:58:14.817 INFO:teuthology.orchestra.run.trial086.stdout:(24/35): qatlib-service-25.08.0-2.el9.x86_64.rp 450 kB/s | 37 kB 00:00 2026-02-17T20:58:14.848 INFO:teuthology.orchestra.run.trial086.stdout:(25/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 753 kB/s | 66 kB 00:00 2026-02-17T20:58:14.984 INFO:teuthology.orchestra.run.trial086.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 186 kB/s | 25 kB 00:00 2026-02-17T20:58:14.988 INFO:teuthology.orchestra.run.trial138.stdout:CentOS Stream 9 - Extras packages 106 kB/s | 20 kB 00:00 2026-02-17T20:58:15.044 INFO:teuthology.orchestra.run.trial086.stdout:(27/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-17T20:58:15.045 INFO:teuthology.orchestra.run.trial086.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 811 kB/s | 49 kB 00:00 2026-02-17T20:58:15.078 INFO:teuthology.orchestra.run.trial086.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2026-02-17T20:58:15.141 INFO:teuthology.orchestra.run.trial086.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.5 MB/s | 838 kB 00:00 2026-02-17T20:58:15.147 INFO:teuthology.orchestra.run.trial086.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 2.7 MB/s | 191 kB 00:00 2026-02-17T20:58:15.249 INFO:teuthology.orchestra.run.trial086.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2026-02-17T20:58:15.260 INFO:teuthology.orchestra.run.trial045.stdout:(1/35): ceph-base-19.2.3-679.gd855f53b.el9.x86_ 16 MB/s | 5.5 MB 00:00 2026-02-17T20:58:15.261 INFO:teuthology.orchestra.run.trial086.stdout:(33/35): libarrow-9.0.0-15.el9.x86_64.rpm 9.9 MB/s | 4.4 MB 00:00 2026-02-17T20:58:15.305 INFO:teuthology.orchestra.run.trial045.stdout:(2/35): ceph-selinux-19.2.3-679.gd855f53b.el9.x 564 kB/s | 25 kB 00:00 2026-02-17T20:58:15.375 INFO:teuthology.orchestra.run.trial045.stdout:(3/35): libcephfs2-19.2.3-679.gd855f53b.el9.x86 14 MB/s | 1.0 MB 00:00 2026-02-17T20:58:15.438 INFO:teuthology.orchestra.run.trial045.stdout:(4/35): libradosstriper1-19.2.3-679.gd855f53b.e 7.8 MB/s | 504 kB 00:00 2026-02-17T20:58:15.628 INFO:teuthology.orchestra.run.trial045.stdout:(5/35): ceph-radosgw-19.2.3-679.gd855f53b.el9.x 15 MB/s | 11 MB 00:00 2026-02-17T20:58:15.635 INFO:teuthology.orchestra.run.trial086.stdout:(34/35): librados2-19.2.3-679.gd855f53b.el9.x86 7.0 MB/s | 3.4 MB 00:00 2026-02-17T20:58:15.660 INFO:teuthology.orchestra.run.trial045.stdout:(6/35): python3-ceph-argparse-19.2.3-679.gd855f 1.4 MB/s | 45 kB 00:00 2026-02-17T20:58:15.703 INFO:teuthology.orchestra.run.trial045.stdout:(7/35): python3-ceph-common-19.2.3-679.gd855f53 3.3 MB/s | 142 kB 00:00 2026-02-17T20:58:15.747 INFO:teuthology.orchestra.run.trial045.stdout:(8/35): python3-cephfs-19.2.3-679.gd855f53b.el9 3.7 MB/s | 165 kB 00:00 2026-02-17T20:58:15.770 INFO:teuthology.orchestra.run.trial086.stdout:(35/35): librbd1-19.2.3-679.gd855f53b.el9.x86_6 6.1 MB/s | 3.2 MB 00:00 2026-02-17T20:58:15.775 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:15.775 INFO:teuthology.orchestra.run.trial086.stdout:Total 22 MB/s | 63 MB 00:02 2026-02-17T20:58:15.784 INFO:teuthology.orchestra.run.trial045.stdout:(9/35): python3-rados-19.2.3-679.gd855f53b.el9. 8.6 MB/s | 322 kB 00:00 2026-02-17T20:58:15.800 INFO:teuthology.orchestra.run.trial045.stdout:(10/35): librgw2-19.2.3-679.gd855f53b.el9.x86_6 15 MB/s | 5.4 MB 00:00 2026-02-17T20:58:15.812 INFO:teuthology.orchestra.run.trial045.stdout:(11/35): python3-rbd-19.2.3-679.gd855f53b.el9.x 10 MB/s | 303 kB 00:00 2026-02-17T20:58:15.819 INFO:teuthology.orchestra.run.trial045.stdout:(12/35): python3-rgw-19.2.3-679.gd855f53b.el9.x 5.2 MB/s | 100 kB 00:00 2026-02-17T20:58:15.839 INFO:teuthology.orchestra.run.trial045.stdout:(13/35): mailcap-2.1.49-5.el9.noarch.rpm 1.2 MB/s | 33 kB 00:00 2026-02-17T20:58:15.856 INFO:teuthology.orchestra.run.trial045.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 5.2 MB/s | 93 kB 00:00 2026-02-17T20:58:15.877 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:15.881 INFO:teuthology.orchestra.run.trial045.stdout:(15/35): nvme-cli-2.13-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2026-02-17T20:58:15.896 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:15.896 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:15.929 INFO:teuthology.orchestra.run.trial045.stdout:(16/35): ceph-common-19.2.3-679.gd855f53b.el9.x 22 MB/s | 22 MB 00:01 2026-02-17T20:58:15.950 INFO:teuthology.orchestra.run.trial045.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 1.1 MB/s | 104 kB 00:00 2026-02-17T20:58:15.970 INFO:teuthology.orchestra.run.trial045.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.2 MB/s | 45 kB 00:00 2026-02-17T20:58:16.029 INFO:teuthology.orchestra.run.trial045.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2026-02-17T20:58:16.051 INFO:teuthology.orchestra.run.trial045.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 13 MB/s | 292 kB 00:00 2026-02-17T20:58:16.073 INFO:teuthology.orchestra.run.trial045.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 11 MB/s | 240 kB 00:00 2026-02-17T20:58:16.093 INFO:teuthology.orchestra.run.trial045.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.8 MB/s | 37 kB 00:00 2026-02-17T20:58:16.104 INFO:teuthology.orchestra.run.trial138.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-17T20:58:16.113 INFO:teuthology.orchestra.run.trial045.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.2 MB/s | 66 kB 00:00 2026-02-17T20:58:16.146 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:16.146 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:16.435 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:16.444 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T20:58:16.448 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T20:58:16.450 INFO:teuthology.orchestra.run.trial045.stdout:(24/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 912 kB/s | 308 kB 00:00 2026-02-17T20:58:16.460 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T20:58:16.610 INFO:teuthology.orchestra.run.trial086.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T20:58:16.614 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:16.642 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:16.676 INFO:teuthology.orchestra.run.trial045.stdout:(25/35): libarrow-9.0.0-15.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2026-02-17T20:58:16.684 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T20:58:16.685 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:16.697 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:16.701 INFO:teuthology.orchestra.run.trial086.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T20:58:16.711 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 9/37 2026-02-17T20:58:16.719 INFO:teuthology.orchestra.run.trial045.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 579 kB/s | 25 kB 00:00 2026-02-17T20:58:16.733 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T20:58:16.733 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:16.747 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:16.762 INFO:teuthology.orchestra.run.trial045.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2026-02-17T20:58:16.783 INFO:teuthology.orchestra.run.trial086.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T20:58:16.787 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T20:58:16.793 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T20:58:16.796 INFO:teuthology.orchestra.run.trial086.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T20:58:16.799 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T20:58:16.803 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T20:58:16.805 INFO:teuthology.orchestra.run.trial045.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 1.5 MB/s | 67 kB 00:00 2026-02-17T20:58:16.854 INFO:teuthology.orchestra.run.trial045.stdout:(29/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 17 MB/s | 838 kB 00:00 2026-02-17T20:58:16.898 INFO:teuthology.orchestra.run.trial045.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 4.3 MB/s | 191 kB 00:00 2026-02-17T20:58:16.943 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:58:16.944 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T20:58:16.952 INFO:teuthology.orchestra.run.trial045.stdout:(31/35): thrift-0.15.0-4.el9.x86_64.rpm 29 MB/s | 1.6 MB 00:00 2026-02-17T20:58:16.969 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T20:58:16.972 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 20/37 2026-02-17T20:58:16.978 INFO:teuthology.orchestra.run.trial086.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T20:58:17.054 INFO:teuthology.orchestra.run.trial045.stdout:(32/35): librados2-19.2.3-679.gd855f53b.el9.x86 34 MB/s | 3.4 MB 00:00 2026-02-17T20:58:17.101 INFO:teuthology.orchestra.run.trial045.stdout:(33/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 137 kB/s | 160 kB 00:01 2026-02-17T20:58:17.113 INFO:teuthology.orchestra.run.trial045.stdout:(34/35): librbd1-19.2.3-679.gd855f53b.el9.x86_6 53 MB/s | 3.2 MB 00:00 2026-02-17T20:58:17.202 INFO:teuthology.orchestra.run.trial086.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T20:58:17.203 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T20:58:17.219 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T20:58:17.223 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 24/37 2026-02-17T20:58:17.228 INFO:teuthology.orchestra.run.trial086.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T20:58:17.230 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T20:58:17.231 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:58:17.249 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:58:17.360 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T20:58:17.363 INFO:teuthology.orchestra.run.trial086.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:58:17.638 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:58:17.639 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T20:58:17.639 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:17.675 INFO:teuthology.orchestra.run.trial086.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T20:58:17.677 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 31/37 2026-02-17T20:58:17.818 INFO:teuthology.orchestra.run.trial045.stdout:(35/35): libnbd-1.20.3-4.el9.x86_64.rpm 85 kB/s | 164 kB 00:01 2026-02-17T20:58:17.823 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:17.823 INFO:teuthology.orchestra.run.trial045.stdout:Total 17 MB/s | 63 MB 00:03 2026-02-17T20:58:17.925 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:58:17.943 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:58:17.943 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:58:18.193 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:58:18.194 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:58:18.495 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:58:18.504 INFO:teuthology.orchestra.run.trial045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T20:58:18.506 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T20:58:18.518 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T20:58:18.657 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:18.660 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:18.672 INFO:teuthology.orchestra.run.trial045.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T20:58:18.676 INFO:teuthology.orchestra.run.trial045.stdout: Upgrading : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:18.707 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:18.750 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T20:58:18.751 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:18.763 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:18.767 INFO:teuthology.orchestra.run.trial045.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T20:58:18.776 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 9/37 2026-02-17T20:58:18.798 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T20:58:18.799 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:18.813 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:18.846 INFO:teuthology.orchestra.run.trial045.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T20:58:18.849 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T20:58:18.855 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T20:58:18.858 INFO:teuthology.orchestra.run.trial045.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T20:58:18.861 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T20:58:18.865 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T20:58:18.940 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:18.944 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T20:58:18.984 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T20:58:18.984 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T20:58:18.984 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T20:58:18.984 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:18.987 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:19.007 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:58:19.009 INFO:teuthology.orchestra.run.trial045.stdout: Upgrading : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T20:58:19.037 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T20:58:19.041 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 20/37 2026-02-17T20:58:19.048 INFO:teuthology.orchestra.run.trial045.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T20:58:19.279 INFO:teuthology.orchestra.run.trial045.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T20:58:19.280 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T20:58:19.296 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T20:58:19.300 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 24/37 2026-02-17T20:58:19.305 INFO:teuthology.orchestra.run.trial045.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T20:58:19.307 INFO:teuthology.orchestra.run.trial045.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T20:58:19.308 INFO:teuthology.orchestra.run.trial045.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:58:19.326 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:58:19.370 INFO:teuthology.orchestra.run.trial138.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-17T20:58:19.439 INFO:teuthology.orchestra.run.trial045.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T20:58:19.441 INFO:teuthology.orchestra.run.trial045.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:58:19.717 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:58:19.717 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T20:58:19.717 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:19.751 INFO:teuthology.orchestra.run.trial045.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T20:58:19.753 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 31/37 2026-02-17T20:58:20.582 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:20.584 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:20.584 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repository Size 2026-02-17T20:58:20.584 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:20.584 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:58:20.584 INFO:teuthology.orchestra.run.trial138.stdout: ceph-radosgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T20:58:20.584 INFO:teuthology.orchestra.run.trial138.stdout:Upgrading: 2026-02-17T20:58:20.584 INFO:teuthology.orchestra.run.trial138.stdout: librados2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.4 M 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: librbd1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.2 M 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: ceph-base x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.5 M 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 22 M 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: ceph-selinux x86_64 2:19.2.3-679.gd855f53b.el9 ceph 25 k 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.0 M 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T20:58:20.585 INFO:teuthology.orchestra.run.trial138.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: libradosstriper1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 504 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: librgw2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.4 M 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: python3-ceph-argparse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 45 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: python3-ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 142 k 2026-02-17T20:58:20.586 INFO:teuthology.orchestra.run.trial138.stdout: python3-cephfs x86_64 2:19.2.3-679.gd855f53b.el9 ceph 165 k 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: python3-rados x86_64 2:19.2.3-679.gd855f53b.el9 ceph 322 k 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: python3-rbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 303 k 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: python3-rgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 100 k 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout:Installing weak dependencies: 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:20.587 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:58:20.588 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:20.588 INFO:teuthology.orchestra.run.trial138.stdout:Install 33 Packages 2026-02-17T20:58:20.588 INFO:teuthology.orchestra.run.trial138.stdout:Upgrade 2 Packages 2026-02-17T20:58:20.588 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:20.588 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 63 M 2026-02-17T20:58:20.589 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:58:20.755 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:20.757 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:21.043 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:21.047 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T20:58:21.086 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T20:58:21.086 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T20:58:21.086 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T20:58:21.086 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:21.090 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:21.437 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - CRB 909 kB/s | 7.8 MB 00:08 2026-02-17T20:58:22.793 INFO:teuthology.orchestra.run.trial138.stdout:(1/35): ceph-base-19.2.3-679.gd855f53b.el9.x86_ 3.7 MB/s | 5.5 MB 00:01 2026-02-17T20:58:22.804 INFO:teuthology.orchestra.run.trial138.stdout:(2/35): ceph-selinux-19.2.3-679.gd855f53b.el9.x 2.1 MB/s | 25 kB 00:00 2026-02-17T20:58:22.915 INFO:teuthology.orchestra.run.trial138.stdout:(3/35): libcephfs2-19.2.3-679.gd855f53b.el9.x86 8.9 MB/s | 1.0 MB 00:00 2026-02-17T20:58:22.970 INFO:teuthology.orchestra.run.trial138.stdout:(4/35): libradosstriper1-19.2.3-679.gd855f53b.e 8.9 MB/s | 504 kB 00:00 2026-02-17T20:58:23.176 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-17T20:58:23.222 INFO:teuthology.orchestra.run.trial138.stdout:(5/35): ceph-radosgw-19.2.3-679.gd855f53b.el9.x 5.6 MB/s | 11 MB 00:01 2026-02-17T20:58:23.234 INFO:teuthology.orchestra.run.trial138.stdout:(6/35): python3-ceph-argparse-19.2.3-679.gd855f 3.5 MB/s | 45 kB 00:00 2026-02-17T20:58:23.257 INFO:teuthology.orchestra.run.trial138.stdout:(7/35): python3-ceph-common-19.2.3-679.gd855f53 6.2 MB/s | 142 kB 00:00 2026-02-17T20:58:23.279 INFO:teuthology.orchestra.run.trial138.stdout:(8/35): python3-cephfs-19.2.3-679.gd855f53b.el9 7.2 MB/s | 165 kB 00:00 2026-02-17T20:58:23.313 INFO:teuthology.orchestra.run.trial138.stdout:(9/35): python3-rados-19.2.3-679.gd855f53b.el9. 9.4 MB/s | 322 kB 00:00 2026-02-17T20:58:23.346 INFO:teuthology.orchestra.run.trial138.stdout:(10/35): python3-rbd-19.2.3-679.gd855f53b.el9.x 8.9 MB/s | 303 kB 00:00 2026-02-17T20:58:23.358 INFO:teuthology.orchestra.run.trial138.stdout:(11/35): python3-rgw-19.2.3-679.gd855f53b.el9.x 8.4 MB/s | 100 kB 00:00 2026-02-17T20:58:23.378 INFO:teuthology.orchestra.run.trial138.stdout:(12/35): mailcap-2.1.49-5.el9.noarch.rpm 1.6 MB/s | 33 kB 00:00 2026-02-17T20:58:23.397 INFO:teuthology.orchestra.run.trial138.stdout:(13/35): nvme-cli-2.13-1.el9.x86_64.rpm 56 MB/s | 1.1 MB 00:00 2026-02-17T20:58:23.402 INFO:teuthology.orchestra.run.trial138.stdout:(14/35): pciutils-3.7.0-7.el9.x86_64.rpm 18 MB/s | 93 kB 00:00 2026-02-17T20:58:23.528 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:23.528 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /sys 2026-02-17T20:58:23.528 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /proc 2026-02-17T20:58:23.528 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /mnt 2026-02-17T20:58:23.528 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /var/tmp 2026-02-17T20:58:23.528 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /home 2026-02-17T20:58:23.528 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /root 2026-02-17T20:58:23.528 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /tmp 2026-02-17T20:58:23.528 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:23.545 INFO:teuthology.orchestra.run.trial138.stdout:(15/35): librgw2-19.2.3-679.gd855f53b.el9.x86_6 9.4 MB/s | 5.4 MB 00:00 2026-02-17T20:58:23.965 INFO:teuthology.orchestra.run.trial138.stdout:(16/35): boost-program-options-1.75.0-13.el9.x8 185 kB/s | 104 kB 00:00 2026-02-17T20:58:23.977 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T20:58:24.000 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T20:58:24.000 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:24.000 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T20:58:24.001 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:58:24.001 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:58:24.001 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:24.002 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:58:24.015 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:58:24.016 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:24.071 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:24.071 INFO:teuthology.orchestra.run.trial086.stdout:Creating group 'qat' with GID 992. 2026-02-17T20:58:24.071 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:24.111 INFO:teuthology.orchestra.run.trial138.stdout:(17/35): libnbd-1.20.3-4.el9.x86_64.rpm 289 kB/s | 164 kB 00:00 2026-02-17T20:58:24.212 INFO:teuthology.orchestra.run.trial138.stdout:(18/35): ceph-common-19.2.3-679.gd855f53b.el9.x 7.5 MB/s | 22 MB 00:02 2026-02-17T20:58:24.212 INFO:teuthology.orchestra.run.trial138.stdout:(19/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 648 kB/s | 160 kB 00:00 2026-02-17T20:58:24.213 INFO:teuthology.orchestra.run.trial138.stdout:(20/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2026-02-17T20:58:24.340 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 1/37 2026-02-17T20:58:24.340 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2/37 2026-02-17T20:58:24.340 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 3/37 2026-02-17T20:58:24.340 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 4/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 8/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 9/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 12/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 13/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T20:58:24.341 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T20:58:24.342 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T20:58:24.343 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T20:58:24.343 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T20:58:24.343 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T20:58:24.343 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T20:58:24.343 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T20:58:24.343 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T20:58:24.343 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:24.343 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T20:58:24.343 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 36/37 2026-02-17T20:58:24.395 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout:Upgraded: 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.396 INFO:teuthology.orchestra.run.trial086.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T20:58:24.397 INFO:teuthology.orchestra.run.trial086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T20:58:24.398 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T20:58:24.399 INFO:teuthology.orchestra.run.trial086.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T20:58:24.399 INFO:teuthology.orchestra.run.trial086.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T20:58:24.399 INFO:teuthology.orchestra.run.trial086.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T20:58:24.399 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:24.399 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:24.438 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-test 2026-02-17T20:58:24.546 INFO:teuthology.orchestra.run.trial092.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-17T20:58:24.612 INFO:teuthology.orchestra.run.trial138.stdout:(21/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 732 kB/s | 292 kB 00:00 2026-02-17T20:58:24.699 INFO:teuthology.orchestra.run.trial138.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 425 kB/s | 37 kB 00:00 2026-02-17T20:58:24.753 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:13 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:24.782 INFO:teuthology.orchestra.run.trial138.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 801 kB/s | 66 kB 00:00 2026-02-17T20:58:24.833 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:24.834 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:24.834 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-17T20:58:24.834 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:24.834 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test x86_64 2:19.2.3-679.gd855f53b.el9 ceph 50 M 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout: libcephsqlite x86_64 2:19.2.3-679.gd855f53b.el9 ceph 163 k 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout:Install 5 Packages 2026-02-17T20:58:24.835 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:24.836 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 50 M 2026-02-17T20:58:24.836 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 212 M 2026-02-17T20:58:24.836 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:24.866 INFO:teuthology.orchestra.run.trial138.stdout:(24/35): qatlib-25.08.0-2.el9.x86_64.rpm 367 kB/s | 240 kB 00:00 2026-02-17T20:58:25.007 INFO:teuthology.orchestra.run.trial138.stdout:(25/35): librdkafka-1.6.1-102.el9.x86_64.rpm 833 kB/s | 662 kB 00:00 2026-02-17T20:58:25.206 INFO:teuthology.orchestra.run.trial138.stdout:(26/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 726 kB/s | 308 kB 00:00 2026-02-17T20:58:25.226 INFO:teuthology.orchestra.run.trial086.stdout:(1/5): libcephsqlite-19.2.3-679.gd855f53b.el9.x 1.8 MB/s | 163 kB 00:00 2026-02-17T20:58:25.261 INFO:teuthology.orchestra.run.trial138.stdout:(27/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 97 kB/s | 25 kB 00:00 2026-02-17T20:58:25.273 INFO:teuthology.orchestra.run.trial138.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 729 kB/s | 49 kB 00:00 2026-02-17T20:58:25.455 INFO:teuthology.orchestra.run.trial138.stdout:(29/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2026-02-17T20:58:25.476 INFO:teuthology.orchestra.run.trial138.stdout:(30/35): libunwind-1.6.2-1.el9.x86_64.rpm 314 kB/s | 67 kB 00:00 2026-02-17T20:58:25.525 INFO:teuthology.orchestra.run.trial138.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 2.7 MB/s | 191 kB 00:00 2026-02-17T20:58:25.612 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:25.613 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /sys 2026-02-17T20:58:25.613 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /proc 2026-02-17T20:58:25.613 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /mnt 2026-02-17T20:58:25.613 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /var/tmp 2026-02-17T20:58:25.613 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /home 2026-02-17T20:58:25.613 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /root 2026-02-17T20:58:25.614 INFO:teuthology.orchestra.run.trial045.stdout:skipping the directory /tmp 2026-02-17T20:58:25.614 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:25.715 INFO:teuthology.orchestra.run.trial138.stdout:(32/35): libarrow-9.0.0-15.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2026-02-17T20:58:25.935 INFO:teuthology.orchestra.run.trial138.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2026-02-17T20:58:25.951 INFO:teuthology.orchestra.run.trial086.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 287 kB/s | 233 kB 00:00 2026-02-17T20:58:26.077 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T20:58:26.101 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T20:58:26.101 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:26.101 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T20:58:26.101 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:58:26.102 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:58:26.102 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:26.103 INFO:teuthology.orchestra.run.trial045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:58:26.111 INFO:teuthology.orchestra.run.trial086.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 399 kB/s | 64 kB 00:00 2026-02-17T20:58:26.116 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:58:26.117 INFO:teuthology.orchestra.run.trial045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:26.174 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:26.174 INFO:teuthology.orchestra.run.trial045.stdout:Creating group 'qat' with GID 992. 2026-02-17T20:58:26.174 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:26.184 INFO:teuthology.orchestra.run.trial086.stdout:(4/5): ceph-test-19.2.3-679.gd855f53b.el9.x86_6 47 MB/s | 50 MB 00:01 2026-02-17T20:58:26.186 INFO:teuthology.orchestra.run.trial086.stdout:(5/5): socat-1.7.4.1-8.el9.x86_64.rpm 316 kB/s | 303 kB 00:00 2026-02-17T20:58:26.188 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:26.188 INFO:teuthology.orchestra.run.trial086.stdout:Total 37 MB/s | 50 MB 00:01 2026-02-17T20:58:26.215 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:26.224 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:26.225 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:26.251 INFO:teuthology.orchestra.run.trial138.stdout:(34/35): librbd1-19.2.3-679.gd855f53b.el9.x86_6 5.9 MB/s | 3.2 MB 00:00 2026-02-17T20:58:26.288 INFO:teuthology.orchestra.run.trial138.stdout:(35/35): librados2-19.2.3-679.gd855f53b.el9.x86 4.5 MB/s | 3.4 MB 00:00 2026-02-17T20:58:26.291 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:26.291 INFO:teuthology.orchestra.run.trial138.stdout:Total 11 MB/s | 63 MB 00:05 2026-02-17T20:58:26.396 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:58:26.410 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:26.410 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:26.414 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:58:26.414 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:58:26.452 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 1/37 2026-02-17T20:58:26.452 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2/37 2026-02-17T20:58:26.452 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 3/37 2026-02-17T20:58:26.452 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 4/37 2026-02-17T20:58:26.452 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 8/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 9/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 12/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 13/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T20:58:26.453 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T20:58:26.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T20:58:26.455 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T20:58:26.455 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T20:58:26.455 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:26.455 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T20:58:26.455 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 36/37 2026-02-17T20:58:26.509 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:26.509 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:26.509 INFO:teuthology.orchestra.run.trial045.stdout:Upgraded: 2026-02-17T20:58:26.509 INFO:teuthology.orchestra.run.trial045.stdout: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.509 INFO:teuthology.orchestra.run.trial045.stdout: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.509 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:58:26.509 INFO:teuthology.orchestra.run.trial045.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T20:58:26.509 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.509 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T20:58:26.510 INFO:teuthology.orchestra.run.trial045.stdout: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.511 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:26.512 INFO:teuthology.orchestra.run.trial045.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T20:58:26.512 INFO:teuthology.orchestra.run.trial045.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T20:58:26.512 INFO:teuthology.orchestra.run.trial045.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T20:58:26.512 INFO:teuthology.orchestra.run.trial045.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T20:58:26.512 INFO:teuthology.orchestra.run.trial045.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T20:58:26.512 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:26.512 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:58:26.552 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-test 2026-02-17T20:58:26.617 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:26.623 INFO:teuthology.orchestra.run.trial086.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T20:58:26.628 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T20:58:26.636 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T20:58:26.637 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T20:58:26.665 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:58:26.665 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:58:26.866 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:14 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:58:26.949 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:58:26.950 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:58:26.950 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-17T20:58:26.950 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test x86_64 2:19.2.3-679.gd855f53b.el9 ceph 50 M 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout: libcephsqlite x86_64 2:19.2.3-679.gd855f53b.el9 ceph 163 k 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:58:26.951 INFO:teuthology.orchestra.run.trial045.stdout:Install 5 Packages 2026-02-17T20:58:26.952 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:26.952 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 50 M 2026-02-17T20:58:26.952 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 212 M 2026-02-17T20:58:26.952 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:58:26.954 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:58:26.963 INFO:teuthology.orchestra.run.trial138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T20:58:26.965 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T20:58:26.977 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T20:58:27.037 INFO:teuthology.orchestra.run.trial045.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 9.4 MB/s | 233 kB 00:00 2026-02-17T20:58:27.050 INFO:teuthology.orchestra.run.trial045.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 24 MB/s | 303 kB 00:00 2026-02-17T20:58:27.054 INFO:teuthology.orchestra.run.trial045.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-17T20:58:27.099 INFO:teuthology.orchestra.run.trial045.stdout:(4/5): libcephsqlite-19.2.3-679.gd855f53b.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T20:58:27.127 INFO:teuthology.orchestra.run.trial138.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T20:58:27.132 INFO:teuthology.orchestra.run.trial138.stdout: Upgrading : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:27.163 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:27.207 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T20:58:27.207 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:27.220 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:27.224 INFO:teuthology.orchestra.run.trial138.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T20:58:27.233 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 9/37 2026-02-17T20:58:27.255 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T20:58:27.255 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:27.269 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:27.302 INFO:teuthology.orchestra.run.trial138.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T20:58:27.306 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T20:58:27.312 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T20:58:27.314 INFO:teuthology.orchestra.run.trial138.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T20:58:27.317 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T20:58:27.322 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T20:58:27.462 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:58:27.463 INFO:teuthology.orchestra.run.trial138.stdout: Upgrading : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T20:58:27.491 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T20:58:27.495 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 20/37 2026-02-17T20:58:27.503 INFO:teuthology.orchestra.run.trial138.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T20:58:27.724 INFO:teuthology.orchestra.run.trial092.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-17T20:58:27.729 INFO:teuthology.orchestra.run.trial138.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T20:58:27.730 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T20:58:27.746 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T20:58:27.750 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 24/37 2026-02-17T20:58:27.757 INFO:teuthology.orchestra.run.trial138.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T20:58:27.760 INFO:teuthology.orchestra.run.trial138.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T20:58:27.760 INFO:teuthology.orchestra.run.trial138.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:58:27.779 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:58:27.894 INFO:teuthology.orchestra.run.trial138.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T20:58:27.897 INFO:teuthology.orchestra.run.trial138.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:58:28.023 INFO:teuthology.orchestra.run.trial045.stdout:(5/5): ceph-test-19.2.3-679.gd855f53b.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T20:58:28.024 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:28.025 INFO:teuthology.orchestra.run.trial045.stdout:Total 47 MB/s | 50 MB 00:01 2026-02-17T20:58:28.052 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:58:28.061 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:58:28.061 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:58:28.171 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:58:28.172 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T20:58:28.172 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:28.207 INFO:teuthology.orchestra.run.trial138.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T20:58:28.208 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 31/37 2026-02-17T20:58:28.248 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:58:28.248 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:58:28.460 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:58:28.466 INFO:teuthology.orchestra.run.trial045.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T20:58:28.470 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T20:58:28.478 INFO:teuthology.orchestra.run.trial045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T20:58:28.479 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T20:58:28.884 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T20:58:28.902 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T20:58:28.932 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:58:28.933 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:58:28.934 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repository Size 2026-02-17T20:58:28.934 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:58:28.934 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:58:28.934 INFO:teuthology.orchestra.run.trial092.stdout: ceph-radosgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T20:58:28.934 INFO:teuthology.orchestra.run.trial092.stdout:Upgrading: 2026-02-17T20:58:28.934 INFO:teuthology.orchestra.run.trial092.stdout: librados2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.4 M 2026-02-17T20:58:28.934 INFO:teuthology.orchestra.run.trial092.stdout: librbd1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.2 M 2026-02-17T20:58:28.934 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-17T20:58:28.934 INFO:teuthology.orchestra.run.trial092.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: ceph-base x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.5 M 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 22 M 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: ceph-selinux x86_64 2:19.2.3-679.gd855f53b.el9 ceph 25 k 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.0 M 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T20:58:28.935 INFO:teuthology.orchestra.run.trial092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: libradosstriper1 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 504 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: librgw2 x86_64 2:19.2.3-679.gd855f53b.el9 ceph 5.4 M 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-argparse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 45 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-common x86_64 2:19.2.3-679.gd855f53b.el9 ceph 142 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: python3-cephfs x86_64 2:19.2.3-679.gd855f53b.el9 ceph 165 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: python3-rados x86_64 2:19.2.3-679.gd855f53b.el9 ceph 322 k 2026-02-17T20:58:28.936 INFO:teuthology.orchestra.run.trial092.stdout: python3-rbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 303 k 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout: python3-rgw x86_64 2:19.2.3-679.gd855f53b.el9 ceph 100 k 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout:Installing weak dependencies: 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:28.937 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:58:28.938 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:58:28.938 INFO:teuthology.orchestra.run.trial092.stdout:Install 33 Packages 2026-02-17T20:58:28.938 INFO:teuthology.orchestra.run.trial092.stdout:Upgrade 2 Packages 2026-02-17T20:58:28.938 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:28.939 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 63 M 2026-02-17T20:58:28.939 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:58:29.126 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T20:58:29.126 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 1/5 2026-02-17T20:58:29.126 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2/5 2026-02-17T20:58:29.126 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T20:58:29.126 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T20:58:29.178 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T20:58:29.178 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:29.178 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:29.178 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:29.178 INFO:teuthology.orchestra.run.trial086.stdout: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:29.179 INFO:teuthology.orchestra.run.trial086.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T20:58:29.179 INFO:teuthology.orchestra.run.trial086.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T20:58:29.179 INFO:teuthology.orchestra.run.trial086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T20:58:29.179 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:29.179 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:29.188 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:29.190 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:29.212 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph 2026-02-17T20:58:29.478 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:29.481 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T20:58:29.515 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:18 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:29.524 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T20:58:29.525 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T20:58:29.525 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T20:58:29.525 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:29.529 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:29.600 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:29.603 INFO:teuthology.orchestra.run.trial086.stdout:====================================================================================== 2026-02-17T20:58:29.603 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-17T20:58:29.603 INFO:teuthology.orchestra.run.trial086.stdout:====================================================================================== 2026-02-17T20:58:29.603 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:29.603 INFO:teuthology.orchestra.run.trial086.stdout: ceph x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.5 k 2026-02-17T20:58:29.603 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-17T20:58:29.603 INFO:teuthology.orchestra.run.trial086.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T20:58:29.603 INFO:teuthology.orchestra.run.trial086.stdout: ceph-grafana-dashboards noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 31 k 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds x86_64 2:19.2.3-679.gd855f53b.el9 ceph 2.4 M 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-modules-core noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 253 k 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon x86_64 2:19.2.3-679.gd855f53b.el9 ceph 4.7 M 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 17 M 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: ceph-prometheus-alerts noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 17 k 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 769 k 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T20:58:29.604 INFO:teuthology.orchestra.run.trial086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T20:58:29.605 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T20:58:29.606 INFO:teuthology.orchestra.run.trial086.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T20:58:29.607 INFO:teuthology.orchestra.run.trial086.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T20:58:29.608 INFO:teuthology.orchestra.run.trial086.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T20:58:29.609 INFO:teuthology.orchestra.run.trial086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T20:58:29.610 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 150 k 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-dashboard noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 3.8 M 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 7.4 M 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 22 k 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-rook noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 49 k 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: ceph-volume noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 299 k 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout:====================================================================================== 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout:Install 99 Packages 2026-02-17T20:58:29.611 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:29.612 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 95 M 2026-02-17T20:58:29.612 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 520 M 2026-02-17T20:58:29.612 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:30.116 INFO:teuthology.orchestra.run.trial086.stdout:(1/99): ceph-19.2.3-679.gd855f53b.el9.x86_64.rp 30 kB/s | 6.5 kB 00:00 2026-02-17T20:58:30.130 INFO:teuthology.orchestra.run.trial092.stdout:(1/35): ceph-radosgw-19.2.3-679.gd855f53b.el9.x 25 MB/s | 11 MB 00:00 2026-02-17T20:58:30.153 INFO:teuthology.orchestra.run.trial092.stdout:(2/35): ceph-selinux-19.2.3-679.gd855f53b.el9.x 1.1 MB/s | 25 kB 00:00 2026-02-17T20:58:30.205 INFO:teuthology.orchestra.run.trial092.stdout:(3/35): libcephfs2-19.2.3-679.gd855f53b.el9.x86 19 MB/s | 1.0 MB 00:00 2026-02-17T20:58:30.251 INFO:teuthology.orchestra.run.trial092.stdout:(4/35): libradosstriper1-19.2.3-679.gd855f53b.e 11 MB/s | 504 kB 00:00 2026-02-17T20:58:30.418 INFO:teuthology.orchestra.run.trial092.stdout:(5/35): ceph-base-19.2.3-679.gd855f53b.el9.x86_ 7.6 MB/s | 5.5 MB 00:00 2026-02-17T20:58:30.466 INFO:teuthology.orchestra.run.trial092.stdout:(6/35): python3-ceph-argparse-19.2.3-679.gd855f 947 kB/s | 45 kB 00:00 2026-02-17T20:58:30.486 INFO:teuthology.orchestra.run.trial092.stdout:(7/35): librgw2-19.2.3-679.gd855f53b.el9.x86_64 23 MB/s | 5.4 MB 00:00 2026-02-17T20:58:30.502 INFO:teuthology.orchestra.run.trial092.stdout:(8/35): python3-ceph-common-19.2.3-679.gd855f53 3.9 MB/s | 142 kB 00:00 2026-02-17T20:58:30.515 INFO:teuthology.orchestra.run.trial092.stdout:(9/35): python3-cephfs-19.2.3-679.gd855f53b.el9 5.6 MB/s | 165 kB 00:00 2026-02-17T20:58:30.535 INFO:teuthology.orchestra.run.trial092.stdout:(10/35): python3-rados-19.2.3-679.gd855f53b.el9 9.5 MB/s | 322 kB 00:00 2026-02-17T20:58:30.550 INFO:teuthology.orchestra.run.trial092.stdout:(11/35): python3-rbd-19.2.3-679.gd855f53b.el9.x 8.5 MB/s | 303 kB 00:00 2026-02-17T20:58:30.567 INFO:teuthology.orchestra.run.trial092.stdout:(12/35): python3-rgw-19.2.3-679.gd855f53b.el9.x 3.1 MB/s | 100 kB 00:00 2026-02-17T20:58:30.627 INFO:teuthology.orchestra.run.trial086.stdout:(2/99): ceph-mgr-19.2.3-679.gd855f53b.el9.x86_6 1.5 MB/s | 1.1 MB 00:00 2026-02-17T20:58:30.639 INFO:teuthology.orchestra.run.trial092.stdout:(13/35): ceph-common-19.2.3-679.gd855f53b.el9.x 23 MB/s | 22 MB 00:00 2026-02-17T20:58:30.731 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T20:58:30.741 INFO:teuthology.orchestra.run.trial086.stdout:(3/99): ceph-mds-19.2.3-679.gd855f53b.el9.x86_6 2.9 MB/s | 2.4 MB 00:00 2026-02-17T20:58:30.749 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T20:58:30.754 INFO:teuthology.orchestra.run.trial086.stdout:(4/99): ceph-grafana-dashboards-19.2.3-679.gd85 2.4 MB/s | 31 kB 00:00 2026-02-17T20:58:30.782 INFO:teuthology.orchestra.run.trial086.stdout:(5/99): ceph-mgr-cephadm-19.2.3-679.gd855f53b.e 5.2 MB/s | 150 kB 00:00 2026-02-17T20:58:30.970 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T20:58:30.970 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 1/5 2026-02-17T20:58:30.970 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2/5 2026-02-17T20:58:30.970 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T20:58:30.970 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T20:58:31.023 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T20:58:31.023 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:31.023 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:58:31.023 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:31.024 INFO:teuthology.orchestra.run.trial045.stdout: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:31.024 INFO:teuthology.orchestra.run.trial045.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T20:58:31.024 INFO:teuthology.orchestra.run.trial045.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T20:58:31.024 INFO:teuthology.orchestra.run.trial045.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T20:58:31.024 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:31.024 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:58:31.057 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph 2026-02-17T20:58:31.131 INFO:teuthology.orchestra.run.trial086.stdout:(6/99): ceph-mgr-dashboard-19.2.3-679.gd855f53b 11 MB/s | 3.8 MB 00:00 2026-02-17T20:58:31.138 INFO:teuthology.orchestra.run.trial092.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 56 kB/s | 33 kB 00:00 2026-02-17T20:58:31.176 INFO:teuthology.orchestra.run.trial092.stdout:(15/35): boost-program-options-1.75.0-13.el9.x8 2.7 MB/s | 104 kB 00:00 2026-02-17T20:58:31.193 INFO:teuthology.orchestra.run.trial092.stdout:(16/35): libnbd-1.20.3-4.el9.x86_64.rpm 9.6 MB/s | 164 kB 00:00 2026-02-17T20:58:31.193 INFO:teuthology.orchestra.run.trial086.stdout:(7/99): ceph-mon-19.2.3-679.gd855f53b.el9.x86_6 4.4 MB/s | 4.7 MB 00:01 2026-02-17T20:58:31.204 INFO:teuthology.orchestra.run.trial092.stdout:(17/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 14 MB/s | 160 kB 00:00 2026-02-17T20:58:31.206 INFO:teuthology.orchestra.run.trial086.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-679.gd855f53b 1.7 MB/s | 22 kB 00:00 2026-02-17T20:58:31.213 INFO:teuthology.orchestra.run.trial092.stdout:(18/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 5.2 MB/s | 45 kB 00:00 2026-02-17T20:58:31.233 INFO:teuthology.orchestra.run.trial092.stdout:(19/35): librdkafka-1.6.1-102.el9.x86_64.rpm 32 MB/s | 662 kB 00:00 2026-02-17T20:58:31.239 INFO:teuthology.orchestra.run.trial086.stdout:(9/99): ceph-osd-19.2.3-679.gd855f53b.el9.x86_6 28 MB/s | 17 MB 00:00 2026-02-17T20:58:31.244 INFO:teuthology.orchestra.run.trial092.stdout:(20/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 26 MB/s | 292 kB 00:00 2026-02-17T20:58:31.254 INFO:teuthology.orchestra.run.trial086.stdout:(10/99): ceph-mgr-rook-19.2.3-679.gd855f53b.el9 3.4 MB/s | 49 kB 00:00 2026-02-17T20:58:31.255 INFO:teuthology.orchestra.run.trial092.stdout:(21/35): qatlib-25.08.0-2.el9.x86_64.rpm 22 MB/s | 240 kB 00:00 2026-02-17T20:58:31.262 INFO:teuthology.orchestra.run.trial086.stdout:(11/99): ceph-mgr-modules-core-19.2.3-679.gd855 4.4 MB/s | 253 kB 00:00 2026-02-17T20:58:31.263 INFO:teuthology.orchestra.run.trial092.stdout:(22/35): qatlib-service-25.08.0-2.el9.x86_64.rp 4.2 MB/s | 37 kB 00:00 2026-02-17T20:58:31.268 INFO:teuthology.orchestra.run.trial086.stdout:(12/99): ceph-prometheus-alerts-19.2.3-679.gd85 1.1 MB/s | 17 kB 00:00 2026-02-17T20:58:31.272 INFO:teuthology.orchestra.run.trial092.stdout:(23/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.5 MB/s | 66 kB 00:00 2026-02-17T20:58:31.284 INFO:teuthology.orchestra.run.trial086.stdout:(13/99): cephadm-19.2.3-679.gd855f53b.el9.noarc 48 MB/s | 769 kB 00:00 2026-02-17T20:58:31.298 INFO:teuthology.orchestra.run.trial086.stdout:(14/99): ceph-volume-19.2.3-679.gd855f53b.el9.n 8.1 MB/s | 299 kB 00:00 2026-02-17T20:58:31.346 INFO:teuthology.orchestra.run.trial092.stdout:(24/35): pciutils-3.7.0-7.el9.x86_64.rpm 132 kB/s | 93 kB 00:00 2026-02-17T20:58:31.360 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:19 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:58:31.385 INFO:teuthology.orchestra.run.trial086.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 466 kB/s | 40 kB 00:00 2026-02-17T20:58:31.444 INFO:teuthology.orchestra.run.trial086.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 1.2 MB/s | 72 kB 00:00 2026-02-17T20:58:31.445 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:58:31.448 INFO:teuthology.orchestra.run.trial045.stdout:====================================================================================== 2026-02-17T20:58:31.448 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repository Size 2026-02-17T20:58:31.448 INFO:teuthology.orchestra.run.trial045.stdout:====================================================================================== 2026-02-17T20:58:31.448 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:58:31.448 INFO:teuthology.orchestra.run.trial045.stdout: ceph x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.5 k 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: ceph-grafana-dashboards noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 31 k 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds x86_64 2:19.2.3-679.gd855f53b.el9 ceph 2.4 M 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-modules-core noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 253 k 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon x86_64 2:19.2.3-679.gd855f53b.el9 ceph 4.7 M 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 17 M 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: ceph-prometheus-alerts noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 17 k 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 769 k 2026-02-17T20:58:31.449 INFO:teuthology.orchestra.run.trial045.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T20:58:31.450 INFO:teuthology.orchestra.run.trial045.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T20:58:31.451 INFO:teuthology.orchestra.run.trial045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T20:58:31.452 INFO:teuthology.orchestra.run.trial045.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T20:58:31.453 INFO:teuthology.orchestra.run.trial045.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T20:58:31.454 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T20:58:31.455 INFO:teuthology.orchestra.run.trial045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T20:58:31.456 INFO:teuthology.orchestra.run.trial045.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout:Installing weak dependencies: 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 150 k 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-dashboard noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 3.8 M 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 7.4 M 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 22 k 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-rook noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 49 k 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: ceph-volume noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 299 k 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T20:58:31.457 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:31.458 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:58:31.458 INFO:teuthology.orchestra.run.trial045.stdout:====================================================================================== 2026-02-17T20:58:31.458 INFO:teuthology.orchestra.run.trial045.stdout:Install 99 Packages 2026-02-17T20:58:31.458 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:31.459 INFO:teuthology.orchestra.run.trial086.stdout:(17/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.0 MB/s | 350 kB 00:00 2026-02-17T20:58:31.459 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 95 M 2026-02-17T20:58:31.459 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 520 M 2026-02-17T20:58:31.459 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:58:31.460 INFO:teuthology.orchestra.run.trial092.stdout:(25/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.6 MB/s | 308 kB 00:00 2026-02-17T20:58:31.484 INFO:teuthology.orchestra.run.trial086.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 5.5 MB/s | 184 kB 00:00 2026-02-17T20:58:31.521 INFO:teuthology.orchestra.run.trial086.stdout:(19/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.8 MB/s | 253 kB 00:00 2026-02-17T20:58:31.546 INFO:teuthology.orchestra.run.trial092.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 289 kB/s | 25 kB 00:00 2026-02-17T20:58:31.551 INFO:teuthology.orchestra.run.trial086.stdout:(20/99): libgfortran-11.5.0-14.el9.x86_64.rpm 7.3 MB/s | 794 kB 00:00 2026-02-17T20:58:31.559 INFO:teuthology.orchestra.run.trial092.stdout:(27/35): libarrow-9.0.0-15.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2026-02-17T20:58:31.571 INFO:teuthology.orchestra.run.trial092.stdout:(28/35): liboath-2.6.12-1.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2026-02-17T20:58:31.578 INFO:teuthology.orchestra.run.trial086.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 3.9 MB/s | 106 kB 00:00 2026-02-17T20:58:31.584 INFO:teuthology.orchestra.run.trial092.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2026-02-17T20:58:31.598 INFO:teuthology.orchestra.run.trial086.stdout:(22/99): python3-cryptography-36.0.1-5.el9.x86_ 16 MB/s | 1.2 MB 00:00 2026-02-17T20:58:31.599 INFO:teuthology.orchestra.run.trial092.stdout:(30/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 29 MB/s | 838 kB 00:00 2026-02-17T20:58:31.605 INFO:teuthology.orchestra.run.trial086.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 5.0 MB/s | 135 kB 00:00 2026-02-17T20:58:31.609 INFO:teuthology.orchestra.run.trial092.stdout:(31/35): re2-20211101-20.el9.x86_64.rpm 7.4 MB/s | 191 kB 00:00 2026-02-17T20:58:31.627 INFO:teuthology.orchestra.run.trial086.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 5.2 MB/s | 150 kB 00:00 2026-02-17T20:58:31.631 INFO:teuthology.orchestra.run.trial092.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 50 MB/s | 1.6 MB 00:00 2026-02-17T20:58:31.632 INFO:teuthology.orchestra.run.trial086.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 4.6 MB/s | 126 kB 00:00 2026-02-17T20:58:31.655 INFO:teuthology.orchestra.run.trial086.stdout:(26/99): python3-urllib3-1.26.5-7.el9.noarch.rp 7.6 MB/s | 218 kB 00:00 2026-02-17T20:58:31.659 INFO:teuthology.orchestra.run.trial086.stdout:(27/99): unzip-6.0-59.el9.x86_64.rpm 6.5 MB/s | 182 kB 00:00 2026-02-17T20:58:31.683 INFO:teuthology.orchestra.run.trial086.stdout:(28/99): zip-3.0-35.el9.x86_64.rpm 9.3 MB/s | 266 kB 00:00 2026-02-17T20:58:31.746 INFO:teuthology.orchestra.run.trial092.stdout:(33/35): librbd1-19.2.3-679.gd855f53b.el9.x86_6 28 MB/s | 3.2 MB 00:00 2026-02-17T20:58:31.751 INFO:teuthology.orchestra.run.trial086.stdout:(29/99): ceph-mgr-diskprediction-local-19.2.3-6 12 MB/s | 7.4 MB 00:00 2026-02-17T20:58:31.778 INFO:teuthology.orchestra.run.trial092.stdout:(34/35): librados2-19.2.3-679.gd855f53b.el9.x86 20 MB/s | 3.4 MB 00:00 2026-02-17T20:58:31.998 INFO:teuthology.orchestra.run.trial045.stdout:(1/99): ceph-19.2.3-679.gd855f53b.el9.x86_64.rp 129 kB/s | 6.5 kB 00:00 2026-02-17T20:58:32.086 INFO:teuthology.orchestra.run.trial045.stdout:(2/99): ceph-mgr-19.2.3-679.gd855f53b.el9.x86_6 7.7 MB/s | 1.1 MB 00:00 2026-02-17T20:58:32.110 INFO:teuthology.orchestra.run.trial045.stdout:(3/99): ceph-mds-19.2.3-679.gd855f53b.el9.x86_6 15 MB/s | 2.4 MB 00:00 2026-02-17T20:58:32.137 INFO:teuthology.orchestra.run.trial045.stdout:(4/99): ceph-grafana-dashboards-19.2.3-679.gd85 1.1 MB/s | 31 kB 00:00 2026-02-17T20:58:32.168 INFO:teuthology.orchestra.run.trial045.stdout:(5/99): ceph-mgr-cephadm-19.2.3-679.gd855f53b.e 4.8 MB/s | 150 kB 00:00 2026-02-17T20:58:32.215 INFO:teuthology.orchestra.run.trial086.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 53 kB/s | 30 kB 00:00 2026-02-17T20:58:32.224 INFO:teuthology.orchestra.run.trial092.stdout:(35/35): nvme-cli-2.13-1.el9.x86_64.rpm 678 kB/s | 1.1 MB 00:01 2026-02-17T20:58:32.230 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:32.231 INFO:teuthology.orchestra.run.trial092.stdout:Total 19 MB/s | 63 MB 00:03 2026-02-17T20:58:32.302 INFO:teuthology.orchestra.run.trial045.stdout:(6/99): ceph-mon-19.2.3-679.gd855f53b.el9.x86_6 16 MB/s | 4.7 MB 00:00 2026-02-17T20:58:32.305 INFO:teuthology.orchestra.run.trial086.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 27 kB/s | 15 kB 00:00 2026-02-17T20:58:32.324 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:58:32.325 INFO:teuthology.orchestra.run.trial045.stdout:(7/99): ceph-mgr-dashboard-19.2.3-679.gd855f53b 24 MB/s | 3.8 MB 00:00 2026-02-17T20:58:32.343 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:58:32.343 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:58:32.359 INFO:teuthology.orchestra.run.trial045.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-679.gd855f53b 646 kB/s | 22 kB 00:00 2026-02-17T20:58:32.400 INFO:teuthology.orchestra.run.trial045.stdout:(9/99): ceph-mgr-modules-core-19.2.3-679.gd855f 6.1 MB/s | 253 kB 00:00 2026-02-17T20:58:32.438 INFO:teuthology.orchestra.run.trial045.stdout:(10/99): ceph-mgr-rook-19.2.3-679.gd855f53b.el9 1.3 MB/s | 49 kB 00:00 2026-02-17T20:58:32.478 INFO:teuthology.orchestra.run.trial045.stdout:(11/99): ceph-prometheus-alerts-19.2.3-679.gd85 421 kB/s | 17 kB 00:00 2026-02-17T20:58:32.526 INFO:teuthology.orchestra.run.trial045.stdout:(12/99): ceph-volume-19.2.3-679.gd855f53b.el9.n 6.1 MB/s | 299 kB 00:00 2026-02-17T20:58:32.585 INFO:teuthology.orchestra.run.trial045.stdout:(13/99): cephadm-19.2.3-679.gd855f53b.el9.noarc 13 MB/s | 769 kB 00:00 2026-02-17T20:58:32.594 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:58:32.594 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:58:32.606 INFO:teuthology.orchestra.run.trial086.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 629 kB/s | 246 kB 00:00 2026-02-17T20:58:32.646 INFO:teuthology.orchestra.run.trial045.stdout:(14/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 5.6 MB/s | 350 kB 00:00 2026-02-17T20:58:32.659 INFO:teuthology.orchestra.run.trial045.stdout:(15/99): ceph-mgr-diskprediction-local-19.2.3-6 21 MB/s | 7.4 MB 00:00 2026-02-17T20:58:32.672 INFO:teuthology.orchestra.run.trial045.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.5 MB/s | 40 kB 00:00 2026-02-17T20:58:32.696 INFO:teuthology.orchestra.run.trial086.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 482 kB/s | 188 kB 00:00 2026-02-17T20:58:32.704 INFO:teuthology.orchestra.run.trial045.stdout:(17/99): ceph-osd-19.2.3-679.gd855f53b.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T20:58:32.705 INFO:teuthology.orchestra.run.trial045.stdout:(18/99): libconfig-1.7.2-9.el9.x86_64.rpm 1.5 MB/s | 72 kB 00:00 2026-02-17T20:58:32.715 INFO:teuthology.orchestra.run.trial045.stdout:(19/99): libgfortran-11.5.0-14.el9.x86_64.rpm 18 MB/s | 794 kB 00:00 2026-02-17T20:58:32.736 INFO:teuthology.orchestra.run.trial045.stdout:(20/99): libquadmath-11.5.0-14.el9.x86_64.rpm 5.7 MB/s | 184 kB 00:00 2026-02-17T20:58:32.745 INFO:teuthology.orchestra.run.trial045.stdout:(21/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.2 MB/s | 253 kB 00:00 2026-02-17T20:58:32.752 INFO:teuthology.orchestra.run.trial045.stdout:(22/99): python3-cryptography-36.0.1-5.el9.x86_ 34 MB/s | 1.2 MB 00:00 2026-02-17T20:58:32.761 INFO:teuthology.orchestra.run.trial045.stdout:(23/99): python3-ply-3.11-14.el9.noarch.rpm 4.3 MB/s | 106 kB 00:00 2026-02-17T20:58:32.764 INFO:teuthology.orchestra.run.trial086.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 267 kB/s | 42 kB 00:00 2026-02-17T20:58:32.779 INFO:teuthology.orchestra.run.trial045.stdout:(24/99): python3-pycparser-2.20-6.el9.noarch.rp 3.9 MB/s | 135 kB 00:00 2026-02-17T20:58:32.785 INFO:teuthology.orchestra.run.trial045.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 4.4 MB/s | 150 kB 00:00 2026-02-17T20:58:32.800 INFO:teuthology.orchestra.run.trial045.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 3.2 MB/s | 126 kB 00:00 2026-02-17T20:58:32.806 INFO:teuthology.orchestra.run.trial045.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 7.9 MB/s | 218 kB 00:00 2026-02-17T20:58:32.811 INFO:teuthology.orchestra.run.trial045.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 6.9 MB/s | 182 kB 00:00 2026-02-17T20:58:32.826 INFO:teuthology.orchestra.run.trial045.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 10 MB/s | 266 kB 00:00 2026-02-17T20:58:32.890 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:58:32.900 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T20:58:32.902 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T20:58:32.915 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T20:58:33.067 INFO:teuthology.orchestra.run.trial092.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T20:58:33.071 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:33.098 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:33.107 INFO:teuthology.orchestra.run.trial086.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.1 MB/s | 3.0 MB 00:01 2026-02-17T20:58:33.142 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T20:58:33.143 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:33.154 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:33.158 INFO:teuthology.orchestra.run.trial092.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T20:58:33.167 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 9/37 2026-02-17T20:58:33.189 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T20:58:33.189 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:33.202 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:33.231 INFO:teuthology.orchestra.run.trial092.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T20:58:33.233 INFO:teuthology.orchestra.run.trial086.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 2.1 MB/s | 1.0 MB 00:00 2026-02-17T20:58:33.235 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T20:58:33.242 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T20:58:33.244 INFO:teuthology.orchestra.run.trial092.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T20:58:33.247 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T20:58:33.252 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T20:58:33.362 INFO:teuthology.orchestra.run.trial045.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 53 kB/s | 30 kB 00:00 2026-02-17T20:58:33.381 INFO:teuthology.orchestra.run.trial045.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 27 kB/s | 15 kB 00:00 2026-02-17T20:58:33.392 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:58:33.392 INFO:teuthology.orchestra.run.trial086.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2026-02-17T20:58:33.393 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T20:58:33.417 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 19/37 2026-02-17T20:58:33.420 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 20/37 2026-02-17T20:58:33.426 INFO:teuthology.orchestra.run.trial092.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T20:58:33.551 INFO:teuthology.orchestra.run.trial086.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.5 MB/s | 249 kB 00:00 2026-02-17T20:58:33.595 INFO:teuthology.orchestra.run.trial086.stdout:(39/99): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2026-02-17T20:58:33.650 INFO:teuthology.orchestra.run.trial092.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T20:58:33.651 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T20:58:33.666 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 23/37 2026-02-17T20:58:33.671 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 24/37 2026-02-17T20:58:33.676 INFO:teuthology.orchestra.run.trial092.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T20:58:33.678 INFO:teuthology.orchestra.run.trial092.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T20:58:33.679 INFO:teuthology.orchestra.run.trial092.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:58:33.697 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:58:33.711 INFO:teuthology.orchestra.run.trial086.stdout:[MIRROR] python3-libstoragemgmt-1.10.1-1.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-libstoragemgmt-1.10.1-1.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:33.755 INFO:teuthology.orchestra.run.trial086.stdout:[MIRROR] python3-lxml-4.6.5-3.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-lxml-4.6.5-3.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:33.756 INFO:teuthology.orchestra.run.trial045.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 627 kB/s | 246 kB 00:00 2026-02-17T20:58:33.773 INFO:teuthology.orchestra.run.trial045.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 481 kB/s | 188 kB 00:00 2026-02-17T20:58:33.809 INFO:teuthology.orchestra.run.trial092.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T20:58:33.812 INFO:teuthology.orchestra.run.trial092.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:58:33.913 INFO:teuthology.orchestra.run.trial045.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 266 kB/s | 42 kB 00:00 2026-02-17T20:58:33.950 INFO:teuthology.orchestra.run.trial086.stdout:(40/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 4.2 MB/s | 5.3 MB 00:01 2026-02-17T20:58:34.053 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:34.053 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /sys 2026-02-17T20:58:34.053 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /proc 2026-02-17T20:58:34.053 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /mnt 2026-02-17T20:58:34.053 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /var/tmp 2026-02-17T20:58:34.053 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /home 2026-02-17T20:58:34.054 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /root 2026-02-17T20:58:34.054 INFO:teuthology.orchestra.run.trial138.stdout:skipping the directory /tmp 2026-02-17T20:58:34.054 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:34.089 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:58:34.089 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T20:58:34.089 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:34.109 INFO:teuthology.orchestra.run.trial086.stdout:(41/99): python3-libstoragemgmt-1.10.1-1.el9.x8 317 kB/s | 177 kB 00:00 2026-02-17T20:58:34.126 INFO:teuthology.orchestra.run.trial092.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T20:58:34.128 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 31/37 2026-02-17T20:58:34.267 INFO:teuthology.orchestra.run.trial086.stdout:[MIRROR] python3-markupsafe-1.1.1-12.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-markupsafe-1.1.1-12.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:34.395 INFO:teuthology.orchestra.run.trial086.stdout:[MIRROR] python3-lxml-4.6.5-3.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-lxml-4.6.5-3.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:34.469 INFO:teuthology.orchestra.run.trial086.stdout:(42/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 1.4 MB/s | 1.2 MB 00:00 2026-02-17T20:58:34.500 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T20:58:34.525 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T20:58:34.525 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:34.525 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T20:58:34.525 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:58:34.525 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:58:34.525 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:34.527 INFO:teuthology.orchestra.run.trial138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:58:34.540 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:58:34.540 INFO:teuthology.orchestra.run.trial138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:34.592 INFO:teuthology.orchestra.run.trial086.stdout:[MIRROR] python3-mako-1.1.4-6.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-mako-1.1.4-6.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:34.597 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:34.597 INFO:teuthology.orchestra.run.trial138.stdout:Creating group 'qat' with GID 992. 2026-02-17T20:58:34.597 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:34.670 INFO:teuthology.orchestra.run.trial086.stdout:[MIRROR] python3-markupsafe-1.1.1-12.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-markupsafe-1.1.1-12.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:34.680 INFO:teuthology.orchestra.run.trial086.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 61 kB/s | 35 kB 00:00 2026-02-17T20:58:34.692 INFO:teuthology.orchestra.run.trial086.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 38 MB/s | 442 kB 00:00 2026-02-17T20:58:34.702 INFO:teuthology.orchestra.run.trial086.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 7.4 MB/s | 77 kB 00:00 2026-02-17T20:58:34.713 INFO:teuthology.orchestra.run.trial086.stdout:(46/99): python3-protobuf-3.14.0-17.el9.noarch. 25 MB/s | 267 kB 00:00 2026-02-17T20:58:34.724 INFO:teuthology.orchestra.run.trial086.stdout:(47/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 14 MB/s | 159 kB 00:00 2026-02-17T20:58:34.736 INFO:teuthology.orchestra.run.trial086.stdout:(48/99): python3-pyasn1-modules-0.4.8-6.el9.noa 23 MB/s | 279 kB 00:00 2026-02-17T20:58:34.745 INFO:teuthology.orchestra.run.trial086.stdout:(49/99): python3-requests-oauthlib-1.3.0-12.el9 5.3 MB/s | 54 kB 00:00 2026-02-17T20:58:34.837 INFO:teuthology.orchestra.run.trial086.stdout:(50/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 210 MB/s | 19 MB 00:00 2026-02-17T20:58:34.848 INFO:teuthology.orchestra.run.trial086.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 4.1 MB/s | 42 kB 00:00 2026-02-17T20:58:34.860 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 1/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 3/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 4/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 8/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 9/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:34.861 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 12/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 13/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T20:58:34.862 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T20:58:34.863 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 36/37 2026-02-17T20:58:34.864 INFO:teuthology.orchestra.run.trial086.stdout:(52/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 18 MB/s | 189 kB 00:00 2026-02-17T20:58:34.868 INFO:teuthology.orchestra.run.trial086.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 8.9 MB/s | 90 kB 00:00 2026-02-17T20:58:34.869 INFO:teuthology.orchestra.run.trial086.stdout:[MIRROR] python3-numpy-1.23.5-2.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-numpy-1.23.5-2.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:34.901 INFO:teuthology.orchestra.run.trial086.stdout:(54/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 14 MB/s | 6.1 MB 00:00 2026-02-17T20:58:34.917 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:34.918 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:34.918 INFO:teuthology.orchestra.run.trial138.stdout:Upgraded: 2026-02-17T20:58:34.918 INFO:teuthology.orchestra.run.trial138.stdout: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.918 INFO:teuthology.orchestra.run.trial138.stdout: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.918 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:58:34.918 INFO:teuthology.orchestra.run.trial138.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T20:58:34.918 INFO:teuthology.orchestra.run.trial138.stdout: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.918 INFO:teuthology.orchestra.run.trial138.stdout: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.918 INFO:teuthology.orchestra.run.trial138.stdout: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.919 INFO:teuthology.orchestra.run.trial138.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:34.920 INFO:teuthology.orchestra.run.trial138.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T20:58:34.921 INFO:teuthology.orchestra.run.trial138.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T20:58:34.921 INFO:teuthology.orchestra.run.trial138.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T20:58:34.921 INFO:teuthology.orchestra.run.trial138.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T20:58:34.921 INFO:teuthology.orchestra.run.trial138.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T20:58:34.921 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:34.921 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:34.961 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-test 2026-02-17T20:58:35.110 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:35.112 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:35.164 INFO:teuthology.orchestra.run.trial045.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 823 kB/s | 1.0 MB 00:01 2026-02-17T20:58:35.235 INFO:teuthology.orchestra.run.trial086.stdout:(55/99): python3-mako-1.1.4-6.el9.noarch.rpm 134 kB/s | 172 kB 00:01 2026-02-17T20:58:35.269 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:16 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:35.305 INFO:teuthology.orchestra.run.trial086.stdout:(56/99): lua-devel-5.4.4-4.el9.x86_64.rpm 51 kB/s | 22 kB 00:00 2026-02-17T20:58:35.349 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:35.350 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:35.350 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repository Size 2026-02-17T20:58:35.350 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:35.350 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:58:35.350 INFO:teuthology.orchestra.run.trial138.stdout: ceph-test x86_64 2:19.2.3-679.gd855f53b.el9 ceph 50 M 2026-02-17T20:58:35.350 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-17T20:58:35.350 INFO:teuthology.orchestra.run.trial138.stdout: libcephsqlite x86_64 2:19.2.3-679.gd855f53b.el9 ceph 163 k 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout:Install 5 Packages 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 50 M 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 212 M 2026-02-17T20:58:35.351 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:58:35.393 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 32/37 2026-02-17T20:58:35.396 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T20:58:35.436 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 33/37 2026-02-17T20:58:35.436 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T20:58:35.436 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T20:58:35.436 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:35.439 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:35.496 INFO:teuthology.orchestra.run.trial138.stdout:(1/5): libcephsqlite-19.2.3-679.gd855f53b.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T20:58:35.556 INFO:teuthology.orchestra.run.trial086.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2026-02-17T20:58:35.566 INFO:teuthology.orchestra.run.trial138.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.5 MB/s | 233 kB 00:00 2026-02-17T20:58:35.595 INFO:teuthology.orchestra.run.trial138.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.2 MB/s | 64 kB 00:00 2026-02-17T20:58:35.658 INFO:teuthology.orchestra.run.trial138.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 1.8 MB/s | 303 kB 00:00 2026-02-17T20:58:35.686 INFO:teuthology.orchestra.run.trial086.stdout:(58/99): protobuf-compiler-3.14.0-17.el9.x86_64 1.1 MB/s | 862 kB 00:00 2026-02-17T20:58:35.753 INFO:teuthology.orchestra.run.trial086.stdout:(59/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.0 MB/s | 551 kB 00:00 2026-02-17T20:58:35.769 INFO:teuthology.orchestra.run.trial086.stdout:(60/99): luarocks-3.9.2-5.el9.noarch.rpm 711 kB/s | 151 kB 00:00 2026-02-17T20:58:35.815 INFO:teuthology.orchestra.run.trial086.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 473 kB/s | 29 kB 00:00 2026-02-17T20:58:35.845 INFO:teuthology.orchestra.run.trial086.stdout:(62/99): python3-backports-tarfile-1.2.0-1.el9. 788 kB/s | 60 kB 00:00 2026-02-17T20:58:35.878 INFO:teuthology.orchestra.run.trial086.stdout:(63/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 686 kB/s | 43 kB 00:00 2026-02-17T20:58:35.914 INFO:teuthology.orchestra.run.trial086.stdout:(64/99): python3-cachetools-4.2.4-1.el9.noarch. 470 kB/s | 32 kB 00:00 2026-02-17T20:58:35.940 INFO:teuthology.orchestra.run.trial086.stdout:(65/99): python3-certifi-2023.05.07-4.el9.noarc 230 kB/s | 14 kB 00:00 2026-02-17T20:58:36.019 INFO:teuthology.orchestra.run.trial086.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 1.6 MB/s | 173 kB 00:00 2026-02-17T20:58:36.027 INFO:teuthology.orchestra.run.trial086.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 4.0 MB/s | 358 kB 00:00 2026-02-17T20:58:36.133 INFO:teuthology.orchestra.run.trial086.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 2.2 MB/s | 254 kB 00:00 2026-02-17T20:58:36.220 INFO:teuthology.orchestra.run.trial086.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 1.6 MB/s | 144 kB 00:00 2026-02-17T20:58:36.233 INFO:teuthology.orchestra.run.trial086.stdout:(70/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 9.9 MB/s | 2.0 MB 00:00 2026-02-17T20:58:36.294 INFO:teuthology.orchestra.run.trial086.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 917 kB/s | 56 kB 00:00 2026-02-17T20:58:36.302 INFO:teuthology.orchestra.run.trial086.stdout:(72/99): python3-influxdb-5.3.1-1.el9.noarch.rp 1.7 MB/s | 139 kB 00:00 2026-02-17T20:58:36.343 INFO:teuthology.orchestra.run.trial086.stdout:(73/99): python3-asyncssh-2.13.2-5.el9.noarch.r 834 kB/s | 548 kB 00:00 2026-02-17T20:58:36.355 INFO:teuthology.orchestra.run.trial086.stdout:(74/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 175 kB/s | 11 kB 00:00 2026-02-17T20:58:36.365 INFO:teuthology.orchestra.run.trial086.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 280 kB/s | 18 kB 00:00 2026-02-17T20:58:36.417 INFO:teuthology.orchestra.run.trial086.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 322 kB/s | 20 kB 00:00 2026-02-17T20:58:36.423 INFO:teuthology.orchestra.run.trial138.stdout:(5/5): ceph-test-19.2.3-679.gd855f53b.el9.x86_6 49 MB/s | 50 MB 00:01 2026-02-17T20:58:36.424 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:36.424 INFO:teuthology.orchestra.run.trial138.stdout:Total 47 MB/s | 50 MB 00:01 2026-02-17T20:58:36.426 INFO:teuthology.orchestra.run.trial086.stdout:(77/99): python3-jaraco-collections-3.0.0-8.el9 276 kB/s | 23 kB 00:00 2026-02-17T20:58:36.428 INFO:teuthology.orchestra.run.trial086.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 309 kB/s | 19 kB 00:00 2026-02-17T20:58:36.447 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:58:36.455 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:58:36.456 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:58:36.478 INFO:teuthology.orchestra.run.trial086.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 431 kB/s | 26 kB 00:00 2026-02-17T20:58:36.495 INFO:teuthology.orchestra.run.trial086.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 686 kB/s | 46 kB 00:00 2026-02-17T20:58:36.540 INFO:teuthology.orchestra.run.trial086.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-17T20:58:36.569 INFO:teuthology.orchestra.run.trial086.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2026-02-17T20:58:36.601 INFO:teuthology.orchestra.run.trial086.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 944 kB/s | 58 kB 00:00 2026-02-17T20:58:36.631 INFO:teuthology.orchestra.run.trial086.stdout:(84/99): python3-kubernetes-26.1.0-3.el9.noarch 5.0 MB/s | 1.0 MB 00:00 2026-02-17T20:58:36.643 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:58:36.643 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:58:36.662 INFO:teuthology.orchestra.run.trial086.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 269 kB/s | 16 kB 00:00 2026-02-17T20:58:36.672 INFO:teuthology.orchestra.run.trial086.stdout:(86/99): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2026-02-17T20:58:36.714 INFO:teuthology.orchestra.run.trial086.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2026-02-17T20:58:36.723 INFO:teuthology.orchestra.run.trial086.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 503 kB/s | 31 kB 00:00 2026-02-17T20:58:36.757 INFO:teuthology.orchestra.run.trial086.stdout:(89/99): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2026-02-17T20:58:36.796 INFO:teuthology.orchestra.run.trial086.stdout:(90/99): python3-rsa-4.9-2.el9.noarch.rpm 722 kB/s | 59 kB 00:00 2026-02-17T20:58:36.797 INFO:teuthology.orchestra.run.trial086.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.7 MB/s | 125 kB 00:00 2026-02-17T20:58:36.822 INFO:teuthology.orchestra.run.trial086.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 550 kB/s | 36 kB 00:00 2026-02-17T20:58:36.850 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial138.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T20:58:36.861 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T20:58:36.862 INFO:teuthology.orchestra.run.trial086.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 3.5 MB/s | 230 kB 00:00 2026-02-17T20:58:36.869 INFO:teuthology.orchestra.run.trial138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T20:58:36.870 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T20:58:36.879 INFO:teuthology.orchestra.run.trial086.stdout:(94/99): python3-typing-extensions-4.15.0-1.el9 1.0 MB/s | 86 kB 00:00 2026-02-17T20:58:36.893 INFO:teuthology.orchestra.run.trial086.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2026-02-17T20:58:36.930 INFO:teuthology.orchestra.run.trial086.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.1 MB/s | 427 kB 00:00 2026-02-17T20:58:36.960 INFO:teuthology.orchestra.run.trial086.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 597 kB/s | 48 kB 00:00 2026-02-17T20:58:36.970 INFO:teuthology.orchestra.run.trial086.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 290 kB/s | 22 kB 00:00 2026-02-17T20:58:36.992 INFO:teuthology.orchestra.run.trial086.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 322 kB/s | 20 kB 00:00 2026-02-17T20:58:36.998 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:36.998 INFO:teuthology.orchestra.run.trial086.stdout:Total 13 MB/s | 95 MB 00:07 2026-02-17T20:58:37.419 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:37.457 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:37.457 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:37.840 INFO:teuthology.orchestra.run.trial045.stdout:(36/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 609 kB/s | 3.0 MB 00:05 2026-02-17T20:58:37.872 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:37.872 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:38.235 INFO:teuthology.orchestra.run.trial045.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 619 kB/s | 244 kB 00:00 2026-02-17T20:58:38.311 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:38.313 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T20:58:38.344 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T20:58:38.350 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T20:58:38.371 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T20:58:38.377 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T20:58:38.411 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T20:58:38.420 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T20:58:38.425 INFO:teuthology.orchestra.run.trial086.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T20:58:38.428 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T20:58:38.432 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T20:58:38.456 INFO:teuthology.orchestra.run.trial086.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T20:58:38.469 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T20:58:38.472 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T20:58:38.478 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T20:58:38.480 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T20:58:38.491 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T20:58:38.498 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T20:58:38.522 INFO:teuthology.orchestra.run.trial086.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T20:58:38.526 INFO:teuthology.orchestra.run.trial086.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T20:58:38.533 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T20:58:38.558 INFO:teuthology.orchestra.run.trial086.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T20:58:38.610 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T20:58:38.623 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T20:58:38.625 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T20:58:38.629 INFO:teuthology.orchestra.run.trial045.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 630 kB/s | 249 kB 00:00 2026-02-17T20:58:38.630 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T20:58:38.635 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T20:58:38.640 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T20:58:38.643 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T20:58:38.658 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T20:58:38.679 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T20:58:38.684 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T20:58:38.689 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T20:58:38.701 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T20:58:38.710 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T20:58:38.716 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T20:58:38.736 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T20:58:38.745 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T20:58:38.801 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T20:58:38.813 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T20:58:38.829 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T20:58:38.833 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T20:58:38.841 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T20:58:38.882 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T20:58:38.946 INFO:teuthology.orchestra.run.trial045.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 559 kB/s | 177 kB 00:00 2026-02-17T20:58:39.212 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T20:58:39.222 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T20:58:39.226 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T20:58:39.232 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T20:58:39.233 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T20:58:39.254 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T20:58:39.261 INFO:teuthology.orchestra.run.trial086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T20:58:39.271 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T20:58:39.305 INFO:teuthology.orchestra.run.trial086.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T20:58:39.312 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T20:58:39.315 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T20:58:39.321 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T20:58:39.325 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T20:58:39.332 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T20:58:39.335 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T20:58:39.364 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T20:58:39.374 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T20:58:39.409 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T20:58:39.484 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T20:58:39.484 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 1/5 2026-02-17T20:58:39.484 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2/5 2026-02-17T20:58:39.484 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T20:58:39.484 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:39.537 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:39.571 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph 2026-02-17T20:58:39.636 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T20:58:39.660 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T20:58:39.664 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T20:58:39.722 INFO:teuthology.orchestra.run.trial086.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T20:58:39.724 INFO:teuthology.orchestra.run.trial086.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T20:58:39.745 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T20:58:39.875 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:20 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:39.926 INFO:teuthology.orchestra.run.trial045.stdout:(40/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 879 kB/s | 5.3 MB 00:06 2026-02-17T20:58:39.959 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:39.962 INFO:teuthology.orchestra.run.trial138.stdout:====================================================================================== 2026-02-17T20:58:39.962 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repository Size 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout:====================================================================================== 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout: ceph x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.5 k 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout: ceph-grafana-dashboards noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 31 k 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mds x86_64 2:19.2.3-679.gd855f53b.el9 ceph 2.4 M 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-modules-core noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 253 k 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mon x86_64 2:19.2.3-679.gd855f53b.el9 ceph 4.7 M 2026-02-17T20:58:39.963 INFO:teuthology.orchestra.run.trial138.stdout: ceph-osd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 17 M 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: ceph-prometheus-alerts noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 17 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 769 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T20:58:39.964 INFO:teuthology.orchestra.run.trial138.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T20:58:39.965 INFO:teuthology.orchestra.run.trial138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T20:58:39.966 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T20:58:39.967 INFO:teuthology.orchestra.run.trial138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T20:58:39.968 INFO:teuthology.orchestra.run.trial138.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T20:58:39.969 INFO:teuthology.orchestra.run.trial138.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout:Installing weak dependencies: 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 150 k 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-dashboard noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 3.8 M 2026-02-17T20:58:39.970 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 7.4 M 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 22 k 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-rook noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 49 k 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout: ceph-volume noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 299 k 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout:====================================================================================== 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout:Install 99 Packages 2026-02-17T20:58:39.971 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:39.972 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 95 M 2026-02-17T20:58:39.972 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 520 M 2026-02-17T20:58:39.972 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:58:40.004 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:40.004 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /sys 2026-02-17T20:58:40.004 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /proc 2026-02-17T20:58:40.004 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /mnt 2026-02-17T20:58:40.004 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /var/tmp 2026-02-17T20:58:40.005 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /home 2026-02-17T20:58:40.005 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /root 2026-02-17T20:58:40.005 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /tmp 2026-02-17T20:58:40.005 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:40.075 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T20:58:40.150 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T20:58:40.241 INFO:teuthology.orchestra.run.trial045.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 548 kB/s | 172 kB 00:00 2026-02-17T20:58:40.400 INFO:teuthology.orchestra.run.trial045.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 218 kB/s | 35 kB 00:00 2026-02-17T20:58:40.447 INFO:teuthology.orchestra.run.trial045.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 834 kB/s | 1.2 MB 00:01 2026-02-17T20:58:40.452 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T20:58:40.475 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 35/37 2026-02-17T20:58:40.475 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:40.476 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T20:58:40.476 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:58:40.476 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:58:40.476 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:40.478 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:58:40.490 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:58:40.490 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:40.546 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:40.546 INFO:teuthology.orchestra.run.trial092.stdout:Creating group 'qat' with GID 992. 2026-02-17T20:58:40.546 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:40.608 INFO:teuthology.orchestra.run.trial138.stdout:(1/99): ceph-19.2.3-679.gd855f53b.el9.x86_64.rp 129 kB/s | 6.5 kB 00:00 2026-02-17T20:58:40.685 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-numpy-f2py-1.23.5-2.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-numpy-f2py-1.23.5-2.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:40.698 INFO:teuthology.orchestra.run.trial138.stdout:(2/99): ceph-mgr-19.2.3-679.gd855f53b.el9.x86_6 7.7 MB/s | 1.1 MB 00:00 2026-02-17T20:58:40.728 INFO:teuthology.orchestra.run.trial138.stdout:(3/99): ceph-mds-19.2.3-679.gd855f53b.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-17T20:58:40.759 INFO:teuthology.orchestra.run.trial138.stdout:(4/99): ceph-grafana-dashboards-19.2.3-679.gd85 995 kB/s | 31 kB 00:00 2026-02-17T20:58:40.795 INFO:teuthology.orchestra.run.trial138.stdout:(5/99): ceph-mgr-cephadm-19.2.3-679.gd855f53b.e 4.1 MB/s | 150 kB 00:00 2026-02-17T20:58:40.827 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 1/37 2026-02-17T20:58:40.827 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 3/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 4/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 5/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 6/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 7/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x 8/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86 9/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 10/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 11/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 12/37 2026-02-17T20:58:40.828 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 13/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados2-2:19.2.3-679.gd855f53b.el9.x86_64 34/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 36/37 2026-02-17T20:58:40.831 INFO:teuthology.orchestra.run.trial138.stdout:(6/99): ceph-mon-19.2.3-679.gd855f53b.el9.x86_6 22 MB/s | 4.7 MB 00:00 2026-02-17T20:58:40.831 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T20:58:40.849 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T20:58:40.858 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T20:58:40.865 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T20:58:40.879 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T20:58:40.884 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:58:40.884 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:40.884 INFO:teuthology.orchestra.run.trial092.stdout:Upgraded: 2026-02-17T20:58:40.884 INFO:teuthology.orchestra.run.trial092.stdout: librados2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.884 INFO:teuthology.orchestra.run.trial092.stdout: librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.884 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: ceph-radosgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: ceph-selinux-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T20:58:40.885 INFO:teuthology.orchestra.run.trial092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: libradosstriper1-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: librgw2-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-argparse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.886 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-common-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:40.887 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:58:40.895 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T20:58:40.926 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-test 2026-02-17T20:58:40.966 INFO:teuthology.orchestra.run.trial138.stdout:(7/99): ceph-mgr-dashboard-19.2.3-679.gd855f53b 22 MB/s | 3.8 MB 00:00 2026-02-17T20:58:40.971 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T20:58:40.980 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T20:58:41.003 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T20:58:41.006 INFO:teuthology.orchestra.run.trial138.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-679.gd855f53b 550 kB/s | 22 kB 00:00 2026-02-17T20:58:41.033 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T20:58:41.053 INFO:teuthology.orchestra.run.trial138.stdout:(9/99): ceph-mgr-modules-core-19.2.3-679.gd855f 5.3 MB/s | 253 kB 00:00 2026-02-17T20:58:41.085 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T20:58:41.091 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T20:58:41.096 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T20:58:41.098 INFO:teuthology.orchestra.run.trial138.stdout:(10/99): ceph-mgr-rook-19.2.3-679.gd855f53b.el9 1.1 MB/s | 49 kB 00:00 2026-02-17T20:58:41.098 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T20:58:41.117 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:58:41.117 INFO:teuthology.orchestra.run.trial086.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T20:58:41.117 INFO:teuthology.orchestra.run.trial086.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T20:58:41.117 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:41.125 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:58:41.133 INFO:teuthology.orchestra.run.trial138.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-6 24 MB/s | 7.4 MB 00:00 2026-02-17T20:58:41.134 INFO:teuthology.orchestra.run.trial138.stdout:(12/99): ceph-prometheus-alerts-19.2.3-679.gd85 455 kB/s | 17 kB 00:00 2026-02-17T20:58:41.152 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:58:41.152 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T20:58:41.152 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:41.160 INFO:teuthology.orchestra.run.trial138.stdout:(13/99): ceph-volume-19.2.3-679.gd855f53b.el9.n 11 MB/s | 299 kB 00:00 2026-02-17T20:58:41.176 INFO:teuthology.orchestra.run.trial138.stdout:(14/99): cephadm-19.2.3-679.gd855f53b.el9.noarc 18 MB/s | 769 kB 00:00 2026-02-17T20:58:41.189 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T20:58:41.202 INFO:teuthology.orchestra.run.trial138.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.5 MB/s | 40 kB 00:00 2026-02-17T20:58:41.220 INFO:teuthology.orchestra.run.trial138.stdout:(16/99): libconfig-1.7.2-9.el9.x86_64.rpm 4.0 MB/s | 72 kB 00:00 2026-02-17T20:58:41.221 INFO:teuthology.orchestra.run.trial138.stdout:(17/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 5.7 MB/s | 350 kB 00:00 2026-02-17T20:58:41.235 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:14 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:58:41.240 INFO:teuthology.orchestra.run.trial138.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 9.2 MB/s | 184 kB 00:00 2026-02-17T20:58:41.242 INFO:teuthology.orchestra.run.trial138.stdout:(19/99): libgfortran-11.5.0-14.el9.x86_64.rpm 34 MB/s | 794 kB 00:00 2026-02-17T20:58:41.254 INFO:teuthology.orchestra.run.trial086.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T20:58:41.254 INFO:teuthology.orchestra.run.trial138.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 18 MB/s | 253 kB 00:00 2026-02-17T20:58:41.256 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T20:58:41.266 INFO:teuthology.orchestra.run.trial138.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 8.5 MB/s | 106 kB 00:00 2026-02-17T20:58:41.270 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T20:58:41.270 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:41.270 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T20:58:41.270 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:41.276 INFO:teuthology.orchestra.run.trial138.stdout:(22/99): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-17T20:58:41.277 INFO:teuthology.orchestra.run.trial138.stdout:(23/99): python3-pycparser-2.20-6.el9.noarch.rp 12 MB/s | 135 kB 00:00 2026-02-17T20:58:41.287 INFO:teuthology.orchestra.run.trial138.stdout:(24/99): python3-pyparsing-2.4.7-9.el9.noarch.r 14 MB/s | 150 kB 00:00 2026-02-17T20:58:41.288 INFO:teuthology.orchestra.run.trial138.stdout:(25/99): python3-requests-2.25.1-10.el9.noarch. 12 MB/s | 126 kB 00:00 2026-02-17T20:58:41.312 INFO:teuthology.orchestra.run.trial138.stdout:(26/99): ceph-osd-19.2.3-679.gd855f53b.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T20:58:41.313 INFO:teuthology.orchestra.run.trial138.stdout:(27/99): unzip-6.0-59.el9.x86_64.rpm 7.2 MB/s | 182 kB 00:00 2026-02-17T20:58:41.313 INFO:teuthology.orchestra.run.trial138.stdout:(28/99): python3-urllib3-1.26.5-7.el9.noarch.rp 8.2 MB/s | 218 kB 00:00 2026-02-17T20:58:41.316 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repository Size 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout: ceph-test x86_64 2:19.2.3-679.gd855f53b.el9 ceph 50 M 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout: libcephsqlite x86_64 2:19.2.3-679.gd855f53b.el9 ceph 163 k 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T20:58:41.317 INFO:teuthology.orchestra.run.trial092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T20:58:41.318 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:41.318 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:58:41.318 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:58:41.318 INFO:teuthology.orchestra.run.trial092.stdout:Install 5 Packages 2026-02-17T20:58:41.318 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:41.319 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 50 M 2026-02-17T20:58:41.319 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 212 M 2026-02-17T20:58:41.319 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:58:41.346 INFO:teuthology.orchestra.run.trial138.stdout:(29/99): flexiblas-3.0.4-9.el9.x86_64.rpm 881 kB/s | 30 kB 00:00 2026-02-17T20:58:41.355 INFO:teuthology.orchestra.run.trial138.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 1.7 MB/s | 15 kB 00:00 2026-02-17T20:58:41.375 INFO:teuthology.orchestra.run.trial138.stdout:(31/99): zip-3.0-35.el9.x86_64.rpm 4.1 MB/s | 266 kB 00:00 2026-02-17T20:58:41.386 INFO:teuthology.orchestra.run.trial138.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 7.9 MB/s | 246 kB 00:00 2026-02-17T20:58:41.398 INFO:teuthology.orchestra.run.trial138.stdout:(33/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 35 MB/s | 3.0 MB 00:00 2026-02-17T20:58:41.398 INFO:teuthology.orchestra.run.trial138.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 3.4 MB/s | 42 kB 00:00 2026-02-17T20:58:41.411 INFO:teuthology.orchestra.run.trial138.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 77 MB/s | 1.0 MB 00:00 2026-02-17T20:58:41.419 INFO:teuthology.orchestra.run.trial138.stdout:(36/99): lua-5.4.4-4.el9.x86_64.rpm 4.2 MB/s | 188 kB 00:00 2026-02-17T20:58:41.439 INFO:teuthology.orchestra.run.trial138.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 12 MB/s | 244 kB 00:00 2026-02-17T20:58:41.446 INFO:teuthology.orchestra.run.trial138.stdout:(38/99): python3-babel-2.9.1-2.el9.noarch.rpm 170 MB/s | 6.0 MB 00:00 2026-02-17T20:58:41.452 INFO:teuthology.orchestra.run.trial138.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 18 MB/s | 249 kB 00:00 2026-02-17T20:58:41.457 INFO:teuthology.orchestra.run.trial138.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 16 MB/s | 177 kB 00:00 2026-02-17T20:58:41.468 INFO:teuthology.orchestra.run.trial138.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 15 MB/s | 172 kB 00:00 2026-02-17T20:58:41.478 INFO:teuthology.orchestra.run.trial138.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 3.8 MB/s | 35 kB 00:00 2026-02-17T20:58:41.494 INFO:teuthology.orchestra.run.trial138.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 30 MB/s | 1.2 MB 00:00 2026-02-17T20:58:41.509 INFO:teuthology.orchestra.run.trial092.stdout:(1/5): libcephsqlite-19.2.3-679.gd855f53b.el9.x 1.6 MB/s | 163 kB 00:00 2026-02-17T20:58:41.510 INFO:teuthology.orchestra.run.trial138.stdout:(44/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 190 MB/s | 6.1 MB 00:00 2026-02-17T20:58:41.512 INFO:teuthology.orchestra.run.trial138.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 24 MB/s | 442 kB 00:00 2026-02-17T20:58:41.520 INFO:teuthology.orchestra.run.trial138.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 7.6 MB/s | 77 kB 00:00 2026-02-17T20:58:41.526 INFO:teuthology.orchestra.run.trial138.stdout:(47/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 41 MB/s | 5.3 MB 00:00 2026-02-17T20:58:41.527 INFO:teuthology.orchestra.run.trial138.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 17 MB/s | 267 kB 00:00 2026-02-17T20:58:41.531 INFO:teuthology.orchestra.run.trial138.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 14 MB/s | 159 kB 00:00 2026-02-17T20:58:41.531 INFO:teuthology.orchestra.run.trial092.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.9 MB/s | 233 kB 00:00 2026-02-17T20:58:41.536 INFO:teuthology.orchestra.run.trial138.stdout:(50/99): python3-pyasn1-modules-0.4.8-6.el9.noa 27 MB/s | 279 kB 00:00 2026-02-17T20:58:41.536 INFO:teuthology.orchestra.run.trial138.stdout:(51/99): python3-requests-oauthlib-1.3.0-12.el9 5.6 MB/s | 54 kB 00:00 2026-02-17T20:58:41.545 INFO:teuthology.orchestra.run.trial138.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 4.4 MB/s | 42 kB 00:00 2026-02-17T20:58:41.546 INFO:teuthology.orchestra.run.trial138.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 19 MB/s | 189 kB 00:00 2026-02-17T20:58:41.551 INFO:teuthology.orchestra.run.trial092.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 3.1 MB/s | 64 kB 00:00 2026-02-17T20:58:41.555 INFO:teuthology.orchestra.run.trial138.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 9.6 MB/s | 90 kB 00:00 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial092.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 2.3 MB/s | 303 kB 00:00 2026-02-17T20:58:41.934 INFO:teuthology.orchestra.run.trial138.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 48 MB/s | 19 MB 00:00 2026-02-17T20:58:41.967 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T20:58:41.970 INFO:teuthology.orchestra.run.trial045.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 290 kB/s | 442 kB 00:01 2026-02-17T20:58:41.983 INFO:teuthology.orchestra.run.trial138.stdout:(56/99): lua-devel-5.4.4-4.el9.x86_64.rpm 51 kB/s | 22 kB 00:00 2026-02-17T20:58:41.993 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T20:58:41.993 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:41.993 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T20:58:41.993 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:58:41.993 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:58:41.994 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:42.037 INFO:teuthology.orchestra.run.trial045.stdout:(45/99): python3-babel-2.9.1-2.el9.noarch.rpm 888 kB/s | 6.0 MB 00:06 2026-02-17T20:58:42.049 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T20:58:42.051 INFO:teuthology.orchestra.run.trial086.stdout: Installing : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T20:58:42.055 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 88/99 2026-02-17T20:58:42.075 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 89/99 2026-02-17T20:58:42.077 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T20:58:42.128 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-packaging-20.9-5.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-packaging-20.9-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:42.199 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-protobuf-3.14.0-17.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-protobuf-3.14.0-17.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:42.253 INFO:teuthology.orchestra.run.trial138.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:42.306 INFO:teuthology.orchestra.run.trial138.stdout:[MIRROR] grpc-data-1.46.7-10.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/g/grpc-data-1.46.7-10.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:42.417 INFO:teuthology.orchestra.run.trial138.stdout:[MIRROR] abseil-cpp-20211102.0-4.el9.x86_64.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/a/abseil-cpp-20211102.0-4.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:42.443 INFO:teuthology.orchestra.run.trial092.stdout:(5/5): ceph-test-19.2.3-679.gd855f53b.el9.x86_6 48 MB/s | 50 MB 00:01 2026-02-17T20:58:42.444 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:42.444 INFO:teuthology.orchestra.run.trial092.stdout:Total 45 MB/s | 50 MB 00:01 2026-02-17T20:58:42.464 INFO:teuthology.orchestra.run.trial138.stdout:[MIRROR] grpc-data-1.46.7-10.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/g/grpc-data-1.46.7-10.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:42.471 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:58:42.481 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:58:42.481 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:58:42.536 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-packaging-20.9-5.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-packaging-20.9-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:42.571 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T20:58:42.573 INFO:teuthology.orchestra.run.trial138.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 33 kB/s | 19 kB 00:00 2026-02-17T20:58:42.575 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T20:58:42.669 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:58:42.669 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:58:42.694 INFO:teuthology.orchestra.run.trial138.stdout:(58/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 726 kB/s | 551 kB 00:00 2026-02-17T20:58:42.877 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:58:42.883 INFO:teuthology.orchestra.run.trial092.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T20:58:42.888 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T20:58:42.894 INFO:teuthology.orchestra.run.trial138.stdout:[MIRROR] luarocks-3.9.2-5.el9.noarch.rpm: Status code: 503 for https://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/l/luarocks-3.9.2-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:42.896 INFO:teuthology.orchestra.run.trial092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T20:58:42.900 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-packaging-20.9-5.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-packaging-20.9-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:42.947 INFO:teuthology.orchestra.run.trial138.stdout:(59/99): protobuf-compiler-3.14.0-17.el9.x86_64 619 kB/s | 862 kB 00:01 2026-02-17T20:58:42.993 INFO:teuthology.orchestra.run.trial045.stdout:(46/99): python3-protobuf-3.14.0-17.el9.noarch. 280 kB/s | 267 kB 00:00 2026-02-17T20:58:43.034 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T20:58:43.035 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T20:58:43.049 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T20:58:43.050 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T20:58:43.051 INFO:teuthology.orchestra.run.trial138.stdout:[MIRROR] luarocks-3.9.2-5.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/l/luarocks-3.9.2-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:43.074 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-packaging-20.9-5.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-packaging-20.9-5.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:43.099 INFO:teuthology.orchestra.run.trial045.stdout:(47/99): python3-packaging-20.9-5.el9.noarch.rp 68 kB/s | 77 kB 00:01 2026-02-17T20:58:43.102 INFO:teuthology.orchestra.run.trial138.stdout:(60/99): luarocks-3.9.2-5.el9.noarch.rpm 286 kB/s | 151 kB 00:00 2026-02-17T20:58:43.106 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T20:58:43.112 INFO:teuthology.orchestra.run.trial138.stdout:[MIRROR] python3-autocommand-2.2.2-8.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-autocommand-2.2.2-8.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:43.155 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 94/99 2026-02-17T20:58:43.157 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T20:58:43.166 INFO:teuthology.orchestra.run.trial138.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 134 kB/s | 29 kB 00:00 2026-02-17T20:58:43.179 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T20:58:43.179 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:43.179 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T20:58:43.179 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:58:43.180 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:58:43.180 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:43.192 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T20:58:43.208 INFO:teuthology.orchestra.run.trial138.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2026-02-17T20:58:43.247 INFO:teuthology.orchestra.run.trial138.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 834 kB/s | 32 kB 00:00 2026-02-17T20:58:43.260 INFO:teuthology.orchestra.run.trial138.stdout:[MIRROR] python3-backports-tarfile-1.2.0-1.el9.noarch.rpm: Status code: 503 for http://ftp-osl.osuosl.org/pub/fedora-epel/9/Everything/x86_64/Packages/p/python3-backports-tarfile-1.2.0-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:43.287 INFO:teuthology.orchestra.run.trial138.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 350 kB/s | 14 kB 00:00 2026-02-17T20:58:43.342 INFO:teuthology.orchestra.run.trial138.stdout:(65/99): python3-cheroot-10.0.1-4.el9.noarch.rp 3.1 MB/s | 173 kB 00:00 2026-02-17T20:58:43.358 INFO:teuthology.orchestra.run.trial138.stdout:(66/99): python3-backports-tarfile-1.2.0-1.el9. 235 kB/s | 60 kB 00:00 2026-02-17T20:58:43.390 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-pyasn1-0.4.8-6.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-0.4.8-6.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:43.402 INFO:teuthology.orchestra.run.trial138.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 5.8 MB/s | 358 kB 00:00 2026-02-17T20:58:43.408 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T20:58:43.410 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T20:58:43.431 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T20:58:43.431 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:43.431 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T20:58:43.431 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:58:43.432 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:58:43.432 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:43.484 INFO:teuthology.orchestra.run.trial138.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 2.0 MB/s | 254 kB 00:00 2026-02-17T20:58:43.523 INFO:teuthology.orchestra.run.trial138.stdout:(69/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 17 MB/s | 2.0 MB 00:00 2026-02-17T20:58:43.533 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T20:58:43.545 INFO:teuthology.orchestra.run.trial138.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 2.3 MB/s | 144 kB 00:00 2026-02-17T20:58:43.554 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T20:58:43.554 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:43.554 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T20:58:43.555 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:58:43.555 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:58:43.555 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:43.574 INFO:teuthology.orchestra.run.trial138.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 2.7 MB/s | 139 kB 00:00 2026-02-17T20:58:43.574 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T20:58:43.595 INFO:teuthology.orchestra.run.trial138.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 1.1 MB/s | 56 kB 00:00 2026-02-17T20:58:43.610 INFO:teuthology.orchestra.run.trial138.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 296 kB/s | 11 kB 00:00 2026-02-17T20:58:43.632 INFO:teuthology.orchestra.run.trial138.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 475 kB/s | 18 kB 00:00 2026-02-17T20:58:43.646 INFO:teuthology.orchestra.run.trial138.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 635 kB/s | 23 kB 00:00 2026-02-17T20:58:43.670 INFO:teuthology.orchestra.run.trial138.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 522 kB/s | 20 kB 00:00 2026-02-17T20:58:43.683 INFO:teuthology.orchestra.run.trial138.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 536 kB/s | 19 kB 00:00 2026-02-17T20:58:43.716 INFO:teuthology.orchestra.run.trial138.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 576 kB/s | 26 kB 00:00 2026-02-17T20:58:43.738 INFO:teuthology.orchestra.run.trial138.stdout:(79/99): python3-kubernetes-26.1.0-3.el9.noarch 19 MB/s | 1.0 MB 00:00 2026-02-17T20:58:43.743 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-pyasn1-0.4.8-6.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-0.4.8-6.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:43.762 INFO:teuthology.orchestra.run.trial138.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 1.0 MB/s | 46 kB 00:00 2026-02-17T20:58:43.793 INFO:teuthology.orchestra.run.trial138.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 1.4 MB/s | 79 kB 00:00 2026-02-17T20:58:43.814 INFO:teuthology.orchestra.run.trial138.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.6 MB/s | 86 kB 00:00 2026-02-17T20:58:43.830 INFO:teuthology.orchestra.run.trial138.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 1.5 MB/s | 58 kB 00:00 2026-02-17T20:58:43.875 INFO:teuthology.orchestra.run.trial138.stdout:(84/99): python3-portend-3.1.0-2.el9.noarch.rpm 370 kB/s | 16 kB 00:00 2026-02-17T20:58:43.890 INFO:teuthology.orchestra.run.trial138.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2026-02-17T20:58:43.907 INFO:teuthology.orchestra.run.trial045.stdout:(48/99): python3-pyasn1-modules-0.4.8-6.el9.noa 345 kB/s | 279 kB 00:00 2026-02-17T20:58:43.949 INFO:teuthology.orchestra.run.trial138.stdout:(86/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2026-02-17T20:58:43.972 INFO:teuthology.orchestra.run.trial138.stdout:(87/99): python3-repoze-lru-0.7-16.el9.noarch.r 376 kB/s | 31 kB 00:00 2026-02-17T20:58:44.005 INFO:teuthology.orchestra.run.trial138.stdout:(88/99): python3-routes-2.5.1-5.el9.noarch.rpm 3.3 MB/s | 188 kB 00:00 2026-02-17T20:58:44.023 INFO:teuthology.orchestra.run.trial138.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2026-02-17T20:58:44.049 INFO:teuthology.orchestra.run.trial138.stdout:(90/99): python3-saml-1.16.0-1.el9.noarch.rpm 2.8 MB/s | 125 kB 00:00 2026-02-17T20:58:44.064 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-requests-oauthlib-1.3.0-12.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-requests-oauthlib-1.3.0-12.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:44.068 INFO:teuthology.orchestra.run.trial138.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 788 kB/s | 36 kB 00:00 2026-02-17T20:58:44.096 INFO:teuthology.orchestra.run.trial138.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 1.8 MB/s | 86 kB 00:00 2026-02-17T20:58:44.134 INFO:teuthology.orchestra.run.trial138.stdout:(93/99): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2026-02-17T20:58:44.143 INFO:teuthology.orchestra.run.trial138.stdout:(94/99): python3-websocket-client-1.2.3-2.el9.n 1.9 MB/s | 90 kB 00:00 2026-02-17T20:58:44.188 INFO:teuthology.orchestra.run.trial138.stdout:(95/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.1 MB/s | 48 kB 00:00 2026-02-17T20:58:44.201 INFO:teuthology.orchestra.run.trial138.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.2 MB/s | 427 kB 00:00 2026-02-17T20:58:44.225 INFO:teuthology.orchestra.run.trial138.stdout:(97/99): python3-xmltodict-0.12.0-15.el9.noarch 613 kB/s | 22 kB 00:00 2026-02-17T20:58:44.238 INFO:teuthology.orchestra.run.trial138.stdout:(98/99): python3-zc-lockfile-2.0-10.el9.noarch. 543 kB/s | 20 kB 00:00 2026-02-17T20:58:44.261 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 1/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 3/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 4/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 5/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 6/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 7/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 8/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 9/99 2026-02-17T20:58:44.262 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 10/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 11/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 12/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 13/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 14/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 15/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T20:58:44.263 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T20:58:44.264 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T20:58:44.265 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T20:58:44.266 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T20:58:44.267 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T20:58:44.268 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T20:58:44.269 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T20:58:44.323 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T20:58:44.323 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:44.323 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.324 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T20:58:44.325 INFO:teuthology.orchestra.run.trial086.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T20:58:44.326 INFO:teuthology.orchestra.run.trial086.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T20:58:44.327 INFO:teuthology.orchestra.run.trial086.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T20:58:44.328 INFO:teuthology.orchestra.run.trial086.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T20:58:44.328 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T20:58:44.328 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T20:58:44.328 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T20:58:44.328 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T20:58:44.328 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T20:58:44.329 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T20:58:44.329 INFO:teuthology.orchestra.run.trial086.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T20:58:44.329 INFO:teuthology.orchestra.run.trial086.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T20:58:44.329 INFO:teuthology.orchestra.run.trial086.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:58:44.329 INFO:teuthology.orchestra.run.trial086.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T20:58:44.329 INFO:teuthology.orchestra.run.trial086.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T20:58:44.330 INFO:teuthology.orchestra.run.trial086.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T20:58:44.330 INFO:teuthology.orchestra.run.trial086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T20:58:44.330 INFO:teuthology.orchestra.run.trial086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T20:58:44.330 INFO:teuthology.orchestra.run.trial086.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T20:58:44.330 INFO:teuthology.orchestra.run.trial086.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T20:58:44.330 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T20:58:44.330 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T20:58:44.331 INFO:teuthology.orchestra.run.trial086.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T20:58:44.331 INFO:teuthology.orchestra.run.trial086.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T20:58:44.331 INFO:teuthology.orchestra.run.trial086.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T20:58:44.331 INFO:teuthology.orchestra.run.trial086.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T20:58:44.331 INFO:teuthology.orchestra.run.trial086.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T20:58:44.331 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T20:58:44.331 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T20:58:44.331 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T20:58:44.331 INFO:teuthology.orchestra.run.trial086.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T20:58:44.332 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T20:58:44.332 INFO:teuthology.orchestra.run.trial086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T20:58:44.332 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T20:58:44.332 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T20:58:44.332 INFO:teuthology.orchestra.run.trial086.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T20:58:44.332 INFO:teuthology.orchestra.run.trial086.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T20:58:44.332 INFO:teuthology.orchestra.run.trial086.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T20:58:44.332 INFO:teuthology.orchestra.run.trial086.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T20:58:44.333 INFO:teuthology.orchestra.run.trial086.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T20:58:44.333 INFO:teuthology.orchestra.run.trial086.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T20:58:44.333 INFO:teuthology.orchestra.run.trial086.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T20:58:44.333 INFO:teuthology.orchestra.run.trial086.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T20:58:44.333 INFO:teuthology.orchestra.run.trial086.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T20:58:44.333 INFO:teuthology.orchestra.run.trial086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T20:58:44.334 INFO:teuthology.orchestra.run.trial086.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T20:58:44.334 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T20:58:44.334 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T20:58:44.334 INFO:teuthology.orchestra.run.trial086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T20:58:44.334 INFO:teuthology.orchestra.run.trial086.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T20:58:44.334 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T20:58:44.334 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T20:58:44.334 INFO:teuthology.orchestra.run.trial086.stdout: zip-3.0-35.el9.x86_64 2026-02-17T20:58:44.335 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:44.335 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:44.378 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-base 2026-02-17T20:58:44.405 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-requests-oauthlib-1.3.0-12.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-requests-oauthlib-1.3.0-12.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:44.460 INFO:teuthology.orchestra.run.trial045.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 108 kB/s | 159 kB 00:01 2026-02-17T20:58:44.564 INFO:teuthology.orchestra.run.trial045.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 82 kB/s | 54 kB 00:00 2026-02-17T20:58:44.658 INFO:teuthology.orchestra.run.trial138.stdout:(99/99): python3-asyncssh-2.13.2-5.el9.noarch.r 279 kB/s | 548 kB 00:01 2026-02-17T20:58:44.662 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:44.662 INFO:teuthology.orchestra.run.trial138.stdout:Total 20 MB/s | 95 MB 00:04 2026-02-17T20:58:44.685 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:44.724 INFO:teuthology.orchestra.run.trial045.stdout:[MIRROR] python3-toml-0.10.2-6.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-toml-0.10.2-6.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-17T20:58:44.750 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:44.767 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:44.768 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:44.768 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:44.789 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install cephadm 2026-02-17T20:58:45.096 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:58:45.098 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:45.133 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:58:45.133 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:58:45.142 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 4/5 2026-02-17T20:58:45.160 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T20:58:45.162 INFO:teuthology.orchestra.run.trial086.stdout:Package cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:45.180 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:45.181 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:45.181 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:45.202 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T20:58:45.203 INFO:teuthology.orchestra.run.trial045.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 65 kB/s | 42 kB 00:00 2026-02-17T20:58:45.384 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 5/5 2026-02-17T20:58:45.384 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 1/5 2026-02-17T20:58:45.385 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2/5 2026-02-17T20:58:45.385 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T20:58:45.385 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T20:58:45.436 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T20:58:45.437 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:45.437 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:58:45.437 INFO:teuthology.orchestra.run.trial092.stdout: ceph-test-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:45.437 INFO:teuthology.orchestra.run.trial092.stdout: libcephsqlite-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:45.437 INFO:teuthology.orchestra.run.trial092.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T20:58:45.437 INFO:teuthology.orchestra.run.trial092.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T20:58:45.437 INFO:teuthology.orchestra.run.trial092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T20:58:45.437 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:45.437 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:58:45.470 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph 2026-02-17T20:58:45.511 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:45.548 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:58:45.548 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:58:45.562 INFO:teuthology.orchestra.run.trial045.stdout:(52/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 527 kB/s | 189 kB 00:00 2026-02-17T20:58:45.593 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:45.593 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:45.594 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T20:58:45.594 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:45.594 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:45.594 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-679.gd855f53b.el9 ceph 145 k 2026-02-17T20:58:45.594 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:45.594 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:45.594 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:45.594 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:58:45.594 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:45.595 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 145 k 2026-02-17T20:58:45.595 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 431 k 2026-02-17T20:58:45.595 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:45.701 INFO:teuthology.orchestra.run.trial086.stdout:ceph-immutable-object-cache-19.2.3-679.gd855f53 1.3 MB/s | 145 kB 00:00 2026-02-17T20:58:45.703 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:45.703 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.3 MB/s | 145 kB 00:00 2026-02-17T20:58:45.703 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:45.706 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:45.706 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:45.737 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:45.737 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:45.780 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:18 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:58:45.791 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:45.793 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:58:45.799 INFO:teuthology.orchestra.run.trial045.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 381 kB/s | 90 kB 00:00 2026-02-17T20:58:45.815 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:58:45.815 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:45.815 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T20:58:45.815 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:45.864 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:58:45.867 INFO:teuthology.orchestra.run.trial092.stdout:====================================================================================== 2026-02-17T20:58:45.867 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repository Size 2026-02-17T20:58:45.867 INFO:teuthology.orchestra.run.trial092.stdout:====================================================================================== 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout: ceph x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.5 k 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout: ceph-grafana-dashboards noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 31 k 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mds x86_64 2:19.2.3-679.gd855f53b.el9 ceph 2.4 M 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-modules-core noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 253 k 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mon x86_64 2:19.2.3-679.gd855f53b.el9 ceph 4.7 M 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 17 M 2026-02-17T20:58:45.868 INFO:teuthology.orchestra.run.trial092.stdout: ceph-prometheus-alerts noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 17 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 769 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T20:58:45.869 INFO:teuthology.orchestra.run.trial092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T20:58:45.870 INFO:teuthology.orchestra.run.trial092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T20:58:45.871 INFO:teuthology.orchestra.run.trial092.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T20:58:45.871 INFO:teuthology.orchestra.run.trial092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T20:58:45.871 INFO:teuthology.orchestra.run.trial092.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T20:58:45.871 INFO:teuthology.orchestra.run.trial092.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T20:58:45.871 INFO:teuthology.orchestra.run.trial092.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T20:58:45.871 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T20:58:45.871 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T20:58:45.871 INFO:teuthology.orchestra.run.trial092.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T20:58:45.871 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T20:58:45.872 INFO:teuthology.orchestra.run.trial092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T20:58:45.873 INFO:teuthology.orchestra.run.trial092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T20:58:45.874 INFO:teuthology.orchestra.run.trial092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T20:58:45.875 INFO:teuthology.orchestra.run.trial092.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout:Installing weak dependencies: 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-cephadm noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 150 k 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-dashboard noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 3.8 M 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 7.4 M 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 22 k 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-rook noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 49 k 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout: ceph-volume noarch 2:19.2.3-679.gd855f53b.el9 ceph-noarch 299 k 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:58:45.876 INFO:teuthology.orchestra.run.trial092.stdout:====================================================================================== 2026-02-17T20:58:45.877 INFO:teuthology.orchestra.run.trial092.stdout:Install 99 Packages 2026-02-17T20:58:45.877 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:58:45.877 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 95 M 2026-02-17T20:58:45.878 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 520 M 2026-02-17T20:58:45.878 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:58:45.886 INFO:teuthology.orchestra.run.trial045.stdout:(54/99): lua-devel-5.4.4-4.el9.x86_64.rpm 257 kB/s | 22 kB 00:00 2026-02-17T20:58:45.989 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:58:45.991 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T20:58:46.022 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T20:58:46.027 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T20:58:46.032 INFO:teuthology.orchestra.run.trial045.stdout:(55/99): protobuf-compiler-3.14.0-17.el9.x86_64 5.8 MB/s | 862 kB 00:00 2026-02-17T20:58:46.048 INFO:teuthology.orchestra.run.trial138.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T20:58:46.054 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T20:58:46.087 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T20:58:46.096 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T20:58:46.101 INFO:teuthology.orchestra.run.trial138.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T20:58:46.104 INFO:teuthology.orchestra.run.trial138.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T20:58:46.108 INFO:teuthology.orchestra.run.trial138.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T20:58:46.110 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:58:46.110 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:46.110 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:46.110 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:46.110 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:46.110 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:46.131 INFO:teuthology.orchestra.run.trial138.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T20:58:46.136 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr 2026-02-17T20:58:46.144 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T20:58:46.147 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T20:58:46.153 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T20:58:46.155 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T20:58:46.167 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T20:58:46.173 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T20:58:46.197 INFO:teuthology.orchestra.run.trial138.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T20:58:46.201 INFO:teuthology.orchestra.run.trial138.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T20:58:46.208 INFO:teuthology.orchestra.run.trial138.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T20:58:46.232 INFO:teuthology.orchestra.run.trial138.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T20:58:46.271 INFO:teuthology.orchestra.run.trial045.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.3 MB/s | 551 kB 00:00 2026-02-17T20:58:46.283 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T20:58:46.296 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T20:58:46.299 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T20:58:46.302 INFO:teuthology.orchestra.run.trial045.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 635 kB/s | 19 kB 00:00 2026-02-17T20:58:46.304 INFO:teuthology.orchestra.run.trial138.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T20:58:46.309 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T20:58:46.314 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T20:58:46.317 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T20:58:46.331 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T20:58:46.337 INFO:teuthology.orchestra.run.trial045.stdout:(58/99): luarocks-3.9.2-5.el9.noarch.rpm 4.2 MB/s | 151 kB 00:00 2026-02-17T20:58:46.353 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T20:58:46.357 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T20:58:46.362 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T20:58:46.374 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T20:58:46.383 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T20:58:46.387 INFO:teuthology.orchestra.run.trial045.stdout:(59/99): python3-asyncssh-2.13.2-5.el9.noarch.r 11 MB/s | 548 kB 00:00 2026-02-17T20:58:46.389 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T20:58:46.408 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T20:58:46.417 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T20:58:46.420 INFO:teuthology.orchestra.run.trial045.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 919 kB/s | 29 kB 00:00 2026-02-17T20:58:46.441 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:46.451 INFO:teuthology.orchestra.run.trial045.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 1.9 MB/s | 60 kB 00:00 2026-02-17T20:58:46.472 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T20:58:46.483 INFO:teuthology.orchestra.run.trial045.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.4 MB/s | 43 kB 00:00 2026-02-17T20:58:46.484 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T20:58:46.499 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T20:58:46.504 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T20:58:46.505 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:46.512 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T20:58:46.514 INFO:teuthology.orchestra.run.trial045.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 1.0 MB/s | 32 kB 00:00 2026-02-17T20:58:46.523 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:46.523 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:46.523 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:46.544 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T20:58:46.545 INFO:teuthology.orchestra.run.trial045.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 459 kB/s | 14 kB 00:00 2026-02-17T20:58:46.552 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T20:58:46.580 INFO:teuthology.orchestra.run.trial045.stdout:(65/99): python3-cheroot-10.0.1-4.el9.noarch.rp 4.8 MB/s | 173 kB 00:00 2026-02-17T20:58:46.622 INFO:teuthology.orchestra.run.trial045.stdout:(66/99): python3-cherrypy-18.6.1-2.el9.noarch.r 8.5 MB/s | 358 kB 00:00 2026-02-17T20:58:46.660 INFO:teuthology.orchestra.run.trial045.stdout:(67/99): python3-google-auth-2.45.0-1.el9.noarc 6.6 MB/s | 254 kB 00:00 2026-02-17T20:58:46.665 INFO:teuthology.orchestra.run.trial092.stdout:(1/99): ceph-19.2.3-679.gd855f53b.el9.x86_64.rp 113 kB/s | 6.5 kB 00:00 2026-02-17T20:58:46.741 INFO:teuthology.orchestra.run.trial092.stdout:(2/99): ceph-mgr-19.2.3-679.gd855f53b.el9.x86_6 8.1 MB/s | 1.1 MB 00:00 2026-02-17T20:58:46.753 INFO:teuthology.orchestra.run.trial045.stdout:(68/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 22 MB/s | 2.0 MB 00:00 2026-02-17T20:58:46.761 INFO:teuthology.orchestra.run.trial092.stdout:(3/99): ceph-mds-19.2.3-679.gd855f53b.el9.x86_6 16 MB/s | 2.4 MB 00:00 2026-02-17T20:58:46.786 INFO:teuthology.orchestra.run.trial045.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 4.3 MB/s | 144 kB 00:00 2026-02-17T20:58:46.788 INFO:teuthology.orchestra.run.trial092.stdout:(4/99): ceph-grafana-dashboards-19.2.3-679.gd85 1.1 MB/s | 31 kB 00:00 2026-02-17T20:58:46.819 INFO:teuthology.orchestra.run.trial045.stdout:(70/99): python3-influxdb-5.3.1-1.el9.noarch.rp 4.1 MB/s | 139 kB 00:00 2026-02-17T20:58:46.822 INFO:teuthology.orchestra.run.trial092.stdout:(5/99): ceph-mgr-cephadm-19.2.3-679.gd855f53b.e 4.3 MB/s | 150 kB 00:00 2026-02-17T20:58:46.850 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:46.850 INFO:teuthology.orchestra.run.trial045.stdout:(71/99): python3-isodate-0.6.1-3.el9.noarch.rpm 1.7 MB/s | 56 kB 00:00 2026-02-17T20:58:46.875 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T20:58:46.881 INFO:teuthology.orchestra.run.trial045.stdout:(72/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 348 kB/s | 11 kB 00:00 2026-02-17T20:58:46.885 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T20:58:46.889 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T20:58:46.895 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T20:58:46.896 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T20:58:46.912 INFO:teuthology.orchestra.run.trial045.stdout:(73/99): python3-jaraco-classes-3.2.1-5.el9.noa 574 kB/s | 18 kB 00:00 2026-02-17T20:58:46.914 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:46.923 INFO:teuthology.orchestra.run.trial138.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T20:58:46.932 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:46.932 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:46.933 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:46.943 INFO:teuthology.orchestra.run.trial045.stdout:(74/99): python3-jaraco-collections-3.0.0-8.el9 751 kB/s | 23 kB 00:00 2026-02-17T20:58:46.954 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T20:58:46.967 INFO:teuthology.orchestra.run.trial138.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T20:58:46.974 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T20:58:46.974 INFO:teuthology.orchestra.run.trial045.stdout:(75/99): python3-jaraco-context-6.0.1-3.el9.noa 636 kB/s | 20 kB 00:00 2026-02-17T20:58:46.977 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T20:58:46.983 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T20:58:46.987 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T20:58:46.993 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T20:58:46.997 INFO:teuthology.orchestra.run.trial092.stdout:(6/99): ceph-mgr-dashboard-19.2.3-679.gd855f53b 22 MB/s | 3.8 MB 00:00 2026-02-17T20:58:46.997 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T20:58:47.005 INFO:teuthology.orchestra.run.trial045.stdout:(76/99): python3-jaraco-functools-3.5.0-2.el9.n 627 kB/s | 19 kB 00:00 2026-02-17T20:58:47.025 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T20:58:47.034 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T20:58:47.036 INFO:teuthology.orchestra.run.trial092.stdout:(7/99): ceph-mon-19.2.3-679.gd855f53b.el9.x86_6 13 MB/s | 4.7 MB 00:00 2026-02-17T20:58:47.036 INFO:teuthology.orchestra.run.trial045.stdout:(77/99): python3-jaraco-text-4.0.0-2.el9.noarch 851 kB/s | 26 kB 00:00 2026-02-17T20:58:47.069 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T20:58:47.078 INFO:teuthology.orchestra.run.trial045.stdout:(78/99): python3-kubernetes-26.1.0-3.el9.noarch 25 MB/s | 1.0 MB 00:00 2026-02-17T20:58:47.089 INFO:teuthology.orchestra.run.trial092.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-679.gd855f53b 416 kB/s | 22 kB 00:00 2026-02-17T20:58:47.110 INFO:teuthology.orchestra.run.trial045.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2026-02-17T20:58:47.141 INFO:teuthology.orchestra.run.trial045.stdout:(80/99): python3-more-itertools-8.12.0-2.el9.no 2.4 MB/s | 79 kB 00:00 2026-02-17T20:58:47.152 INFO:teuthology.orchestra.run.trial092.stdout:(9/99): ceph-mgr-modules-core-19.2.3-679.gd855f 3.9 MB/s | 253 kB 00:00 2026-02-17T20:58:47.173 INFO:teuthology.orchestra.run.trial045.stdout:(81/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.7 MB/s | 86 kB 00:00 2026-02-17T20:58:47.204 INFO:teuthology.orchestra.run.trial045.stdout:(82/99): python3-natsort-7.1.1-5.el9.noarch.rpm 1.8 MB/s | 58 kB 00:00 2026-02-17T20:58:47.214 INFO:teuthology.orchestra.run.trial092.stdout:(10/99): ceph-mgr-rook-19.2.3-679.gd855f53b.el9 799 kB/s | 49 kB 00:00 2026-02-17T20:58:47.238 INFO:teuthology.orchestra.run.trial045.stdout:(83/99): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2026-02-17T20:58:47.266 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:47.269 INFO:teuthology.orchestra.run.trial045.stdout:(84/99): python3-portend-3.1.0-2.el9.noarch.rpm 528 kB/s | 16 kB 00:00 2026-02-17T20:58:47.279 INFO:teuthology.orchestra.run.trial092.stdout:(11/99): ceph-prometheus-alerts-19.2.3-679.gd85 259 kB/s | 17 kB 00:00 2026-02-17T20:58:47.293 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T20:58:47.296 INFO:teuthology.orchestra.run.trial092.stdout:(12/99): ceph-mgr-diskprediction-local-19.2.3-6 25 MB/s | 7.4 MB 00:00 2026-02-17T20:58:47.301 INFO:teuthology.orchestra.run.trial045.stdout:(85/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.7 MB/s | 90 kB 00:00 2026-02-17T20:58:47.317 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T20:58:47.320 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T20:58:47.325 INFO:teuthology.orchestra.run.trial092.stdout:(13/99): ceph-volume-19.2.3-679.gd855f53b.el9.n 6.2 MB/s | 299 kB 00:00 2026-02-17T20:58:47.331 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:47.332 INFO:teuthology.orchestra.run.trial045.stdout:(86/99): python3-repoze-lru-0.7-16.el9.noarch.r 980 kB/s | 31 kB 00:00 2026-02-17T20:58:47.347 INFO:teuthology.orchestra.run.trial092.stdout:(14/99): ceph-osd-19.2.3-679.gd855f53b.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T20:58:47.348 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:47.349 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:47.349 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:47.350 INFO:teuthology.orchestra.run.trial092.stdout:(15/99): cephadm-19.2.3-679.gd855f53b.el9.noarc 14 MB/s | 769 kB 00:00 2026-02-17T20:58:47.371 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-rook 2026-02-17T20:58:47.374 INFO:teuthology.orchestra.run.trial045.stdout:(87/99): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2026-02-17T20:58:47.379 INFO:teuthology.orchestra.run.trial138.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T20:58:47.381 INFO:teuthology.orchestra.run.trial138.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T20:58:47.402 INFO:teuthology.orchestra.run.trial138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T20:58:47.406 INFO:teuthology.orchestra.run.trial045.stdout:(88/99): python3-rsa-4.9-2.el9.noarch.rpm 1.8 MB/s | 59 kB 00:00 2026-02-17T20:58:47.438 INFO:teuthology.orchestra.run.trial045.stdout:(89/99): python3-saml-1.16.0-1.el9.noarch.rpm 3.8 MB/s | 125 kB 00:00 2026-02-17T20:58:47.469 INFO:teuthology.orchestra.run.trial045.stdout:(90/99): python3-tempora-5.0.0-2.el9.noarch.rpm 1.1 MB/s | 36 kB 00:00 2026-02-17T20:58:47.501 INFO:teuthology.orchestra.run.trial045.stdout:(91/99): python3-typing-extensions-4.15.0-1.el9 2.7 MB/s | 86 kB 00:00 2026-02-17T20:58:47.533 INFO:teuthology.orchestra.run.trial045.stdout:(92/99): python3-webob-1.8.8-2.el9.noarch.rpm 7.0 MB/s | 230 kB 00:00 2026-02-17T20:58:47.566 INFO:teuthology.orchestra.run.trial045.stdout:(93/99): python3-websocket-client-1.2.3-2.el9.n 2.7 MB/s | 90 kB 00:00 2026-02-17T20:58:47.604 INFO:teuthology.orchestra.run.trial045.stdout:(94/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 871 kB/s | 6.1 MB 00:07 2026-02-17T20:58:47.605 INFO:teuthology.orchestra.run.trial045.stdout:(95/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 10 MB/s | 427 kB 00:00 2026-02-17T20:58:47.637 INFO:teuthology.orchestra.run.trial045.stdout:(96/99): python3-xmltodict-0.12.0-15.el9.noarch 712 kB/s | 22 kB 00:00 2026-02-17T20:58:47.669 INFO:teuthology.orchestra.run.trial045.stdout:(97/99): python3-zc-lockfile-2.0-10.el9.noarch. 621 kB/s | 20 kB 00:00 2026-02-17T20:58:47.679 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:47.727 INFO:teuthology.orchestra.run.trial138.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T20:58:47.727 INFO:teuthology.orchestra.run.trial045.stdout:(98/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 393 kB/s | 48 kB 00:00 2026-02-17T20:58:47.743 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:47.760 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:47.761 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:47.761 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:47.783 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T20:58:47.784 INFO:teuthology.orchestra.run.trial092.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 93 kB/s | 40 kB 00:00 2026-02-17T20:58:47.799 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T20:58:47.872 INFO:teuthology.orchestra.run.trial092.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 138 kB/s | 72 kB 00:00 2026-02-17T20:58:48.092 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:48.133 INFO:teuthology.orchestra.run.trial092.stdout:(18/99): libquadmath-11.5.0-14.el9.x86_64.rpm 712 kB/s | 184 kB 00:00 2026-02-17T20:58:48.156 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:48.173 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:48.174 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:48.174 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:48.193 INFO:teuthology.orchestra.run.trial092.stdout:(19/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 404 kB/s | 350 kB 00:00 2026-02-17T20:58:48.195 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-fuse 2026-02-17T20:58:48.471 INFO:teuthology.orchestra.run.trial092.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 746 kB/s | 253 kB 00:00 2026-02-17T20:58:48.471 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T20:58:48.488 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T20:58:48.498 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T20:58:48.500 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:48.505 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T20:58:48.518 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T20:58:48.534 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.2 M 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:58:48.582 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:48.583 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 1.2 M 2026-02-17T20:58:48.583 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 3.6 M 2026-02-17T20:58:48.583 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:48.609 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T20:58:48.618 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T20:58:48.642 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T20:58:48.659 INFO:teuthology.orchestra.run.trial092.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 568 kB/s | 106 kB 00:00 2026-02-17T20:58:48.671 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T20:58:48.702 INFO:teuthology.orchestra.run.trial086.stdout:ceph-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2026-02-17T20:58:48.703 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:48.703 INFO:teuthology.orchestra.run.trial086.stdout:Total 9.6 MB/s | 1.2 MB 00:00 2026-02-17T20:58:48.703 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:48.707 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:48.707 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:48.721 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T20:58:48.727 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T20:58:48.731 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T20:58:48.732 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T20:58:48.743 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:48.743 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:48.750 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:58:48.750 INFO:teuthology.orchestra.run.trial138.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T20:58:48.750 INFO:teuthology.orchestra.run.trial138.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T20:58:48.750 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:48.757 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:58:48.782 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:58:48.782 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T20:58:48.782 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:48.816 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T20:58:48.842 INFO:teuthology.orchestra.run.trial092.stdout:(22/99): python3-pycparser-2.20-6.el9.noarch.rp 740 kB/s | 135 kB 00:00 2026-02-17T20:58:48.844 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:48.861 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:48.880 INFO:teuthology.orchestra.run.trial138.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T20:58:48.882 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T20:58:48.895 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T20:58:48.895 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:48.895 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T20:58:48.895 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:49.098 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:49.102 INFO:teuthology.orchestra.run.trial092.stdout:(23/99): python3-pyparsing-2.4.7-9.el9.noarch.r 578 kB/s | 150 kB 00:00 2026-02-17T20:58:49.155 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:49.155 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:49.156 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:49.156 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:49.156 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:49.156 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:49.184 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-volume 2026-02-17T20:58:49.286 INFO:teuthology.orchestra.run.trial092.stdout:(24/99): python3-requests-2.25.1-10.el9.noarch. 688 kB/s | 126 kB 00:00 2026-02-17T20:58:49.495 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:49.559 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:49.577 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:49.577 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:49.578 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:49.598 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados-devel 2026-02-17T20:58:49.606 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T20:58:49.615 INFO:teuthology.orchestra.run.trial092.stdout:(25/99): libgfortran-11.5.0-14.el9.x86_64.rpm 434 kB/s | 794 kB 00:01 2026-02-17T20:58:49.630 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T20:58:49.631 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:49.631 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T20:58:49.631 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:58:49.631 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:58:49.631 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:49.633 INFO:teuthology.orchestra.run.trial092.stdout:(26/99): python3-urllib3-1.26.5-7.el9.noarch.rp 628 kB/s | 218 kB 00:00 2026-02-17T20:58:49.689 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T20:58:49.691 INFO:teuthology.orchestra.run.trial138.stdout: Installing : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T20:58:49.695 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 88/99 2026-02-17T20:58:49.705 INFO:teuthology.orchestra.run.trial092.stdout:(27/99): python3-cryptography-36.0.1-5.el9.x86_ 844 kB/s | 1.2 MB 00:01 2026-02-17T20:58:49.715 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 89/99 2026-02-17T20:58:49.716 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T20:58:49.717 INFO:teuthology.orchestra.run.trial092.stdout:[MIRROR] unzip-6.0-59.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/unzip-6.0-59.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:49.741 INFO:teuthology.orchestra.run.trial092.stdout:[MIRROR] zip-3.0-35.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/zip-3.0-35.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-17T20:58:49.748 INFO:teuthology.orchestra.run.trial092.stdout:(28/99): flexiblas-3.0.4-9.el9.x86_64.rpm 690 kB/s | 30 kB 00:00 2026-02-17T20:58:49.879 INFO:teuthology.orchestra.run.trial092.stdout:(29/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 23 MB/s | 3.0 MB 00:00 2026-02-17T20:58:49.901 INFO:teuthology.orchestra.run.trial092.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 689 kB/s | 15 kB 00:00 2026-02-17T20:58:49.909 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:49.924 INFO:teuthology.orchestra.run.trial092.stdout:(31/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 10 MB/s | 246 kB 00:00 2026-02-17T20:58:49.948 INFO:teuthology.orchestra.run.trial092.stdout:(32/99): lua-5.4.4-4.el9.x86_64.rpm 7.9 MB/s | 188 kB 00:00 2026-02-17T20:58:49.970 INFO:teuthology.orchestra.run.trial092.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-17T20:58:49.991 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:49.992 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:49.992 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T20:58:49.992 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:49.992 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:49.993 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 126 k 2026-02-17T20:58:49.993 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:49.993 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:49.993 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:49.993 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:58:49.993 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:49.993 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 126 k 2026-02-17T20:58:49.993 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 456 k 2026-02-17T20:58:49.993 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:50.022 INFO:teuthology.orchestra.run.trial092.stdout:(34/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 101 MB/s | 5.3 MB 00:00 2026-02-17T20:58:50.036 INFO:teuthology.orchestra.run.trial092.stdout:(35/99): unzip-6.0-59.el9.x86_64.rpm 432 kB/s | 182 kB 00:00 2026-02-17T20:58:50.048 INFO:teuthology.orchestra.run.trial092.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 39 MB/s | 1.0 MB 00:00 2026-02-17T20:58:50.073 INFO:teuthology.orchestra.run.trial092.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 9.7 MB/s | 244 kB 00:00 2026-02-17T20:58:50.077 INFO:teuthology.orchestra.run.trial086.stdout:librados-devel-19.2.3-679.gd855f53b.el9.x86_64. 1.5 MB/s | 126 kB 00:00 2026-02-17T20:58:50.078 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:50.078 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-17T20:58:50.078 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:50.080 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:50.081 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:50.097 INFO:teuthology.orchestra.run.trial092.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 10 MB/s | 249 kB 00:00 2026-02-17T20:58:50.112 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:50.112 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:50.121 INFO:teuthology.orchestra.run.trial092.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 7.2 MB/s | 177 kB 00:00 2026-02-17T20:58:50.149 INFO:teuthology.orchestra.run.trial092.stdout:(40/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 45 MB/s | 1.2 MB 00:00 2026-02-17T20:58:50.166 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:50.173 INFO:teuthology.orchestra.run.trial092.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 7.0 MB/s | 172 kB 00:00 2026-02-17T20:58:50.182 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:50.195 INFO:teuthology.orchestra.run.trial092.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-17T20:58:50.209 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T20:58:50.212 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T20:58:50.232 INFO:teuthology.orchestra.run.trial092.stdout:(43/99): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2026-02-17T20:58:50.251 INFO:teuthology.orchestra.run.trial092.stdout:(44/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 110 MB/s | 6.1 MB 00:00 2026-02-17T20:58:50.257 INFO:teuthology.orchestra.run.trial092.stdout:(45/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 17 MB/s | 442 kB 00:00 2026-02-17T20:58:50.260 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:50.274 INFO:teuthology.orchestra.run.trial092.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-17T20:58:50.282 INFO:teuthology.orchestra.run.trial092.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-17T20:58:50.298 INFO:teuthology.orchestra.run.trial092.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.7 MB/s | 159 kB 00:00 2026-02-17T20:58:50.306 INFO:teuthology.orchestra.run.trial092.stdout:(49/99): python3-pyasn1-modules-0.4.8-6.el9.noa 11 MB/s | 279 kB 00:00 2026-02-17T20:58:50.317 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:50.317 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:50.317 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:50.317 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:50.317 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:50.317 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:50.320 INFO:teuthology.orchestra.run.trial092.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 2.3 MB/s | 54 kB 00:00 2026-02-17T20:58:50.343 INFO:teuthology.orchestra.run.trial092.stdout:(51/99): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-17T20:58:50.345 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs2 2026-02-17T20:58:50.365 INFO:teuthology.orchestra.run.trial092.stdout:(52/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.3 MB/s | 189 kB 00:00 2026-02-17T20:58:50.388 INFO:teuthology.orchestra.run.trial092.stdout:(53/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.9 MB/s | 90 kB 00:00 2026-02-17T20:58:50.461 INFO:teuthology.orchestra.run.trial092.stdout:(54/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 124 MB/s | 19 MB 00:00 2026-02-17T20:58:50.462 INFO:teuthology.orchestra.run.trial092.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 301 kB/s | 22 kB 00:00 2026-02-17T20:58:50.502 INFO:teuthology.orchestra.run.trial092.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 21 MB/s | 862 kB 00:00 2026-02-17T20:58:50.532 INFO:teuthology.orchestra.run.trial092.stdout:(57/99): zip-3.0-35.el9.x86_64.rpm 296 kB/s | 266 kB 00:00 2026-02-17T20:58:50.602 INFO:teuthology.orchestra.run.trial092.stdout:(58/99): grpc-data-1.46.7-10.el9.noarch.rpm 195 kB/s | 19 kB 00:00 2026-02-17T20:58:50.662 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:50.669 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T20:58:50.671 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T20:58:50.684 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T20:58:50.684 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T20:58:50.698 INFO:teuthology.orchestra.run.trial092.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 912 kB/s | 151 kB 00:00 2026-02-17T20:58:50.726 INFO:teuthology.orchestra.run.trial086.stdout:Package libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:50.740 INFO:teuthology.orchestra.run.trial092.stdout:(60/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.9 MB/s | 551 kB 00:00 2026-02-17T20:58:50.740 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T20:58:50.743 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:50.744 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:50.744 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:50.765 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs-devel 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 94/99 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T20:58:50.811 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T20:58:50.812 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:50.812 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T20:58:50.812 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:58:50.812 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:58:50.812 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:50.823 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T20:58:51.046 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T20:58:51.047 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T20:58:51.068 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T20:58:51.068 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:51.068 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T20:58:51.068 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:58:51.068 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:58:51.068 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:51.077 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:51.159 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:51.160 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:51.160 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T20:58:51.160 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:51.160 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:51.160 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 34 k 2026-02-17T20:58:51.160 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:51.160 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:51.160 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:51.161 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:58:51.161 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:51.161 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 34 k 2026-02-17T20:58:51.161 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 153 k 2026-02-17T20:58:51.161 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:51.172 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T20:58:51.193 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T20:58:51.193 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:51.193 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T20:58:51.193 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:58:51.193 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:58:51.193 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:51.211 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T20:58:51.222 INFO:teuthology.orchestra.run.trial086.stdout:libcephfs-devel-19.2.3-679.gd855f53b.el9.x86_64 537 kB/s | 34 kB 00:00 2026-02-17T20:58:51.223 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:51.223 INFO:teuthology.orchestra.run.trial086.stdout:Total 530 kB/s | 34 kB 00:00 2026-02-17T20:58:51.223 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:51.225 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:51.225 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:51.227 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:51.227 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:51.247 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:51.263 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:51.317 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:51.375 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:51.375 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:51.375 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:51.375 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:51.375 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:51.376 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:51.401 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados2 2026-02-17T20:58:51.705 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:51.770 INFO:teuthology.orchestra.run.trial086.stdout:Package librados2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:51.788 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:51.788 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:51.788 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:51.811 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librbd1 2026-02-17T20:58:51.882 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 1/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 3/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 4/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 5/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 6/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 7/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 8/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 9/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 10/99 2026-02-17T20:58:51.883 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 11/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 12/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 13/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 14/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 15/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T20:58:51.884 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T20:58:51.885 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T20:58:51.886 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T20:58:51.887 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T20:58:51.888 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T20:58:51.889 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T20:58:51.890 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T20:58:51.947 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T20:58:51.947 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:51.947 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.948 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T20:58:51.949 INFO:teuthology.orchestra.run.trial138.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T20:58:51.950 INFO:teuthology.orchestra.run.trial138.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T20:58:51.951 INFO:teuthology.orchestra.run.trial138.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T20:58:51.952 INFO:teuthology.orchestra.run.trial138.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T20:58:51.953 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T20:58:51.954 INFO:teuthology.orchestra.run.trial138.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T20:58:51.955 INFO:teuthology.orchestra.run.trial138.stdout: zip-3.0-35.el9.x86_64 2026-02-17T20:58:51.956 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:51.956 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:52.003 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-base 2026-02-17T20:58:52.120 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:52.185 INFO:teuthology.orchestra.run.trial086.stdout:Package librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:52.202 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:52.203 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:52.203 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:52.224 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rados 2026-02-17T20:58:52.319 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:52.369 INFO:teuthology.orchestra.run.trial045.stdout:(99/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 2.4 MB/s | 19 MB 00:07 2026-02-17T20:58:52.371 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:52.371 INFO:teuthology.orchestra.run.trial045.stdout:Total 4.6 MB/s | 95 MB 00:20 2026-02-17T20:58:52.384 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:52.401 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:52.402 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:52.402 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:52.424 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install cephadm 2026-02-17T20:58:52.532 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:52.597 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:52.614 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:52.615 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:52.615 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:52.637 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rgw 2026-02-17T20:58:52.731 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:52.795 INFO:teuthology.orchestra.run.trial138.stdout:Package cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:52.795 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:58:52.812 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:52.813 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:52.813 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:52.833 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T20:58:52.834 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:58:52.835 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:58:52.944 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:53.008 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:53.026 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:53.027 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:53.027 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:53.048 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-cephfs 2026-02-17T20:58:53.150 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:53.233 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:53.233 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:53.233 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T20:58:53.233 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-679.gd855f53b.el9 ceph 145 k 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 145 k 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 431 k 2026-02-17T20:58:53.234 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:58:53.256 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:58:53.257 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:58:53.318 INFO:teuthology.orchestra.run.trial138.stdout:ceph-immutable-object-cache-19.2.3-679.gd855f53 1.7 MB/s | 145 kB 00:00 2026-02-17T20:58:53.318 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:53.318 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T20:58:53.318 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:58:53.321 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:58:53.321 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:58:53.353 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:58:53.353 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:58:53.358 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:53.408 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:58:53.409 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:58:53.421 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:53.432 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:58:53.432 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:53.433 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T20:58:53.433 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:53.439 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:53.439 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:53.439 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:53.462 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rbd 2026-02-17T20:58:53.697 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:58:53.699 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T20:58:53.731 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T20:58:53.736 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T20:58:53.744 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:58:53.744 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:53.744 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:58:53.744 INFO:teuthology.orchestra.run.trial138.stdout: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:53.744 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:53.744 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:53.757 INFO:teuthology.orchestra.run.trial045.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T20:58:53.763 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T20:58:53.772 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr 2026-02-17T20:58:53.773 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:53.796 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T20:58:53.806 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T20:58:53.811 INFO:teuthology.orchestra.run.trial045.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T20:58:53.814 INFO:teuthology.orchestra.run.trial045.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T20:58:53.818 INFO:teuthology.orchestra.run.trial045.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T20:58:53.836 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:53.842 INFO:teuthology.orchestra.run.trial045.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T20:58:53.854 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:53.854 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T20:58:53.855 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:53.855 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T20:58:53.858 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T20:58:53.866 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T20:58:53.869 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T20:58:53.876 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-fuse 2026-02-17T20:58:53.880 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T20:58:53.887 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T20:58:53.911 INFO:teuthology.orchestra.run.trial045.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T20:58:53.915 INFO:teuthology.orchestra.run.trial045.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T20:58:53.922 INFO:teuthology.orchestra.run.trial045.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T20:58:53.946 INFO:teuthology.orchestra.run.trial045.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T20:58:53.998 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T20:58:54.011 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T20:58:54.013 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T20:58:54.018 INFO:teuthology.orchestra.run.trial045.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T20:58:54.023 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T20:58:54.028 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T20:58:54.031 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T20:58:54.046 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T20:58:54.067 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T20:58:54.071 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T20:58:54.077 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T20:58:54.084 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:54.088 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T20:58:54.097 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T20:58:54.103 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T20:58:54.123 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T20:58:54.132 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T20:58:54.148 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:54.165 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:54.166 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:54.166 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:54.181 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:54.186 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T20:58:54.187 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T20:58:54.199 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T20:58:54.214 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T20:58:54.219 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T20:58:54.227 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T20:58:54.263 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:54.264 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:54.264 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-17T20:58:54.264 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:54.264 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:54.264 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 85 k 2026-02-17T20:58:54.265 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:54.265 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:54.265 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:54.265 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:58:54.265 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:54.265 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 85 k 2026-02-17T20:58:54.265 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 227 k 2026-02-17T20:58:54.265 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:54.267 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T20:58:54.338 INFO:teuthology.orchestra.run.trial086.stdout:rbd-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T20:58:54.339 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:54.339 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T20:58:54.339 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:54.343 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:54.343 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:54.374 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:54.374 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:54.425 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:54.442 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:54.491 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:54.522 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:54.555 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:54.572 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:54.573 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:54.573 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:54.579 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:54.579 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:54.579 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:54.580 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:54.580 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:54.580 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:54.594 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T20:58:54.595 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T20:58:54.605 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T20:58:54.606 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-mirror 2026-02-17T20:58:54.609 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T20:58:54.615 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T20:58:54.617 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T20:58:54.645 INFO:teuthology.orchestra.run.trial045.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T20:58:54.689 INFO:teuthology.orchestra.run.trial045.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T20:58:54.695 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T20:58:54.699 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T20:58:54.705 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T20:58:54.715 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T20:58:54.747 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T20:58:54.757 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T20:58:54.792 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T20:58:54.901 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:54.916 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:54.965 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:54.982 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:54.983 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:54.983 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:54.998 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:54.999 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:54.999 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T20:58:54.999 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:54.999 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:54.999 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.1 M 2026-02-17T20:58:54.999 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:54.999 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:54.999 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:54.999 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:58:55.000 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:55.000 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 3.1 M 2026-02-17T20:58:55.000 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 13 M 2026-02-17T20:58:55.000 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:55.005 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr-rook 2026-02-17T20:58:55.020 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T20:58:55.044 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T20:58:55.048 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T20:58:55.107 INFO:teuthology.orchestra.run.trial045.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T20:58:55.109 INFO:teuthology.orchestra.run.trial045.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T20:58:55.130 INFO:teuthology.orchestra.run.trial045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T20:58:55.146 INFO:teuthology.orchestra.run.trial086.stdout:rbd-mirror-19.2.3-679.gd855f53b.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T20:58:55.147 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:55.147 INFO:teuthology.orchestra.run.trial086.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T20:58:55.147 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:55.151 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:55.151 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:55.191 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:55.191 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:55.316 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:55.381 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:55.382 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:55.384 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:55.398 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:55.399 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:55.399 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:55.407 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:55.407 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:55.407 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T20:58:55.407 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:58:55.407 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:58:55.407 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:55.421 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T20:58:55.458 INFO:teuthology.orchestra.run.trial045.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T20:58:55.533 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T20:58:55.711 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:55.712 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:55.712 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:55.712 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:55.712 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:55.712 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:55.733 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:55.739 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-nbd 2026-02-17T20:58:55.797 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:55.814 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:55.815 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:55.815 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:55.836 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-fuse 2026-02-17T20:58:56.052 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:56.135 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:56.135 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:56.135 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-17T20:58:56.135 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:56.135 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:56.135 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 170 k 2026-02-17T20:58:56.135 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:56.135 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:56.135 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:56.136 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:58:56.136 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:56.136 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 170 k 2026-02-17T20:58:56.136 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 490 k 2026-02-17T20:58:56.136 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:56.146 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:56.211 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T20:58:56.220 INFO:teuthology.orchestra.run.trial086.stdout:rbd-nbd-19.2.3-679.gd855f53b.el9.x86_64.rpm 2.0 MB/s | 170 kB 00:00 2026-02-17T20:58:56.221 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:56.221 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.9 MB/s | 170 kB 00:00 2026-02-17T20:58:56.221 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:56.224 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:56.224 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:56.228 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:56.228 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T20:58:56.229 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:56.229 INFO:teuthology.orchestra.run.trial138.stdout: Package Architecture Version Repository Size 2026-02-17T20:58:56.229 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:56.229 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:58:56.229 INFO:teuthology.orchestra.run.trial138.stdout: ceph-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.2 M 2026-02-17T20:58:56.229 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:56.230 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:58:56.230 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:56.230 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T20:58:56.230 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:56.230 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 1.2 M 2026-02-17T20:58:56.230 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 3.6 M 2026-02-17T20:58:56.230 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:58:56.238 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T20:58:56.245 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T20:58:56.257 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:56.257 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:58:56.258 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T20:58:56.274 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T20:58:56.314 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:58:56.332 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:56.347 INFO:teuthology.orchestra.run.trial138.stdout:ceph-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2026-02-17T20:58:56.348 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:56.348 INFO:teuthology.orchestra.run.trial138.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-17T20:58:56.348 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:58:56.351 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T20:58:56.352 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:58:56.352 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:58:56.360 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T20:58:56.384 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T20:58:56.387 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:58:56.387 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:58:56.411 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:56.414 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T20:58:56.465 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T20:58:56.468 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:56.468 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:56.468 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:58:56.468 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:56.468 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:56.468 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:58:56.471 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T20:58:56.477 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T20:58:56.478 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T20:58:56.487 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:58:56.496 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-base-debuginfo 2026-02-17T20:58:56.497 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:58:56.497 INFO:teuthology.orchestra.run.trial045.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T20:58:56.497 INFO:teuthology.orchestra.run.trial045.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T20:58:56.497 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:56.503 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:58:56.504 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:56.527 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:58:56.527 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T20:58:56.528 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:56.562 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T20:58:56.627 INFO:teuthology.orchestra.run.trial045.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T20:58:56.629 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T20:58:56.642 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T20:58:56.642 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:56.642 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T20:58:56.642 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:56.744 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:56.802 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:56.802 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:56.802 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:58:56.803 INFO:teuthology.orchestra.run.trial138.stdout: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:56.803 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:56.803 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:56.810 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:58:56.832 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-volume 2026-02-17T20:58:56.893 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 72 M 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout: ceph-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 24 M 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout: ceph-debugsource x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T20:58:56.894 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:56.895 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:58:56.895 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:58:56.895 INFO:teuthology.orchestra.run.trial086.stdout:Install 3 Packages 2026-02-17T20:58:56.895 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:58:56.895 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 107 M 2026-02-17T20:58:56.895 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 654 M 2026-02-17T20:58:56.895 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:58:57.144 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:57.208 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:58:57.225 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:57.226 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:57.226 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:57.248 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install librados-devel 2026-02-17T20:58:57.352 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T20:58:57.377 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T20:58:57.377 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:57.377 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T20:58:57.377 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:58:57.377 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:58:57.378 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:57.434 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T20:58:57.436 INFO:teuthology.orchestra.run.trial045.stdout: Installing : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T20:58:57.441 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 88/99 2026-02-17T20:58:57.461 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 89/99 2026-02-17T20:58:57.462 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T20:58:57.562 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:57.644 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:57.644 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:57.644 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T20:58:57.644 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout: librados-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 126 k 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 126 k 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 456 k 2026-02-17T20:58:57.645 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:58:57.837 INFO:teuthology.orchestra.run.trial086.stdout:(1/3): ceph-debuginfo-19.2.3-679.gd855f53b.el9. 26 MB/s | 24 MB 00:00 2026-02-17T20:58:57.898 INFO:teuthology.orchestra.run.trial138.stdout:librados-devel-19.2.3-679.gd855f53b.el9.x86_64. 500 kB/s | 126 kB 00:00 2026-02-17T20:58:57.898 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:57.899 INFO:teuthology.orchestra.run.trial138.stdout:Total 498 kB/s | 126 kB 00:00 2026-02-17T20:58:57.899 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:58:57.901 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:58:57.902 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:58:57.933 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:58:57.933 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:58:57.951 INFO:teuthology.orchestra.run.trial086.stdout:(2/3): ceph-debugsource-19.2.3-679.gd855f53b.el 10 MB/s | 11 MB 00:01 2026-02-17T20:58:57.959 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T20:58:57.962 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T20:58:57.988 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:58:58.005 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:58.094 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:58.153 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:58.154 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:58.154 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:58:58.154 INFO:teuthology.orchestra.run.trial138.stdout: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:58.154 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:58.154 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:58.183 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install libcephfs2 2026-02-17T20:58:58.420 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T20:58:58.421 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T20:58:58.433 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T20:58:58.433 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T20:58:58.490 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T20:58:58.496 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:58.540 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 94/99 2026-02-17T20:58:58.541 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T20:58:58.562 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T20:58:58.562 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:58.563 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T20:58:58.563 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:58:58.563 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:58:58.563 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:58.563 INFO:teuthology.orchestra.run.trial138.stdout:Package libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:58.576 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T20:58:58.580 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:58.581 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:58.581 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:58.602 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install libcephfs-devel 2026-02-17T20:58:58.795 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T20:58:58.797 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T20:58:58.819 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T20:58:58.819 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:58.819 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T20:58:58.819 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:58:58.819 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:58:58.819 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:58.908 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:58.923 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T20:58:58.944 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T20:58:58.944 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:58:58.944 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T20:58:58.944 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:58:58.944 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:58:58.944 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:58.962 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T20:58:58.990 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:58.991 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:58.991 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T20:58:58.991 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:58.991 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:58:58.991 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 34 k 2026-02-17T20:58:58.991 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:58.991 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:58:58.992 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:58:58.992 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T20:58:58.992 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:58.992 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 34 k 2026-02-17T20:58:58.992 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 153 k 2026-02-17T20:58:58.992 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:58:59.073 INFO:teuthology.orchestra.run.trial138.stdout:libcephfs-devel-19.2.3-679.gd855f53b.el9.x86_64 410 kB/s | 34 kB 00:00 2026-02-17T20:58:59.073 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:59.073 INFO:teuthology.orchestra.run.trial138.stdout:Total 406 kB/s | 34 kB 00:00 2026-02-17T20:58:59.074 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:58:59.075 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:58:59.075 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:58:59.077 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:58:59.077 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:58:59.097 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:58:59.113 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:59.169 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:59.225 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:58:59.225 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:59.225 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:58:59.226 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:59.226 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:58:59.226 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:59.252 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install librados2 2026-02-17T20:58:59.557 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:59.590 INFO:teuthology.orchestra.run.trial086.stdout:(3/3): ceph-base-debuginfo-19.2.3-679.gd855f53b 27 MB/s | 72 MB 00:02 2026-02-17T20:58:59.593 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:58:59.593 INFO:teuthology.orchestra.run.trial086.stdout:Total 40 MB/s | 107 MB 00:02 2026-02-17T20:58:59.593 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:58:59.598 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:58:59.598 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:58:59.622 INFO:teuthology.orchestra.run.trial138.stdout:Package librados2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:58:59.640 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:58:59.641 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:58:59.641 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:58:59.649 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T20:58:59.649 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 1/99 2026-02-17T20:58:59.649 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2/99 2026-02-17T20:58:59.649 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 3/99 2026-02-17T20:58:59.649 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 4/99 2026-02-17T20:58:59.649 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 5/99 2026-02-17T20:58:59.649 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 6/99 2026-02-17T20:58:59.649 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 7/99 2026-02-17T20:58:59.649 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 8/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 9/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 10/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 11/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 12/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 13/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 14/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 15/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T20:58:59.650 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T20:58:59.651 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T20:58:59.652 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T20:58:59.653 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T20:58:59.654 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T20:58:59.655 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T20:58:59.656 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T20:58:59.662 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install librbd1 2026-02-17T20:58:59.710 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.711 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T20:58:59.712 INFO:teuthology.orchestra.run.trial045.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T20:58:59.713 INFO:teuthology.orchestra.run.trial045.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T20:58:59.714 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:58:59.715 INFO:teuthology.orchestra.run.trial045.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T20:58:59.716 INFO:teuthology.orchestra.run.trial045.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T20:58:59.717 INFO:teuthology.orchestra.run.trial045.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T20:58:59.718 INFO:teuthology.orchestra.run.trial045.stdout: zip-3.0-35.el9.x86_64 2026-02-17T20:58:59.719 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:58:59.719 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:58:59.765 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-base 2026-02-17T20:58:59.972 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:58:59.978 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:58:59.978 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:59:00.036 INFO:teuthology.orchestra.run.trial138.stdout:Package librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:00.053 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:00.054 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:59:00.054 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:59:00.076 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-rados 2026-02-17T20:59:00.084 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:00.150 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:00.167 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:00.168 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:00.168 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:00.189 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install cephadm 2026-02-17T20:59:00.388 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:59:00.452 INFO:teuthology.orchestra.run.trial138.stdout:Package python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:00.469 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:00.470 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:59:00.470 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:59:00.491 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-rgw 2026-02-17T20:59:00.504 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:00.569 INFO:teuthology.orchestra.run.trial045.stdout:Package cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:00.587 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:00.588 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:00.588 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:00.609 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T20:59:00.718 INFO:teuthology.orchestra.run.trial092.stdout:(61/99): python3-autocommand-2.2.2-8.el9.noarch 2.9 kB/s | 29 kB 00:10 2026-02-17T20:59:00.767 INFO:teuthology.orchestra.run.trial092.stdout:(62/99): python3-asyncssh-2.13.2-5.el9.noarch.r 54 kB/s | 548 kB 00:10 2026-02-17T20:59:00.788 INFO:teuthology.orchestra.run.trial092.stdout:(63/99): python3-backports-tarfile-1.2.0-1.el9. 6.0 kB/s | 60 kB 00:10 2026-02-17T20:59:00.800 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:59:00.811 INFO:teuthology.orchestra.run.trial092.stdout:(64/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 481 kB/s | 43 kB 00:00 2026-02-17T20:59:00.833 INFO:teuthology.orchestra.run.trial092.stdout:(65/99): python3-cachetools-4.2.4-1.el9.noarch. 490 kB/s | 32 kB 00:00 2026-02-17T20:59:00.835 INFO:teuthology.orchestra.run.trial092.stdout:(66/99): python3-certifi-2023.05.07-4.el9.noarc 302 kB/s | 14 kB 00:00 2026-02-17T20:59:00.864 INFO:teuthology.orchestra.run.trial138.stdout:Package python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:00.881 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:00.882 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:59:00.882 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:59:00.903 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-cephfs 2026-02-17T20:59:00.907 INFO:teuthology.orchestra.run.trial092.stdout:(67/99): python3-cheroot-10.0.1-4.el9.noarch.rp 1.8 MB/s | 173 kB 00:00 2026-02-17T20:59:00.917 INFO:teuthology.orchestra.run.trial092.stdout:(68/99): python3-cherrypy-18.6.1-2.el9.noarch.r 4.2 MB/s | 358 kB 00:00 2026-02-17T20:59:00.920 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:00.964 INFO:teuthology.orchestra.run.trial092.stdout:(69/99): python3-google-auth-2.45.0-1.el9.noarc 1.9 MB/s | 254 kB 00:00 2026-02-17T20:59:01.002 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:01.003 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:01.003 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T20:59:01.003 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:01.004 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:59:01.004 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-679.gd855f53b.el9 ceph 145 k 2026-02-17T20:59:01.004 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:01.004 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:59:01.004 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:01.004 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T20:59:01.004 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:01.004 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 145 k 2026-02-17T20:59:01.004 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 431 k 2026-02-17T20:59:01.005 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:59:01.016 INFO:teuthology.orchestra.run.trial092.stdout:(70/99): python3-grpcio-tools-1.46.7-10.el9.x86 1.4 MB/s | 144 kB 00:00 2026-02-17T20:59:01.088 INFO:teuthology.orchestra.run.trial045.stdout:ceph-immutable-object-cache-19.2.3-679.gd855f53 1.7 MB/s | 145 kB 00:00 2026-02-17T20:59:01.089 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:01.089 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.7 MB/s | 145 kB 00:00 2026-02-17T20:59:01.089 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:59:01.093 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:59:01.093 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:59:01.104 INFO:teuthology.orchestra.run.trial092.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 996 kB/s | 139 kB 00:00 2026-02-17T20:59:01.117 INFO:teuthology.orchestra.run.trial092.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 556 kB/s | 56 kB 00:00 2026-02-17T20:59:01.124 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:59:01.124 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:59:01.160 INFO:teuthology.orchestra.run.trial092.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 193 kB/s | 11 kB 00:00 2026-02-17T20:59:01.179 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:59:01.181 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:59:01.201 INFO:teuthology.orchestra.run.trial092.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 210 kB/s | 18 kB 00:00 2026-02-17T20:59:01.203 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:59:01.203 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:01.203 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T20:59:01.203 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:01.211 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:59:01.251 INFO:teuthology.orchestra.run.trial092.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 253 kB/s | 23 kB 00:00 2026-02-17T20:59:01.276 INFO:teuthology.orchestra.run.trial138.stdout:Package python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:01.284 INFO:teuthology.orchestra.run.trial092.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 239 kB/s | 20 kB 00:00 2026-02-17T20:59:01.293 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:01.294 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:59:01.294 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:59:01.316 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-rbd 2026-02-17T20:59:01.332 INFO:teuthology.orchestra.run.trial092.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 240 kB/s | 19 kB 00:00 2026-02-17T20:59:01.363 INFO:teuthology.orchestra.run.trial092.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 335 kB/s | 26 kB 00:00 2026-02-17T20:59:01.398 INFO:teuthology.orchestra.run.trial092.stdout:(79/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 4.2 MB/s | 2.0 MB 00:00 2026-02-17T20:59:01.402 INFO:teuthology.orchestra.run.trial092.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2026-02-17T20:59:01.488 INFO:teuthology.orchestra.run.trial092.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 875 kB/s | 79 kB 00:00 2026-02-17T20:59:01.490 INFO:teuthology.orchestra.run.trial092.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 984 kB/s | 86 kB 00:00 2026-02-17T20:59:01.513 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:59:01.513 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:01.513 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:59:01.513 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:01.513 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:01.513 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:01.540 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr 2026-02-17T20:59:01.555 INFO:teuthology.orchestra.run.trial092.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 864 kB/s | 58 kB 00:00 2026-02-17T20:59:01.605 INFO:teuthology.orchestra.run.trial092.stdout:(84/99): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2026-02-17T20:59:01.626 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:59:01.647 INFO:teuthology.orchestra.run.trial092.stdout:(85/99): python3-kubernetes-26.1.0-3.el9.noarch 3.2 MB/s | 1.0 MB 00:00 2026-02-17T20:59:01.665 INFO:teuthology.orchestra.run.trial092.stdout:(86/99): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2026-02-17T20:59:01.677 INFO:teuthology.orchestra.run.trial092.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2026-02-17T20:59:01.690 INFO:teuthology.orchestra.run.trial138.stdout:Package python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:01.707 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:01.708 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T20:59:01.708 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:59:01.729 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install rbd-fuse 2026-02-17T20:59:01.737 INFO:teuthology.orchestra.run.trial092.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 343 kB/s | 31 kB 00:00 2026-02-17T20:59:01.752 INFO:teuthology.orchestra.run.trial092.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 780 kB/s | 59 kB 00:00 2026-02-17T20:59:01.784 INFO:teuthology.orchestra.run.trial092.stdout:(90/99): python3-routes-2.5.1-5.el9.noarch.rpm 1.6 MB/s | 188 kB 00:00 2026-02-17T20:59:01.824 INFO:teuthology.orchestra.run.trial092.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 498 kB/s | 36 kB 00:00 2026-02-17T20:59:01.830 INFO:teuthology.orchestra.run.trial092.stdout:(92/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.3 MB/s | 125 kB 00:00 2026-02-17T20:59:01.858 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:01.874 INFO:teuthology.orchestra.run.trial092.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 959 kB/s | 86 kB 00:00 2026-02-17T20:59:01.922 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:01.922 INFO:teuthology.orchestra.run.trial092.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2026-02-17T20:59:01.938 INFO:teuthology.orchestra.run.trial092.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 827 kB/s | 90 kB 00:00 2026-02-17T20:59:01.940 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:01.941 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:01.941 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:01.963 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T20:59:01.964 INFO:teuthology.orchestra.run.trial092.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.7 MB/s | 427 kB 00:00 2026-02-17T20:59:01.981 INFO:teuthology.orchestra.run.trial092.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 825 kB/s | 48 kB 00:00 2026-02-17T20:59:02.042 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:59:02.059 INFO:teuthology.orchestra.run.trial092.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 183 kB/s | 22 kB 00:00 2026-02-17T20:59:02.094 INFO:teuthology.orchestra.run.trial092.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 153 kB/s | 20 kB 00:00 2026-02-17T20:59:02.095 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:02.095 INFO:teuthology.orchestra.run.trial092.stdout:Total 5.9 MB/s | 95 MB 00:16 2026-02-17T20:59:02.124 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:02.124 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:02.124 INFO:teuthology.orchestra.run.trial138.stdout: Package Architecture Version Repository Size 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout: rbd-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 85 k 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 85 k 2026-02-17T20:59:02.125 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 227 k 2026-02-17T20:59:02.126 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:59:02.199 INFO:teuthology.orchestra.run.trial138.stdout:rbd-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T20:59:02.200 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:02.200 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T20:59:02.200 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:59:02.203 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:59:02.203 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:59:02.235 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:59:02.235 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:59:02.267 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:02.286 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:59:02.302 INFO:teuthology.orchestra.run.trial138.stdout: Installing : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:02.332 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:02.349 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:02.350 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:02.350 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:02.371 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T20:59:02.379 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:02.438 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:02.438 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:02.438 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:59:02.438 INFO:teuthology.orchestra.run.trial138.stdout: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:02.438 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:02.438 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:59:02.443 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:59:02.468 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install rbd-mirror 2026-02-17T20:59:02.509 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:02.547 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:02.547 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:02.682 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:02.745 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:02.763 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:02.764 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:02.764 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:02.780 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:59:02.785 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-rook 2026-02-17T20:59:02.862 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:02.863 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:02.863 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T20:59:02.863 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:02.863 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:59:02.863 INFO:teuthology.orchestra.run.trial138.stdout: rbd-mirror x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.1 M 2026-02-17T20:59:02.863 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:02.863 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:59:02.864 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:02.864 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T20:59:02.864 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:02.864 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 3.1 M 2026-02-17T20:59:02.864 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 13 M 2026-02-17T20:59:02.864 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:59:02.962 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:02.963 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:03.012 INFO:teuthology.orchestra.run.trial138.stdout:rbd-mirror-19.2.3-679.gd855f53b.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T20:59:03.013 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:03.013 INFO:teuthology.orchestra.run.trial138.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T20:59:03.013 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:59:03.017 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:59:03.017 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:59:03.057 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:59:03.057 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:59:03.098 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:03.162 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:03.180 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:03.181 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:03.181 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:03.202 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T20:59:03.250 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:59:03.252 INFO:teuthology.orchestra.run.trial138.stdout: Installing : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:03.276 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:03.276 INFO:teuthology.orchestra.run.trial138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:03.276 INFO:teuthology.orchestra.run.trial138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T20:59:03.276 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:59:03.276 INFO:teuthology.orchestra.run.trial138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:59:03.277 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:03.402 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:59:03.404 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T20:59:03.435 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T20:59:03.440 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T20:59:03.462 INFO:teuthology.orchestra.run.trial092.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T20:59:03.468 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T20:59:03.501 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T20:59:03.510 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T20:59:03.514 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:03.515 INFO:teuthology.orchestra.run.trial092.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T20:59:03.518 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T20:59:03.522 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T20:59:03.545 INFO:teuthology.orchestra.run.trial092.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T20:59:03.558 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T20:59:03.562 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T20:59:03.568 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T20:59:03.571 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T20:59:03.578 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:03.583 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T20:59:03.589 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T20:59:03.595 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:03.596 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:03.596 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:03.600 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:03.600 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:03.600 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:59:03.601 INFO:teuthology.orchestra.run.trial138.stdout: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:03.601 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:03.601 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:59:03.613 INFO:teuthology.orchestra.run.trial092.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T20:59:03.617 INFO:teuthology.orchestra.run.trial092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T20:59:03.618 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-fuse 2026-02-17T20:59:03.624 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T20:59:03.628 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install rbd-nbd 2026-02-17T20:59:03.648 INFO:teuthology.orchestra.run.trial092.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T20:59:03.700 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T20:59:03.713 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T20:59:03.717 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T20:59:03.723 INFO:teuthology.orchestra.run.trial092.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T20:59:03.728 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T20:59:03.733 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T20:59:03.736 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T20:59:03.751 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T20:59:03.772 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T20:59:03.773 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 1/3 2026-02-17T20:59:03.776 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T20:59:03.781 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T20:59:03.793 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T20:59:03.802 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T20:59:03.808 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T20:59:03.828 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T20:59:03.837 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T20:59:03.891 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T20:59:03.903 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T20:59:03.919 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T20:59:03.924 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T20:59:03.931 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:03.932 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T20:59:03.938 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:59:03.972 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T20:59:04.013 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:04.013 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:04.013 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-17T20:59:04.013 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:04.013 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:59:04.013 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.2 M 2026-02-17T20:59:04.013 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:04.014 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:59:04.014 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:04.014 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T20:59:04.014 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:04.014 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 1.2 M 2026-02-17T20:59:04.014 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 3.6 M 2026-02-17T20:59:04.014 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:59:04.020 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:04.021 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:04.021 INFO:teuthology.orchestra.run.trial138.stdout: Package Architecture Version Repository Size 2026-02-17T20:59:04.021 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:04.021 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:59:04.021 INFO:teuthology.orchestra.run.trial138.stdout: rbd-nbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 170 k 2026-02-17T20:59:04.021 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:04.021 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:59:04.022 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:04.022 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T20:59:04.022 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:04.022 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 170 k 2026-02-17T20:59:04.022 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 490 k 2026-02-17T20:59:04.022 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:59:04.106 INFO:teuthology.orchestra.run.trial138.stdout:rbd-nbd-19.2.3-679.gd855f53b.el9.x86_64.rpm 1.9 MB/s | 170 kB 00:00 2026-02-17T20:59:04.107 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:04.107 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.9 MB/s | 170 kB 00:00 2026-02-17T20:59:04.107 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:59:04.111 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:59:04.111 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:59:04.132 INFO:teuthology.orchestra.run.trial045.stdout:ceph-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2026-02-17T20:59:04.132 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:04.132 INFO:teuthology.orchestra.run.trial045.stdout:Total 9.6 MB/s | 1.2 MB 00:00 2026-02-17T20:59:04.132 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:59:04.136 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:59:04.136 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:59:04.145 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:59:04.145 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:59:04.171 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:59:04.171 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:59:04.203 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:59:04.220 INFO:teuthology.orchestra.run.trial138.stdout: Installing : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:04.273 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:59:04.290 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:04.298 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T20:59:04.300 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:04.308 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T20:59:04.312 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T20:59:04.318 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T20:59:04.320 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T20:59:04.347 INFO:teuthology.orchestra.run.trial092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T20:59:04.356 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:04.356 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:04.356 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:59:04.357 INFO:teuthology.orchestra.run.trial138.stdout: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:04.357 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:04.357 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:59:04.384 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-base-debuginfo 2026-02-17T20:59:04.391 INFO:teuthology.orchestra.run.trial092.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T20:59:04.397 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T20:59:04.400 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T20:59:04.406 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T20:59:04.410 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T20:59:04.417 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T20:59:04.420 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T20:59:04.448 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T20:59:04.457 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T20:59:04.492 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T20:59:04.505 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:04.562 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:04.562 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:04.562 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:59:04.562 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:04.562 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:04.562 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:04.590 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-volume 2026-02-17T20:59:04.696 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:59:04.717 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T20:59:04.740 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T20:59:04.744 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T20:59:04.778 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout: ceph-base-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 72 M 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout:Installing dependencies: 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout: ceph-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 24 M 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout:Installing weak dependencies: 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout: ceph-debugsource x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T20:59:04.779 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:04.780 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:59:04.780 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:04.780 INFO:teuthology.orchestra.run.trial138.stdout:Install 3 Packages 2026-02-17T20:59:04.780 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:04.780 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 107 M 2026-02-17T20:59:04.780 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 654 M 2026-02-17T20:59:04.780 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial092.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T20:59:04.805 INFO:teuthology.orchestra.run.trial092.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T20:59:04.826 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T20:59:04.904 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:04.967 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:04.985 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:04.986 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:04.986 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:05.008 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados-devel 2026-02-17T20:59:05.152 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T20:59:05.224 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T20:59:05.290 INFO:teuthology.orchestra.run.trial138.stdout:(1/3): ceph-debugsource-19.2.3-679.gd855f53b.el 21 MB/s | 11 MB 00:00 2026-02-17T20:59:05.319 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:05.402 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:05.402 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 126 k 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:05.403 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 126 k 2026-02-17T20:59:05.404 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 456 k 2026-02-17T20:59:05.404 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:59:05.761 INFO:teuthology.orchestra.run.trial045.stdout:librados-devel-19.2.3-679.gd855f53b.el9.x86_64. 354 kB/s | 126 kB 00:00 2026-02-17T20:59:05.762 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:05.762 INFO:teuthology.orchestra.run.trial045.stdout:Total 352 kB/s | 126 kB 00:00 2026-02-17T20:59:05.762 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:59:05.765 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:59:05.765 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:59:05.796 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:59:05.796 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:59:05.850 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:59:05.866 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:05.895 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T20:59:05.912 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T20:59:05.922 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T20:59:05.929 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T20:59:05.942 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T20:59:05.945 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:05.958 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T20:59:06.002 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:06.002 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:06.002 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:59:06.002 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:06.002 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:06.002 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:06.014 INFO:teuthology.orchestra.run.trial138.stdout:(2/3): ceph-debuginfo-19.2.3-679.gd855f53b.el9. 20 MB/s | 24 MB 00:01 2026-02-17T20:59:06.028 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install libcephfs2 2026-02-17T20:59:06.033 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T20:59:06.041 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T20:59:06.065 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T20:59:06.095 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T20:59:06.145 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T20:59:06.151 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T20:59:06.154 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T20:59:06.156 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T20:59:06.174 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:59:06.174 INFO:teuthology.orchestra.run.trial092.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T20:59:06.174 INFO:teuthology.orchestra.run.trial092.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T20:59:06.174 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:06.183 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:59:06.211 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:59:06.211 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T20:59:06.211 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:06.246 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T20:59:06.311 INFO:teuthology.orchestra.run.trial092.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T20:59:06.314 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T20:59:06.327 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 85/99 2026-02-17T20:59:06.327 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:06.328 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T20:59:06.328 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:06.348 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:06.413 INFO:teuthology.orchestra.run.trial045.stdout:Package libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:06.431 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:06.432 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:06.432 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:06.453 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install libcephfs-devel 2026-02-17T20:59:06.769 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:06.793 INFO:teuthology.orchestra.run.trial138.stdout:(3/3): ceph-base-debuginfo-19.2.3-679.gd855f53b 36 MB/s | 72 MB 00:02 2026-02-17T20:59:06.795 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:06.795 INFO:teuthology.orchestra.run.trial138.stdout:Total 53 MB/s | 107 MB 00:02 2026-02-17T20:59:06.795 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:59:06.800 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:59:06.800 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:59:06.853 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:06.853 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 34 k 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:06.854 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 34 k 2026-02-17T20:59:06.855 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 153 k 2026-02-17T20:59:06.855 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:59:06.918 INFO:teuthology.orchestra.run.trial045.stdout:libcephfs-devel-19.2.3-679.gd855f53b.el9.x86_64 528 kB/s | 34 kB 00:00 2026-02-17T20:59:06.918 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:06.919 INFO:teuthology.orchestra.run.trial045.stdout:Total 522 kB/s | 34 kB 00:00 2026-02-17T20:59:06.919 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:59:06.920 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:59:06.920 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:59:06.921 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:59:06.922 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:59:06.942 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:59:06.958 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:07.011 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:07.022 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T20:59:07.048 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 86/99 2026-02-17T20:59:07.048 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:07.048 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T20:59:07.048 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:59:07.048 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:59:07.048 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:07.069 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:07.069 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:07.069 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:59:07.069 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:07.069 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:07.069 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:07.097 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados2 2026-02-17T20:59:07.105 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T20:59:07.107 INFO:teuthology.orchestra.run.trial092.stdout: Installing : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 87/99 2026-02-17T20:59:07.112 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 88/99 2026-02-17T20:59:07.131 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 89/99 2026-02-17T20:59:07.133 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T20:59:07.181 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:59:07.181 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:59:07.407 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:07.472 INFO:teuthology.orchestra.run.trial045.stdout:Package librados2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:07.489 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:07.490 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:07.490 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:07.511 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librbd1 2026-02-17T20:59:07.584 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T20:59:07.604 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T20:59:07.630 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 90/99 2026-02-17T20:59:07.633 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T20:59:07.818 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:07.882 INFO:teuthology.orchestra.run.trial045.stdout:Package librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:07.900 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:07.901 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:07.901 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:07.922 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rados 2026-02-17T20:59:08.089 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 91/99 2026-02-17T20:59:08.090 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T20:59:08.103 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 92/99 2026-02-17T20:59:08.104 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T20:59:08.119 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T20:59:08.119 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/3 2026-02-17T20:59:08.119 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T20:59:08.159 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 93/99 2026-02-17T20:59:08.178 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 3/3 2026-02-17T20:59:08.178 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:08.179 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:59:08.179 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:08.179 INFO:teuthology.orchestra.run.trial086.stdout: ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:08.179 INFO:teuthology.orchestra.run.trial086.stdout: ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:08.179 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:08.179 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:59:08.208 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 94/99 2026-02-17T20:59:08.209 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T20:59:08.218 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-common-debuginfo 2026-02-17T20:59:08.231 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 95/99 2026-02-17T20:59:08.231 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:08.231 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T20:59:08.232 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:59:08.232 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:59:08.232 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:08.234 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:08.243 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T20:59:08.298 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:08.315 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:08.316 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:08.316 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:08.337 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rgw 2026-02-17T20:59:08.459 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 96/99 2026-02-17T20:59:08.461 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T20:59:08.482 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 97/99 2026-02-17T20:59:08.482 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:08.482 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T20:59:08.483 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:59:08.483 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:59:08.483 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:08.531 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:59:08.585 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T20:59:08.607 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 98/99 2026-02-17T20:59:08.607 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:08.607 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T20:59:08.607 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:59:08.607 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:59:08.608 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:08.614 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:59:08.615 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:59:08.615 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T20:59:08.615 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:59:08.615 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:59:08.615 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 474 M 2026-02-17T20:59:08.616 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:08.616 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:59:08.616 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:59:08.616 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:59:08.616 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:08.616 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 474 M 2026-02-17T20:59:08.617 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 2.0 G 2026-02-17T20:59:08.617 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:59:08.626 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T20:59:08.650 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:08.714 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:08.731 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:08.732 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:08.732 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:08.754 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-cephfs 2026-02-17T20:59:09.074 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:09.139 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:09.158 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:09.159 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:09.159 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:09.181 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rbd 2026-02-17T20:59:09.299 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 99/99 2026-02-17T20:59:09.299 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-2:19.2.3-679.gd855f53b.el9.x86_64 1/99 2026-02-17T20:59:09.299 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2/99 2026-02-17T20:59:09.299 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 3/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 4/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 5/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9 6/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 7/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noar 8/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f5 9/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noar 10/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.n 11/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 12/99 2026-02-17T20:59:09.300 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9. 13/99 2026-02-17T20:59:09.301 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 14/99 2026-02-17T20:59:09.301 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : cephadm-2:19.2.3-679.gd855f53b.el9.noarch 15/99 2026-02-17T20:59:09.301 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T20:59:09.301 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T20:59:09.301 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T20:59:09.301 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T20:59:09.301 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T20:59:09.309 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T20:59:09.309 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T20:59:09.310 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T20:59:09.311 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T20:59:09.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T20:59:09.313 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T20:59:09.314 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T20:59:09.314 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T20:59:09.314 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T20:59:09.314 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T20:59:09.314 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T20:59:09.314 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T20:59:09.314 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T20:59:09.314 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T20:59:09.314 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T20:59:09.315 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T20:59:09.315 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T20:59:09.315 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T20:59:09.315 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T20:59:09.315 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T20:59:09.315 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T20:59:09.315 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T20:59:09.315 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T20:59:09.315 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T20:59:09.316 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T20:59:09.316 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T20:59:09.316 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T20:59:09.316 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T20:59:09.316 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T20:59:09.316 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T20:59:09.316 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T20:59:09.316 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T20:59:09.317 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T20:59:09.317 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T20:59:09.317 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T20:59:09.317 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T20:59:09.317 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T20:59:09.317 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T20:59:09.317 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T20:59:09.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T20:59:09.370 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:09.370 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:59:09.370 INFO:teuthology.orchestra.run.trial092.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T20:59:09.370 INFO:teuthology.orchestra.run.trial092.stdout: ceph-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:09.370 INFO:teuthology.orchestra.run.trial092.stdout: ceph-grafana-dashboards-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.370 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mds-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:09.370 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:09.370 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.371 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.371 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.371 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-k8sevents-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.371 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-modules-core-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.371 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.371 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mon-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:09.371 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:09.371 INFO:teuthology.orchestra.run.trial092.stdout: ceph-prometheus-alerts-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.372 INFO:teuthology.orchestra.run.trial092.stdout: ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.372 INFO:teuthology.orchestra.run.trial092.stdout: cephadm-2:19.2.3-679.gd855f53b.el9.noarch 2026-02-17T20:59:09.372 INFO:teuthology.orchestra.run.trial092.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T20:59:09.372 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T20:59:09.372 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T20:59:09.372 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T20:59:09.372 INFO:teuthology.orchestra.run.trial092.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T20:59:09.372 INFO:teuthology.orchestra.run.trial092.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T20:59:09.372 INFO:teuthology.orchestra.run.trial092.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T20:59:09.373 INFO:teuthology.orchestra.run.trial092.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T20:59:09.373 INFO:teuthology.orchestra.run.trial092.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T20:59:09.373 INFO:teuthology.orchestra.run.trial092.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:59:09.373 INFO:teuthology.orchestra.run.trial092.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T20:59:09.373 INFO:teuthology.orchestra.run.trial092.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T20:59:09.373 INFO:teuthology.orchestra.run.trial092.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T20:59:09.373 INFO:teuthology.orchestra.run.trial092.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T20:59:09.373 INFO:teuthology.orchestra.run.trial092.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T20:59:09.373 INFO:teuthology.orchestra.run.trial092.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T20:59:09.374 INFO:teuthology.orchestra.run.trial092.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T20:59:09.374 INFO:teuthology.orchestra.run.trial092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T20:59:09.374 INFO:teuthology.orchestra.run.trial092.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T20:59:09.374 INFO:teuthology.orchestra.run.trial092.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T20:59:09.374 INFO:teuthology.orchestra.run.trial092.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T20:59:09.374 INFO:teuthology.orchestra.run.trial092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T20:59:09.374 INFO:teuthology.orchestra.run.trial092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T20:59:09.374 INFO:teuthology.orchestra.run.trial092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T20:59:09.374 INFO:teuthology.orchestra.run.trial092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T20:59:09.375 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T20:59:09.376 INFO:teuthology.orchestra.run.trial092.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T20:59:09.377 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T20:59:09.378 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T20:59:09.378 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T20:59:09.378 INFO:teuthology.orchestra.run.trial092.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T20:59:09.378 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T20:59:09.378 INFO:teuthology.orchestra.run.trial092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T20:59:09.378 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T20:59:09.378 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T20:59:09.379 INFO:teuthology.orchestra.run.trial092.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T20:59:09.379 INFO:teuthology.orchestra.run.trial092.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T20:59:09.379 INFO:teuthology.orchestra.run.trial092.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T20:59:09.379 INFO:teuthology.orchestra.run.trial092.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T20:59:09.379 INFO:teuthology.orchestra.run.trial092.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T20:59:09.379 INFO:teuthology.orchestra.run.trial092.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T20:59:09.379 INFO:teuthology.orchestra.run.trial092.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T20:59:09.379 INFO:teuthology.orchestra.run.trial092.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T20:59:09.379 INFO:teuthology.orchestra.run.trial092.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: zip-3.0-35.el9.x86_64 2026-02-17T20:59:09.380 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:09.381 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:09.424 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-base 2026-02-17T20:59:09.493 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:09.556 INFO:teuthology.orchestra.run.trial045.stdout:Package python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:09.574 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:09.574 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T20:59:09.575 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:09.596 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-fuse 2026-02-17T20:59:09.638 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T20:59:09.741 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:09.805 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-base-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:09.822 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:09.823 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:09.823 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:09.845 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install cephadm 2026-02-17T20:59:09.905 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:09.988 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:09.988 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:09.988 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 85 k 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 85 k 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 227 k 2026-02-17T20:59:09.989 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:59:10.109 INFO:teuthology.orchestra.run.trial045.stdout:rbd-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 707 kB/s | 85 kB 00:00 2026-02-17T20:59:10.110 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:10.110 INFO:teuthology.orchestra.run.trial045.stdout:Total 703 kB/s | 85 kB 00:00 2026-02-17T20:59:10.110 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:59:10.113 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:59:10.113 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:59:10.143 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:59:10.144 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:59:10.157 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:10.194 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:59:10.211 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:10.223 INFO:teuthology.orchestra.run.trial092.stdout:Package cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:10.241 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:10.241 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:10.242 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:10.263 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T20:59:10.287 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:10.344 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:10.344 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:10.344 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:59:10.344 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:10.345 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:10.345 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:10.371 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-mirror 2026-02-17T20:59:10.572 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:10.654 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:10.654 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:10.654 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T20:59:10.654 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:10.654 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:59:10.654 INFO:teuthology.orchestra.run.trial092.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-679.gd855f53b.el9 ceph 145 k 2026-02-17T20:59:10.654 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:10.654 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:59:10.655 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:10.655 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T20:59:10.655 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:10.655 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 145 k 2026-02-17T20:59:10.655 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 431 k 2026-02-17T20:59:10.655 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:59:10.684 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:10.739 INFO:teuthology.orchestra.run.trial092.stdout:ceph-immutable-object-cache-19.2.3-679.gd855f53 1.7 MB/s | 145 kB 00:00 2026-02-17T20:59:10.740 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:10.740 INFO:teuthology.orchestra.run.trial092.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T20:59:10.740 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:10.743 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:10.743 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:10.769 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:10.769 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:10.769 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T20:59:10.769 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:10.769 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:59:10.769 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.1 M 2026-02-17T20:59:10.769 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:10.769 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:59:10.769 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:10.770 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T20:59:10.770 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:10.770 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 3.1 M 2026-02-17T20:59:10.770 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 13 M 2026-02-17T20:59:10.770 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:59:10.774 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:10.774 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:10.829 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:59:10.830 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:59:10.854 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:59:10.854 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:10.854 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T20:59:10.854 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:10.917 INFO:teuthology.orchestra.run.trial045.stdout:rbd-mirror-19.2.3-679.gd855f53b.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T20:59:10.917 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:10.917 INFO:teuthology.orchestra.run.trial045.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T20:59:10.917 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:59:10.921 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:59:10.921 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:59:10.922 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 1/3 2026-02-17T20:59:10.961 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:59:10.961 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:59:11.154 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.e 1/1 2026-02-17T20:59:11.154 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:11.154 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:59:11.154 INFO:teuthology.orchestra.run.trial092.stdout: ceph-immutable-object-cache-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:11.154 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:11.155 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:11.155 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:59:11.156 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:11.178 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:11.178 INFO:teuthology.orchestra.run.trial045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:11.178 INFO:teuthology.orchestra.run.trial045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T20:59:11.179 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:59:11.179 INFO:teuthology.orchestra.run.trial045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:59:11.179 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:11.180 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr 2026-02-17T20:59:11.498 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:11.498 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:11.498 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:59:11.498 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:11.498 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:11.499 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:11.499 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:11.525 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-nbd 2026-02-17T20:59:11.563 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:11.581 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:11.582 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:11.582 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:11.604 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T20:59:11.840 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:11.917 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:11.922 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:11.923 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:11.923 INFO:teuthology.orchestra.run.trial045.stdout: Package Architecture Version Repository Size 2026-02-17T20:59:11.923 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 170 k 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 170 k 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 490 k 2026-02-17T20:59:11.924 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:59:11.980 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-dashboard-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:11.998 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:11.998 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:11.999 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:12.020 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T20:59:12.125 INFO:teuthology.orchestra.run.trial045.stdout:rbd-nbd-19.2.3-679.gd855f53b.el9.x86_64.rpm 847 kB/s | 170 kB 00:00 2026-02-17T20:59:12.125 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:12.126 INFO:teuthology.orchestra.run.trial045.stdout:Total 842 kB/s | 170 kB 00:00 2026-02-17T20:59:12.126 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:59:12.129 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:59:12.129 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:59:12.162 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:59:12.162 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:59:12.218 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:59:12.234 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:12.316 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:12.329 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:12.373 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:12.373 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:12.373 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:59:12.373 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:12.374 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:12.374 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:12.393 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:12.404 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-base-debuginfo 2026-02-17T20:59:12.411 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:12.411 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:12.412 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:12.433 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr-rook 2026-02-17T20:59:12.715 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:00 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:12.745 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:12.799 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:12.799 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:12.799 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T20:59:12.799 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:12.799 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 72 M 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout:Installing dependencies: 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout: ceph-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 24 M 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout:Installing weak dependencies: 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout: ceph-debugsource x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout:Install 3 Packages 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:12.800 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 107 M 2026-02-17T20:59:12.801 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 654 M 2026-02-17T20:59:12.801 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:59:12.808 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-rook-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:12.826 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:12.826 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:12.827 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:12.847 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T20:59:13.162 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:13.227 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-cephadm-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:13.244 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:13.245 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:13.245 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:13.266 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-fuse 2026-02-17T20:59:13.580 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:13.662 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:13.663 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:13.663 INFO:teuthology.orchestra.run.trial092.stdout: Package Architecture Version Repository Size 2026-02-17T20:59:13.663 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:13.663 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:59:13.663 INFO:teuthology.orchestra.run.trial092.stdout: ceph-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.2 M 2026-02-17T20:59:13.663 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:13.663 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:59:13.664 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:13.664 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T20:59:13.664 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:13.664 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 1.2 M 2026-02-17T20:59:13.664 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 3.6 M 2026-02-17T20:59:13.664 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:59:14.284 INFO:teuthology.orchestra.run.trial092.stdout:ceph-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 1.9 MB/s | 1.2 MB 00:00 2026-02-17T20:59:14.285 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:14.285 INFO:teuthology.orchestra.run.trial092.stdout:Total 1.8 MB/s | 1.2 MB 00:00 2026-02-17T20:59:14.285 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:14.289 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:14.289 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:14.324 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:14.325 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:14.387 INFO:teuthology.orchestra.run.trial045.stdout:(1/3): ceph-debugsource-19.2.3-679.gd855f53b.el 6.8 MB/s | 11 MB 00:01 2026-02-17T20:59:14.425 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:59:14.442 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:14.663 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T20:59:14.677 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:14.682 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T20:59:14.706 INFO:teuthology.orchestra.run.trial045.stdout:(2/3): ceph-debuginfo-19.2.3-679.gd855f53b.el9. 13 MB/s | 24 MB 00:01 2026-02-17T20:59:14.734 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:14.734 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:14.735 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:59:14.735 INFO:teuthology.orchestra.run.trial092.stdout: ceph-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:14.735 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:14.735 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:14.763 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-volume 2026-02-17T20:59:15.081 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:15.145 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-volume-2:19.2.3-679.gd855f53b.el9.noarch is already installed. 2026-02-17T20:59:15.163 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:15.164 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:15.164 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:15.185 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install librados-devel 2026-02-17T20:59:15.235 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T20:59:15.235 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/3 2026-02-17T20:59:15.235 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T20:59:15.293 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 3/3 2026-02-17T20:59:15.293 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:15.293 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T20:59:15.293 INFO:teuthology.orchestra.run.trial138.stdout: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:15.293 INFO:teuthology.orchestra.run.trial138.stdout: ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:15.293 INFO:teuthology.orchestra.run.trial138.stdout: ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:15.293 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:15.294 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T20:59:15.334 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-common-debuginfo 2026-02-17T20:59:15.499 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:15.584 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:15.585 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:15.585 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T20:59:15.585 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:15.585 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:59:15.585 INFO:teuthology.orchestra.run.trial092.stdout: librados-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 126 k 2026-02-17T20:59:15.585 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:15.585 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:59:15.585 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:15.585 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T20:59:15.586 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:15.586 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 126 k 2026-02-17T20:59:15.586 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 456 k 2026-02-17T20:59:15.586 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:59:15.642 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T20:59:15.725 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T20:59:15.725 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:15.725 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T20:59:15.725 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:15.725 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T20:59:15.725 INFO:teuthology.orchestra.run.trial138.stdout: ceph-common-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 474 M 2026-02-17T20:59:15.725 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:15.726 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T20:59:15.726 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T20:59:15.726 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T20:59:15.726 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T20:59:15.726 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 474 M 2026-02-17T20:59:15.726 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 2.0 G 2026-02-17T20:59:15.726 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T20:59:15.845 INFO:teuthology.orchestra.run.trial092.stdout:librados-devel-19.2.3-679.gd855f53b.el9.x86_64. 488 kB/s | 126 kB 00:00 2026-02-17T20:59:15.845 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:15.846 INFO:teuthology.orchestra.run.trial092.stdout:Total 486 kB/s | 126 kB 00:00 2026-02-17T20:59:15.846 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:15.848 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:15.848 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:15.879 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:15.880 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:15.934 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:59:15.951 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:16.031 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:16.090 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:16.090 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:16.090 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:59:16.090 INFO:teuthology.orchestra.run.trial092.stdout: librados-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:16.090 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:16.090 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:16.119 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install libcephfs2 2026-02-17T20:59:16.438 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:16.502 INFO:teuthology.orchestra.run.trial092.stdout:Package libcephfs2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:16.520 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:16.520 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:16.521 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:16.541 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install libcephfs-devel 2026-02-17T20:59:16.855 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:16.938 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:16.939 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:16.939 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T20:59:16.939 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:16.939 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:59:16.939 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-devel x86_64 2:19.2.3-679.gd855f53b.el9 ceph 34 k 2026-02-17T20:59:16.939 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:16.939 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:59:16.939 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:16.940 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T20:59:16.940 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:16.940 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 34 k 2026-02-17T20:59:16.940 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 153 k 2026-02-17T20:59:16.940 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:59:17.113 INFO:teuthology.orchestra.run.trial092.stdout:libcephfs-devel-19.2.3-679.gd855f53b.el9.x86_64 192 kB/s | 34 kB 00:00 2026-02-17T20:59:17.115 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:17.115 INFO:teuthology.orchestra.run.trial092.stdout:Total 190 kB/s | 34 kB 00:00 2026-02-17T20:59:17.115 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:17.117 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:17.117 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:17.119 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:17.119 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:17.140 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:59:17.156 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:17.210 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:17.267 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:17.268 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:17.268 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:59:17.268 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-devel-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:17.268 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:17.268 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:17.294 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install librados2 2026-02-17T20:59:17.607 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:17.672 INFO:teuthology.orchestra.run.trial092.stdout:Package librados2-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:17.689 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:17.690 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:17.690 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:17.711 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install librbd1 2026-02-17T20:59:18.023 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:18.087 INFO:teuthology.orchestra.run.trial092.stdout:Package librbd1-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:18.105 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:18.106 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:18.106 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:18.127 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-rados 2026-02-17T20:59:18.440 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:18.504 INFO:teuthology.orchestra.run.trial092.stdout:Package python3-rados-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:18.522 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:18.522 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:18.522 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:18.543 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-rgw 2026-02-17T20:59:18.857 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:18.921 INFO:teuthology.orchestra.run.trial092.stdout:Package python3-rgw-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:18.939 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:18.939 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:18.939 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:18.960 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-cephfs 2026-02-17T20:59:19.271 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:19.334 INFO:teuthology.orchestra.run.trial092.stdout:Package python3-cephfs-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:19.352 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:19.352 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:19.352 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:19.374 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-rbd 2026-02-17T20:59:19.562 INFO:teuthology.orchestra.run.trial045.stdout:(3/3): ceph-base-debuginfo-19.2.3-679.gd855f53b 11 MB/s | 72 MB 00:06 2026-02-17T20:59:19.564 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:19.564 INFO:teuthology.orchestra.run.trial045.stdout:Total 16 MB/s | 107 MB 00:06 2026-02-17T20:59:19.565 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:59:19.569 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:59:19.570 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:59:19.684 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:19.748 INFO:teuthology.orchestra.run.trial092.stdout:Package python3-rbd-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T20:59:19.766 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:19.766 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T20:59:19.766 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:19.787 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install rbd-fuse 2026-02-17T20:59:19.951 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:59:19.951 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:59:20.103 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:20.184 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:20.185 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:20.185 INFO:teuthology.orchestra.run.trial092.stdout: Package Architecture Version Repository Size 2026-02-17T20:59:20.185 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:20.185 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:59:20.186 INFO:teuthology.orchestra.run.trial092.stdout: rbd-fuse x86_64 2:19.2.3-679.gd855f53b.el9 ceph 85 k 2026-02-17T20:59:20.186 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:20.186 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:59:20.186 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:20.186 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T20:59:20.186 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:20.186 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 85 k 2026-02-17T20:59:20.186 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 227 k 2026-02-17T20:59:20.186 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:59:20.483 INFO:teuthology.orchestra.run.trial092.stdout:rbd-fuse-19.2.3-679.gd855f53b.el9.x86_64.rpm 287 kB/s | 85 kB 00:00 2026-02-17T20:59:20.483 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:20.484 INFO:teuthology.orchestra.run.trial092.stdout:Total 286 kB/s | 85 kB 00:00 2026-02-17T20:59:20.484 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:20.487 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:20.487 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:20.518 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:20.519 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:20.569 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:59:20.586 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:20.665 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:20.722 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:20.722 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:20.722 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:59:20.722 INFO:teuthology.orchestra.run.trial092.stdout: rbd-fuse-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:20.722 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:20.722 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:20.750 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install rbd-mirror 2026-02-17T20:59:21.069 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:21.152 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:21.152 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:21.152 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T20:59:21.152 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout: rbd-mirror x86_64 2:19.2.3-679.gd855f53b.el9 ceph 3.1 M 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 3.1 M 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 13 M 2026-02-17T20:59:21.153 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:59:21.938 INFO:teuthology.orchestra.run.trial092.stdout:rbd-mirror-19.2.3-679.gd855f53b.el9.x86_64.rpm 4.0 MB/s | 3.1 MB 00:00 2026-02-17T20:59:21.939 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:21.939 INFO:teuthology.orchestra.run.trial092.stdout:Total 4.0 MB/s | 3.1 MB 00:00 2026-02-17T20:59:21.940 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:21.944 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:21.944 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:21.983 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:21.983 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:22.176 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:59:22.178 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:22.200 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:22.201 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:59:22.201 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T20:59:22.201 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:59:22.201 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:59:22.201 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:22.388 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T20:59:22.511 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:22.511 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:22.512 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:59:22.512 INFO:teuthology.orchestra.run.trial092.stdout: rbd-mirror-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:22.512 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:22.512 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:22.540 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install rbd-nbd 2026-02-17T20:59:22.853 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:22.937 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:22.937 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:22.937 INFO:teuthology.orchestra.run.trial092.stdout: Package Architecture Version Repository Size 2026-02-17T20:59:22.937 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:22.937 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:59:22.937 INFO:teuthology.orchestra.run.trial092.stdout: rbd-nbd x86_64 2:19.2.3-679.gd855f53b.el9 ceph 170 k 2026-02-17T20:59:22.937 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:22.937 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:59:22.938 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:22.938 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T20:59:22.938 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:22.938 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 170 k 2026-02-17T20:59:22.938 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 490 k 2026-02-17T20:59:22.938 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:59:23.045 INFO:teuthology.orchestra.run.trial092.stdout:rbd-nbd-19.2.3-679.gd855f53b.el9.x86_64.rpm 1.5 MB/s | 170 kB 00:00 2026-02-17T20:59:23.045 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:23.045 INFO:teuthology.orchestra.run.trial092.stdout:Total 1.5 MB/s | 170 kB 00:00 2026-02-17T20:59:23.046 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:23.049 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:23.049 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:23.081 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:23.081 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:23.137 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:59:23.154 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:23.235 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:23.292 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T20:59:23.292 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:23.292 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:59:23.292 INFO:teuthology.orchestra.run.trial092.stdout: rbd-nbd-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:23.293 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:23.293 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:23.321 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-base-debuginfo 2026-02-17T20:59:23.342 INFO:teuthology.orchestra.run.trial086.stdout:ceph-common-debuginfo-19.2.3-679.gd855f53b.el9. 32 MB/s | 474 MB 00:14 2026-02-17T20:59:23.342 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:23.342 INFO:teuthology.orchestra.run.trial086.stdout:Total 32 MB/s | 474 MB 00:14 2026-02-17T20:59:23.343 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:59:23.345 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:59:23.345 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:59:23.634 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:23.657 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 1/3 2026-02-17T20:59:23.716 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:23.717 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout: ceph-base-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 72 M 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout: ceph-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 24 M 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout:Installing weak dependencies: 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout: ceph-debugsource x86_64 2:19.2.3-679.gd855f53b.el9 ceph 11 M 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:59:23.718 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:23.719 INFO:teuthology.orchestra.run.trial092.stdout:Install 3 Packages 2026-02-17T20:59:23.719 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:23.719 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 107 M 2026-02-17T20:59:23.719 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 654 M 2026-02-17T20:59:23.719 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:59:24.836 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:59:24.836 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:59:25.121 INFO:teuthology.orchestra.run.trial092.stdout:(1/3): ceph-debugsource-19.2.3-679.gd855f53b.el 7.7 MB/s | 11 MB 00:01 2026-02-17T20:59:25.785 INFO:teuthology.orchestra.run.trial092.stdout:(2/3): ceph-debuginfo-19.2.3-679.gd855f53b.el9. 12 MB/s | 24 MB 00:02 2026-02-17T20:59:26.611 INFO:teuthology.orchestra.run.trial092.stdout:(3/3): ceph-base-debuginfo-19.2.3-679.gd855f53b 25 MB/s | 72 MB 00:02 2026-02-17T20:59:26.613 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:26.614 INFO:teuthology.orchestra.run.trial092.stdout:Total 37 MB/s | 107 MB 00:02 2026-02-17T20:59:26.614 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:26.618 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:26.618 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:26.996 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:26.996 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:27.352 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T20:59:27.371 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T20:59:27.872 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T20:59:27.872 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/3 2026-02-17T20:59:27.873 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T20:59:27.929 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 3/3 2026-02-17T20:59:27.929 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:27.930 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T20:59:27.930 INFO:teuthology.orchestra.run.trial045.stdout: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:27.930 INFO:teuthology.orchestra.run.trial045.stdout: ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:27.930 INFO:teuthology.orchestra.run.trial045.stdout: ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:27.930 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:27.930 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T20:59:27.969 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-common-debuginfo 2026-02-17T20:59:28.283 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:16 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T20:59:28.365 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T20:59:28.365 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:28.366 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T20:59:28.366 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:28.366 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T20:59:28.366 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 474 M 2026-02-17T20:59:28.366 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:28.366 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T20:59:28.366 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T20:59:28.366 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T20:59:28.366 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T20:59:28.367 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 474 M 2026-02-17T20:59:28.367 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 2.0 G 2026-02-17T20:59:28.367 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T20:59:29.421 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T20:59:30.703 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 1/3 2026-02-17T20:59:34.435 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T20:59:34.454 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T20:59:34.968 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 3/3 2026-02-17T20:59:34.968 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/3 2026-02-17T20:59:34.968 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2/3 2026-02-17T20:59:35.025 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 3/3 2026-02-17T20:59:35.025 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:35.025 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T20:59:35.025 INFO:teuthology.orchestra.run.trial092.stdout: ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:35.025 INFO:teuthology.orchestra.run.trial092.stdout: ceph-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:35.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-debugsource-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:35.026 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:35.026 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T20:59:35.067 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-common-debuginfo 2026-02-17T20:59:35.374 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:01:08 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T20:59:35.456 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout: ceph-common-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 474 M 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 474 M 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 2.0 G 2026-02-17T20:59:35.457 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T20:59:37.237 INFO:teuthology.orchestra.run.trial138.stdout:ceph-common-debuginfo-19.2.3-679.gd855f53b.el9. 22 MB/s | 474 MB 00:21 2026-02-17T20:59:37.237 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:37.238 INFO:teuthology.orchestra.run.trial138.stdout:Total 22 MB/s | 474 MB 00:21 2026-02-17T20:59:37.238 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T20:59:37.240 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T20:59:37.240 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T20:59:38.651 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T20:59:38.652 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T20:59:40.446 INFO:teuthology.orchestra.run.trial045.stdout:ceph-common-debuginfo-19.2.3-679.gd855f53b.el9. 39 MB/s | 474 MB 00:12 2026-02-17T20:59:40.447 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:40.448 INFO:teuthology.orchestra.run.trial045.stdout:Total 39 MB/s | 474 MB 00:12 2026-02-17T20:59:40.448 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T20:59:40.449 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T20:59:40.450 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T20:59:41.861 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T20:59:41.862 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T20:59:48.784 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:59:48.802 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T20:59:50.319 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T20:59:50.377 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T20:59:50.377 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:50.377 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:59:50.377 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:50.377 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:50.378 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:59:50.450 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T20:59:50.760 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:59:50.841 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:59:50.842 INFO:teuthology.orchestra.run.trial086.stdout:======================================================================================= 2026-02-17T20:59:50.842 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T20:59:50.842 INFO:teuthology.orchestra.run.trial086.stdout:======================================================================================= 2026-02-17T20:59:50.842 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:59:50.842 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.5 M 2026-02-17T20:59:50.842 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:50.842 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:59:50.843 INFO:teuthology.orchestra.run.trial086.stdout:======================================================================================= 2026-02-17T20:59:50.843 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:59:50.843 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:50.843 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 1.5 M 2026-02-17T20:59:50.843 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 7.6 M 2026-02-17T20:59:50.843 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:59:51.929 INFO:teuthology.orchestra.run.trial086.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 1.4 MB/s | 1.5 MB 00:01 2026-02-17T20:59:51.929 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:51.930 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.4 MB/s | 1.5 MB 00:01 2026-02-17T20:59:51.930 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:59:51.932 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:59:51.932 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:59:51.954 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:59:51.955 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T20:59:52.069 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T20:59:52.087 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T20:59:52.145 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T20:59:52.204 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T20:59:52.204 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:52.204 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T20:59:52.204 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T20:59:52.204 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:52.204 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T20:59:52.229 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T20:59:52.540 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T20:59:52.623 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T20:59:52.623 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:59:52.623 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T20:59:52.623 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 200 M 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 200 M 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 893 M 2026-02-17T20:59:52.624 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T20:59:53.336 INFO:teuthology.orchestra.run.trial092.stdout:ceph-common-debuginfo-19.2.3-679.gd855f53b.el9. 27 MB/s | 474 MB 00:17 2026-02-17T20:59:53.337 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:53.337 INFO:teuthology.orchestra.run.trial092.stdout:Total 27 MB/s | 474 MB 00:17 2026-02-17T20:59:53.337 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T20:59:53.339 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T20:59:53.339 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T20:59:54.749 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T20:59:54.749 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T20:59:58.678 INFO:teuthology.orchestra.run.trial086.stdout:ceph-radosgw-debuginfo-19.2.3-679.gd855f53b.el9 33 MB/s | 200 MB 00:06 2026-02-17T20:59:58.678 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:59:58.679 INFO:teuthology.orchestra.run.trial086.stdout:Total 33 MB/s | 200 MB 00:06 2026-02-17T20:59:58.679 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T20:59:58.681 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T20:59:58.681 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T20:59:59.283 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T20:59:59.283 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:00:02.188 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:00:02.207 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:00:03.739 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:00:03.797 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:00:03.797 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:03.797 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:00:03.797 INFO:teuthology.orchestra.run.trial138.stdout: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:03.797 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:03.797 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:00:03.869 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T21:00:04.182 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:00:04.265 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:00:04.265 INFO:teuthology.orchestra.run.trial138.stdout:======================================================================================= 2026-02-17T21:00:04.265 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:00:04.266 INFO:teuthology.orchestra.run.trial138.stdout:======================================================================================= 2026-02-17T21:00:04.266 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:00:04.266 INFO:teuthology.orchestra.run.trial138.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.5 M 2026-02-17T21:00:04.266 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:04.266 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:00:04.266 INFO:teuthology.orchestra.run.trial138.stdout:======================================================================================= 2026-02-17T21:00:04.266 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:00:04.266 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:04.266 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 1.5 M 2026-02-17T21:00:04.267 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 7.6 M 2026-02-17T21:00:04.267 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:00:04.413 INFO:teuthology.orchestra.run.trial138.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 10 MB/s | 1.5 MB 00:00 2026-02-17T21:00:04.414 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:00:04.414 INFO:teuthology.orchestra.run.trial138.stdout:Total 10 MB/s | 1.5 MB 00:00 2026-02-17T21:00:04.414 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:00:04.416 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:00:04.416 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:00:04.439 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:00:04.439 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:00:04.551 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:00:04.568 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:00:04.629 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:00:04.687 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:00:04.688 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:04.688 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:00:04.688 INFO:teuthology.orchestra.run.trial138.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:04.688 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:04.688 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:00:04.716 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T21:00:05.031 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:01:46 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:00:05.113 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:00:05.114 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:00:05.114 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:00:05.114 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:00:05.114 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:00:05.115 INFO:teuthology.orchestra.run.trial138.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 200 M 2026-02-17T21:00:05.115 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:05.115 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:00:05.115 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:00:05.115 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:00:05.115 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:05.115 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 200 M 2026-02-17T21:00:05.115 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 893 M 2026-02-17T21:00:05.115 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:00:05.385 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:00:05.403 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:00:06.911 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:00:06.969 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:00:06.969 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:06.969 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:00:06.969 INFO:teuthology.orchestra.run.trial045.stdout: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:06.969 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:06.969 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:00:07.040 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T21:00:07.357 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:55 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:00:07.439 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:00:07.439 INFO:teuthology.orchestra.run.trial045.stdout:======================================================================================= 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout:======================================================================================= 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.5 M 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout:======================================================================================= 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 1.5 M 2026-02-17T21:00:07.440 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 7.6 M 2026-02-17T21:00:07.441 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:00:08.631 INFO:teuthology.orchestra.run.trial045.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 1.3 MB/s | 1.5 MB 00:01 2026-02-17T21:00:08.631 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:00:08.631 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.3 MB/s | 1.5 MB 00:01 2026-02-17T21:00:08.631 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:00:08.633 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:00:08.633 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:00:08.655 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:00:08.655 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:00:08.768 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:00:08.785 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:00:08.843 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:00:08.900 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:00:08.900 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:08.900 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:00:08.900 INFO:teuthology.orchestra.run.trial045.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:08.900 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:08.901 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:00:08.927 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T21:00:08.969 INFO:teuthology.orchestra.run.trial138.stdout:ceph-radosgw-debuginfo-19.2.3-679.gd855f53b.el9 52 MB/s | 200 MB 00:03 2026-02-17T21:00:08.969 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:00:08.970 INFO:teuthology.orchestra.run.trial138.stdout:Total 52 MB/s | 200 MB 00:03 2026-02-17T21:00:08.970 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:00:08.972 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:00:08.972 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:00:09.239 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:01:57 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:00:09.321 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 200 M 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:00:09.322 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:09.323 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 200 M 2026-02-17T21:00:09.323 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 893 M 2026-02-17T21:00:09.323 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:00:09.579 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:00:09.579 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:00:09.703 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:00:09.721 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:10.394 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:10.452 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:10.452 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:00:10.452 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:00:10.452 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:10.453 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:00:10.453 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:00:10.498 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-test-debuginfo 2026-02-17T21:00:10.807 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:59 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:00:10.889 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:00:10.889 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:00:10.889 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 729 M 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 729 M 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 3.6 G 2026-02-17T21:00:10.890 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:00:13.482 INFO:teuthology.orchestra.run.trial045.stdout:ceph-radosgw-debuginfo-19.2.3-679.gd855f53b.el9 48 MB/s | 200 MB 00:04 2026-02-17T21:00:13.483 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:00:13.483 INFO:teuthology.orchestra.run.trial045.stdout:Total 48 MB/s | 200 MB 00:04 2026-02-17T21:00:13.483 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:00:13.485 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:00:13.485 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:00:14.091 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:00:14.091 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:00:18.223 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:00:18.241 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:00:19.759 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:00:19.817 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:00:19.818 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:19.818 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:00:19.818 INFO:teuthology.orchestra.run.trial092.stdout: ceph-common-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:19.818 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:19.818 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:00:19.838 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:00:19.856 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:19.896 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-17T21:00:20.212 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:01:53 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:00:20.294 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:00:20.295 INFO:teuthology.orchestra.run.trial092.stdout:======================================================================================= 2026-02-17T21:00:20.295 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:00:20.295 INFO:teuthology.orchestra.run.trial092.stdout:======================================================================================= 2026-02-17T21:00:20.295 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:00:20.295 INFO:teuthology.orchestra.run.trial092.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.5 M 2026-02-17T21:00:20.295 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:20.295 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:00:20.295 INFO:teuthology.orchestra.run.trial092.stdout:======================================================================================= 2026-02-17T21:00:20.296 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:00:20.296 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:20.296 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 1.5 M 2026-02-17T21:00:20.296 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 7.6 M 2026-02-17T21:00:20.296 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:00:20.431 INFO:teuthology.orchestra.run.trial092.stdout:ceph-immutable-object-cache-debuginfo-19.2.3-67 11 MB/s | 1.5 MB 00:00 2026-02-17T21:00:20.431 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:00:20.431 INFO:teuthology.orchestra.run.trial092.stdout:Total 11 MB/s | 1.5 MB 00:00 2026-02-17T21:00:20.431 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:00:20.433 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:00:20.433 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:00:20.456 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:00:20.456 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:00:20.559 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:20.571 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:00:20.588 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:00:20.616 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:20.616 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:20.617 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:00:20.617 INFO:teuthology.orchestra.run.trial138.stdout: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:20.617 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:20.617 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:00:20.646 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:00:20.660 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-test-debuginfo 2026-02-17T21:00:20.706 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.2.3-679.g 1/1 2026-02-17T21:00:20.706 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:20.706 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:00:20.706 INFO:teuthology.orchestra.run.trial092.stdout: ceph-immutable-object-cache-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:20.706 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:20.706 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:00:20.733 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-17T21:00:20.969 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:02:01 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:00:21.044 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:01:54 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:00:21.051 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:00:21.051 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:00:21.052 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:00:21.052 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:00:21.052 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:00:21.052 INFO:teuthology.orchestra.run.trial138.stdout: ceph-test-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 729 M 2026-02-17T21:00:21.052 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:21.052 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:00:21.052 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:00:21.052 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:00:21.052 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:00:21.053 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 729 M 2026-02-17T21:00:21.053 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 3.6 G 2026-02-17T21:00:21.053 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:00:21.128 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:00:21.129 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:00:21.129 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:00:21.129 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:00:21.129 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:00:21.129 INFO:teuthology.orchestra.run.trial092.stdout: ceph-radosgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 200 M 2026-02-17T21:00:21.129 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:21.129 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:00:21.129 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:00:21.129 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:00:21.130 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:21.130 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 200 M 2026-02-17T21:00:21.130 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 893 M 2026-02-17T21:00:21.130 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:00:24.321 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:00:24.338 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:25.017 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:25.075 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:25.075 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:25.076 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:00:25.076 INFO:teuthology.orchestra.run.trial045.stdout: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:25.076 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:25.076 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:00:25.119 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-test-debuginfo 2026-02-17T21:00:25.429 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:02:13 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:00:25.512 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:00:25.512 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:00:25.512 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:00:25.512 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:00:25.512 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:00:25.513 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 729 M 2026-02-17T21:00:25.513 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:25.513 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:00:25.513 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:00:25.513 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:00:25.513 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:00:25.513 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 729 M 2026-02-17T21:00:25.513 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 3.6 G 2026-02-17T21:00:25.513 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:00:35.266 INFO:teuthology.orchestra.run.trial092.stdout:ceph-radosgw-debuginfo-19.2.3-679.gd855f53b.el9 14 MB/s | 200 MB 00:14 2026-02-17T21:00:35.267 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:00:35.267 INFO:teuthology.orchestra.run.trial092.stdout:Total 14 MB/s | 200 MB 00:14 2026-02-17T21:00:35.267 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:00:35.269 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:00:35.269 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:00:35.873 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:00:35.873 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:00:45.909 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:00:45.926 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:46.604 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:46.662 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x8 1/1 2026-02-17T21:00:46.662 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:46.663 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:00:46.663 INFO:teuthology.orchestra.run.trial092.stdout: ceph-radosgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:00:46.663 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:46.663 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:00:46.706 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-test-debuginfo 2026-02-17T21:00:47.021 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:02:20 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:00:47.103 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:00:47.104 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:00:47.104 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:00:47.104 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:00:47.104 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:00:47.104 INFO:teuthology.orchestra.run.trial092.stdout: ceph-test-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 729 M 2026-02-17T21:00:47.104 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:47.105 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:00:47.105 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:00:47.105 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:00:47.105 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:00:47.105 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 729 M 2026-02-17T21:00:47.105 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 3.6 G 2026-02-17T21:00:47.105 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:00:51.897 INFO:teuthology.orchestra.run.trial138.stdout:ceph-test-debuginfo-19.2.3-679.gd855f53b.el9.x8 24 MB/s | 729 MB 00:30 2026-02-17T21:00:51.898 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:00:51.898 INFO:teuthology.orchestra.run.trial138.stdout:Total 24 MB/s | 729 MB 00:30 2026-02-17T21:00:51.898 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:00:51.901 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:00:51.901 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:00:54.059 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:00:54.059 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:00:56.355 INFO:teuthology.orchestra.run.trial086.stdout:ceph-test-debuginfo-19.2.3-679.gd855f53b.el9.x8 16 MB/s | 729 MB 00:45 2026-02-17T21:00:56.356 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:00:56.356 INFO:teuthology.orchestra.run.trial086.stdout:Total 16 MB/s | 729 MB 00:45 2026-02-17T21:00:56.356 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:00:56.358 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:00:56.359 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:00:58.515 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:00:58.515 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:01:10.425 INFO:teuthology.orchestra.run.trial045.stdout:ceph-test-debuginfo-19.2.3-679.gd855f53b.el9.x8 16 MB/s | 729 MB 00:44 2026-02-17T21:01:10.425 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:10.425 INFO:teuthology.orchestra.run.trial045.stdout:Total 16 MB/s | 729 MB 00:44 2026-02-17T21:01:10.425 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:01:10.429 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:01:10.429 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:01:12.584 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:01:12.584 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:01:27.489 INFO:teuthology.orchestra.run.trial092.stdout:ceph-test-debuginfo-19.2.3-679.gd855f53b.el9.x8 18 MB/s | 729 MB 00:40 2026-02-17T21:01:27.490 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:27.490 INFO:teuthology.orchestra.run.trial092.stdout:Total 18 MB/s | 729 MB 00:40 2026-02-17T21:01:27.491 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:01:27.493 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:01:27.493 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:01:29.660 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:01:29.660 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:01:31.902 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:01:31.922 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:01:33.007 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:01:33.065 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:01:33.065 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:33.065 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:01:33.065 INFO:teuthology.orchestra.run.trial138.stdout: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:33.065 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:33.065 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:01:33.160 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:01:33.471 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:03:14 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:01:33.535 INFO:teuthology.orchestra.run.trial138.stdout:Package ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:01:33.553 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:01:33.554 INFO:teuthology.orchestra.run.trial138.stdout:Nothing to do. 2026-02-17T21:01:33.554 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:01:33.576 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T21:01:33.887 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:03:14 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:01:33.969 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:01:33.969 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:33.969 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:01:33.969 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 18 M 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 18 M 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 110 M 2026-02-17T21:01:33.970 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:01:34.603 INFO:teuthology.orchestra.run.trial138.stdout:ceph-mgr-debuginfo-19.2.3-679.gd855f53b.el9.x86 28 MB/s | 18 MB 00:00 2026-02-17T21:01:34.604 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:34.604 INFO:teuthology.orchestra.run.trial138.stdout:Total 28 MB/s | 18 MB 00:00 2026-02-17T21:01:34.604 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:01:34.605 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:01:34.605 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:01:34.675 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:01:34.676 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:01:35.705 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:01:35.722 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:35.857 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:35.914 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:35.915 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:35.915 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:01:35.915 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:35.915 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:35.915 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:01:35.944 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T21:01:36.251 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:03:17 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:01:36.333 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:01:36.334 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:36.334 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:01:36.334 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:36.334 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:01:36.334 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:01:36.334 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:36.334 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:01:36.334 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:36.334 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:01:36.335 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:36.335 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 55 M 2026-02-17T21:01:36.335 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 211 M 2026-02-17T21:01:36.335 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:01:38.413 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:01:38.433 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:01:39.063 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:01:39.120 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:01:39.120 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:39.120 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:01:39.120 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:39.120 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:39.120 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:01:39.219 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:01:39.532 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:03:28 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:01:39.596 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:01:39.615 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:01:39.616 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-17T21:01:39.616 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:01:39.638 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T21:01:39.946 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:03:28 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:01:40.028 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:01:40.028 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:40.028 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 18 M 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 18 M 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 110 M 2026-02-17T21:01:40.029 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:01:40.992 INFO:teuthology.orchestra.run.trial086.stdout:ceph-mgr-debuginfo-19.2.3-679.gd855f53b.el9.x86 19 MB/s | 18 MB 00:00 2026-02-17T21:01:40.993 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:40.993 INFO:teuthology.orchestra.run.trial086.stdout:Total 19 MB/s | 18 MB 00:00 2026-02-17T21:01:40.993 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:01:40.995 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:01:40.995 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:01:41.065 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:01:41.065 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:01:41.356 INFO:teuthology.orchestra.run.trial138.stdout:ceph-mds-debuginfo-19.2.3-679.gd855f53b.el9.x86 11 MB/s | 55 MB 00:05 2026-02-17T21:01:41.356 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:41.357 INFO:teuthology.orchestra.run.trial138.stdout:Total 11 MB/s | 55 MB 00:05 2026-02-17T21:01:41.357 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:01:41.359 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:01:41.359 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:01:41.538 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:01:41.538 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:01:42.129 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:01:42.147 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:42.287 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:42.345 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:42.345 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:42.345 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:01:42.345 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:42.345 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:42.345 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:01:42.373 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T21:01:42.685 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:03:31 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:01:42.768 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:01:42.769 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:42.769 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:01:42.769 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:42.769 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:01:42.769 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:01:42.770 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:42.770 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:01:42.770 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:42.770 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:01:42.770 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:42.770 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 55 M 2026-02-17T21:01:42.770 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 211 M 2026-02-17T21:01:42.771 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:01:44.211 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:01:44.228 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:44.418 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:44.476 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:44.476 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:44.476 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:01:44.476 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:44.476 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:44.476 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:01:44.506 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T21:01:44.811 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:03:25 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:01:44.893 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 102 M 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 102 M 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 497 M 2026-02-17T21:01:44.894 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:01:45.621 INFO:teuthology.orchestra.run.trial086.stdout:ceph-mds-debuginfo-19.2.3-679.gd855f53b.el9.x86 19 MB/s | 55 MB 00:02 2026-02-17T21:01:45.622 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:45.622 INFO:teuthology.orchestra.run.trial086.stdout:Total 19 MB/s | 55 MB 00:02 2026-02-17T21:01:45.622 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:01:45.624 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:01:45.624 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:01:45.802 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:01:45.803 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:01:47.801 INFO:teuthology.orchestra.run.trial138.stdout:ceph-mon-debuginfo-19.2.3-679.gd855f53b.el9.x86 35 MB/s | 102 MB 00:02 2026-02-17T21:01:47.802 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:47.802 INFO:teuthology.orchestra.run.trial138.stdout:Total 35 MB/s | 102 MB 00:02 2026-02-17T21:01:47.802 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:01:47.804 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:01:47.804 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:01:48.119 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:01:48.120 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:01:48.484 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:01:48.501 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:48.703 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:48.760 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:48.761 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:48.761 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:01:48.761 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:48.761 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:48.761 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:01:48.792 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T21:01:49.099 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:03:38 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:01:49.182 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:01:49.182 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 102 M 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:49.183 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 102 M 2026-02-17T21:01:49.184 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 497 M 2026-02-17T21:01:49.184 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:01:50.499 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:01:50.519 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:01:50.857 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:01:50.916 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:01:50.916 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:50.916 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:01:50.916 INFO:teuthology.orchestra.run.trial045.stdout: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:50.916 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:50.916 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:01:51.012 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:01:51.183 INFO:teuthology.orchestra.run.trial086.stdout:ceph-mon-debuginfo-19.2.3-679.gd855f53b.el9.x86 51 MB/s | 102 MB 00:01 2026-02-17T21:01:51.184 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:51.184 INFO:teuthology.orchestra.run.trial086.stdout:Total 51 MB/s | 102 MB 00:02 2026-02-17T21:01:51.184 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:01:51.186 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:01:51.186 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:01:51.321 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:03:39 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:01:51.384 INFO:teuthology.orchestra.run.trial045.stdout:Package ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:01:51.403 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:01:51.403 INFO:teuthology.orchestra.run.trial045.stdout:Nothing to do. 2026-02-17T21:01:51.404 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:01:51.423 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T21:01:51.500 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:01:51.501 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:01:51.729 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:03:39 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:01:51.810 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:01:51.811 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:01:51.811 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:01:51.811 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:01:51.811 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:01:51.811 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 18 M 2026-02-17T21:01:51.811 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:51.812 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:01:51.812 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:01:51.812 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:01:51.812 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:51.812 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 18 M 2026-02-17T21:01:51.812 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 110 M 2026-02-17T21:01:51.812 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:01:52.247 INFO:teuthology.orchestra.run.trial045.stdout:ceph-mgr-debuginfo-19.2.3-679.gd855f53b.el9.x86 41 MB/s | 18 MB 00:00 2026-02-17T21:01:52.248 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:52.248 INFO:teuthology.orchestra.run.trial045.stdout:Total 41 MB/s | 18 MB 00:00 2026-02-17T21:01:52.248 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:01:52.250 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:01:52.250 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:01:52.320 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:01:52.320 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:01:53.320 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:01:53.335 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:01:53.337 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:53.353 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:53.488 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:53.546 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:53.547 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:53.547 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:01:53.547 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:53.547 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:53.547 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:01:53.576 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T21:01:53.733 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:53.792 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:53.792 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:53.792 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:01:53.792 INFO:teuthology.orchestra.run.trial138.stdout: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:53.792 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:53.793 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:01:53.827 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T21:01:53.886 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:03:41 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:01:53.970 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:01:53.970 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:53.971 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 55 M 2026-02-17T21:01:53.972 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 211 M 2026-02-17T21:01:53.972 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:01:54.139 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:03:35 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:01:54.220 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:01:54.221 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 298 M 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 298 M 2026-02-17T21:01:54.222 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 1.4 G 2026-02-17T21:01:54.223 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:01:55.155 INFO:teuthology.orchestra.run.trial045.stdout:ceph-mds-debuginfo-19.2.3-679.gd855f53b.el9.x86 47 MB/s | 55 MB 00:01 2026-02-17T21:01:55.156 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:01:55.156 INFO:teuthology.orchestra.run.trial045.stdout:Total 47 MB/s | 55 MB 00:01 2026-02-17T21:01:55.156 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:01:55.158 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:01:55.158 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:01:55.337 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:01:55.338 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:01:56.820 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:01:56.838 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:57.248 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:57.306 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:57.306 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:57.306 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:01:57.306 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:57.306 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:57.306 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:01:57.343 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T21:01:57.650 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:03:46 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:01:57.731 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:01:57.731 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:57.731 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:01:57.731 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:57.732 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:01:57.732 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 298 M 2026-02-17T21:01:57.732 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:57.732 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:01:57.732 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:01:57.732 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:01:57.732 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:01:57.733 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 298 M 2026-02-17T21:01:57.733 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 1.4 G 2026-02-17T21:01:57.733 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:01:58.005 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:01:58.023 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:58.239 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:58.300 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:01:58.300 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:58.300 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:01:58.301 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:01:58.301 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:58.301 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:01:58.331 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T21:01:58.644 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:03:46 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:01:58.726 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:01:58.727 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:01:58.727 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:01:58.727 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:01:58.727 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:01:58.727 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 102 M 2026-02-17T21:01:58.727 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:58.727 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:01:58.728 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:01:58.728 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:01:58.728 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:01:58.728 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 102 M 2026-02-17T21:01:58.728 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 497 M 2026-02-17T21:01:58.728 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:02:06.329 INFO:teuthology.orchestra.run.trial138.stdout:ceph-osd-debuginfo-19.2.3-679.gd855f53b.el9.x86 25 MB/s | 298 MB 00:12 2026-02-17T21:02:06.330 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:06.330 INFO:teuthology.orchestra.run.trial138.stdout:Total 25 MB/s | 298 MB 00:12 2026-02-17T21:02:06.330 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:06.331 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:06.332 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:06.399 INFO:teuthology.orchestra.run.trial045.stdout:ceph-mon-debuginfo-19.2.3-679.gd855f53b.el9.x86 13 MB/s | 102 MB 00:07 2026-02-17T21:02:06.399 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:06.399 INFO:teuthology.orchestra.run.trial045.stdout:Total 13 MB/s | 102 MB 00:07 2026-02-17T21:02:06.400 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:02:06.401 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:02:06.402 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:02:06.719 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:02:06.719 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:02:07.221 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:07.222 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:08.250 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:02:08.269 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:10.731 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:10.789 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:10.789 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:10.789 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:02:10.789 INFO:teuthology.orchestra.run.trial092.stdout: ceph-test-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:10.789 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:10.789 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:02:10.889 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-base-debuginfo 2026-02-17T21:02:11.204 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:03:44 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:02:11.268 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-base-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 is already installed. 2026-02-17T21:02:11.286 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:02:11.287 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T21:02:11.287 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:02:11.307 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr-debuginfo 2026-02-17T21:02:11.620 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:03:44 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:02:11.703 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:02:11.704 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:11.704 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:02:11.704 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:11.704 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:02:11.704 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 18 M 2026-02-17T21:02:11.704 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:11.705 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:02:11.705 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:11.705 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:02:11.705 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:11.705 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 18 M 2026-02-17T21:02:11.705 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 110 M 2026-02-17T21:02:11.705 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:02:11.928 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:02:11.946 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:12.218 INFO:teuthology.orchestra.run.trial092.stdout:ceph-mgr-debuginfo-19.2.3-679.gd855f53b.el9.x86 35 MB/s | 18 MB 00:00 2026-02-17T21:02:12.219 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:12.219 INFO:teuthology.orchestra.run.trial092.stdout:Total 35 MB/s | 18 MB 00:00 2026-02-17T21:02:12.219 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:02:12.221 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:02:12.221 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:02:12.291 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:02:12.292 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:02:12.357 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:12.416 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:12.416 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:12.416 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:02:12.416 INFO:teuthology.orchestra.run.trial045.stdout: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:12.416 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:12.416 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:02:12.451 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T21:02:12.762 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:00 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:02:12.844 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 298 M 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:02:12.845 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:12.846 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 298 M 2026-02-17T21:02:12.846 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 1.4 G 2026-02-17T21:02:12.846 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:02:13.310 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:02:13.328 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:13.466 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:13.525 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:13.526 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:13.526 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:02:13.526 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:13.526 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:13.526 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:02:13.555 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mds-debuginfo 2026-02-17T21:02:13.860 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:03:46 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:02:13.943 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:02:13.943 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:13.943 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:02:13.943 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:13.943 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:02:13.943 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mds-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:02:13.943 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:13.943 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:02:13.944 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:13.944 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:02:13.944 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:13.944 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 55 M 2026-02-17T21:02:13.944 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 211 M 2026-02-17T21:02:13.944 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:02:20.730 INFO:teuthology.orchestra.run.trial045.stdout:ceph-osd-debuginfo-19.2.3-679.gd855f53b.el9.x86 38 MB/s | 298 MB 00:07 2026-02-17T21:02:20.731 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:20.731 INFO:teuthology.orchestra.run.trial045.stdout:Total 38 MB/s | 298 MB 00:07 2026-02-17T21:02:20.731 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:02:20.733 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:02:20.733 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:02:20.935 INFO:teuthology.orchestra.run.trial092.stdout:ceph-mds-debuginfo-19.2.3-679.gd855f53b.el9.x86 7.9 MB/s | 55 MB 00:06 2026-02-17T21:02:20.936 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:20.936 INFO:teuthology.orchestra.run.trial092.stdout:Total 7.9 MB/s | 55 MB 00:06 2026-02-17T21:02:20.936 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:02:20.938 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:02:20.938 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:02:21.118 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:02:21.118 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:02:21.137 INFO:teuthology.orchestra.run.trial086.stdout:ceph-osd-debuginfo-19.2.3-679.gd855f53b.el9.x86 13 MB/s | 298 MB 00:23 2026-02-17T21:02:21.137 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:21.138 INFO:teuthology.orchestra.run.trial086.stdout:Total 13 MB/s | 298 MB 00:23 2026-02-17T21:02:21.138 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:02:21.140 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:02:21.140 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:02:21.627 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:02:21.627 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:02:22.032 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:02:22.033 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:02:22.224 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:22.241 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:23.263 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:23.321 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:23.321 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:23.321 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:23.321 INFO:teuthology.orchestra.run.trial138.stdout: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:23.321 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:23.322 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:23.377 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T21:02:23.687 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:04 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:23.769 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:23.769 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:23.769 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.8 M 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 6.8 M 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 36 M 2026-02-17T21:02:23.770 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:23.795 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:02:23.813 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:24.010 INFO:teuthology.orchestra.run.trial138.stdout:ceph-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x8 28 MB/s | 6.8 MB 00:00 2026-02-17T21:02:24.011 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:24.011 INFO:teuthology.orchestra.run.trial138.stdout:Total 28 MB/s | 6.8 MB 00:00 2026-02-17T21:02:24.011 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:24.013 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:24.013 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:24.023 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:24.050 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:24.050 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:24.080 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:24.080 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:24.080 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:02:24.080 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mds-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:24.080 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:24.081 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:02:24.112 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mon-debuginfo 2026-02-17T21:02:24.430 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:03:57 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:02:24.441 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:24.458 INFO:teuthology.orchestra.run.trial138.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:24.513 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:02:24.514 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:24.514 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:02:24.514 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mon-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 102 M 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 102 M 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 497 M 2026-02-17T21:02:24.515 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:02:24.541 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:24.599 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:24.599 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:24.599 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:24.599 INFO:teuthology.orchestra.run.trial138.stdout: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:24.599 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:24.599 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:24.625 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install librados-devel-debuginfo 2026-02-17T21:02:24.934 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:05 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:25.016 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:25.016 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:25.016 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout: librados-devel-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 112 k 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 112 k 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 493 k 2026-02-17T21:02:25.017 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:25.368 INFO:teuthology.orchestra.run.trial138.stdout:librados-devel-debuginfo-19.2.3-679.gd855f53b.e 319 kB/s | 112 kB 00:00 2026-02-17T21:02:25.368 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:25.368 INFO:teuthology.orchestra.run.trial138.stdout:Total 319 kB/s | 112 kB 00:00 2026-02-17T21:02:25.368 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:25.370 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:25.370 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:25.389 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:25.389 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:25.428 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:25.445 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:25.502 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:25.560 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:25.561 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:25.561 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:25.561 INFO:teuthology.orchestra.run.trial138.stdout: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:25.561 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:25.561 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:25.589 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T21:02:25.898 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:06 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:25.980 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:25.981 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:25.981 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.0 M 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 6.0 M 2026-02-17T21:02:25.982 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 31 M 2026-02-17T21:02:25.983 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:26.537 INFO:teuthology.orchestra.run.trial092.stdout:ceph-mon-debuginfo-19.2.3-679.gd855f53b.el9.x86 50 MB/s | 102 MB 00:02 2026-02-17T21:02:26.538 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:26.538 INFO:teuthology.orchestra.run.trial092.stdout:Total 50 MB/s | 102 MB 00:02 2026-02-17T21:02:26.538 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:02:26.540 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:02:26.540 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:02:26.857 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:02:26.857 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:02:27.084 INFO:teuthology.orchestra.run.trial138.stdout:libcephfs2-debuginfo-19.2.3-679.gd855f53b.el9.x 5.4 MB/s | 6.0 MB 00:01 2026-02-17T21:02:27.084 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:27.085 INFO:teuthology.orchestra.run.trial138.stdout:Total 5.4 MB/s | 6.0 MB 00:01 2026-02-17T21:02:27.085 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:27.086 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:27.087 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:27.122 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:27.122 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:27.469 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:27.486 INFO:teuthology.orchestra.run.trial138.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:27.565 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:27.623 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:27.624 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:27.624 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:27.624 INFO:teuthology.orchestra.run.trial138.stdout: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:27.624 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:27.624 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:27.651 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install librados2-debuginfo 2026-02-17T21:02:27.958 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:08 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:28.041 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:28.041 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:28.041 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:28.041 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:28.042 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:28.042 INFO:teuthology.orchestra.run.trial138.stdout: librados2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 47 M 2026-02-17T21:02:28.042 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:28.042 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:28.042 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:28.042 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:28.042 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:28.042 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 47 M 2026-02-17T21:02:28.042 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 302 M 2026-02-17T21:02:28.043 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:29.860 INFO:teuthology.orchestra.run.trial138.stdout:librados2-debuginfo-19.2.3-679.gd855f53b.el9.x8 26 MB/s | 47 MB 00:01 2026-02-17T21:02:29.860 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:29.860 INFO:teuthology.orchestra.run.trial138.stdout:Total 26 MB/s | 47 MB 00:01 2026-02-17T21:02:29.860 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:29.863 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:29.863 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:30.020 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:30.020 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:32.068 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:02:32.086 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:32.497 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:32.556 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:32.556 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:32.556 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:02:32.556 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mon-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:32.556 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:32.556 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:02:32.593 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-osd-debuginfo 2026-02-17T21:02:32.670 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:32.688 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:32.906 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:05 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:02:32.969 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:32.988 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 298 M 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:02:32.989 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:32.990 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 298 M 2026-02-17T21:02:32.990 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 1.4 G 2026-02-17T21:02:32.990 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:02:33.026 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:33.026 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:33.026 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:33.027 INFO:teuthology.orchestra.run.trial138.stdout: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:33.027 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:33.027 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:33.060 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install librbd1-debuginfo 2026-02-17T21:02:33.369 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:14 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout: librbd1-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:33.452 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:33.453 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 55 M 2026-02-17T21:02:33.453 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 374 M 2026-02-17T21:02:33.453 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:35.766 INFO:teuthology.orchestra.run.trial138.stdout:librbd1-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 24 MB/s | 55 MB 00:02 2026-02-17T21:02:35.767 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:35.767 INFO:teuthology.orchestra.run.trial138.stdout:Total 24 MB/s | 55 MB 00:02 2026-02-17T21:02:35.767 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:35.769 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:35.769 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:35.948 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:35.948 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:36.654 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:02:36.672 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:37.292 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:02:37.310 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:37.737 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:37.796 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:37.796 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:37.796 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:02:37.796 INFO:teuthology.orchestra.run.trial045.stdout: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:37.796 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:37.797 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:02:37.852 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T21:02:38.166 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:26 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:02:38.248 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:02:38.249 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:38.249 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.8 M 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 6.8 M 2026-02-17T21:02:38.250 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 36 M 2026-02-17T21:02:38.251 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:02:38.338 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:38.397 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:38.397 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:38.397 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:02:38.397 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:38.397 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:38.397 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:02:38.448 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T21:02:38.754 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:27 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:02:38.836 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:02:38.837 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:38.837 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:02:38.837 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:38.837 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:02:38.837 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.8 M 2026-02-17T21:02:38.837 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:38.837 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:02:38.838 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:38.838 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:02:38.838 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:38.838 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 6.8 M 2026-02-17T21:02:38.838 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 36 M 2026-02-17T21:02:38.838 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:02:39.096 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:39.113 INFO:teuthology.orchestra.run.trial138.stdout: Installing : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:39.224 INFO:teuthology.orchestra.run.trial045.stdout:ceph-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x8 7.0 MB/s | 6.8 MB 00:00 2026-02-17T21:02:39.225 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:39.226 INFO:teuthology.orchestra.run.trial045.stdout:Total 7.0 MB/s | 6.8 MB 00:00 2026-02-17T21:02:39.226 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:02:39.227 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:02:39.228 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:02:39.265 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:02:39.265 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:02:39.420 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:39.479 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:39.479 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:39.479 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:39.479 INFO:teuthology.orchestra.run.trial138.stdout: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:39.479 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:39.479 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:39.510 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T21:02:39.656 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:02:39.674 INFO:teuthology.orchestra.run.trial045.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:39.764 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:39.766 INFO:teuthology.orchestra.run.trial086.stdout:ceph-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x8 7.4 MB/s | 6.8 MB 00:00 2026-02-17T21:02:39.767 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:39.767 INFO:teuthology.orchestra.run.trial086.stdout:Total 7.4 MB/s | 6.8 MB 00:00 2026-02-17T21:02:39.767 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:02:39.768 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:02:39.769 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:02:39.806 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:02:39.806 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:02:39.820 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:20 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:39.823 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:39.823 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:39.823 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:02:39.824 INFO:teuthology.orchestra.run.trial045.stdout: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:39.824 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:39.824 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:02:39.851 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados-devel-debuginfo 2026-02-17T21:02:39.898 INFO:teuthology.orchestra.run.trial092.stdout:ceph-osd-debuginfo-19.2.3-679.gd855f53b.el9.x86 43 MB/s | 298 MB 00:06 2026-02-17T21:02:39.898 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:39.899 INFO:teuthology.orchestra.run.trial092.stdout:Total 43 MB/s | 298 MB 00:06 2026-02-17T21:02:39.899 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:02:39.901 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:02:39.901 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:02:39.902 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:39.903 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:39.903 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:39.903 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:39.903 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:39.903 INFO:teuthology.orchestra.run.trial138.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 629 k 2026-02-17T21:02:39.903 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:39.903 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:39.903 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:39.903 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:39.904 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:39.904 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 629 k 2026-02-17T21:02:39.904 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 2.1 M 2026-02-17T21:02:39.904 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:40.165 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:28 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:02:40.216 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:02:40.234 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:40.247 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:02:40.248 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:40.248 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:02:40.248 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:40.248 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:02:40.248 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 112 k 2026-02-17T21:02:40.248 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:40.248 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:02:40.248 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:40.248 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:02:40.249 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:40.249 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 112 k 2026-02-17T21:02:40.249 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 493 k 2026-02-17T21:02:40.249 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:02:40.317 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:40.374 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:40.375 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:40.375 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:02:40.375 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:40.375 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:40.375 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:02:40.401 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados-devel-debuginfo 2026-02-17T21:02:40.466 INFO:teuthology.orchestra.run.trial138.stdout:python3-cephfs-debuginfo-19.2.3-679.gd855f53b.e 1.1 MB/s | 629 kB 00:00 2026-02-17T21:02:40.467 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:40.467 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.1 MB/s | 629 kB 00:00 2026-02-17T21:02:40.467 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:40.469 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:40.469 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:40.488 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:40.489 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:40.552 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:40.569 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:40.614 INFO:teuthology.orchestra.run.trial045.stdout:librados-devel-debuginfo-19.2.3-679.gd855f53b.e 306 kB/s | 112 kB 00:00 2026-02-17T21:02:40.615 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:40.615 INFO:teuthology.orchestra.run.trial045.stdout:Total 305 kB/s | 112 kB 00:00 2026-02-17T21:02:40.615 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:02:40.617 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:02:40.617 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:02:40.624 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:40.634 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:02:40.634 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:02:40.673 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:02:40.681 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:40.682 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:40.682 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:40.682 INFO:teuthology.orchestra.run.trial138.stdout: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:40.682 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:40.682 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:40.690 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:40.707 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-rados-debuginfo 2026-02-17T21:02:40.708 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:29 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:02:40.745 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:40.789 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:02:40.790 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:40.790 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:02:40.790 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 112 k 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 112 k 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 493 k 2026-02-17T21:02:40.791 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:02:40.792 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:02:40.792 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:02:40.803 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:40.803 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:40.803 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:02:40.803 INFO:teuthology.orchestra.run.trial045.stdout: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:40.803 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:40.803 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:02:40.828 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T21:02:41.021 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:22 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:41.103 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:41.104 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:41.104 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout: python3-rados-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 778 k 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 778 k 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 2.8 M 2026-02-17T21:02:41.105 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:41.135 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:29 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:02:41.152 INFO:teuthology.orchestra.run.trial086.stdout:librados-devel-debuginfo-19.2.3-679.gd855f53b.e 310 kB/s | 112 kB 00:00 2026-02-17T21:02:41.152 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:41.153 INFO:teuthology.orchestra.run.trial086.stdout:Total 309 kB/s | 112 kB 00:00 2026-02-17T21:02:41.153 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:02:41.155 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:02:41.155 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:02:41.173 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:02:41.173 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:02:41.212 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:02:41.218 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:02:41.219 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:41.219 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:02:41.219 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:41.219 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:02:41.220 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.0 M 2026-02-17T21:02:41.220 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:41.220 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:02:41.220 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:41.220 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:02:41.220 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:41.220 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 6.0 M 2026-02-17T21:02:41.220 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 31 M 2026-02-17T21:02:41.220 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:02:41.229 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:41.283 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:41.340 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:41.340 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:41.340 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:02:41.340 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:41.341 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:41.341 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:02:41.366 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T21:02:41.592 INFO:teuthology.orchestra.run.trial138.stdout:python3-rados-debuginfo-19.2.3-679.gd855f53b.el 1.6 MB/s | 778 kB 00:00 2026-02-17T21:02:41.593 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:41.593 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.6 MB/s | 778 kB 00:00 2026-02-17T21:02:41.593 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:41.595 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:41.595 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:41.614 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:41.614 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:41.675 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:30 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:02:41.684 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:41.702 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:02:41.757 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:02:41.758 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:02:41.758 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:41.758 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.0 M 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 6.0 M 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 31 M 2026-02-17T21:02:41.759 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:02:41.815 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:02:41.815 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:41.816 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:41.816 INFO:teuthology.orchestra.run.trial138.stdout: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:41.816 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:41.816 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:41.842 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T21:02:42.158 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:23 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:42.240 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:42.241 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:42.241 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:42.241 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 1.1 M 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 4.3 M 2026-02-17T21:02:42.242 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:42.837 INFO:teuthology.orchestra.run.trial086.stdout:libcephfs2-debuginfo-19.2.3-679.gd855f53b.el9.x 5.5 MB/s | 6.0 MB 00:01 2026-02-17T21:02:42.838 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:42.838 INFO:teuthology.orchestra.run.trial086.stdout:Total 5.5 MB/s | 6.0 MB 00:01 2026-02-17T21:02:42.838 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:02:42.840 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:02:42.840 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:02:42.875 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:02:42.875 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:02:42.889 INFO:teuthology.orchestra.run.trial138.stdout:python3-rbd-debuginfo-19.2.3-679.gd855f53b.el9. 1.8 MB/s | 1.1 MB 00:00 2026-02-17T21:02:42.889 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:42.889 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.8 MB/s | 1.1 MB 00:00 2026-02-17T21:02:42.890 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:42.891 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:42.891 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:42.912 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:42.912 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:43.003 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:43.020 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:02:43.077 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:02:43.137 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:02:43.137 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:43.137 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:43.137 INFO:teuthology.orchestra.run.trial138.stdout: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:43.137 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:43.137 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:43.164 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T21:02:43.190 INFO:teuthology.orchestra.run.trial045.stdout:libcephfs2-debuginfo-19.2.3-679.gd855f53b.el9.x 3.0 MB/s | 6.0 MB 00:01 2026-02-17T21:02:43.191 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:43.191 INFO:teuthology.orchestra.run.trial045.stdout:Total 3.0 MB/s | 6.0 MB 00:01 2026-02-17T21:02:43.191 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:02:43.192 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:02:43.193 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:02:43.221 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:02:43.227 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:02:43.228 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:02:43.238 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:43.318 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:43.376 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:43.376 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:43.376 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:02:43.376 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:43.376 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:43.376 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:02:43.402 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados2-debuginfo 2026-02-17T21:02:43.477 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:24 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:43.561 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:43.562 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:43.562 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:43.562 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:43.562 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:43.562 INFO:teuthology.orchestra.run.trial138.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 339 k 2026-02-17T21:02:43.562 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:43.562 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:43.562 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:43.563 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:43.563 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:43.563 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 339 k 2026-02-17T21:02:43.563 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 1.0 M 2026-02-17T21:02:43.563 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:43.574 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:02:43.592 INFO:teuthology.orchestra.run.trial045.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:43.671 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:43.711 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:32 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:02:43.729 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:43.729 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:43.729 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:02:43.729 INFO:teuthology.orchestra.run.trial045.stdout: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:43.729 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:43.730 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:02:43.756 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librados2-debuginfo 2026-02-17T21:02:43.792 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:02:43.793 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:43.793 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout: librados2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 47 M 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 47 M 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 302 M 2026-02-17T21:02:43.794 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:02:44.067 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:32 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:02:44.150 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:02:44.151 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:44.151 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:02:44.151 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:44.151 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:02:44.152 INFO:teuthology.orchestra.run.trial045.stdout: librados2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 47 M 2026-02-17T21:02:44.152 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:44.152 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:02:44.152 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:44.152 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:02:44.152 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:44.152 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 47 M 2026-02-17T21:02:44.152 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 302 M 2026-02-17T21:02:44.152 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:02:44.180 INFO:teuthology.orchestra.run.trial138.stdout:python3-rgw-debuginfo-19.2.3-679.gd855f53b.el9. 549 kB/s | 339 kB 00:00 2026-02-17T21:02:44.180 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:44.181 INFO:teuthology.orchestra.run.trial138.stdout:Total 548 kB/s | 339 kB 00:00 2026-02-17T21:02:44.181 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:44.183 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:44.183 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:44.202 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:44.202 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:44.252 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:44.269 INFO:teuthology.orchestra.run.trial138.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:02:44.325 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:02:44.384 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:02:44.384 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:44.384 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:44.385 INFO:teuthology.orchestra.run.trial138.stdout: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:44.385 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:44.385 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:44.411 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T21:02:44.725 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:25 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:44.808 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:44.809 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:44.809 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:44.809 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:44.809 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:44.809 INFO:teuthology.orchestra.run.trial138.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 546 k 2026-02-17T21:02:44.809 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:44.809 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:44.809 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:44.810 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:44.810 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:44.810 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 546 k 2026-02-17T21:02:44.810 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 3.0 M 2026-02-17T21:02:44.810 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:45.498 INFO:teuthology.orchestra.run.trial138.stdout:rbd-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x86 794 kB/s | 546 kB 00:00 2026-02-17T21:02:45.498 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:45.498 INFO:teuthology.orchestra.run.trial138.stdout:Total 793 kB/s | 546 kB 00:00 2026-02-17T21:02:45.498 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:45.500 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:45.500 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:45.520 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:45.520 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:45.583 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:45.600 INFO:teuthology.orchestra.run.trial138.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:45.657 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:45.716 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:45.716 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:45.716 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:45.716 INFO:teuthology.orchestra.run.trial138.stdout: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:45.716 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:45.716 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:45.742 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T21:02:46.052 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:27 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:46.135 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:46.136 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:46.136 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:46.136 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:46.136 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:46.136 INFO:teuthology.orchestra.run.trial138.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 54 M 2026-02-17T21:02:46.136 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:46.136 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:46.137 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:46.137 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:46.137 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:46.137 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 54 M 2026-02-17T21:02:46.137 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 353 M 2026-02-17T21:02:46.137 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:49.479 INFO:teuthology.orchestra.run.trial138.stdout:rbd-mirror-debuginfo-19.2.3-679.gd855f53b.el9.x 16 MB/s | 54 MB 00:03 2026-02-17T21:02:49.480 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:49.480 INFO:teuthology.orchestra.run.trial138.stdout:Total 16 MB/s | 54 MB 00:03 2026-02-17T21:02:49.480 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:49.482 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:49.482 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:49.657 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:49.657 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:50.492 INFO:teuthology.orchestra.run.trial086.stdout:librados2-debuginfo-19.2.3-679.gd855f53b.el9.x8 7.0 MB/s | 47 MB 00:06 2026-02-17T21:02:50.493 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:50.493 INFO:teuthology.orchestra.run.trial086.stdout:Total 7.0 MB/s | 47 MB 00:06 2026-02-17T21:02:50.493 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:02:50.495 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:02:50.495 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:02:50.652 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:02:50.653 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:02:51.689 INFO:teuthology.orchestra.run.trial045.stdout:librados2-debuginfo-19.2.3-679.gd855f53b.el9.x8 6.3 MB/s | 47 MB 00:07 2026-02-17T21:02:51.690 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:51.690 INFO:teuthology.orchestra.run.trial045.stdout:Total 6.3 MB/s | 47 MB 00:07 2026-02-17T21:02:51.690 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:02:51.692 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:02:51.692 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:02:51.849 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:02:51.850 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:02:52.711 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:52.729 INFO:teuthology.orchestra.run.trial138.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:53.037 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:53.095 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:02:53.095 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:53.095 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:53.095 INFO:teuthology.orchestra.run.trial138.stdout: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:53.095 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:53.095 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:53.127 DEBUG:teuthology.orchestra.run.trial138:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T21:02:53.302 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:02:53.320 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:53.439 INFO:teuthology.orchestra.run.trial138.stdout:Last metadata expiration check: 0:04:34 ago on Tue 17 Feb 2026 08:58:19 PM UTC. 2026-02-17T21:02:53.521 INFO:teuthology.orchestra.run.trial138.stdout:Dependencies resolved. 2026-02-17T21:02:53.522 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:53.522 INFO:teuthology.orchestra.run.trial138.stdout: Package Arch Version Repo Size 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout:Installing: 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.4 M 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout:Transaction Summary 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout:================================================================================ 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout:Install 1 Package 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout:Total download size: 1.4 M 2026-02-17T21:02:53.523 INFO:teuthology.orchestra.run.trial138.stdout:Installed size: 6.6 M 2026-02-17T21:02:53.524 INFO:teuthology.orchestra.run.trial138.stdout:Downloading Packages: 2026-02-17T21:02:53.597 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:53.656 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:53.656 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:53.656 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:02:53.656 INFO:teuthology.orchestra.run.trial086.stdout: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:53.657 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:53.657 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:02:53.687 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librbd1-debuginfo 2026-02-17T21:02:53.992 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:42 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:02:54.075 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:02:54.076 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout: librbd1-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 55 M 2026-02-17T21:02:54.077 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 374 M 2026-02-17T21:02:54.078 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:02:54.454 INFO:teuthology.orchestra.run.trial138.stdout:rbd-nbd-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 1.5 MB/s | 1.4 MB 00:00 2026-02-17T21:02:54.455 INFO:teuthology.orchestra.run.trial138.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:54.456 INFO:teuthology.orchestra.run.trial138.stdout:Total 1.5 MB/s | 1.4 MB 00:00 2026-02-17T21:02:54.456 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction check 2026-02-17T21:02:54.458 INFO:teuthology.orchestra.run.trial138.stdout:Transaction check succeeded. 2026-02-17T21:02:54.458 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction test 2026-02-17T21:02:54.480 INFO:teuthology.orchestra.run.trial138.stdout:Transaction test succeeded. 2026-02-17T21:02:54.480 INFO:teuthology.orchestra.run.trial138.stdout:Running transaction 2026-02-17T21:02:54.498 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:02:54.516 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:54.585 INFO:teuthology.orchestra.run.trial138.stdout: Preparing : 1/1 2026-02-17T21:02:54.602 INFO:teuthology.orchestra.run.trial138.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:54.662 INFO:teuthology.orchestra.run.trial138.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:54.721 INFO:teuthology.orchestra.run.trial138.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:54.721 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:54.721 INFO:teuthology.orchestra.run.trial138.stdout:Installed: 2026-02-17T21:02:54.721 INFO:teuthology.orchestra.run.trial138.stdout: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:54.721 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:02:54.721 INFO:teuthology.orchestra.run.trial138.stdout:Complete! 2026-02-17T21:02:54.752 DEBUG:teuthology.parallel:result is None 2026-02-17T21:02:54.791 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:54.849 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:54.849 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:54.849 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:02:54.849 INFO:teuthology.orchestra.run.trial045.stdout: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:54.849 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:54.849 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:02:54.879 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install librbd1-debuginfo 2026-02-17T21:02:55.188 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:43 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:02:55.270 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:02:55.271 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:55.271 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:02:55.271 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:55.271 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:02:55.271 INFO:teuthology.orchestra.run.trial045.stdout: librbd1-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:02:55.271 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:55.271 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:02:55.272 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:02:55.272 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:02:55.272 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:02:55.272 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 55 M 2026-02-17T21:02:55.272 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 374 M 2026-02-17T21:02:55.272 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:02:56.104 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:02:56.122 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:56.734 INFO:teuthology.orchestra.run.trial086.stdout:librbd1-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 21 MB/s | 55 MB 00:02 2026-02-17T21:02:56.734 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:56.735 INFO:teuthology.orchestra.run.trial086.stdout:Total 21 MB/s | 55 MB 00:02 2026-02-17T21:02:56.735 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:02:56.736 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:02:56.737 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:02:56.916 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:02:56.916 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:02:57.183 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:57.241 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:02:57.241 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:57.242 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:02:57.242 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:57.242 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:57.242 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:02:57.295 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-fuse-debuginfo 2026-02-17T21:02:57.606 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:30 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:02:57.688 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:02:57.689 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:57.689 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:02:57.689 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:57.689 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:02:57.689 INFO:teuthology.orchestra.run.trial092.stdout: ceph-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.8 M 2026-02-17T21:02:57.689 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:57.689 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:02:57.689 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:57.690 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:02:57.690 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:57.690 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 6.8 M 2026-02-17T21:02:57.690 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 36 M 2026-02-17T21:02:57.690 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:02:58.105 INFO:teuthology.orchestra.run.trial045.stdout:librbd1-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 19 MB/s | 55 MB 00:02 2026-02-17T21:02:58.106 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:58.106 INFO:teuthology.orchestra.run.trial045.stdout:Total 19 MB/s | 55 MB 00:02 2026-02-17T21:02:58.106 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:02:58.109 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:02:58.109 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:02:58.289 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:02:58.290 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:02:58.354 INFO:teuthology.orchestra.run.trial092.stdout:ceph-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x8 10 MB/s | 6.8 MB 00:00 2026-02-17T21:02:58.355 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:58.355 INFO:teuthology.orchestra.run.trial092.stdout:Total 10 MB/s | 6.8 MB 00:00 2026-02-17T21:02:58.355 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:02:58.357 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:02:58.357 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:02:58.395 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:02:58.395 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:02:58.793 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:02:58.811 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:58.895 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:58.954 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:02:58.954 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:58.954 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:02:58.954 INFO:teuthology.orchestra.run.trial092.stdout: ceph-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:58.954 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:58.954 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:02:58.981 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install librados-devel-debuginfo 2026-02-17T21:02:59.295 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:32 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:02:59.377 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:02:59.378 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:59.378 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:02:59.378 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout: librados-devel-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 112 k 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 112 k 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 493 k 2026-02-17T21:02:59.379 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:02:59.739 INFO:teuthology.orchestra.run.trial092.stdout:librados-devel-debuginfo-19.2.3-679.gd855f53b.e 310 kB/s | 112 kB 00:00 2026-02-17T21:02:59.740 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:02:59.740 INFO:teuthology.orchestra.run.trial092.stdout:Total 309 kB/s | 112 kB 00:00 2026-02-17T21:02:59.741 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:02:59.742 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:02:59.742 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:02:59.760 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:02:59.761 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:02:59.800 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:02:59.817 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:59.872 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:59.929 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:02:59.929 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:59.929 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:02:59.929 INFO:teuthology.orchestra.run.trial092.stdout: librados-devel-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:02:59.930 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:02:59.930 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:02:59.955 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install libcephfs2-debuginfo 2026-02-17T21:03:00.056 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:03:00.074 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:00.263 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:33 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:00.345 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:00.346 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:00.346 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:00.346 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 6.0 M 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 6.0 M 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 31 M 2026-02-17T21:03:00.347 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:00.366 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:00.423 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:00.423 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:00.424 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:03:00.424 INFO:teuthology.orchestra.run.trial086.stdout: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:00.424 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:00.424 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:03:00.454 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T21:03:00.764 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:49 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:03:00.846 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:03:00.846 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:00.847 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:03:00.847 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:00.847 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:03:00.847 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 629 k 2026-02-17T21:03:00.847 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:00.847 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:03:00.847 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:00.847 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:03:00.847 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:00.848 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 629 k 2026-02-17T21:03:00.848 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 2.1 M 2026-02-17T21:03:00.848 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:03:01.474 INFO:teuthology.orchestra.run.trial086.stdout:python3-cephfs-debuginfo-19.2.3-679.gd855f53b.e 1.0 MB/s | 629 kB 00:00 2026-02-17T21:03:01.474 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:01.474 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.0 MB/s | 629 kB 00:00 2026-02-17T21:03:01.474 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:03:01.476 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:03:01.476 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:03:01.495 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:03:01.495 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:03:01.496 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:03:01.514 INFO:teuthology.orchestra.run.trial045.stdout: Installing : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:01.558 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:03:01.576 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:03:01.632 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:03:01.690 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:03:01.690 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:01.691 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:03:01.691 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:01.691 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:01.691 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:03:01.718 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rados-debuginfo 2026-02-17T21:03:01.846 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:01.904 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:01.904 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:01.905 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:03:01.905 INFO:teuthology.orchestra.run.trial045.stdout: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:01.905 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:01.905 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:03:01.936 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T21:03:01.936 INFO:teuthology.orchestra.run.trial092.stdout:libcephfs2-debuginfo-19.2.3-679.gd855f53b.el9.x 3.8 MB/s | 6.0 MB 00:01 2026-02-17T21:03:01.937 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:01.937 INFO:teuthology.orchestra.run.trial092.stdout:Total 3.8 MB/s | 6.0 MB 00:01 2026-02-17T21:03:01.938 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:01.939 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:01.939 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:01.974 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:01.974 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:02.024 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:51 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:03:02.106 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:03:02.107 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:02.108 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:03:02.108 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:02.108 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:03:02.108 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 778 k 2026-02-17T21:03:02.108 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:02.108 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:03:02.108 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:02.109 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:03:02.109 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:02.109 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 778 k 2026-02-17T21:03:02.109 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 2.8 M 2026-02-17T21:03:02.109 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:03:02.253 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:50 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:03:02.322 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:02.335 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:03:02.336 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:02.336 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:03:02.336 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:02.336 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:03:02.336 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 629 k 2026-02-17T21:03:02.336 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:02.336 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:03:02.336 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:02.337 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:03:02.337 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:02.337 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 629 k 2026-02-17T21:03:02.337 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 2.1 M 2026-02-17T21:03:02.337 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:03:02.340 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:02.420 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:02.478 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:02.478 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:02.478 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:02.478 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:02.478 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:02.478 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:02.505 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install librados2-debuginfo 2026-02-17T21:03:02.771 INFO:teuthology.orchestra.run.trial086.stdout:python3-rados-debuginfo-19.2.3-679.gd855f53b.el 1.1 MB/s | 778 kB 00:00 2026-02-17T21:03:02.771 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:02.772 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.1 MB/s | 778 kB 00:00 2026-02-17T21:03:02.772 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:03:02.773 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:03:02.773 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:03:02.792 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:03:02.793 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:03:02.801 INFO:teuthology.orchestra.run.trial045.stdout:python3-cephfs-debuginfo-19.2.3-679.gd855f53b.e 1.3 MB/s | 629 kB 00:00 2026-02-17T21:03:02.801 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:02.802 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.3 MB/s | 629 kB 00:00 2026-02-17T21:03:02.802 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:03:02.804 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:03:02.804 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:03:02.820 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:35 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:02.822 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:03:02.823 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:03:02.866 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:03:02.883 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:03:02.886 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:03:02.903 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:02.903 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:02.903 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout: librados2-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 47 M 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 47 M 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 302 M 2026-02-17T21:03:02.904 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:02.905 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:03:02.945 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:03:02.958 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:03:03.003 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:03:03.003 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:03.003 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:03:03.003 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:03.003 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:03.003 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:03:03.015 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:03:03.015 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:03.015 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:03:03.016 INFO:teuthology.orchestra.run.trial045.stdout: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:03.016 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:03.016 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:03:03.029 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T21:03:03.042 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rados-debuginfo 2026-02-17T21:03:03.334 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:52 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:03:03.353 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:51 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:03:03.417 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:03:03.418 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:03.418 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:03:03.418 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:03.418 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:03:03.418 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:03:03.418 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:03.419 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:03:03.419 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:03.419 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:03:03.419 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:03.419 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 1.1 M 2026-02-17T21:03:03.419 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 4.3 M 2026-02-17T21:03:03.419 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:03:03.436 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:03:03.436 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 778 k 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 778 k 2026-02-17T21:03:03.437 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 2.8 M 2026-02-17T21:03:03.438 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:03:04.244 INFO:teuthology.orchestra.run.trial045.stdout:python3-rados-debuginfo-19.2.3-679.gd855f53b.el 965 kB/s | 778 kB 00:00 2026-02-17T21:03:04.244 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:04.244 INFO:teuthology.orchestra.run.trial045.stdout:Total 964 kB/s | 778 kB 00:00 2026-02-17T21:03:04.244 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:03:04.245 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:03:04.246 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:03:04.264 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:03:04.265 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:03:04.336 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:03:04.354 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:03:04.409 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:03:04.430 INFO:teuthology.orchestra.run.trial092.stdout:librados2-debuginfo-19.2.3-679.gd855f53b.el9.x8 31 MB/s | 47 MB 00:01 2026-02-17T21:03:04.431 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:04.432 INFO:teuthology.orchestra.run.trial092.stdout:Total 31 MB/s | 47 MB 00:01 2026-02-17T21:03:04.432 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:04.433 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:04.434 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:04.454 INFO:teuthology.orchestra.run.trial086.stdout:python3-rbd-debuginfo-19.2.3-679.gd855f53b.el9. 1.1 MB/s | 1.1 MB 00:01 2026-02-17T21:03:04.455 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:04.455 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.1 MB/s | 1.1 MB 00:01 2026-02-17T21:03:04.455 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:03:04.457 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:03:04.457 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:03:04.467 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:03:04.467 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:04.468 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:03:04.468 INFO:teuthology.orchestra.run.trial045.stdout: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:04.468 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:04.468 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:03:04.477 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:03:04.478 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:03:04.494 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T21:03:04.567 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:03:04.584 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:04.592 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:04.592 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:04.641 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:04.699 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:04.699 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:04.699 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:03:04.699 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:04.699 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:04.699 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:03:04.725 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T21:03:04.805 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:52 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:03:04.888 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:03:04.888 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:04.889 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 1.1 M 2026-02-17T21:03:04.890 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 4.3 M 2026-02-17T21:03:04.890 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:03:05.032 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:54 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:03:05.114 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:03:05.115 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:05.115 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:03:05.115 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 339 k 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 339 k 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 1.0 M 2026-02-17T21:03:05.116 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:03:05.726 INFO:teuthology.orchestra.run.trial086.stdout:python3-rgw-debuginfo-19.2.3-679.gd855f53b.el9. 556 kB/s | 339 kB 00:00 2026-02-17T21:03:05.727 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:05.727 INFO:teuthology.orchestra.run.trial086.stdout:Total 554 kB/s | 339 kB 00:00 2026-02-17T21:03:05.727 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:03:05.729 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:03:05.729 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:03:05.747 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:03:05.747 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:03:05.796 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:03:05.814 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:05.826 INFO:teuthology.orchestra.run.trial045.stdout:python3-rbd-debuginfo-19.2.3-679.gd855f53b.el9. 1.2 MB/s | 1.1 MB 00:00 2026-02-17T21:03:05.828 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:05.828 INFO:teuthology.orchestra.run.trial045.stdout:Total 1.2 MB/s | 1.1 MB 00:00 2026-02-17T21:03:05.828 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:03:05.830 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:03:05.830 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:03:05.851 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:03:05.851 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:03:05.875 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:05.933 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:05.933 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:05.933 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:03:05.933 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:05.934 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:05.934 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:03:05.941 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:03:05.958 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:05.961 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T21:03:06.015 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:06.072 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:06.072 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:06.072 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:03:06.072 INFO:teuthology.orchestra.run.trial045.stdout: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:06.072 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:06.073 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:03:06.099 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T21:03:06.270 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:55 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:03:06.352 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:03:06.353 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:06.353 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:03:06.353 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:06.353 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:03:06.353 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 546 k 2026-02-17T21:03:06.353 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:06.353 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:03:06.353 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:06.354 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:03:06.354 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:06.354 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 546 k 2026-02-17T21:03:06.354 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 3.0 M 2026-02-17T21:03:06.354 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:03:06.414 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:54 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:03:06.496 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:03:06.497 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:06.497 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 339 k 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 339 k 2026-02-17T21:03:06.498 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 1.0 M 2026-02-17T21:03:06.499 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:03:06.924 INFO:teuthology.orchestra.run.trial086.stdout:rbd-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x86 956 kB/s | 546 kB 00:00 2026-02-17T21:03:06.925 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:06.925 INFO:teuthology.orchestra.run.trial086.stdout:Total 955 kB/s | 546 kB 00:00 2026-02-17T21:03:06.925 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:03:06.927 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:03:06.927 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:03:06.945 INFO:teuthology.orchestra.run.trial045.stdout:python3-rgw-debuginfo-19.2.3-679.gd855f53b.el9. 757 kB/s | 339 kB 00:00 2026-02-17T21:03:06.946 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:06.946 INFO:teuthology.orchestra.run.trial045.stdout:Total 756 kB/s | 339 kB 00:00 2026-02-17T21:03:06.946 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:03:06.947 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:03:06.947 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:03:06.948 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:03:06.948 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:03:06.967 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:03:06.967 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:03:07.010 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:03:07.016 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:03:07.027 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:07.033 INFO:teuthology.orchestra.run.trial045.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:07.084 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:07.088 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:07.142 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:07.142 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:07.142 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:03:07.142 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:07.142 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:07.142 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:03:07.146 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:07.146 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:07.146 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:03:07.146 INFO:teuthology.orchestra.run.trial045.stdout: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:07.146 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:07.146 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:03:07.169 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T21:03:07.173 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T21:03:07.288 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:07.306 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:03:07.475 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:04:56 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:03:07.484 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:55 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:03:07.557 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:03:07.558 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:07.558 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:03:07.558 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:07.558 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:03:07.558 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 54 M 2026-02-17T21:03:07.558 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:07.559 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:03:07.559 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:07.559 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:03:07.559 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:07.559 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 54 M 2026-02-17T21:03:07.559 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 353 M 2026-02-17T21:03:07.559 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:03:07.567 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:03:07.567 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:07.567 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 546 k 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 546 k 2026-02-17T21:03:07.568 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 3.0 M 2026-02-17T21:03:07.569 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:03:07.581 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:03:07.640 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_6 1/1 2026-02-17T21:03:07.640 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:07.641 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:07.641 INFO:teuthology.orchestra.run.trial092.stdout: librados2-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:07.641 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:07.641 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:07.671 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install librbd1-debuginfo 2026-02-17T21:03:07.984 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:40 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:08.066 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout: librbd1-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 55 M 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:08.067 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:08.068 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 55 M 2026-02-17T21:03:08.068 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 374 M 2026-02-17T21:03:08.068 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:08.237 INFO:teuthology.orchestra.run.trial045.stdout:rbd-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x86 816 kB/s | 546 kB 00:00 2026-02-17T21:03:08.238 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:08.238 INFO:teuthology.orchestra.run.trial045.stdout:Total 815 kB/s | 546 kB 00:00 2026-02-17T21:03:08.238 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:03:08.240 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:03:08.240 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:03:08.259 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:03:08.260 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:03:08.322 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:03:08.339 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:08.397 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:08.454 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:08.454 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:08.454 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:03:08.454 INFO:teuthology.orchestra.run.trial045.stdout: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:08.455 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:08.455 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:03:08.480 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T21:03:08.793 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:04:56 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:03:08.875 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:03:08.876 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:08.876 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:03:08.876 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:08.876 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:03:08.877 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 54 M 2026-02-17T21:03:08.877 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:08.877 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:03:08.877 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:08.877 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:03:08.877 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:08.877 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 54 M 2026-02-17T21:03:08.877 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 353 M 2026-02-17T21:03:08.877 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:03:10.272 INFO:teuthology.orchestra.run.trial092.stdout:librbd1-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 25 MB/s | 55 MB 00:02 2026-02-17T21:03:10.272 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:10.273 INFO:teuthology.orchestra.run.trial092.stdout:Total 25 MB/s | 55 MB 00:02 2026-02-17T21:03:10.273 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:10.274 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:10.275 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:10.453 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:10.453 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:11.837 INFO:teuthology.orchestra.run.trial045.stdout:rbd-mirror-debuginfo-19.2.3-679.gd855f53b.el9.x 18 MB/s | 54 MB 00:02 2026-02-17T21:03:11.838 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:11.838 INFO:teuthology.orchestra.run.trial045.stdout:Total 18 MB/s | 54 MB 00:02 2026-02-17T21:03:11.838 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:03:11.840 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:03:11.840 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:03:12.015 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:03:12.016 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:03:12.413 INFO:teuthology.orchestra.run.trial086.stdout:rbd-mirror-debuginfo-19.2.3-679.gd855f53b.el9.x 11 MB/s | 54 MB 00:04 2026-02-17T21:03:12.414 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:12.414 INFO:teuthology.orchestra.run.trial086.stdout:Total 11 MB/s | 54 MB 00:04 2026-02-17T21:03:12.414 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:03:12.416 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:03:12.416 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:03:12.591 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:03:12.591 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:03:13.641 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:13.659 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:13.991 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:14.050 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:14.050 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:14.050 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:14.051 INFO:teuthology.orchestra.run.trial092.stdout: librbd1-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:14.051 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:14.051 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:14.083 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-cephfs-debuginfo 2026-02-17T21:03:14.397 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:47 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:14.480 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:14.481 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:14.481 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:14.481 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:14.481 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:14.482 INFO:teuthology.orchestra.run.trial092.stdout: python3-cephfs-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 629 k 2026-02-17T21:03:14.482 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:14.482 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:14.482 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:14.482 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:14.482 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:14.482 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 629 k 2026-02-17T21:03:14.482 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 2.1 M 2026-02-17T21:03:14.482 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:14.782 INFO:teuthology.orchestra.run.trial092.stdout:python3-cephfs-debuginfo-19.2.3-679.gd855f53b.e 2.0 MB/s | 629 kB 00:00 2026-02-17T21:03:14.783 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:14.783 INFO:teuthology.orchestra.run.trial092.stdout:Total 2.0 MB/s | 629 kB 00:00 2026-02-17T21:03:14.783 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:14.785 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:14.785 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:14.804 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:14.804 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:14.870 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:14.888 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:03:14.948 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:03:15.006 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9. 1/1 2026-02-17T21:03:15.006 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:15.006 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:15.007 INFO:teuthology.orchestra.run.trial092.stdout: python3-cephfs-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:15.007 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:15.007 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:15.033 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-rados-debuginfo 2026-02-17T21:03:15.116 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:03:15.134 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:15.344 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:48 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:15.426 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:15.427 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:15.427 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:15.427 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:15.427 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:15.427 INFO:teuthology.orchestra.run.trial092.stdout: python3-rados-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 778 k 2026-02-17T21:03:15.427 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:15.427 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:15.427 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:15.427 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:15.428 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:15.428 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 778 k 2026-02-17T21:03:15.428 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 2.8 M 2026-02-17T21:03:15.428 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:15.445 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:15.503 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:15.503 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:15.503 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:03:15.503 INFO:teuthology.orchestra.run.trial045.stdout: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:15.504 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:15.504 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:03:15.533 DEBUG:teuthology.orchestra.run.trial045:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T21:03:15.535 INFO:teuthology.orchestra.run.trial092.stdout:python3-rados-debuginfo-19.2.3-679.gd855f53b.el 7.0 MB/s | 778 kB 00:00 2026-02-17T21:03:15.536 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:15.537 INFO:teuthology.orchestra.run.trial092.stdout:Total 6.9 MB/s | 778 kB 00:00 2026-02-17T21:03:15.537 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:15.538 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:15.538 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:15.557 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:15.557 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:15.629 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:15.630 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:03:15.646 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:03:15.648 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:15.708 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:03:15.768 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x 1/1 2026-02-17T21:03:15.768 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:15.768 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:15.768 INFO:teuthology.orchestra.run.trial092.stdout: python3-rados-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:15.768 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:15.768 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:15.795 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-rbd-debuginfo 2026-02-17T21:03:15.840 INFO:teuthology.orchestra.run.trial045.stdout:Last metadata expiration check: 0:05:03 ago on Tue 17 Feb 2026 08:58:12 PM UTC. 2026-02-17T21:03:15.923 INFO:teuthology.orchestra.run.trial045.stdout:Dependencies resolved. 2026-02-17T21:03:15.924 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:15.924 INFO:teuthology.orchestra.run.trial045.stdout: Package Arch Version Repo Size 2026-02-17T21:03:15.924 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:15.924 INFO:teuthology.orchestra.run.trial045.stdout:Installing: 2026-02-17T21:03:15.924 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.4 M 2026-02-17T21:03:15.924 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:15.924 INFO:teuthology.orchestra.run.trial045.stdout:Transaction Summary 2026-02-17T21:03:15.924 INFO:teuthology.orchestra.run.trial045.stdout:================================================================================ 2026-02-17T21:03:15.925 INFO:teuthology.orchestra.run.trial045.stdout:Install 1 Package 2026-02-17T21:03:15.925 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:15.925 INFO:teuthology.orchestra.run.trial045.stdout:Total download size: 1.4 M 2026-02-17T21:03:15.925 INFO:teuthology.orchestra.run.trial045.stdout:Installed size: 6.6 M 2026-02-17T21:03:15.925 INFO:teuthology.orchestra.run.trial045.stdout:Downloading Packages: 2026-02-17T21:03:15.946 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:16.004 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:16.004 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:16.004 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:03:16.004 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:16.004 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:16.005 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:03:16.038 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T21:03:16.042 INFO:teuthology.orchestra.run.trial045.stdout:rbd-nbd-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T21:03:16.042 INFO:teuthology.orchestra.run.trial045.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:16.042 INFO:teuthology.orchestra.run.trial045.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T21:03:16.043 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction check 2026-02-17T21:03:16.044 INFO:teuthology.orchestra.run.trial045.stdout:Transaction check succeeded. 2026-02-17T21:03:16.044 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction test 2026-02-17T21:03:16.065 INFO:teuthology.orchestra.run.trial045.stdout:Transaction test succeeded. 2026-02-17T21:03:16.066 INFO:teuthology.orchestra.run.trial045.stdout:Running transaction 2026-02-17T21:03:16.102 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:49 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:16.169 INFO:teuthology.orchestra.run.trial045.stdout: Preparing : 1/1 2026-02-17T21:03:16.185 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:16.185 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout: python3-rbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.1 M 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:16.186 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 1.1 M 2026-02-17T21:03:16.187 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 4.3 M 2026-02-17T21:03:16.187 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:16.187 INFO:teuthology.orchestra.run.trial045.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:16.245 INFO:teuthology.orchestra.run.trial045.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:16.303 INFO:teuthology.orchestra.run.trial045.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:16.303 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:16.303 INFO:teuthology.orchestra.run.trial045.stdout:Installed: 2026-02-17T21:03:16.303 INFO:teuthology.orchestra.run.trial045.stdout: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:16.303 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:16.304 INFO:teuthology.orchestra.run.trial045.stdout:Complete! 2026-02-17T21:03:16.304 INFO:teuthology.orchestra.run.trial092.stdout:python3-rbd-debuginfo-19.2.3-679.gd855f53b.el9. 9.7 MB/s | 1.1 MB 00:00 2026-02-17T21:03:16.305 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:16.305 INFO:teuthology.orchestra.run.trial092.stdout:Total 9.6 MB/s | 1.1 MB 00:00 2026-02-17T21:03:16.305 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:16.306 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:16.306 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:16.327 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:16.327 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:16.332 DEBUG:teuthology.parallel:result is None 2026-02-17T21:03:16.347 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:05:05 ago on Tue 17 Feb 2026 08:58:11 PM UTC. 2026-02-17T21:03:16.417 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:16.429 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-17T21:03:16.430 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:16.430 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-17T21:03:16.430 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:16.430 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-17T21:03:16.430 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.4 M 2026-02-17T21:03:16.430 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:16.431 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-17T21:03:16.431 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-17T21:03:16.431 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-17T21:03:16.431 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:16.431 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 1.4 M 2026-02-17T21:03:16.431 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 6.6 M 2026-02-17T21:03:16.431 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-17T21:03:16.435 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:16.493 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:16.548 INFO:teuthology.orchestra.run.trial086.stdout:rbd-nbd-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 11 MB/s | 1.4 MB 00:00 2026-02-17T21:03:16.549 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:16.549 INFO:teuthology.orchestra.run.trial086.stdout:Total 11 MB/s | 1.4 MB 00:00 2026-02-17T21:03:16.549 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-17T21:03:16.551 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-17T21:03:16.551 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-17T21:03:16.551 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:16.552 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:16.552 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:16.552 INFO:teuthology.orchestra.run.trial092.stdout: python3-rbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:16.552 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:16.552 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:16.572 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-17T21:03:16.572 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-17T21:03:16.577 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-rgw-debuginfo 2026-02-17T21:03:16.676 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-17T21:03:16.693 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:16.754 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:16.812 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:16.812 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:16.812 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-17T21:03:16.812 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:16.812 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:16.812 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-17T21:03:16.842 DEBUG:teuthology.parallel:result is None 2026-02-17T21:03:16.900 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:49 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:16.982 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:16.983 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:16.983 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:16.983 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:16.983 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:16.983 INFO:teuthology.orchestra.run.trial092.stdout: python3-rgw-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 339 k 2026-02-17T21:03:16.984 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:16.984 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:16.984 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:16.984 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:16.984 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:16.984 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 339 k 2026-02-17T21:03:16.984 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 1.0 M 2026-02-17T21:03:16.984 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:17.078 INFO:teuthology.orchestra.run.trial092.stdout:python3-rgw-debuginfo-19.2.3-679.gd855f53b.el9. 3.5 MB/s | 339 kB 00:00 2026-02-17T21:03:17.079 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:17.079 INFO:teuthology.orchestra.run.trial092.stdout:Total 3.5 MB/s | 339 kB 00:00 2026-02-17T21:03:17.079 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:17.080 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:17.081 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:17.099 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:17.099 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:17.149 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:17.167 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:17.222 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:17.280 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86 1/1 2026-02-17T21:03:17.280 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:17.280 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:17.281 INFO:teuthology.orchestra.run.trial092.stdout: python3-rgw-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:17.281 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:17.281 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:17.306 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install rbd-fuse-debuginfo 2026-02-17T21:03:17.616 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:50 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:17.698 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:17.699 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:17.699 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:17.699 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:17.699 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:17.699 INFO:teuthology.orchestra.run.trial092.stdout: rbd-fuse-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 546 k 2026-02-17T21:03:17.699 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:17.699 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:17.700 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:17.700 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:17.700 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:17.700 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 546 k 2026-02-17T21:03:17.700 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 3.0 M 2026-02-17T21:03:17.700 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:17.804 INFO:teuthology.orchestra.run.trial092.stdout:rbd-fuse-debuginfo-19.2.3-679.gd855f53b.el9.x86 5.1 MB/s | 546 kB 00:00 2026-02-17T21:03:17.805 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:17.805 INFO:teuthology.orchestra.run.trial092.stdout:Total 5.0 MB/s | 546 kB 00:00 2026-02-17T21:03:17.805 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:17.807 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:17.807 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:17.826 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:17.827 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:17.891 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:17.911 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:17.973 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:18.032 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:18.032 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:18.032 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:18.032 INFO:teuthology.orchestra.run.trial092.stdout: rbd-fuse-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:18.032 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:18.032 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:18.060 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install rbd-mirror-debuginfo 2026-02-17T21:03:18.374 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:51 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:18.456 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:18.457 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:18.457 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:18.457 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:18.457 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:18.457 INFO:teuthology.orchestra.run.trial092.stdout: rbd-mirror-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 54 M 2026-02-17T21:03:18.457 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:18.457 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:18.457 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:18.458 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:18.458 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:18.458 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 54 M 2026-02-17T21:03:18.458 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 353 M 2026-02-17T21:03:18.458 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:19.557 INFO:teuthology.orchestra.run.trial092.stdout:rbd-mirror-debuginfo-19.2.3-679.gd855f53b.el9.x 49 MB/s | 54 MB 00:01 2026-02-17T21:03:19.558 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:19.558 INFO:teuthology.orchestra.run.trial092.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-17T21:03:19.558 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:19.560 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:19.560 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:19.736 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:19.736 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:22.919 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:22.936 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:23.245 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:23.304 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_ 1/1 2026-02-17T21:03:23.304 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:23.305 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:23.305 INFO:teuthology.orchestra.run.trial092.stdout: rbd-mirror-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:23.305 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:23.305 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:23.338 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install rbd-nbd-debuginfo 2026-02-17T21:03:23.648 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:04:56 ago on Tue 17 Feb 2026 08:58:27 PM UTC. 2026-02-17T21:03:23.730 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T21:03:23.731 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:23.731 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T21:03:23.731 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:23.731 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T21:03:23.731 INFO:teuthology.orchestra.run.trial092.stdout: rbd-nbd-debuginfo x86_64 2:19.2.3-679.gd855f53b.el9 ceph 1.4 M 2026-02-17T21:03:23.732 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:23.732 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T21:03:23.732 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T21:03:23.732 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T21:03:23.732 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:23.732 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 1.4 M 2026-02-17T21:03:23.732 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 6.6 M 2026-02-17T21:03:23.732 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T21:03:25.136 INFO:teuthology.orchestra.run.trial092.stdout:rbd-nbd-debuginfo-19.2.3-679.gd855f53b.el9.x86_ 987 kB/s | 1.4 MB 00:01 2026-02-17T21:03:25.137 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:03:25.137 INFO:teuthology.orchestra.run.trial092.stdout:Total 986 kB/s | 1.4 MB 00:01 2026-02-17T21:03:25.137 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T21:03:25.139 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T21:03:25.139 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T21:03:25.161 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T21:03:25.161 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T21:03:25.266 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T21:03:25.283 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:25.346 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:25.405 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 1/1 2026-02-17T21:03:25.406 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:25.406 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T21:03:25.406 INFO:teuthology.orchestra.run.trial092.stdout: rbd-nbd-debuginfo-2:19.2.3-679.gd855f53b.el9.x86_64 2026-02-17T21:03:25.406 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:25.406 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T21:03:25.436 DEBUG:teuthology.parallel:result is None 2026-02-17T21:03:25.437 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:03:25.604 DEBUG:teuthology.orchestra.run.trial045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T21:03:25.625 INFO:teuthology.orchestra.run.trial045.stdout:19.2.3-679.gd855f53b.el9 2026-02-17T21:03:25.626 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-679.gd855f53b.el9 2026-02-17T21:03:25.626 INFO:teuthology.task.install:The correct ceph version 19.2.3-679.gd855f53b is installed. 2026-02-17T21:03:25.629 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:03:25.784 DEBUG:teuthology.orchestra.run.trial086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T21:03:25.805 INFO:teuthology.orchestra.run.trial086.stdout:19.2.3-679.gd855f53b.el9 2026-02-17T21:03:25.805 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-679.gd855f53b.el9 2026-02-17T21:03:25.805 INFO:teuthology.task.install:The correct ceph version 19.2.3-679.gd855f53b is installed. 2026-02-17T21:03:25.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:03:25.950 DEBUG:teuthology.orchestra.run.trial092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T21:03:25.970 INFO:teuthology.orchestra.run.trial092.stdout:19.2.3-679.gd855f53b.el9 2026-02-17T21:03:25.970 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-679.gd855f53b.el9 2026-02-17T21:03:25.970 INFO:teuthology.task.install:The correct ceph version 19.2.3-679.gd855f53b is installed. 2026-02-17T21:03:25.972 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d855f53b89fdcec760fd9232a5fb55ed4fb111a1 2026-02-17T21:03:26.115 DEBUG:teuthology.orchestra.run.trial138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T21:03:26.137 INFO:teuthology.orchestra.run.trial138.stdout:19.2.3-679.gd855f53b.el9 2026-02-17T21:03:26.137 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-679.gd855f53b.el9 2026-02-17T21:03:26.137 INFO:teuthology.task.install:The correct ceph version 19.2.3-679.gd855f53b is installed. 2026-02-17T21:03:26.139 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T21:03:26.139 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:26.140 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T21:03:26.165 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:03:26.165 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T21:03:26.192 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:03:26.192 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T21:03:26.218 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:03:26.218 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T21:03:26.245 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T21:03:26.245 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:26.245 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T21:03:26.270 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T21:03:26.334 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:03:26.335 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T21:03:26.360 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T21:03:26.425 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:03:26.425 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T21:03:26.451 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T21:03:26.516 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:03:26.517 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T21:03:26.543 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T21:03:26.607 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T21:03:26.608 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:26.608 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T21:03:26.633 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T21:03:26.697 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:03:26.698 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T21:03:26.728 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T21:03:26.795 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:03:26.795 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T21:03:26.820 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T21:03:26.883 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:03:26.883 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T21:03:26.908 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T21:03:26.972 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T21:03:26.972 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:26.972 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T21:03:26.998 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T21:03:27.062 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:03:27.062 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T21:03:27.088 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T21:03:27.153 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:03:27.153 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T21:03:27.178 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T21:03:27.243 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:03:27.243 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T21:03:27.269 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T21:03:27.334 INFO:teuthology.run_tasks:Running task ceph... 2026-02-17T21:03:27.450 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-17T21:03:27.451 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 777 /var/log/ceph 2026-02-17T21:03:27.452 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 777 /var/log/ceph 2026-02-17T21:03:27.454 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod 777 /var/log/ceph 2026-02-17T21:03:27.456 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod 777 /var/log/ceph 2026-02-17T21:03:27.480 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-17T21:03:27.480 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T21:03:27.516 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T21:03:27.520 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T21:03:27.522 DEBUG:teuthology.orchestra.run.trial138:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-17T21:03:27.545 INFO:tasks.ceph:Creating extra log directories... 2026-02-17T21:03:27.545 DEBUG:teuthology.orchestra.run.trial045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T21:03:27.581 DEBUG:teuthology.orchestra.run.trial086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T21:03:27.584 DEBUG:teuthology.orchestra.run.trial092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T21:03:27.586 DEBUG:teuthology.orchestra.run.trial138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-17T21:03:27.630 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-17T21:03:27.630 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-17T21:03:27.631 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862', 'branch': 'wip-yuri6-testing-2026-02-17-1732-squid', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '53862', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2026-02-17-1732-squid'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result'], 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2026-02-17-1732-squid', 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 2987, 'sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2026-02-17-1732-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'd855f53b89fdcec760fd9232a5fb55ed4fb111a1', 'targets': {'trial045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMy3NDbAmRHB66y1kYnnM2aRn2XHhqj7GBvGDOLK/MqRCqQY1iiEW5L5g8mqZuhv4qPDSZdTUVnyOJKesDRQaUk=', 'trial086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGrUuo7j8DH2/wxmBcXNaiA2+IT6d975xOi5sioHy46TAV/LQf4jHP50YeC/xAz89qwBUY4sgx0TpgCAXp4YMnE=', 'trial092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO43lVmkaPCgv38RI3n76MgHsjnbj33CU5JMyM8Vwo4NVNrNOJvYNdKV9DulJgFLK2zXSGEjr2EXR3hnGPLeK8M=', 'trial138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVBea1YBDNgKDpnfI4xh9Nz1LeiU35ArFO3XM8l0ezkRBC7ijCpSXlXS3SksNXK8MVclAui0okoYW9NvbnwmyI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': '5f66ecfb34c0370410e78b3ee641753d19da653b', 'timestamp': '2026-02-17_20:43:43', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-17T21:03:27.631 DEBUG:teuthology.orchestra.run.trial045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T21:03:27.646 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T21:03:27.649 DEBUG:teuthology.orchestra.run.trial092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T21:03:27.651 DEBUG:teuthology.orchestra.run.trial138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-17T21:03:27.668 DEBUG:teuthology.orchestra.run.trial045:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T21:03:27.702 DEBUG:teuthology.orchestra.run.trial086:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T21:03:27.705 DEBUG:teuthology.orchestra.run.trial092:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T21:03:27.708 DEBUG:teuthology.orchestra.run.trial138:> sudo install -d -m0777 -- /var/run/ceph 2026-02-17T21:03:27.734 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:27.735 DEBUG:teuthology.orchestra.run.trial045:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T21:03:27.784 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T21:03:27.784 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_1 2026-02-17T21:03:27.840 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T21:03:27.840 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:27.840 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-17T21:03:27.840 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:27.841 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:27.841 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-17 20:59:11.326749803 +0000 2026-02-17T21:03:27.841 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-17 20:58:19.753091566 +0000 2026-02-17T21:03:27.841 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-17 20:58:19.753091566 +0000 2026-02-17T21:03:27.841 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-17 20:58:19.753091566 +0000 2026-02-17T21:03:27.841 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T21:03:27.903 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-17T21:03:27.903 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-17T21:03:27.903 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000152592 s, 3.4 MB/s 2026-02-17T21:03:27.905 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T21:03:27.961 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_2 2026-02-17T21:03:28.019 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T21:03:28.019 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:28.019 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 1290 Links: 1 2026-02-17T21:03:28.019 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:28.019 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:28.019 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-17 20:59:11.327749780 +0000 2026-02-17T21:03:28.020 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-17 20:58:19.753091566 +0000 2026-02-17T21:03:28.020 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-17 20:58:19.753091566 +0000 2026-02-17T21:03:28.020 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-17 20:58:19.753091566 +0000 2026-02-17T21:03:28.020 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T21:03:28.082 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-17T21:03:28.082 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-17T21:03:28.082 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000136502 s, 3.8 MB/s 2026-02-17T21:03:28.084 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T21:03:28.140 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_3 2026-02-17T21:03:28.199 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T21:03:28.199 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:28.199 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-17T21:03:28.199 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:28.199 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:28.199 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-17 20:59:11.327749780 +0000 2026-02-17T21:03:28.199 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-17 20:58:19.753091566 +0000 2026-02-17T21:03:28.200 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-17 20:58:19.753091566 +0000 2026-02-17T21:03:28.200 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-17 20:58:19.753091566 +0000 2026-02-17T21:03:28.200 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T21:03:28.262 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-17T21:03:28.262 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-17T21:03:28.262 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000142894 s, 3.6 MB/s 2026-02-17T21:03:28.264 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T21:03:28.320 DEBUG:teuthology.orchestra.run.trial045:> stat /dev/vg_nvme/lv_4 2026-02-17T21:03:28.377 INFO:teuthology.orchestra.run.trial045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T21:03:28.377 INFO:teuthology.orchestra.run.trial045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:28.377 INFO:teuthology.orchestra.run.trial045.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-17T21:03:28.377 INFO:teuthology.orchestra.run.trial045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:28.377 INFO:teuthology.orchestra.run.trial045.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:28.377 INFO:teuthology.orchestra.run.trial045.stdout:Access: 2026-02-17 20:59:11.327749780 +0000 2026-02-17T21:03:28.377 INFO:teuthology.orchestra.run.trial045.stdout:Modify: 2026-02-17 20:58:19.754091541 +0000 2026-02-17T21:03:28.378 INFO:teuthology.orchestra.run.trial045.stdout:Change: 2026-02-17 20:58:19.754091541 +0000 2026-02-17T21:03:28.378 INFO:teuthology.orchestra.run.trial045.stdout: Birth: 2026-02-17 20:58:19.754091541 +0000 2026-02-17T21:03:28.378 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T21:03:28.439 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records in 2026-02-17T21:03:28.439 INFO:teuthology.orchestra.run.trial045.stderr:1+0 records out 2026-02-17T21:03:28.439 INFO:teuthology.orchestra.run.trial045.stderr:512 bytes copied, 0.000142223 s, 3.6 MB/s 2026-02-17T21:03:28.440 DEBUG:teuthology.orchestra.run.trial045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T21:03:28.499 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:28.499 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:03:28.500 DEBUG:teuthology.orchestra.run.trial086:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T21:03:28.518 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T21:03:28.518 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_1 2026-02-17T21:03:28.576 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T21:03:28.576 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:28.576 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-17T21:03:28.576 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:28.576 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:28.576 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-17 20:58:55.543639033 +0000 2026-02-17T21:03:28.577 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-17 20:58:17.666566431 +0000 2026-02-17T21:03:28.577 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-17 20:58:17.666566431 +0000 2026-02-17T21:03:28.577 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-17 20:58:17.666566431 +0000 2026-02-17T21:03:28.577 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T21:03:28.639 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-17T21:03:28.639 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-17T21:03:28.639 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000221014 s, 2.3 MB/s 2026-02-17T21:03:28.641 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T21:03:28.699 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_2 2026-02-17T21:03:28.755 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T21:03:28.755 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:28.755 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-17T21:03:28.756 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:28.756 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:28.756 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-17 20:58:55.543639033 +0000 2026-02-17T21:03:28.756 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-17 20:58:17.666566431 +0000 2026-02-17T21:03:28.756 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-17 20:58:17.666566431 +0000 2026-02-17T21:03:28.756 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-17 20:58:17.666566431 +0000 2026-02-17T21:03:28.756 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T21:03:28.819 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-17T21:03:28.819 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-17T21:03:28.819 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000208801 s, 2.5 MB/s 2026-02-17T21:03:28.821 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T21:03:28.877 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_3 2026-02-17T21:03:28.934 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T21:03:28.934 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:28.934 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-17T21:03:28.934 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:28.935 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:28.935 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-17 20:58:55.543639033 +0000 2026-02-17T21:03:28.935 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-17 20:58:17.666566431 +0000 2026-02-17T21:03:28.935 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-17 20:58:17.666566431 +0000 2026-02-17T21:03:28.935 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-17 20:58:17.666566431 +0000 2026-02-17T21:03:28.935 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T21:03:28.995 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-17T21:03:28.996 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-17T21:03:28.996 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000171691 s, 3.0 MB/s 2026-02-17T21:03:28.997 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T21:03:29.053 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_4 2026-02-17T21:03:29.111 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T21:03:29.112 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:29.112 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-17T21:03:29.112 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:29.112 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:29.112 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-17 20:58:55.543639033 +0000 2026-02-17T21:03:29.112 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-17 20:58:17.665566455 +0000 2026-02-17T21:03:29.112 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-17 20:58:17.665566455 +0000 2026-02-17T21:03:29.112 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-17 20:58:17.665566455 +0000 2026-02-17T21:03:29.113 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T21:03:29.174 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-17T21:03:29.175 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-17T21:03:29.175 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000129673 s, 3.9 MB/s 2026-02-17T21:03:29.176 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T21:03:29.235 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:29.235 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:03:29.235 DEBUG:teuthology.orchestra.run.trial092:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T21:03:29.254 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T21:03:29.254 DEBUG:teuthology.orchestra.run.trial092:> stat /dev/vg_nvme/lv_1 2026-02-17T21:03:29.312 INFO:teuthology.orchestra.run.trial092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T21:03:29.312 INFO:teuthology.orchestra.run.trial092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:29.312 INFO:teuthology.orchestra.run.trial092.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-17T21:03:29.312 INFO:teuthology.orchestra.run.trial092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:29.312 INFO:teuthology.orchestra.run.trial092.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:29.312 INFO:teuthology.orchestra.run.trial092.stdout:Access: 2026-02-17 20:59:22.343697396 +0000 2026-02-17T21:03:29.312 INFO:teuthology.orchestra.run.trial092.stdout:Modify: 2026-02-17 20:58:34.125161528 +0000 2026-02-17T21:03:29.313 INFO:teuthology.orchestra.run.trial092.stdout:Change: 2026-02-17 20:58:34.125161528 +0000 2026-02-17T21:03:29.313 INFO:teuthology.orchestra.run.trial092.stdout: Birth: 2026-02-17 20:58:34.125161528 +0000 2026-02-17T21:03:29.313 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T21:03:29.375 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records in 2026-02-17T21:03:29.376 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records out 2026-02-17T21:03:29.376 INFO:teuthology.orchestra.run.trial092.stderr:512 bytes copied, 0.000225579 s, 2.3 MB/s 2026-02-17T21:03:29.377 DEBUG:teuthology.orchestra.run.trial092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T21:03:29.435 DEBUG:teuthology.orchestra.run.trial092:> stat /dev/vg_nvme/lv_2 2026-02-17T21:03:29.492 INFO:teuthology.orchestra.run.trial092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T21:03:29.493 INFO:teuthology.orchestra.run.trial092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:29.493 INFO:teuthology.orchestra.run.trial092.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-17T21:03:29.493 INFO:teuthology.orchestra.run.trial092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:29.493 INFO:teuthology.orchestra.run.trial092.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:29.493 INFO:teuthology.orchestra.run.trial092.stdout:Access: 2026-02-17 20:59:22.343697396 +0000 2026-02-17T21:03:29.493 INFO:teuthology.orchestra.run.trial092.stdout:Modify: 2026-02-17 20:58:34.124161579 +0000 2026-02-17T21:03:29.493 INFO:teuthology.orchestra.run.trial092.stdout:Change: 2026-02-17 20:58:34.124161579 +0000 2026-02-17T21:03:29.493 INFO:teuthology.orchestra.run.trial092.stdout: Birth: 2026-02-17 20:58:34.124161579 +0000 2026-02-17T21:03:29.494 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T21:03:29.555 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records in 2026-02-17T21:03:29.555 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records out 2026-02-17T21:03:29.556 INFO:teuthology.orchestra.run.trial092.stderr:512 bytes copied, 0.000212865 s, 2.4 MB/s 2026-02-17T21:03:29.557 DEBUG:teuthology.orchestra.run.trial092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T21:03:29.614 DEBUG:teuthology.orchestra.run.trial092:> stat /dev/vg_nvme/lv_3 2026-02-17T21:03:29.670 INFO:teuthology.orchestra.run.trial092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T21:03:29.671 INFO:teuthology.orchestra.run.trial092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:29.671 INFO:teuthology.orchestra.run.trial092.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-17T21:03:29.671 INFO:teuthology.orchestra.run.trial092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:29.671 INFO:teuthology.orchestra.run.trial092.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:29.671 INFO:teuthology.orchestra.run.trial092.stdout:Access: 2026-02-17 20:59:22.343697396 +0000 2026-02-17T21:03:29.671 INFO:teuthology.orchestra.run.trial092.stdout:Modify: 2026-02-17 20:58:34.123161630 +0000 2026-02-17T21:03:29.671 INFO:teuthology.orchestra.run.trial092.stdout:Change: 2026-02-17 20:58:34.123161630 +0000 2026-02-17T21:03:29.671 INFO:teuthology.orchestra.run.trial092.stdout: Birth: 2026-02-17 20:58:34.123161630 +0000 2026-02-17T21:03:29.672 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T21:03:29.733 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records in 2026-02-17T21:03:29.733 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records out 2026-02-17T21:03:29.734 INFO:teuthology.orchestra.run.trial092.stderr:512 bytes copied, 0.00014557 s, 3.5 MB/s 2026-02-17T21:03:29.735 DEBUG:teuthology.orchestra.run.trial092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T21:03:29.792 DEBUG:teuthology.orchestra.run.trial092:> stat /dev/vg_nvme/lv_4 2026-02-17T21:03:29.849 INFO:teuthology.orchestra.run.trial092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T21:03:29.849 INFO:teuthology.orchestra.run.trial092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:29.850 INFO:teuthology.orchestra.run.trial092.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-17T21:03:29.850 INFO:teuthology.orchestra.run.trial092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:29.850 INFO:teuthology.orchestra.run.trial092.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:29.850 INFO:teuthology.orchestra.run.trial092.stdout:Access: 2026-02-17 20:59:22.344697371 +0000 2026-02-17T21:03:29.850 INFO:teuthology.orchestra.run.trial092.stdout:Modify: 2026-02-17 20:58:34.123161630 +0000 2026-02-17T21:03:29.850 INFO:teuthology.orchestra.run.trial092.stdout:Change: 2026-02-17 20:58:34.123161630 +0000 2026-02-17T21:03:29.850 INFO:teuthology.orchestra.run.trial092.stdout: Birth: 2026-02-17 20:58:34.123161630 +0000 2026-02-17T21:03:29.850 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T21:03:29.911 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records in 2026-02-17T21:03:29.911 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records out 2026-02-17T21:03:29.911 INFO:teuthology.orchestra.run.trial092.stderr:512 bytes copied, 0.00014547 s, 3.5 MB/s 2026-02-17T21:03:29.912 DEBUG:teuthology.orchestra.run.trial092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T21:03:29.970 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:29.970 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:03:29.970 DEBUG:teuthology.orchestra.run.trial138:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T21:03:29.988 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T21:03:29.988 DEBUG:teuthology.orchestra.run.trial138:> stat /dev/vg_nvme/lv_1 2026-02-17T21:03:30.044 INFO:teuthology.orchestra.run.trial138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T21:03:30.044 INFO:teuthology.orchestra.run.trial138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:30.044 INFO:teuthology.orchestra.run.trial138.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-17T21:03:30.044 INFO:teuthology.orchestra.run.trial138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:30.045 INFO:teuthology.orchestra.run.trial138.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:30.045 INFO:teuthology.orchestra.run.trial138.stdout:Access: 2026-02-17 20:59:03.430390186 +0000 2026-02-17T21:03:30.045 INFO:teuthology.orchestra.run.trial138.stdout:Modify: 2026-02-17 20:58:28.203148446 +0000 2026-02-17T21:03:30.045 INFO:teuthology.orchestra.run.trial138.stdout:Change: 2026-02-17 20:58:28.203148446 +0000 2026-02-17T21:03:30.045 INFO:teuthology.orchestra.run.trial138.stdout: Birth: 2026-02-17 20:58:28.203148446 +0000 2026-02-17T21:03:30.045 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T21:03:30.106 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records in 2026-02-17T21:03:30.106 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records out 2026-02-17T21:03:30.106 INFO:teuthology.orchestra.run.trial138.stderr:512 bytes copied, 0.00015095 s, 3.4 MB/s 2026-02-17T21:03:30.108 DEBUG:teuthology.orchestra.run.trial138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T21:03:30.164 DEBUG:teuthology.orchestra.run.trial138:> stat /dev/vg_nvme/lv_2 2026-02-17T21:03:30.220 INFO:teuthology.orchestra.run.trial138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T21:03:30.221 INFO:teuthology.orchestra.run.trial138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:30.221 INFO:teuthology.orchestra.run.trial138.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-17T21:03:30.221 INFO:teuthology.orchestra.run.trial138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:30.221 INFO:teuthology.orchestra.run.trial138.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:30.221 INFO:teuthology.orchestra.run.trial138.stdout:Access: 2026-02-17 20:59:03.430390186 +0000 2026-02-17T21:03:30.221 INFO:teuthology.orchestra.run.trial138.stdout:Modify: 2026-02-17 20:58:28.205148403 +0000 2026-02-17T21:03:30.221 INFO:teuthology.orchestra.run.trial138.stdout:Change: 2026-02-17 20:58:28.205148403 +0000 2026-02-17T21:03:30.221 INFO:teuthology.orchestra.run.trial138.stdout: Birth: 2026-02-17 20:58:28.205148403 +0000 2026-02-17T21:03:30.222 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T21:03:30.284 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records in 2026-02-17T21:03:30.285 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records out 2026-02-17T21:03:30.285 INFO:teuthology.orchestra.run.trial138.stderr:512 bytes copied, 0.000148134 s, 3.5 MB/s 2026-02-17T21:03:30.286 DEBUG:teuthology.orchestra.run.trial138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T21:03:30.343 DEBUG:teuthology.orchestra.run.trial138:> stat /dev/vg_nvme/lv_3 2026-02-17T21:03:30.400 INFO:teuthology.orchestra.run.trial138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T21:03:30.400 INFO:teuthology.orchestra.run.trial138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:30.400 INFO:teuthology.orchestra.run.trial138.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-17T21:03:30.400 INFO:teuthology.orchestra.run.trial138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:30.400 INFO:teuthology.orchestra.run.trial138.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:30.400 INFO:teuthology.orchestra.run.trial138.stdout:Access: 2026-02-17 20:59:03.431390164 +0000 2026-02-17T21:03:30.400 INFO:teuthology.orchestra.run.trial138.stdout:Modify: 2026-02-17 20:58:28.203148446 +0000 2026-02-17T21:03:30.401 INFO:teuthology.orchestra.run.trial138.stdout:Change: 2026-02-17 20:58:28.203148446 +0000 2026-02-17T21:03:30.401 INFO:teuthology.orchestra.run.trial138.stdout: Birth: 2026-02-17 20:58:28.203148446 +0000 2026-02-17T21:03:30.401 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T21:03:30.463 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records in 2026-02-17T21:03:30.463 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records out 2026-02-17T21:03:30.463 INFO:teuthology.orchestra.run.trial138.stderr:512 bytes copied, 0.000147072 s, 3.5 MB/s 2026-02-17T21:03:30.464 DEBUG:teuthology.orchestra.run.trial138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T21:03:30.521 DEBUG:teuthology.orchestra.run.trial138:> stat /dev/vg_nvme/lv_4 2026-02-17T21:03:30.577 INFO:teuthology.orchestra.run.trial138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T21:03:30.577 INFO:teuthology.orchestra.run.trial138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T21:03:30.577 INFO:teuthology.orchestra.run.trial138.stdout:Device: 6h/6d Inode: 1292 Links: 1 2026-02-17T21:03:30.577 INFO:teuthology.orchestra.run.trial138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T21:03:30.577 INFO:teuthology.orchestra.run.trial138.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T21:03:30.577 INFO:teuthology.orchestra.run.trial138.stdout:Access: 2026-02-17 20:59:03.431390164 +0000 2026-02-17T21:03:30.577 INFO:teuthology.orchestra.run.trial138.stdout:Modify: 2026-02-17 20:58:28.203148446 +0000 2026-02-17T21:03:30.577 INFO:teuthology.orchestra.run.trial138.stdout:Change: 2026-02-17 20:58:28.203148446 +0000 2026-02-17T21:03:30.578 INFO:teuthology.orchestra.run.trial138.stdout: Birth: 2026-02-17 20:58:28.203148446 +0000 2026-02-17T21:03:30.578 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T21:03:30.639 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records in 2026-02-17T21:03:30.639 INFO:teuthology.orchestra.run.trial138.stderr:1+0 records out 2026-02-17T21:03:30.639 INFO:teuthology.orchestra.run.trial138.stderr:512 bytes copied, 0.000143676 s, 3.6 MB/s 2026-02-17T21:03:30.640 DEBUG:teuthology.orchestra.run.trial138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T21:03:30.697 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:30.697 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial086.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial092.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial138.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-17T21:03:30.698 INFO:tasks.ceph:Generating config... 2026-02-17T21:03:30.700 INFO:tasks.ceph:[client] debug monc = 20 2026-02-17T21:03:30.700 INFO:tasks.ceph:[client] debug ms = 1 2026-02-17T21:03:30.700 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-17T21:03:30.700 INFO:tasks.ceph:[client] debug rados = 20 2026-02-17T21:03:30.700 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-17T21:03:30.700 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-17T21:03:30.701 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-17T21:03:30.701 INFO:tasks.ceph:[global] ms type = async 2026-02-17T21:03:30.701 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-17T21:03:30.701 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-17T21:03:30.701 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-17T21:03:30.701 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-17T21:03:30.701 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-17T21:03:30.701 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-17T21:03:30.701 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-17T21:03:30.701 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-17T21:03:30.701 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-17T21:03:30.701 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-17T21:03:30.702 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-17T21:03:30.702 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-17T21:03:30.702 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-17T21:03:30.702 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-17T21:03:30.702 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-17T21:03:30.702 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-17T21:03:30.702 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-17T21:03:30.702 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-17T21:03:30.702 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-17T21:03:30.702 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-17T21:03:30.702 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-17T21:03:30.702 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-17T21:03:30.703 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-17T21:03:30.704 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-17T21:03:30.704 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-17T21:03:30.704 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-17T21:03:30.704 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-17T21:03:30.704 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-17T21:03:30.704 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-17T21:03:30.704 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-17T21:03:30.704 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-17T21:03:30.704 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-17T21:03:30.704 INFO:tasks.ceph:Setting up mon.a... 2026-02-17T21:03:30.705 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-17T21:03:30.740 INFO:teuthology.orchestra.run.trial045.stdout:creating /etc/ceph/ceph.keyring 2026-02-17T21:03:30.743 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-17T21:03:30.821 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:03:30.885 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.45'), ('mon.b', '10.20.193.86'), ('mon.c', '10.20.193.92')] 2026-02-17T21:03:30.886 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.45,10.20.193.86,10.20.193.92', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-17T21:03:30.887 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:30.887 DEBUG:teuthology.orchestra.run.trial045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T21:03:30.941 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.45 --add b 10.20.193.86 --add c 10.20.193.92 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:31.015 INFO:teuthology.orchestra.run.trial045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:31.015 INFO:teuthology.orchestra.run.trial045.stdout:monmaptool: generated fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:03:31.015 INFO:teuthology.orchestra.run.trial045.stdout:setting min_mon_release = quincy 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:epoch 0 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:min_mon_release 17 (quincy) 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:election_strategy: 1 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:03:31.016 INFO:teuthology.orchestra.run.trial045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-17T21:03:31.018 DEBUG:teuthology.orchestra.run.trial045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-17T21:03:31.073 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d3d77e88-f8f0-42ae-9378-6b5f15ec2a21... 2026-02-17T21:03:31.074 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T21:03:31.115 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T21:03:31.117 DEBUG:teuthology.orchestra.run.trial092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T21:03:31.120 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-17T21:03:31.152 INFO:teuthology.orchestra.run.trial045.stdout:[global] 2026-02-17T21:03:31.152 INFO:teuthology.orchestra.run.trial045.stdout: chdir = "" 2026-02-17T21:03:31.152 INFO:teuthology.orchestra.run.trial045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T21:03:31.152 INFO:teuthology.orchestra.run.trial045.stdout: auth supported = cephx 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: filestore xattr use omap = true 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: mon clock drift allowed = 1.000 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: osd crush chooseleaf type = 0 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: auth debug = true 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: ms die on old message = true 2026-02-17T21:03:31.153 INFO:teuthology.orchestra.run.trial045.stdout: ms die on bug = true 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: mon pg warn max object skew = 0 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: osd pool default size = 2 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.154 INFO:teuthology.orchestra.run.trial045.stdout: mon osd allow primary affinity = true 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: mon osd allow pg remap = true 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on legacy crush tunables = false 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on crush straw calc version zero = false 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on no sortbitwise = false 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on osd down out interval zero = false 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on too few osds = false 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: mon_allow_pool_size_one = true 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.155 INFO:teuthology.orchestra.run.trial045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: osd default data pool replay window = 5 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: mon allow pool delete = true 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: mon cluster log file level = debug 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: debug asserts on shutdown = true 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: mon health detail to clog = false 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: mon host = "10.20.193.45,10.20.193.86,10.20.193.92" 2026-02-17T21:03:31.156 INFO:teuthology.orchestra.run.trial045.stdout: mon client directed command retry = 5 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: mon election default strategy = 1 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: ms inject socket failures = 5000 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: ms type = async 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: osd heartbeat grace = 160 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: osd op thread timeout = 150 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: fsid = d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout:[osd] 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: osd journal size = 100 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.157 INFO:teuthology.orchestra.run.trial045.stdout: osd scrub load threshold = 5.0 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: osd scrub max interval = 600 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: osd mclock profile = high_recovery_ops 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: osd recover clone overlap = true 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: osd recovery max chunk = 1048576 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: osd debug shutdown = true 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: osd debug op order = true 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: osd debug verify stray on activate = true 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: osd debug trim objects = true 2026-02-17T21:03:31.158 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: osd open classes on start = true 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: osd debug pg log writeout = true 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: osd deep scrub update digest min age = 30 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: osd map max advance = 10 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: journal zero on create = true 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: filestore ondisk finisher threads = 3 2026-02-17T21:03:31.159 INFO:teuthology.orchestra.run.trial045.stdout: filestore apply finisher threads = 3 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: bdev debug aio = true 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: osd debug misdirected ops = true 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: bdev async discard = True 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: bdev enable discard = True 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: bluestore allocator = bitmap 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: bluestore block size = 96636764160 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: bluestore fsck on mount = True 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: bluestore zero block detection = True 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: debug bluefs = 1 2026-02-17T21:03:31.160 INFO:teuthology.orchestra.run.trial045.stdout: debug bluestore = 1 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: debug monc = 20 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: debug osd = 20 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: debug rocksdb = 10 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: mon osd full ratio = 0.9 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: mon osd nearfull ratio = 0.8 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: osd class default list = * 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: osd class load list = * 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: osd client watch timeout = 240 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: osd debug verify cached snaps = True 2026-02-17T21:03:31.161 INFO:teuthology.orchestra.run.trial045.stdout: osd debug verify missing on start = True 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: osd failsafe full ratio = 0.95 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: osd fast shutdown = False 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: osd mclock override recovery settings = True 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: osd objectstore = bluestore 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: osd op queue = debug_random 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: osd op queue cut off = debug_random 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: osd shutdown pgref assert = True 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout:[mgr] 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-17T21:03:31.162 INFO:teuthology.orchestra.run.trial045.stdout: debug mgr = 20 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: debug mon = 20 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: debug auth = 20 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: mgr/telemetry/nag = false 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout:[mon] 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: debug mon = 20 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: debug paxos = 20 2026-02-17T21:03:31.163 INFO:teuthology.orchestra.run.trial045.stdout: debug auth = 20 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: mon data avail warn = 5 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: mon mgr mkfs grace = 240 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: mon osd reporter subtree level = osd 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: mon osd prime pg temp = true 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T21:03:31.164 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: # 1m isn't quite enough 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: mon_down_mkfs_grace = 2m 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: mon_warn_on_filestore_osds = false 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: mon min osdmap epochs = 50 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: mon osd crush smoke test = False 2026-02-17T21:03:31.165 INFO:teuthology.orchestra.run.trial045.stdout: mon osdmap full prune interval = 2 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: mon osdmap full prune min = 15 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: mon osdmap full prune txsize = 2 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: mon scrub interval = 300 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: mon warn on pool no app = False 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: paxos service trim min = 10 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout:[client] 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: rgw cache enabled = true 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: rgw enable ops log = true 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: rgw enable usage log = true 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T21:03:31.166 INFO:teuthology.orchestra.run.trial045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T21:03:31.167 INFO:teuthology.orchestra.run.trial045.stdout: debug monc = 20 2026-02-17T21:03:31.167 INFO:teuthology.orchestra.run.trial045.stdout: debug ms = 1 2026-02-17T21:03:31.167 INFO:teuthology.orchestra.run.trial045.stdout: debug objecter = 20 2026-02-17T21:03:31.167 INFO:teuthology.orchestra.run.trial045.stdout: debug rados = 20 2026-02-17T21:03:31.167 INFO:teuthology.orchestra.run.trial045.stdout:[mon.a] 2026-02-17T21:03:31.167 INFO:teuthology.orchestra.run.trial045.stdout:[mon.b] 2026-02-17T21:03:31.167 INFO:teuthology.orchestra.run.trial045.stdout:[mon.c] 2026-02-17T21:03:31.168 INFO:teuthology.orchestra.run.trial138.stdout:[global] 2026-02-17T21:03:31.169 INFO:teuthology.orchestra.run.trial138.stdout: chdir = "" 2026-02-17T21:03:31.169 INFO:teuthology.orchestra.run.trial138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T21:03:31.169 INFO:teuthology.orchestra.run.trial138.stdout: auth supported = cephx 2026-02-17T21:03:31.169 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.169 INFO:teuthology.orchestra.run.trial138.stdout: filestore xattr use omap = true 2026-02-17T21:03:31.169 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.169 INFO:teuthology.orchestra.run.trial138.stdout: mon clock drift allowed = 1.000 2026-02-17T21:03:31.169 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.169 INFO:teuthology.orchestra.run.trial138.stdout: osd crush chooseleaf type = 0 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: auth debug = true 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: ms die on old message = true 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: ms die on bug = true 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: mon pg warn max object skew = 0 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T21:03:31.170 INFO:teuthology.orchestra.run.trial138.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: osd pool default size = 2 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: mon osd allow primary affinity = true 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: mon osd allow pg remap = true 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on legacy crush tunables = false 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on crush straw calc version zero = false 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on no sortbitwise = false 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on osd down out interval zero = false 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on too few osds = false 2026-02-17T21:03:31.171 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: mon_allow_pool_size_one = true 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: osd default data pool replay window = 5 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: mon allow pool delete = true 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.172 INFO:teuthology.orchestra.run.trial138.stdout: mon cluster log file level = debug 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: debug asserts on shutdown = true 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: mon health detail to clog = false 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: mon host = "10.20.193.45,10.20.193.86,10.20.193.92" 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: mon client directed command retry = 5 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: mon election default strategy = 1 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: ms inject socket failures = 5000 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: ms type = async 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: osd heartbeat grace = 160 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: osd op thread timeout = 150 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: fsid = d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:03:31.173 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout:[osd] 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: osd journal size = 100 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: osd scrub load threshold = 5.0 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: osd scrub max interval = 600 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: osd mclock profile = high_recovery_ops 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: osd recover clone overlap = true 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: osd recovery max chunk = 1048576 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.174 INFO:teuthology.orchestra.run.trial138.stdout: osd debug shutdown = true 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: osd debug op order = true 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: osd debug verify stray on activate = true 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: osd debug trim objects = true 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: osd open classes on start = true 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: osd debug pg log writeout = true 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: osd deep scrub update digest min age = 30 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.175 INFO:teuthology.orchestra.run.trial138.stdout: osd map max advance = 10 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: journal zero on create = true 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: filestore ondisk finisher threads = 3 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: filestore apply finisher threads = 3 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: bdev debug aio = true 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: osd debug misdirected ops = true 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: bdev async discard = True 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: bdev enable discard = True 2026-02-17T21:03:31.176 INFO:teuthology.orchestra.run.trial138.stdout: bluestore allocator = bitmap 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: bluestore block size = 96636764160 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: bluestore fsck on mount = True 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: bluestore zero block detection = True 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: debug bluefs = 1 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: debug bluestore = 1 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: debug monc = 20 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: debug ms = 1 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: debug osd = 20 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: debug rocksdb = 10 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T21:03:31.177 INFO:teuthology.orchestra.run.trial138.stdout: mon osd full ratio = 0.9 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: mon osd nearfull ratio = 0.8 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd class default list = * 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd class load list = * 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd client watch timeout = 240 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd debug verify cached snaps = True 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd debug verify missing on start = True 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd failsafe full ratio = 0.95 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd fast shutdown = False 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd mclock override recovery settings = True 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd objectstore = bluestore 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd op queue = debug_random 2026-02-17T21:03:31.178 INFO:teuthology.orchestra.run.trial138.stdout: osd op queue cut off = debug_random 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout: osd shutdown pgref assert = True 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout:[mgr] 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout: debug ms = 1 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout: debug mgr = 20 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout: debug mon = 20 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout: debug auth = 20 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:03:31.179 INFO:teuthology.orchestra.run.trial138.stdout: mgr/telemetry/nag = false 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout:[mon] 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: debug ms = 1 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: debug mon = 20 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: debug paxos = 20 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: debug auth = 20 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: mon data avail warn = 5 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: mon mgr mkfs grace = 240 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: mon osd reporter subtree level = osd 2026-02-17T21:03:31.180 INFO:teuthology.orchestra.run.trial138.stdout: mon osd prime pg temp = true 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: # 1m isn't quite enough 2026-02-17T21:03:31.181 INFO:teuthology.orchestra.run.trial138.stdout: mon_down_mkfs_grace = 2m 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: mon_warn_on_filestore_osds = false 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: mon min osdmap epochs = 50 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: mon osd crush smoke test = False 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: mon osdmap full prune interval = 2 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: mon osdmap full prune min = 15 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: mon osdmap full prune txsize = 2 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: mon scrub interval = 300 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: mon warn on pool no app = False 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: paxos service trim min = 10 2026-02-17T21:03:31.182 INFO:teuthology.orchestra.run.trial138.stdout: 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout:[client] 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout: rgw cache enabled = true 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout: rgw enable ops log = true 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout: rgw enable usage log = true 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout: debug monc = 20 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout: debug ms = 1 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout: debug objecter = 20 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout: debug rados = 20 2026-02-17T21:03:31.183 INFO:teuthology.orchestra.run.trial138.stdout:[mon.a] 2026-02-17T21:03:31.184 INFO:teuthology.orchestra.run.trial138.stdout:[mon.b] 2026-02-17T21:03:31.184 INFO:teuthology.orchestra.run.trial138.stdout:[mon.c] 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout:[global] 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: chdir = "" 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: auth supported = cephx 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: filestore xattr use omap = true 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: mon clock drift allowed = 1.000 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: osd crush chooseleaf type = 0 2026-02-17T21:03:31.186 INFO:teuthology.orchestra.run.trial092.stdout: auth debug = true 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: ms die on old message = true 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: ms die on bug = true 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: mon pg warn max object skew = 0 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: osd pool default size = 2 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.187 INFO:teuthology.orchestra.run.trial092.stdout: mon osd allow primary affinity = true 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: mon osd allow pg remap = true 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: mon warn on legacy crush tunables = false 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: mon warn on crush straw calc version zero = false 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: mon warn on no sortbitwise = false 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: mon warn on osd down out interval zero = false 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: mon warn on too few osds = false 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: mon_allow_pool_size_one = true 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: osd default data pool replay window = 5 2026-02-17T21:03:31.188 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: mon allow pool delete = true 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: mon cluster log file level = debug 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: debug asserts on shutdown = true 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: mon health detail to clog = false 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: mon host = "10.20.193.45,10.20.193.86,10.20.193.92" 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: mon client directed command retry = 5 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: mon election default strategy = 1 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: ms inject socket failures = 5000 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: ms type = async 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: osd heartbeat grace = 160 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: osd op thread timeout = 150 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: fsid = d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:03:31.189 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout:[osd] 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd journal size = 100 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd scrub load threshold = 5.0 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd scrub max interval = 600 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd mclock profile = high_recovery_ops 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd recover clone overlap = true 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd recovery max chunk = 1048576 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd debug shutdown = true 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd debug op order = true 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd debug verify stray on activate = true 2026-02-17T21:03:31.190 INFO:teuthology.orchestra.run.trial092.stdout: osd debug trim objects = true 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: osd open classes on start = true 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: osd debug pg log writeout = true 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: osd deep scrub update digest min age = 30 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: osd map max advance = 10 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: journal zero on create = true 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: filestore ondisk finisher threads = 3 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: filestore apply finisher threads = 3 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.191 INFO:teuthology.orchestra.run.trial092.stdout: bdev debug aio = true 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: osd debug misdirected ops = true 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: bdev async discard = True 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: bdev enable discard = True 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: bluestore allocator = bitmap 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: bluestore block size = 96636764160 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: bluestore fsck on mount = True 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: bluestore zero block detection = True 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: debug bluefs = 1 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: debug bluestore = 1 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: debug monc = 20 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: debug ms = 1 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: debug osd = 20 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: debug rocksdb = 10 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: mon osd full ratio = 0.9 2026-02-17T21:03:31.192 INFO:teuthology.orchestra.run.trial092.stdout: mon osd nearfull ratio = 0.8 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd class default list = * 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd class load list = * 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd client watch timeout = 240 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd debug verify cached snaps = True 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd debug verify missing on start = True 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd failsafe full ratio = 0.95 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd fast shutdown = False 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd mclock override recovery settings = True 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd objectstore = bluestore 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd op queue = debug_random 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd op queue cut off = debug_random 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: osd shutdown pgref assert = True 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout:[mgr] 2026-02-17T21:03:31.193 INFO:teuthology.orchestra.run.trial092.stdout: debug ms = 1 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: debug mgr = 20 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: debug mon = 20 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: debug auth = 20 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: mgr/telemetry/nag = false 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout:[mon] 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: debug ms = 1 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: debug mon = 20 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: debug paxos = 20 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: debug auth = 20 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: mon data avail warn = 5 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: mon mgr mkfs grace = 240 2026-02-17T21:03:31.194 INFO:teuthology.orchestra.run.trial092.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: mon osd reporter subtree level = osd 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: mon osd prime pg temp = true 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: # 1m isn't quite enough 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: mon_down_mkfs_grace = 2m 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: mon_warn_on_filestore_osds = false 2026-02-17T21:03:31.195 INFO:teuthology.orchestra.run.trial092.stdout: mon min osdmap epochs = 50 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: mon osd crush smoke test = False 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: mon osdmap full prune interval = 2 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: mon osdmap full prune min = 15 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: mon osdmap full prune txsize = 2 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: mon scrub interval = 300 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: mon warn on pool no app = False 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: paxos service trim min = 10 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout:[client] 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: rgw cache enabled = true 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: rgw enable ops log = true 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: rgw enable usage log = true 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: debug monc = 20 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: debug ms = 1 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: debug objecter = 20 2026-02-17T21:03:31.196 INFO:teuthology.orchestra.run.trial092.stdout: debug rados = 20 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial092.stdout:[mon.a] 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial092.stdout:[mon.b] 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial092.stdout:[mon.c] 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout:[global] 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: chdir = "" 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: auth supported = cephx 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: filestore xattr use omap = true 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: mon clock drift allowed = 1.000 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: osd crush chooseleaf type = 0 2026-02-17T21:03:31.197 INFO:teuthology.orchestra.run.trial086.stdout: auth debug = true 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: ms die on old message = true 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: ms die on bug = true 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: mon pg warn max object skew = 0 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: # disable pg_autoscaler by default for new pools 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: osd pool default size = 2 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: mon osd allow primary affinity = true 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: mon osd allow pg remap = true 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on legacy crush tunables = false 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on crush straw calc version zero = false 2026-02-17T21:03:31.198 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on no sortbitwise = false 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on osd down out interval zero = false 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on too few osds = false 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon_allow_pool_size_one = true 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: osd default data pool replay window = 5 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon allow pool delete = true 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon cluster log file level = debug 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: debug asserts on shutdown = true 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon health detail to clog = false 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon host = "10.20.193.45,10.20.193.86,10.20.193.92" 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon client directed command retry = 5 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: mon election default strategy = 1 2026-02-17T21:03:31.199 INFO:teuthology.orchestra.run.trial086.stdout: ms inject socket failures = 5000 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: ms type = async 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd heartbeat grace = 160 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd op thread timeout = 150 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: fsid = d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout:[osd] 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd journal size = 100 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd scrub load threshold = 5.0 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd scrub max interval = 600 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd mclock profile = high_recovery_ops 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd recover clone overlap = true 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd recovery max chunk = 1048576 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd debug shutdown = true 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd debug op order = true 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd debug verify stray on activate = true 2026-02-17T21:03:31.200 INFO:teuthology.orchestra.run.trial086.stdout: osd debug trim objects = true 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: osd open classes on start = true 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: osd debug pg log writeout = true 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: osd deep scrub update digest min age = 30 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: osd map max advance = 10 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: journal zero on create = true 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: filestore ondisk finisher threads = 3 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: filestore apply finisher threads = 3 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: bdev debug aio = true 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: osd debug misdirected ops = true 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: bdev async discard = True 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: bdev enable discard = True 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: bluestore allocator = bitmap 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: bluestore block size = 96636764160 2026-02-17T21:03:31.201 INFO:teuthology.orchestra.run.trial086.stdout: bluestore fsck on mount = True 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: bluestore zero block detection = True 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: debug bluefs = 1 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: debug bluestore = 1 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: debug monc = 20 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 1 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: debug osd = 20 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: debug rocksdb = 10 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: mon osd backfillfull_ratio = 0.85 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: mon osd full ratio = 0.9 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: mon osd nearfull ratio = 0.8 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd class default list = * 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd class load list = * 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd client watch timeout = 240 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd debug verify cached snaps = True 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd debug verify missing on start = True 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd failsafe full ratio = 0.95 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd fast shutdown = False 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd mclock override recovery settings = True 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd objectstore = bluestore 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd op queue = debug_random 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd op queue cut off = debug_random 2026-02-17T21:03:31.202 INFO:teuthology.orchestra.run.trial086.stdout: osd shutdown pgref assert = True 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout:[mgr] 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 1 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: debug mgr = 20 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: debug mon = 20 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: debug auth = 20 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: mgr/telemetry/nag = false 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout:[mon] 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 1 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: debug mon = 20 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: debug paxos = 20 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: debug auth = 20 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: mon data avail warn = 5 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: mon mgr mkfs grace = 240 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min pgs per osd = 4 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: mon osd reporter subtree level = osd 2026-02-17T21:03:31.203 INFO:teuthology.orchestra.run.trial086.stdout: mon osd prime pg temp = true 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min bytes per osd = 10 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: auth mon ticket ttl = 660 # 11m 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: auth service ticket ttl = 240 # 4m 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: # don't complain about insecure global_id in the test suite 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: # 1m isn't quite enough 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon_down_mkfs_grace = 2m 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_filestore_osds = false 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon min osdmap epochs = 50 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon osd crush smoke test = False 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon osdmap full prune interval = 2 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon osdmap full prune min = 15 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon osdmap full prune txsize = 2 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon scrub interval = 300 2026-02-17T21:03:31.204 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on pool no app = False 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: paxos service trim min = 10 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout:[client] 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: rgw cache enabled = true 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: rgw enable ops log = true 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: rgw enable usage log = true 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: debug monc = 20 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 1 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: debug objecter = 20 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout: debug rados = 20 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout:[mon.a] 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout:[mon.b] 2026-02-17T21:03:31.205 INFO:teuthology.orchestra.run.trial086.stdout:[mon.c] 2026-02-17T21:03:31.206 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-17T21:03:31.206 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-17T21:03:31.267 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-17T21:03:31.267 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:31.268 DEBUG:teuthology.orchestra.run.trial045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-17T21:03:31.325 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:31.326 DEBUG:teuthology.orchestra.run.trial045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-17T21:03:31.381 INFO:tasks.ceph:Sending monmap to node ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:03:31.382 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:31.382 DEBUG:teuthology.orchestra.run.trial045:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T21:03:31.382 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:03:31.456 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:03:31.456 DEBUG:teuthology.orchestra.run.trial045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:31.514 INFO:tasks.ceph:Sending monmap to node ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:03:31.514 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:03:31.515 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T21:03:31.515 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:03:31.549 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:03:31.549 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:31.606 INFO:tasks.ceph:Sending monmap to node ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:03:31.606 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:03:31.606 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T21:03:31.606 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:03:31.641 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:03:31.641 DEBUG:teuthology.orchestra.run.trial092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:31.697 INFO:tasks.ceph:Sending monmap to node ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:03:31.698 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:03:31.698 DEBUG:teuthology.orchestra.run.trial138:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-17T21:03:31.698 DEBUG:teuthology.orchestra.run.trial138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-17T21:03:31.732 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:03:31.732 DEBUG:teuthology.orchestra.run.trial138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:31.789 INFO:tasks.ceph:Setting up mon nodes... 2026-02-17T21:03:31.789 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-17T21:03:31.789 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T21:03:31.832 INFO:teuthology.orchestra.run.trial045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-17T21:03:31.835 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T21:03:31.879 INFO:teuthology.orchestra.run.trial138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-17T21:03:31.881 INFO:tasks.ceph:Setting up mds nodes... 2026-02-17T21:03:31.882 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-17T21:03:31.882 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T21:03:31.955 INFO:teuthology.orchestra.run.trial138.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-17T21:03:31.966 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-17T21:03:31.966 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial086.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial092.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial138.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-17T21:03:31.966 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-17T21:03:31.992 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:31.992 INFO:tasks.ceph:role: osd.0 2026-02-17T21:03:31.992 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:03:31.993 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T21:03:32.058 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:03:32.058 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:03:32.058 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:03:32.058 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:03:32.059 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:03:32.059 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:03:32.059 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:03:32.059 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:03:32.059 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:03:32.059 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:03:32.632 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-17T21:03:32.634 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-17T21:03:32.634 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-17T21:03:32.702 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-17T21:03:32.768 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-17T21:03:32.831 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:32.832 INFO:tasks.ceph:role: osd.4 2026-02-17T21:03:32.832 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:03:32.832 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T21:03:32.896 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:03:32.896 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:03:32.897 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:03:32.897 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:03:32.897 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:03:32.897 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:03:32.897 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:03:32.897 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:03:32.897 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:03:32.897 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:03:33.456 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-17T21:03:33.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-17T21:03:33.458 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-17T21:03:33.526 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-17T21:03:33.595 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-17T21:03:33.660 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:33.660 INFO:tasks.ceph:role: osd.8 2026-02-17T21:03:33.661 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:03:33.661 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T21:03:33.724 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:03:33.725 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:03:33.725 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:03:33.725 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:03:33.725 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:03:33.725 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:03:33.725 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:03:33.725 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:03:33.725 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:03:33.725 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:03:34.288 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-17T21:03:34.290 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-17T21:03:34.290 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-17T21:03:34.357 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-17T21:03:34.424 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-17T21:03:34.487 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:34.487 INFO:tasks.ceph:role: osd.12 2026-02-17T21:03:34.487 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:03:34.487 DEBUG:teuthology.orchestra.run.trial045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T21:03:34.551 INFO:teuthology.orchestra.run.trial045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:03:34.551 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:03:34.552 INFO:teuthology.orchestra.run.trial045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:03:34.552 INFO:teuthology.orchestra.run.trial045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:03:34.552 INFO:teuthology.orchestra.run.trial045.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:03:34.552 INFO:teuthology.orchestra.run.trial045.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:03:34.552 INFO:teuthology.orchestra.run.trial045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:03:34.552 INFO:teuthology.orchestra.run.trial045.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:03:34.552 INFO:teuthology.orchestra.run.trial045.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:03:34.552 INFO:teuthology.orchestra.run.trial045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:03:35.112 INFO:teuthology.orchestra.run.trial045.stdout:Discarding blocks...Done. 2026-02-17T21:03:35.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial045.front.sepia.ceph.com -o noatime 2026-02-17T21:03:35.114 DEBUG:teuthology.orchestra.run.trial045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-17T21:03:35.191 DEBUG:teuthology.orchestra.run.trial045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-17T21:03:35.260 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:35.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:35.349+0000 7f345c60f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-17T21:03:35.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:35.349+0000 7f345c60f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-17T21:03:35.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:35.349+0000 7f345c60f780 -1 bdev(0x55d7932e5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-17T21:03:35.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:35.349+0000 7f345c60f780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-17T21:03:39.240 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-17T21:03:39.306 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:39.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:39.391+0000 7fda178e9780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-17T21:03:39.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:39.391+0000 7fda178e9780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-17T21:03:39.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:39.391+0000 7fda178e9780 -1 bdev(0x561782ac9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-17T21:03:39.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:39.391+0000 7fda178e9780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-17T21:03:43.267 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-17T21:03:43.332 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:43.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:43.416+0000 7f8e1ac1e780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-17T21:03:43.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:43.416+0000 7f8e1ac1e780 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-17T21:03:43.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:43.416+0000 7f8e1ac1e780 -1 bdev(0x560c94b69800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-17T21:03:43.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:43.417+0000 7f8e1ac1e780 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-17T21:03:47.305 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-17T21:03:47.369 DEBUG:teuthology.orchestra.run.trial045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:47.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:47.454+0000 7f35fe20c780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-17T21:03:47.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:47.454+0000 7f35fe20c780 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-17T21:03:47.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:47.454+0000 7f35fe20c780 -1 bdev(0x5616acc31800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-17T21:03:47.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:03:47.454+0000 7f35fe20c780 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-17T21:03:51.338 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-17T21:03:51.403 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-17T21:03:51.431 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:51.431 INFO:tasks.ceph:role: osd.1 2026-02-17T21:03:51.432 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:03:51.432 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T21:03:51.497 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:03:51.497 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:03:51.497 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:03:51.497 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:03:51.498 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:03:51.498 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:03:51.498 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:03:51.498 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:03:51.498 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:03:51.498 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:03:52.071 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-17T21:03:52.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-17T21:03:52.073 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-17T21:03:52.143 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-17T21:03:52.210 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-17T21:03:52.277 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:52.277 INFO:tasks.ceph:role: osd.5 2026-02-17T21:03:52.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:03:52.277 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T21:03:52.342 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:03:52.342 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:03:52.342 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:03:52.342 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:03:52.342 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:03:52.342 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:03:52.342 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:03:52.342 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:03:52.342 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:03:52.343 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:03:52.902 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-17T21:03:52.904 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-17T21:03:52.904 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-17T21:03:52.973 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-17T21:03:53.041 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-17T21:03:53.104 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:53.104 INFO:tasks.ceph:role: osd.9 2026-02-17T21:03:53.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:03:53.105 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T21:03:53.170 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:03:53.170 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:03:53.170 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:03:53.170 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:03:53.170 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:03:53.170 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:03:53.170 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:03:53.170 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:03:53.170 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:03:53.171 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:03:53.730 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-17T21:03:53.732 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-17T21:03:53.733 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-17T21:03:53.800 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-17T21:03:53.867 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-17T21:03:53.931 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-17T21:03:53.931 INFO:tasks.ceph:role: osd.13 2026-02-17T21:03:53.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:03:53.932 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T21:03:53.998 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:03:53.998 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:03:53.998 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:03:53.998 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:03:53.998 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:03:53.998 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:03:53.998 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:03:53.998 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:03:53.999 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:03:53.999 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:03:54.555 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-17T21:03:54.557 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-17T21:03:54.557 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-17T21:03:54.627 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-17T21:03:54.693 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:54.772 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:03:54.773+0000 7fd55f4b1780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-17T21:03:54.773 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:03:54.773+0000 7fd55f4b1780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-17T21:03:54.773 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:03:54.773+0000 7fd55f4b1780 -1 bdev(0x55c905d19800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-17T21:03:54.773 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:03:54.773+0000 7fd55f4b1780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-17T21:03:58.660 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-17T21:03:58.725 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:03:58.806 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:03:58.806+0000 7f5bc260d780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-17T21:03:58.806 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:03:58.806+0000 7f5bc260d780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-17T21:03:58.806 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:03:58.806+0000 7f5bc260d780 -1 bdev(0x563d7124b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-17T21:03:58.806 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:03:58.806+0000 7f5bc260d780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-17T21:04:02.696 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-17T21:04:02.763 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:02.841 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:04:02.841+0000 7f31eee18780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-17T21:04:02.841 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:04:02.841+0000 7f31eee18780 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-17T21:04:02.841 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:04:02.841+0000 7f31eee18780 -1 bdev(0x55e77b52b800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:02.842 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:04:02.841+0000 7f31eee18780 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-17T21:04:06.722 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-17T21:04:06.786 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:06.865 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:04:06.865+0000 7f3fb7620780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-17T21:04:06.865 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:04:06.865+0000 7f3fb7620780 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-17T21:04:06.865 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:04:06.865+0000 7f3fb7620780 -1 bdev(0x55fc10f47800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:06.865 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-17T21:04:06.865+0000 7f3fb7620780 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-17T21:04:10.744 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-17T21:04:10.808 DEBUG:teuthology.orchestra.run.trial092:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-17T21:04:10.834 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:04:10.834 INFO:tasks.ceph:role: osd.2 2026-02-17T21:04:10.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:04:10.834 DEBUG:teuthology.orchestra.run.trial092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T21:04:10.900 INFO:teuthology.orchestra.run.trial092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:04:10.900 INFO:teuthology.orchestra.run.trial092.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:04:10.900 INFO:teuthology.orchestra.run.trial092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:04:10.900 INFO:teuthology.orchestra.run.trial092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:04:10.900 INFO:teuthology.orchestra.run.trial092.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:04:10.900 INFO:teuthology.orchestra.run.trial092.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:04:10.900 INFO:teuthology.orchestra.run.trial092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:04:10.901 INFO:teuthology.orchestra.run.trial092.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:04:10.901 INFO:teuthology.orchestra.run.trial092.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:04:10.901 INFO:teuthology.orchestra.run.trial092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:04:11.475 INFO:teuthology.orchestra.run.trial092.stdout:Discarding blocks...Done. 2026-02-17T21:04:11.477 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial092.front.sepia.ceph.com -o noatime 2026-02-17T21:04:11.477 DEBUG:teuthology.orchestra.run.trial092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-17T21:04:11.545 DEBUG:teuthology.orchestra.run.trial092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-17T21:04:11.612 DEBUG:teuthology.orchestra.run.trial092:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-17T21:04:11.676 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:04:11.676 INFO:tasks.ceph:role: osd.6 2026-02-17T21:04:11.676 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:04:11.677 DEBUG:teuthology.orchestra.run.trial092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T21:04:11.742 INFO:teuthology.orchestra.run.trial092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:04:11.742 INFO:teuthology.orchestra.run.trial092.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:04:11.743 INFO:teuthology.orchestra.run.trial092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:04:11.743 INFO:teuthology.orchestra.run.trial092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:04:11.743 INFO:teuthology.orchestra.run.trial092.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:04:11.743 INFO:teuthology.orchestra.run.trial092.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:04:11.743 INFO:teuthology.orchestra.run.trial092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:04:11.743 INFO:teuthology.orchestra.run.trial092.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:04:11.743 INFO:teuthology.orchestra.run.trial092.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:04:11.743 INFO:teuthology.orchestra.run.trial092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:04:12.303 INFO:teuthology.orchestra.run.trial092.stdout:Discarding blocks...Done. 2026-02-17T21:04:12.305 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial092.front.sepia.ceph.com -o noatime 2026-02-17T21:04:12.305 DEBUG:teuthology.orchestra.run.trial092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-17T21:04:12.374 DEBUG:teuthology.orchestra.run.trial092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-17T21:04:12.441 DEBUG:teuthology.orchestra.run.trial092:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-17T21:04:12.505 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:04:12.506 INFO:tasks.ceph:role: osd.10 2026-02-17T21:04:12.506 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:04:12.506 DEBUG:teuthology.orchestra.run.trial092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T21:04:12.571 INFO:teuthology.orchestra.run.trial092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:04:12.571 INFO:teuthology.orchestra.run.trial092.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:04:12.571 INFO:teuthology.orchestra.run.trial092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:04:12.571 INFO:teuthology.orchestra.run.trial092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:04:12.571 INFO:teuthology.orchestra.run.trial092.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:04:12.571 INFO:teuthology.orchestra.run.trial092.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:04:12.572 INFO:teuthology.orchestra.run.trial092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:04:12.572 INFO:teuthology.orchestra.run.trial092.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:04:12.572 INFO:teuthology.orchestra.run.trial092.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:04:12.572 INFO:teuthology.orchestra.run.trial092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:04:13.130 INFO:teuthology.orchestra.run.trial092.stdout:Discarding blocks...Done. 2026-02-17T21:04:13.132 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial092.front.sepia.ceph.com -o noatime 2026-02-17T21:04:13.132 DEBUG:teuthology.orchestra.run.trial092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-17T21:04:13.200 DEBUG:teuthology.orchestra.run.trial092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-17T21:04:13.267 DEBUG:teuthology.orchestra.run.trial092:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-17T21:04:13.331 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-17T21:04:13.331 INFO:tasks.ceph:role: osd.14 2026-02-17T21:04:13.331 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:04:13.331 DEBUG:teuthology.orchestra.run.trial092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T21:04:13.396 INFO:teuthology.orchestra.run.trial092.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:04:13.397 INFO:teuthology.orchestra.run.trial092.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:04:13.397 INFO:teuthology.orchestra.run.trial092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:04:13.397 INFO:teuthology.orchestra.run.trial092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:04:13.397 INFO:teuthology.orchestra.run.trial092.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:04:13.397 INFO:teuthology.orchestra.run.trial092.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:04:13.397 INFO:teuthology.orchestra.run.trial092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:04:13.397 INFO:teuthology.orchestra.run.trial092.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:04:13.397 INFO:teuthology.orchestra.run.trial092.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:04:13.397 INFO:teuthology.orchestra.run.trial092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:04:13.953 INFO:teuthology.orchestra.run.trial092.stdout:Discarding blocks...Done. 2026-02-17T21:04:13.955 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial092.front.sepia.ceph.com -o noatime 2026-02-17T21:04:13.956 DEBUG:teuthology.orchestra.run.trial092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-17T21:04:14.033 DEBUG:teuthology.orchestra.run.trial092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-17T21:04:14.102 DEBUG:teuthology.orchestra.run.trial092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:14.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:14.189+0000 7fbedd20b780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-17T21:04:14.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:14.189+0000 7fbedd20b780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-17T21:04:14.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:14.189+0000 7fbedd20b780 -1 bdev(0x55eaab987800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:14.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:14.189+0000 7fbedd20b780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-17T21:04:18.064 DEBUG:teuthology.orchestra.run.trial092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-17T21:04:18.129 DEBUG:teuthology.orchestra.run.trial092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:18.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:18.211+0000 7f60ef01a780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-17T21:04:18.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:18.212+0000 7f60ef01a780 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-17T21:04:18.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:18.212+0000 7f60ef01a780 -1 bdev(0x55841aa13800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:18.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:18.212+0000 7f60ef01a780 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-17T21:04:22.088 DEBUG:teuthology.orchestra.run.trial092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-17T21:04:22.152 DEBUG:teuthology.orchestra.run.trial092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:22.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:22.235+0000 7efd7220b780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-17T21:04:22.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:22.235+0000 7efd7220b780 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-17T21:04:22.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:22.235+0000 7efd7220b780 -1 bdev(0x55b54212d800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:22.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:22.236+0000 7efd7220b780 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-17T21:04:26.121 DEBUG:teuthology.orchestra.run.trial092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-17T21:04:26.186 DEBUG:teuthology.orchestra.run.trial092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:26.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:26.270+0000 7f7ec1010780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-17T21:04:26.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:26.271+0000 7f7ec1010780 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-17T21:04:26.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:26.271+0000 7f7ec1010780 -1 bdev(0x55d6ef707800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:26.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-17T21:04:26.271+0000 7f7ec1010780 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-17T21:04:30.147 DEBUG:teuthology.orchestra.run.trial092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-17T21:04:30.212 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-17T21:04:30.238 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:04:30.239 INFO:tasks.ceph:role: osd.3 2026-02-17T21:04:30.239 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:04:30.239 DEBUG:teuthology.orchestra.run.trial138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-17T21:04:30.303 INFO:teuthology.orchestra.run.trial138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:04:30.303 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:04:30.303 INFO:teuthology.orchestra.run.trial138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:04:30.303 INFO:teuthology.orchestra.run.trial138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:04:30.303 INFO:teuthology.orchestra.run.trial138.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:04:30.303 INFO:teuthology.orchestra.run.trial138.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:04:30.304 INFO:teuthology.orchestra.run.trial138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:04:30.304 INFO:teuthology.orchestra.run.trial138.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:04:30.304 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:04:30.304 INFO:teuthology.orchestra.run.trial138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:04:30.877 INFO:teuthology.orchestra.run.trial138.stdout:Discarding blocks...Done. 2026-02-17T21:04:30.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial138.front.sepia.ceph.com -o noatime 2026-02-17T21:04:30.879 DEBUG:teuthology.orchestra.run.trial138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-17T21:04:30.947 DEBUG:teuthology.orchestra.run.trial138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-17T21:04:31.014 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-17T21:04:31.078 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:04:31.078 INFO:tasks.ceph:role: osd.7 2026-02-17T21:04:31.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:04:31.079 DEBUG:teuthology.orchestra.run.trial138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-17T21:04:31.143 INFO:teuthology.orchestra.run.trial138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:04:31.143 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:04:31.143 INFO:teuthology.orchestra.run.trial138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:04:31.143 INFO:teuthology.orchestra.run.trial138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:04:31.143 INFO:teuthology.orchestra.run.trial138.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:04:31.143 INFO:teuthology.orchestra.run.trial138.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:04:31.144 INFO:teuthology.orchestra.run.trial138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:04:31.144 INFO:teuthology.orchestra.run.trial138.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:04:31.144 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:04:31.144 INFO:teuthology.orchestra.run.trial138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:04:31.701 INFO:teuthology.orchestra.run.trial138.stdout:Discarding blocks...Done. 2026-02-17T21:04:31.703 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial138.front.sepia.ceph.com -o noatime 2026-02-17T21:04:31.704 DEBUG:teuthology.orchestra.run.trial138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-17T21:04:31.772 DEBUG:teuthology.orchestra.run.trial138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-17T21:04:31.838 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-17T21:04:31.901 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:04:31.901 INFO:tasks.ceph:role: osd.11 2026-02-17T21:04:31.901 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:04:31.902 DEBUG:teuthology.orchestra.run.trial138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-17T21:04:31.966 INFO:teuthology.orchestra.run.trial138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:04:31.966 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:04:31.966 INFO:teuthology.orchestra.run.trial138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:04:31.966 INFO:teuthology.orchestra.run.trial138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:04:31.966 INFO:teuthology.orchestra.run.trial138.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:04:31.967 INFO:teuthology.orchestra.run.trial138.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:04:31.967 INFO:teuthology.orchestra.run.trial138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:04:31.967 INFO:teuthology.orchestra.run.trial138.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:04:31.967 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:04:31.967 INFO:teuthology.orchestra.run.trial138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:04:32.525 INFO:teuthology.orchestra.run.trial138.stdout:Discarding blocks...Done. 2026-02-17T21:04:32.527 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial138.front.sepia.ceph.com -o noatime 2026-02-17T21:04:32.528 DEBUG:teuthology.orchestra.run.trial138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-17T21:04:32.596 DEBUG:teuthology.orchestra.run.trial138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-17T21:04:32.662 DEBUG:teuthology.orchestra.run.trial138:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-17T21:04:32.726 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-17T21:04:32.726 INFO:tasks.ceph:role: osd.15 2026-02-17T21:04:32.726 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:04:32.727 DEBUG:teuthology.orchestra.run.trial138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-17T21:04:32.793 INFO:teuthology.orchestra.run.trial138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-17T21:04:32.794 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-17T21:04:32.794 INFO:teuthology.orchestra.run.trial138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-17T21:04:32.794 INFO:teuthology.orchestra.run.trial138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-17T21:04:32.794 INFO:teuthology.orchestra.run.trial138.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-17T21:04:32.794 INFO:teuthology.orchestra.run.trial138.stdout: = sunit=0 swidth=0 blks 2026-02-17T21:04:32.794 INFO:teuthology.orchestra.run.trial138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-17T21:04:32.794 INFO:teuthology.orchestra.run.trial138.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-17T21:04:32.794 INFO:teuthology.orchestra.run.trial138.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-17T21:04:32.794 INFO:teuthology.orchestra.run.trial138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-17T21:04:33.350 INFO:teuthology.orchestra.run.trial138.stdout:Discarding blocks...Done. 2026-02-17T21:04:33.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial138.front.sepia.ceph.com -o noatime 2026-02-17T21:04:33.352 DEBUG:teuthology.orchestra.run.trial138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-17T21:04:33.429 DEBUG:teuthology.orchestra.run.trial138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-17T21:04:33.495 DEBUG:teuthology.orchestra.run.trial138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:33.573 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:33.576+0000 7f9023119780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-17T21:04:33.574 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:33.576+0000 7f9023119780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-17T21:04:33.574 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:33.576+0000 7f9023119780 -1 bdev(0x55e3c8895800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:33.574 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:33.576+0000 7f9023119780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-17T21:04:37.458 DEBUG:teuthology.orchestra.run.trial138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-17T21:04:37.523 DEBUG:teuthology.orchestra.run.trial138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:37.601 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:37.604+0000 7ffb8480d780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-17T21:04:37.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:37.604+0000 7ffb8480d780 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-17T21:04:37.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:37.604+0000 7ffb8480d780 -1 bdev(0x55c7706af800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:37.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:37.604+0000 7ffb8480d780 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-17T21:04:41.486 DEBUG:teuthology.orchestra.run.trial138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-17T21:04:41.552 DEBUG:teuthology.orchestra.run.trial138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:41.630 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:41.632+0000 7f338a41a780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-17T21:04:41.630 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:41.632+0000 7f338a41a780 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-17T21:04:41.630 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:41.632+0000 7f338a41a780 -1 bdev(0x55e07bf25800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:41.630 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:41.632+0000 7f338a41a780 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-17T21:04:45.513 DEBUG:teuthology.orchestra.run.trial138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-17T21:04:45.578 DEBUG:teuthology.orchestra.run.trial138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:45.656 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:45.658+0000 7fac1b00f780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-17T21:04:45.656 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:45.658+0000 7fac1b00f780 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-17T21:04:45.656 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:45.658+0000 7fac1b00f780 -1 bdev(0x55d806411800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-17T21:04:45.656 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:04:45.658+0000 7fac1b00f780 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-17T21:04:49.537 DEBUG:teuthology.orchestra.run.trial138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-17T21:04:49.601 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-17T21:04:49.601 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:04:49.601 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-17T21:04:49.628 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:04:49.628 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-17T21:04:49.692 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:04:49.692 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-17T21:04:49.756 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:04:49.756 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-17T21:04:49.819 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:04:49.819 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-17T21:04:49.882 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:04:49.883 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-17T21:04:49.910 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:04:49.910 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-17T21:04:49.975 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:04:49.975 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-17T21:04:50.039 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:04:50.039 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-17T21:04:50.103 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:04:50.103 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-17T21:04:50.134 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:04:50.134 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-17T21:04:50.203 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:04:50.203 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-17T21:04:50.271 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:04:50.272 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-17T21:04:50.337 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:04:50.337 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-17T21:04:50.363 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:04:50.364 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-17T21:04:50.427 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:04:50.428 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-17T21:04:50.491 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:04:50.492 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-17T21:04:50.555 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:04:50.555 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-17T21:04:50.618 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:04:50.618 DEBUG:teuthology.orchestra.run.trial138:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-17T21:04:50.674 INFO:tasks.ceph:Adding keys to all mons... 2026-02-17T21:04:50.675 DEBUG:teuthology.orchestra.run.trial045:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T21:04:50.677 DEBUG:teuthology.orchestra.run.trial086:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T21:04:50.680 DEBUG:teuthology.orchestra.run.trial092:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-17T21:04:50.699 INFO:teuthology.orchestra.run.trial045.stdout:[mgr.y] 2026-02-17T21:04:50.699 INFO:teuthology.orchestra.run.trial045.stdout: key = AQCj15RpAMwzMhAARDZMmQ43o6KdcH1khE2atw== 2026-02-17T21:04:50.699 INFO:teuthology.orchestra.run.trial045.stdout:[osd.0] 2026-02-17T21:04:50.699 INFO:teuthology.orchestra.run.trial045.stdout: key = AQCn15Rp6PPbFBAAxRqJ8CpJx+usx17PIufL3Q== 2026-02-17T21:04:50.699 INFO:teuthology.orchestra.run.trial045.stdout:[osd.4] 2026-02-17T21:04:50.699 INFO:teuthology.orchestra.run.trial045.stdout: key = AQCr15Rp53VgFxAAMtGM+yQ+Pkc5N3bVprOwrg== 2026-02-17T21:04:50.699 INFO:teuthology.orchestra.run.trial045.stdout:[osd.8] 2026-02-17T21:04:50.699 INFO:teuthology.orchestra.run.trial045.stdout: key = AQCv15RpRyfiGBAAr+sJdFKy8nBOOVWpXmxgqg== 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout:[osd.12] 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout: key = AQCz15RpenotGxAAkFWYipY0cPVVfvhz650ImQ== 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout:[osd.1] 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout: key = AQC615RpZREcLhAAFJF3CY2/46883v6mYpdQ1Q== 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout:[osd.5] 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout: key = AQC+15RpgQcUMBAA+VIiXY0ZHVWPqLqOTxcJ6g== 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout:[osd.9] 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDC15RpC6EtMhAAMCmM7598oKpR6Lh29v4M9A== 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout:[osd.13] 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDG15RpQvCaMxAAeZvsWxXwVTgnJcSEMeTbAA== 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout:[osd.2] 2026-02-17T21:04:50.700 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDO15RpHDNRCxAAve8Ba5idqoh9gtE3vl45Pg== 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout:[osd.6] 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDS15RpLKi9DBAAwJKxYJSgCkcUU/iwlt/ARQ== 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout:[osd.10] 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDW15Rp4oYYDhAAJh7M/7zmXkGFUL9qsGq+4Q== 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout:[osd.14] 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDa15RpT70xEBAAozQhNkAUg7Ra3VFCwt/iHQ== 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout:[mgr.x] 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout: key = AQCj15RpeZWeNBAAtzdUtAg1wKSQajqlpwiFcw== 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout:[osd.3] 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDh15RpFZtnIhAADfJapJD0Y+QuqM5UB9d92w== 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout:[osd.7] 2026-02-17T21:04:50.701 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDl15RpnYQTJBAAIYf5r4S73Mw4164/yp8GuQ== 2026-02-17T21:04:50.702 INFO:teuthology.orchestra.run.trial045.stdout:[osd.11] 2026-02-17T21:04:50.702 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDp15RpSY6+JRAAVEWDObIMajHHwu6H+JCSmw== 2026-02-17T21:04:50.702 INFO:teuthology.orchestra.run.trial045.stdout:[osd.15] 2026-02-17T21:04:50.702 INFO:teuthology.orchestra.run.trial045.stdout: key = AQDt15RprNFLJxAAJFpW8V9uFop3RXc/WtMSbQ== 2026-02-17T21:04:50.702 INFO:teuthology.orchestra.run.trial045.stdout:[client.0] 2026-02-17T21:04:50.702 INFO:teuthology.orchestra.run.trial045.stdout: key = AQCj15RpkYEoORAAO7LhztTAy5CLYk42Ng9X6Q== 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout:[mgr.y] 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout: key = AQCj15RpAMwzMhAARDZMmQ43o6KdcH1khE2atw== 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout:[osd.0] 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout: key = AQCn15Rp6PPbFBAAxRqJ8CpJx+usx17PIufL3Q== 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout:[osd.4] 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout: key = AQCr15Rp53VgFxAAMtGM+yQ+Pkc5N3bVprOwrg== 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout:[osd.8] 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout: key = AQCv15RpRyfiGBAAr+sJdFKy8nBOOVWpXmxgqg== 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout:[osd.12] 2026-02-17T21:04:50.703 INFO:teuthology.orchestra.run.trial086.stdout: key = AQCz15RpenotGxAAkFWYipY0cPVVfvhz650ImQ== 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout:[osd.1] 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout: key = AQC615RpZREcLhAAFJF3CY2/46883v6mYpdQ1Q== 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout:[osd.5] 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout: key = AQC+15RpgQcUMBAA+VIiXY0ZHVWPqLqOTxcJ6g== 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout:[osd.9] 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDC15RpC6EtMhAAMCmM7598oKpR6Lh29v4M9A== 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout:[osd.13] 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDG15RpQvCaMxAAeZvsWxXwVTgnJcSEMeTbAA== 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout:[osd.2] 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDO15RpHDNRCxAAve8Ba5idqoh9gtE3vl45Pg== 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout:[osd.6] 2026-02-17T21:04:50.704 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDS15RpLKi9DBAAwJKxYJSgCkcUU/iwlt/ARQ== 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout:[osd.10] 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDW15Rp4oYYDhAAJh7M/7zmXkGFUL9qsGq+4Q== 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout:[osd.14] 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDa15RpT70xEBAAozQhNkAUg7Ra3VFCwt/iHQ== 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout:[mgr.x] 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout: key = AQCj15RpeZWeNBAAtzdUtAg1wKSQajqlpwiFcw== 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout:[osd.3] 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDh15RpFZtnIhAADfJapJD0Y+QuqM5UB9d92w== 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout:[osd.7] 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDl15RpnYQTJBAAIYf5r4S73Mw4164/yp8GuQ== 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout:[osd.11] 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDp15RpSY6+JRAAVEWDObIMajHHwu6H+JCSmw== 2026-02-17T21:04:50.705 INFO:teuthology.orchestra.run.trial086.stdout:[osd.15] 2026-02-17T21:04:50.706 INFO:teuthology.orchestra.run.trial086.stdout: key = AQDt15RprNFLJxAAJFpW8V9uFop3RXc/WtMSbQ== 2026-02-17T21:04:50.706 INFO:teuthology.orchestra.run.trial086.stdout:[client.0] 2026-02-17T21:04:50.706 INFO:teuthology.orchestra.run.trial086.stdout: key = AQCj15RpkYEoORAAO7LhztTAy5CLYk42Ng9X6Q== 2026-02-17T21:04:50.708 INFO:teuthology.orchestra.run.trial092.stdout:[mgr.y] 2026-02-17T21:04:50.708 INFO:teuthology.orchestra.run.trial092.stdout: key = AQCj15RpAMwzMhAARDZMmQ43o6KdcH1khE2atw== 2026-02-17T21:04:50.708 INFO:teuthology.orchestra.run.trial092.stdout:[osd.0] 2026-02-17T21:04:50.708 INFO:teuthology.orchestra.run.trial092.stdout: key = AQCn15Rp6PPbFBAAxRqJ8CpJx+usx17PIufL3Q== 2026-02-17T21:04:50.708 INFO:teuthology.orchestra.run.trial092.stdout:[osd.4] 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout: key = AQCr15Rp53VgFxAAMtGM+yQ+Pkc5N3bVprOwrg== 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout:[osd.8] 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout: key = AQCv15RpRyfiGBAAr+sJdFKy8nBOOVWpXmxgqg== 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout:[osd.12] 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout: key = AQCz15RpenotGxAAkFWYipY0cPVVfvhz650ImQ== 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout:[osd.1] 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout: key = AQC615RpZREcLhAAFJF3CY2/46883v6mYpdQ1Q== 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout:[osd.5] 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout: key = AQC+15RpgQcUMBAA+VIiXY0ZHVWPqLqOTxcJ6g== 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout:[osd.9] 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDC15RpC6EtMhAAMCmM7598oKpR6Lh29v4M9A== 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout:[osd.13] 2026-02-17T21:04:50.709 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDG15RpQvCaMxAAeZvsWxXwVTgnJcSEMeTbAA== 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout:[osd.2] 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDO15RpHDNRCxAAve8Ba5idqoh9gtE3vl45Pg== 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout:[osd.6] 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDS15RpLKi9DBAAwJKxYJSgCkcUU/iwlt/ARQ== 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout:[osd.10] 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDW15Rp4oYYDhAAJh7M/7zmXkGFUL9qsGq+4Q== 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout:[osd.14] 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDa15RpT70xEBAAozQhNkAUg7Ra3VFCwt/iHQ== 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout:[mgr.x] 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout: key = AQCj15RpeZWeNBAAtzdUtAg1wKSQajqlpwiFcw== 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout:[osd.3] 2026-02-17T21:04:50.710 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDh15RpFZtnIhAADfJapJD0Y+QuqM5UB9d92w== 2026-02-17T21:04:50.711 INFO:teuthology.orchestra.run.trial092.stdout:[osd.7] 2026-02-17T21:04:50.711 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDl15RpnYQTJBAAIYf5r4S73Mw4164/yp8GuQ== 2026-02-17T21:04:50.711 INFO:teuthology.orchestra.run.trial092.stdout:[osd.11] 2026-02-17T21:04:50.711 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDp15RpSY6+JRAAVEWDObIMajHHwu6H+JCSmw== 2026-02-17T21:04:50.711 INFO:teuthology.orchestra.run.trial092.stdout:[osd.15] 2026-02-17T21:04:50.711 INFO:teuthology.orchestra.run.trial092.stdout: key = AQDt15RprNFLJxAAJFpW8V9uFop3RXc/WtMSbQ== 2026-02-17T21:04:50.711 INFO:teuthology.orchestra.run.trial092.stdout:[client.0] 2026-02-17T21:04:50.711 INFO:teuthology.orchestra.run.trial092.stdout: key = AQCj15RpkYEoORAAO7LhztTAy5CLYk42Ng9X6Q== 2026-02-17T21:04:50.711 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:04:50.749 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:04:50.752 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:04:50.797 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:50.831 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:50.834 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:50.876 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:50.911 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:50.914 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:50.954 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:50.991 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:50.994 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.035 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.070 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.073 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.115 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.149 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.152 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.196 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.229 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.232 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.275 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.309 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.312 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.354 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.389 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.394 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.433 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.468 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.473 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.512 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.549 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.553 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.593 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.629 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.632 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.672 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.708 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.711 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.752 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:04:51.788 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:04:51.791 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-17T21:04:51.831 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.868 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.871 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.911 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.948 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.951 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:51.991 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:52.028 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:52.032 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:52.072 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:52.107 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:52.111 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-17T21:04:52.150 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T21:04:52.186 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T21:04:52.190 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-17T21:04:52.230 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-17T21:04:52.230 DEBUG:teuthology.orchestra.run.trial045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-17T21:04:52.290 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T21:04:52.378 DEBUG:teuthology.orchestra.run.trial045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-17T21:04:52.402 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-17T21:04:52.428 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T21:04:52.517 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-17T21:04:52.542 DEBUG:teuthology.orchestra.run.trial092:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-17T21:04:52.568 DEBUG:teuthology.orchestra.run.trial092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-17T21:04:52.655 DEBUG:teuthology.orchestra.run.trial092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-17T21:04:52.679 DEBUG:teuthology.orchestra.run.trial045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:52.682 DEBUG:teuthology.orchestra.run.trial086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:52.685 DEBUG:teuthology.orchestra.run.trial092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-17T21:04:52.735 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-17T21:04:52.736 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T21:04:52.736 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-17T21:04:52.736 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-17T21:04:52.739 INFO:tasks.ceph.mon.a:Started 2026-02-17T21:04:52.739 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T21:04:52.739 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-17T21:04:52.739 DEBUG:teuthology.orchestra.run.trial086:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-17T21:04:52.742 INFO:tasks.ceph.mon.b:Started 2026-02-17T21:04:52.742 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-17T21:04:52.742 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-17T21:04:52.743 DEBUG:teuthology.orchestra.run.trial092:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-17T21:04:52.777 INFO:tasks.ceph.mon.c:Started 2026-02-17T21:04:52.777 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-17T21:04:52.777 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-17T21:04:52.778 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-17T21:04:52.780 INFO:tasks.ceph.mgr.y:Started 2026-02-17T21:04:52.780 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-17T21:04:52.780 DEBUG:teuthology.orchestra.run.trial138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-17T21:04:52.783 INFO:tasks.ceph.mgr.x:Started 2026-02-17T21:04:52.783 INFO:tasks.ceph:Setting crush tunables to default 2026-02-17T21:04:52.783 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph osd crush tunables default 2026-02-17T21:04:52.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.859+0000 7f0cc5561640 10 monclient: get_monmap_and_config 2026-02-17T21:04:52.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.859+0000 7f0cc5561640 10 monclient: build_initial_monmap 2026-02-17T21:04:52.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.859+0000 7f0cc5561640 10 monclient: monmap: 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:04:52.860513+0000 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:04:52.860513+0000 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:04:52.852 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:04:52.853 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 1 Processor -- start 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 1 -- start start 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient: init 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient: _reopen_session rank -1 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient: _add_conns ranks=[3,5,1,0,2,4] 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 0x7f0cc015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient(hunting): picked mon.noname-a con 0x7f0cc015d1e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 0x7f0cc00c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient(hunting): picked mon.noname-c con 0x7f0cc00748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0cc00c90e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:04:52.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00c9570 con 0x7f0cc00c90e0 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient(hunting): start opening mon connection 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5860 con 0x7f0cc015d1e0 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient(hunting): start opening mon connection 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5580 con 0x7f0cc00748e0 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient(hunting): _renew_subs 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cc5561640 10 monclient(hunting): authenticate will time out at 876.490727s 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cbeffd640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 msgr2=0x7f0cc015d5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.860+0000 7f0cbeffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 0x7f0cc015d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.861+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 msgr2=0x7f0cc00c8ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.861+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0cc00c90e0 legacy=0x7f0cc0153610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:04:52.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:52.861+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 0x7f0cc00c8ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:04:53.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.061+0000 7f0cbeffd640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 msgr2=0x7f0cc015d5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:04:53.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.061+0000 7f0cbeffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 0x7f0cc015d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:04:53.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.062+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0cc00c90e0 legacy=0x7f0cc0153610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:04:53.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.062+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 msgr2=0x7f0cc00c8ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:04:53.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.062+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 0x7f0cc00c8ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:04:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.462+0000 7f0cbeffd640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 msgr2=0x7f0cc015d5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:04:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.462+0000 7f0cbeffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 0x7f0cc015d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:04:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.463+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 msgr2=0x7f0cc00c8ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:04:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.463+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0cc00c90e0 legacy=0x7f0cc0153610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:04:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:53.463+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 0x7f0cc00c8ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:04:54.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:54.263+0000 7f0cbeffd640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 msgr2=0x7f0cc015d5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:04:54.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:54.263+0000 7f0cbeffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 0x7f0cc015d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:04:54.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:54.264+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 msgr2=0x7f0cc00c8ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:04:54.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:54.264+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 0x7f0cc00c8ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:04:54.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:54.264+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0cc00c90e0 legacy=0x7f0cc0153610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:04:55.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 10 monclient(hunting): tick 2026-02-17T21:04:55.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:04:55.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 monclient(hunting): continuing hunt 2026-02-17T21:04:55.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:04:55.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 msgr2=0x7f0cc00c8ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:04:55.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0cc00748e0 0x7f0cc00c8ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:04:55.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 msgr2=0x7f0cc015d5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:04:55.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0cc015d1e0 0x7f0cc015d5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:04:55.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0cc00c90e0 legacy=0x7f0cc0153610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 10 monclient: _add_conns ranks=[2,4,0] 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0ca40037f0 addr v1:10.20.193.92:6789/0 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 0x7f0ca4009930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-b con 0x7f0ca4007470 addr v2:10.20.193.86:3300/0 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0ca400a020 addr v1:10.20.193.45:6789/0 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00c7de0 con 0x7f0ca400a020 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00c9570 con 0x7f0ca40037f0 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5860 con 0x7f0ca4007470 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbcff9640 10 monclient(hunting): _renew_subs 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400a020 legacy=0x7f0ca400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbeffd640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40037f0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:04:55.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 msgr2=0x7f0ca4009930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:04:55.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:55.860+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 0x7f0ca4009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:04:56.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:56.061+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400a020 legacy=0x7f0ca400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:04:56.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:56.061+0000 7f0cbeffd640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40037f0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:04:56.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:56.061+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 msgr2=0x7f0ca4009930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:04:56.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:56.061+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 0x7f0ca4009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:04:56.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:56.462+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400a020 legacy=0x7f0ca400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:04:56.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:56.462+0000 7f0cbeffd640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40037f0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:04:56.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:56.462+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 msgr2=0x7f0ca4009930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:04:56.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:56.462+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 0x7f0ca4009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:04:57.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:57.263+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400a020 legacy=0x7f0ca400c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:04:57.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:57.263+0000 7f0cbeffd640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40037f0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:04:57.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:57.263+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 msgr2=0x7f0ca4009930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:04:57.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:57.263+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 0x7f0ca4009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:04:58.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 10 monclient(hunting): tick 2026-02-17T21:04:58.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:04:58.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 1 monclient(hunting): continuing hunt 2026-02-17T21:04:58.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:04:58.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 msgr2=0x7f0ca4009930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:04:58.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4007470 0x7f0ca4009930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:04:58.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40037f0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:04:58.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400a020 legacy=0x7f0ca400c4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:04:58.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbf7fe640 1 -- reap_dead start 2026-02-17T21:04:58.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 10 monclient: _add_conns ranks=[2,3,1,0,4,5] 2026-02-17T21:04:58.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbf7fe640 1 -- reap_dead start 2026-02-17T21:04:58.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0ca400ccb0 addr v1:10.20.193.92:6789/0 2026-02-17T21:04:58.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 0x7f0ca40098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:04:58.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-a con 0x7f0ca400d840 addr v2:10.20.193.45:3300/0 2026-02-17T21:04:58.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0ca400c4e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:04:58.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca400ff60 con 0x7f0ca400c4e0 2026-02-17T21:04:58.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00c7de0 con 0x7f0ca400ccb0 2026-02-17T21:04:58.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:04:58.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5860 con 0x7f0ca400d840 2026-02-17T21:04:58.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbcff9640 10 monclient(hunting): _renew_subs 2026-02-17T21:04:58.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:04:58.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:04:58.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:04:58.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:58.860+0000 7f0cbeffd640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca400ccb0 legacy=0x7f0ca400d090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:04:59.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:59.060+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:04:59.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:59.060+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:04:59.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:59.060+0000 7f0cbeffd640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca400ccb0 legacy=0x7f0ca400d090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:04:59.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:59.060+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:04:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:59.461+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:04:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:59.461+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:04:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:59.461+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:04:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:04:59.461+0000 7f0cbeffd640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca400ccb0 legacy=0x7f0ca400d090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:05:00.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:00.262+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:05:00.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:00.262+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:05:00.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:00.262+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:05:00.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:00.262+0000 7f0cbeffd640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca400ccb0 legacy=0x7f0ca400d090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:05:01.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.859+0000 7f0cbcff9640 10 monclient(hunting): tick 2026-02-17T21:05:01.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.859+0000 7f0cbcff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.859+0000 7f0cbcff9640 1 monclient(hunting): continuing hunt 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.859+0000 7f0cbcff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.859+0000 7f0cbcff9640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.859+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca400d840 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.859+0000 7f0cbcff9640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca400ccb0 legacy=0x7f0ca400d090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.859+0000 7f0cbcff9640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 10 monclient: _add_conns ranks=[0,5,4] 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0ca400ee60 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 0x7f0ca40152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-c con 0x7f0ca400f9b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:01.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 0x7f0ca4017d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-b con 0x7f0ca4015960 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00c9570 con 0x7f0ca400ee60 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5860 con 0x7f0ca4015960 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5580 con 0x7f0ca400f9b0 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbcff9640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbeffd640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400ee60 legacy=0x7f0ca400f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 msgr2=0x7f0ca40152c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 0x7f0ca40152c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbf7fe640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4017d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:05:01.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:01.860+0000 7f0cbf7fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 0x7f0ca4017d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:05:02.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.061+0000 7f0cbeffd640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400ee60 legacy=0x7f0ca400f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:05:02.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.061+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 msgr2=0x7f0ca40152c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:05:02.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.061+0000 7f0cbf7fe640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4017d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:05:02.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.061+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 0x7f0ca40152c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:05:02.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.061+0000 7f0cbf7fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 0x7f0ca4017d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:05:02.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.462+0000 7f0cbeffd640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400ee60 legacy=0x7f0ca400f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:05:02.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.462+0000 7f0cbf7fe640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4017d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:05:02.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.462+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 msgr2=0x7f0ca40152c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:05:02.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.462+0000 7f0cbf7fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 0x7f0ca4017d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:05:02.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:02.462+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 0x7f0ca40152c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:05:03.115 INFO:tasks.ceph.mon.b.trial086.stderr:--00:00:00:10.324 26599-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/8e/304f65e79c5537b8c7950a0e2b40c29362732c.debug 2026-02-17T21:05:03.234 INFO:tasks.ceph.mon.a.trial045.stderr:--00:00:00:10.447 26667-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/8e/304f65e79c5537b8c7950a0e2b40c29362732c.debug 2026-02-17T21:05:03.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:03.263+0000 7f0cbeffd640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400ee60 legacy=0x7f0ca400f240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:05:03.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:03.263+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 msgr2=0x7f0ca40152c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:05:03.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:03.263+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 0x7f0ca40152c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:05:03.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:03.263+0000 7f0cbf7fe640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4017d80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:05:03.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:03.263+0000 7f0cbf7fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 0x7f0ca4017d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:05:03.264 INFO:tasks.ceph.mon.c.trial092.stderr:--00:00:00:10.438 26295-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/8e/304f65e79c5537b8c7950a0e2b40c29362732c.debug 2026-02-17T21:05:04.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 10 monclient(hunting): tick 2026-02-17T21:05:04.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:05:04.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 monclient(hunting): continuing hunt 2026-02-17T21:05:04.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:05:04.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 msgr2=0x7f0ca40152c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca400f9b0 0x7f0ca40152c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4017d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4015960 0x7f0ca4017d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400ee60 legacy=0x7f0ca400f240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbf7fe640 1 -- reap_dead start 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 10 monclient: _add_conns ranks=[5,0,2,3,4,1] 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbf7fe640 1 -- reap_dead start 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 0x7f0ca4018490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-c con 0x7f0ca4015960 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0ca400c4e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0ca40190e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:05:04.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca400ff60 con 0x7f0ca400c4e0 2026-02-17T21:05:04.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00c9570 con 0x7f0ca40190e0 2026-02-17T21:05:04.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:04.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5860 con 0x7f0ca4015960 2026-02-17T21:05:04.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbcff9640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:04.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbe7fc640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca40189d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:05:04.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40190e0 legacy=0x7f0ca400de20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:05:04.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbeffd640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4018490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:05:04.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:04.861+0000 7f0cbeffd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 0x7f0ca4018490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:05:05.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:05.062+0000 7f0cbe7fc640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca40189d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:05:05.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:05.062+0000 7f0cbeffd640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4018490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:05:05.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:05.062+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40190e0 legacy=0x7f0ca400de20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:05:05.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:05.062+0000 7f0cbeffd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 0x7f0ca4018490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:05:05.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:05.463+0000 7f0cbe7fc640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca40189d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:05:05.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:05.463+0000 7f0cbeffd640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4018490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:05:05.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:05.463+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40190e0 legacy=0x7f0ca400de20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:05:05.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:05.463+0000 7f0cbeffd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 0x7f0ca4018490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:05:06.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:06.264+0000 7f0cbe7fc640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca40189d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.45:6789/0 2026-02-17T21:05:06.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:06.264+0000 7f0cbf7fe640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40190e0 legacy=0x7f0ca400de20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.92:6789/0 2026-02-17T21:05:06.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:06.264+0000 7f0cbeffd640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4018490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.92:3300/0 2026-02-17T21:05:06.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:06.264+0000 7f0cbeffd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 0x7f0ca4018490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:05:07.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient(hunting): tick 2026-02-17T21:05:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:05:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 monclient(hunting): continuing hunt 2026-02-17T21:05:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:05:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 -- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 msgr2=0x7f0ca4018490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4015960 0x7f0ca4018490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 -- >> v1:10.20.193.92:6789/0 conn(0x7f0ca40190e0 legacy=0x7f0ca400de20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 -- >> v1:10.20.193.45:6789/0 conn(0x7f0ca400c4e0 legacy=0x7f0ca40189d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient: _add_conns ranks=[1,4,3] 2026-02-17T21:05:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0ca400f540 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 0x7f0ca40098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-b con 0x7f0ca4017eb0 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 0x7f0ca40147d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-a con 0x7f0ca40123b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00c7de0 con 0x7f0ca400f540 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5860 con 0x7f0ca40123b0 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5580 con 0x7f0ca4017eb0 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbcff9640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbf7fe640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 msgr2=0x7f0ca40147d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:05:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbf7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 0x7f0ca40147d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:05:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:05:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbeffd640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400f540 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:05:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:07.861+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:05:08.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.062+0000 7f0cbf7fe640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 msgr2=0x7f0ca40147d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:05:08.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.062+0000 7f0cbf7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 0x7f0ca40147d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:05:08.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.062+0000 7f0cbeffd640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400f540 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:05:08.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.062+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:05:08.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.062+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:05:08.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.463+0000 7f0cbf7fe640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 msgr2=0x7f0ca40147d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:05:08.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.463+0000 7f0cbf7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 0x7f0ca40147d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:05:08.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.463+0000 7f0cbeffd640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400f540 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:05:08.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.463+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:05:08.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:08.463+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:05:08.665 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:00:15.874 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:05:08.786 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:00:15.999 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:05:08.814 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:00:16.023 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:05:08.826 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:00:15.999 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:05:08.936 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:00:16.149 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:05:08.977 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:00:16.151 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:05:09.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:09.264+0000 7f0cbf7fe640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 msgr2=0x7f0ca40147d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.45:3300/0 2026-02-17T21:05:09.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:09.264+0000 7f0cbf7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 0x7f0ca40147d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:05:09.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:09.264+0000 7f0cbeffd640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400f540 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.86:6789/0 2026-02-17T21:05:09.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:09.264+0000 7f0cbe7fc640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.86:3300/0 2026-02-17T21:05:09.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:09.264+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:05:10.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 10 monclient(hunting): tick 2026-02-17T21:05:10.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:05:10.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 monclient(hunting): continuing hunt 2026-02-17T21:05:10.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:05:10.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 -- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca40098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:10.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0ca4017eb0 0x7f0ca40098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 -- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 msgr2=0x7f0ca40147d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0ca40123b0 0x7f0ca40147d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 -- >> v1:10.20.193.86:6789/0 conn(0x7f0ca400f540 legacy=0x7f0ca4005c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbf7fe640 1 -- reap_dead start 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 10 monclient: _add_conns ranks=[1,5,0,4,3,2] 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbf7fe640 1 -- reap_dead start 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0ca40123b0 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-c con 0x7f0ca4017eb0 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0ca400c4c0 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:10.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca400ff60 con 0x7f0ca400c4c0 2026-02-17T21:05:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00c7de0 con 0x7f0ca40123b0 2026-02-17T21:05:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5860 con 0x7f0ca4017eb0 2026-02-17T21:05:10.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.861+0000 7f0cbcff9640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.868+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.868+0000 7f0cbe7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:57126/0 (socket says 10.20.193.45:57126) 2026-02-17T21:05:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.868+0000 7f0cbe7fc640 1 -- 10.20.193.45:0/594576463 learned_addr learned my addr 10.20.193.45:0/594576463 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:05:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.868+0000 7f0cbe7fc640 10 monclient(hunting): get_auth_request con 0x7f0ca4017eb0 auth_method 0 2026-02-17T21:05:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.868+0000 7f0cbe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.868+0000 7f0cbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.868+0000 7f0cbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.869+0000 7f0cbe7fc640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca4018470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T21:05:10.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.869+0000 7f0cbe7fc640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca4018470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.869+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:10.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:10.869+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:05:11.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.070+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:11.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.070+0000 7f0cbe7fc640 10 monclient(hunting): get_auth_request con 0x7f0ca4017eb0 auth_method 0 2026-02-17T21:05:11.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.070+0000 7f0cbe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:11.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.070+0000 7f0cbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:11.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.070+0000 7f0cbe7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:11.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.071+0000 7f0cbe7fc640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca4018470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T21:05:11.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.071+0000 7f0cbe7fc640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca4018470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:11.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.071+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:11.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.071+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:05:11.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.472+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:11.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.472+0000 7f0cbe7fc640 10 monclient(hunting): get_auth_request con 0x7f0ca4017eb0 auth_method 0 2026-02-17T21:05:11.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.472+0000 7f0cbe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:11.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.472+0000 7f0cbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:11.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.472+0000 7f0cbe7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:11.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.473+0000 7f0cbe7fc640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca4018470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T21:05:11.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.473+0000 7f0cbe7fc640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca4018470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:11.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.473+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:11.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:11.473+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:05:12.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:12.274+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:12.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:12.274+0000 7f0cbe7fc640 10 monclient(hunting): get_auth_request con 0x7f0ca4017eb0 auth_method 0 2026-02-17T21:05:12.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:12.274+0000 7f0cbe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:12.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:12.274+0000 7f0cbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:12.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:12.274+0000 7f0cbe7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:12.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:12.275+0000 7f0cbe7fc640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca4018470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T21:05:12.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:12.275+0000 7f0cbe7fc640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca4018470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:12.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:12.275+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:12.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:12.275+0000 7f0cbe7fc640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:05:13.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient(hunting): tick 2026-02-17T21:05:13.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient(hunting): _check_auth_tickets 2026-02-17T21:05:13.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 monclient(hunting): continuing hunt 2026-02-17T21:05:13.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-17T21:05:13.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 msgr2=0x7f0ca4018470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.92:3300/0 conn(0x7f0ca4017eb0 0x7f0ca4018470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 -- 10.20.193.45:0/594576463 >> v1:10.20.193.86:6789/0 conn(0x7f0ca40123b0 legacy=0x7f0ca4014f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 -- 10.20.193.45:0/594576463 >> v1:10.20.193.45:6789/0 conn(0x7f0ca400c4c0 legacy=0x7f0ca40189b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient: _add_conns ranks=[3,2,4] 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-a con 0x7f0ca40190c0 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0ca4017970 addr v1:10.20.193.92:6789/0 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient(hunting): picked mon.noname-b con 0x7f0ca400f520 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 -- 10.20.193.45:0/594576463 --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc00c9570 con 0x7f0ca4017970 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:13.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 -- 10.20.193.45:0/594576463 --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5860 con 0x7f0ca40190c0 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 1 -- 10.20.193.45:0/594576463 --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc00c5580 con 0x7f0ca400f520 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.861+0000 7f0cbcff9640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request con 0x7f0ca400f520 auth_method 0 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbeffd640 10 monclient(hunting): get_auth_request con 0x7f0ca40190c0 auth_method 0 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:13.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:13.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:13.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 msgr2=0x7f0ca4009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T21:05:13.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 msgr2=0x7f0ca4009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:13.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:13.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.862+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:05:13.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.863+0000 7f0cbeffd640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 msgr2=0x7f0ca40147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T21:05:13.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.863+0000 7f0cbeffd640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 msgr2=0x7f0ca40147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:13.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.863+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:13.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:13.863+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:05:14.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.063+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:14.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.063+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request con 0x7f0ca400f520 auth_method 0 2026-02-17T21:05:14.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.063+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:14.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.063+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:14.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.063+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:14.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.064+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 msgr2=0x7f0ca4009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T21:05:14.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.064+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 msgr2=0x7f0ca4009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:14.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.064+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:14.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.064+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:05:14.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.064+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:14.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.064+0000 7f0cbeffd640 10 monclient(hunting): get_auth_request con 0x7f0ca40190c0 auth_method 0 2026-02-17T21:05:14.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.064+0000 7f0cbeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:14.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.064+0000 7f0cbeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:14.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.064+0000 7f0cbeffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:14.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.065+0000 7f0cbeffd640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 msgr2=0x7f0ca40147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T21:05:14.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.065+0000 7f0cbeffd640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 msgr2=0x7f0ca40147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:14.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.065+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:14.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.065+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T21:05:14.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.465+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:14.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.465+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request con 0x7f0ca400f520 auth_method 0 2026-02-17T21:05:14.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.465+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:14.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.465+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:14.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.465+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:14.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 msgr2=0x7f0ca4009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T21:05:14.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 msgr2=0x7f0ca4009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:14.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:14.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:05:14.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:14.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbeffd640 10 monclient(hunting): get_auth_request con 0x7f0ca40190c0 auth_method 0 2026-02-17T21:05:14.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:14.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:14.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbeffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:14.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbeffd640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 msgr2=0x7f0ca40147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T21:05:14.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbeffd640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 msgr2=0x7f0ca40147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:14.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:14.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:14.466+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T21:05:15.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.267+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:15.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.267+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request con 0x7f0ca400f520 auth_method 0 2026-02-17T21:05:15.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.267+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:15.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.267+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:15.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.267+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:15.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.267+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 msgr2=0x7f0ca4009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-17T21:05:15.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.267+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 msgr2=0x7f0ca4009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:15.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.267+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:15.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.267+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:05:15.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.268+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:15.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.268+0000 7f0cbeffd640 10 monclient(hunting): get_auth_request con 0x7f0ca40190c0 auth_method 0 2026-02-17T21:05:15.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.268+0000 7f0cbeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:15.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.268+0000 7f0cbeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:15.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.268+0000 7f0cbeffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:15.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.268+0000 7f0cbeffd640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 msgr2=0x7f0ca40147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-17T21:05:15.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.268+0000 7f0cbeffd640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 msgr2=0x7f0ca40147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:05:15.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.268+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:05:15.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:15.268+0000 7f0cbeffd640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T21:05:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.310+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2591689415 0 0) 0x7f0cc00c9570 con 0x7f0ca4017970 2026-02-17T21:05:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.310+0000 7f0cbdffb640 10 monclient(hunting): _negotiate 2026-02-17T21:05:16.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.310+0000 7f0cbdffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:16.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.310+0000 7f0cbdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:16.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.310+0000 7f0cbdffb640 10 monclient(hunting): my global_id is 4103 2026-02-17T21:05:16.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.310+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cac003620 con 0x7f0ca4017970 2026-02-17T21:05:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 <== mon.2 v1:10.20.193.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3238232244 0 0) 0x7f0cac003620 con 0x7f0ca4017970 2026-02-17T21:05:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 msgr2=0x7f0ca4009860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.86:3300/0 conn(0x7f0ca400f520 0x7f0ca4009860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 msgr2=0x7f0ca40147a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:05:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 --2- 10.20.193.45:0/594576463 >> v2:10.20.193.45:3300/0 conn(0x7f0ca40190c0 0x7f0ca40147a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient: _finish_hunting 0 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.92:6789/0 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 --> v1:10.20.193.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca4006c30 con 0x7f0ca4017970 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient: _finish_auth 0 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient: _check_auth_tickets 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 <== mon.2 v1:10.20.193.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f0ca80099b0 con 0x7f0ca4017970 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 reap_dead start 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cc5561640 5 monclient: authenticate success, global_id 4103 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cc5561640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient: dump: 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:16.366 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:16.367 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:16.367 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:16.367 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] but i'm connected to v1:10.20.193.92:6789/0, reconnecting 2026-02-17T21:05:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 >> v1:10.20.193.92:6789/0 conn(0x7f0ca4017970 legacy=0x7f0ca400ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:05:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0cac003ae0 0x7f0cac003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient(hunting): picked mon.c con 0x7f0cac003ae0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0cac004900 0x7f0cac004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient(hunting): picked mon.a con 0x7f0cac004900 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac005310 0x7f0cac00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient(hunting): picked mon.b con 0x7f0cac005310 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00c5860 con 0x7f0cac004900 2026-02-17T21:05:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00c5580 con 0x7f0cac005310 2026-02-17T21:05:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac00c2c0 con 0x7f0cac003ae0 2026-02-17T21:05:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cbdffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:05:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.372+0000 7f0cc5561640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.375+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac005310 0x7f0cac00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.375+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request con 0x7f0cac005310 auth_method 0 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.375+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.375+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.375+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.376+0000 7f0cbf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.376+0000 7f0cbf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.376+0000 7f0cbf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 10 monclient(hunting): handle_auth_done global_id 4103 payload 293 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0cac003ae0 msgr2=0x7f0cac003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0cac003ae0 0x7f0cac003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0cac004900 msgr2=0x7f0cac004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0cac004900 0x7f0cac004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 1 monclient: found mon.b 2026-02-17T21:05:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/594576463 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac003620 con 0x7f0cac005310 2026-02-17T21:05:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:05:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:05:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.377+0000 7f0cbf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.379+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac005310 0x7f0cac00bac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0076d20 tx=0x7f0cb002fe70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66c5ec1ffd0c52ea server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.382+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb003e070 con 0x7f0cac005310 2026-02-17T21:05:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.382+0000 7f0cbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.382+0000 7f0cbdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.382+0000 7f0cbdffb640 10 monclient: dump: 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.382+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb00308b0 con 0x7f0cac005310 2026-02-17T21:05:16.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.382+0000 7f0cc5561640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.382+0000 7f0cbdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.382+0000 7f0cbdffb640 1 -- 10.20.193.45:0/594576463 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0036070 con 0x7f0cac005310 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.382+0000 7f0cbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cbdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cbdffb640 10 monclient: dump: 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 4 set_mon_vals no callback set 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 10 monclient: shutdown 2026-02-17T21:05:16.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:16.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 1 -- 10.20.193.45:0/594576463 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac005310 msgr2=0x7f0cac00bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:16.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac005310 0x7f0cac00bac0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0076d20 tx=0x7f0cb002fe70 comp rx=0 tx=0).stop 2026-02-17T21:05:16.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 1 -- 10.20.193.45:0/594576463 shutdown_connections 2026-02-17T21:05:16.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0cac004900 0x7f0cac004d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0cac003ae0 0x7f0cac003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 1 --2- 10.20.193.45:0/594576463 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac005310 0x7f0cac00bac0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 1 -- 10.20.193.45:0/594576463 >> 10.20.193.45:0/594576463 conn(0x7f0cc00c9d40 msgr2=0x7f0cc00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:16.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 1 -- 10.20.193.45:0/594576463 shutdown_connections 2026-02-17T21:05:16.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.383+0000 7f0cc5561640 1 -- 10.20.193.45:0/594576463 wait complete. 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient: build_initial_monmap 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient: monmap: 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:16.380 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 librados: starting msgr at 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 librados: starting objecter 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 Processor -- start 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 -- start start 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 librados: setting wanted keys 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 librados: calling monclient init 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient: init 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ca4017970 0x7f0cc0156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient(hunting): picked mon.noname-c con 0x7f0ca4017970 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0cac003ae0 0x7f0cc00cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient(hunting): picked mon.noname-a con 0x7f0cac003ae0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac004900 0x7f0cc0146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient(hunting): picked mon.noname-b con 0x7f0cac004900 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:16.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00c8680 con 0x7f0cac003ae0 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00c83a0 con 0x7f0cac004900 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc0074d30 con 0x7f0ca4017970 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.384+0000 7f0cc5561640 10 monclient(hunting): authenticate will time out at 900.014974s 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.385+0000 7f0cbf7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac004900 0x7f0cc0146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.386+0000 7f0cbf7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac004900 0x7f0cc0146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:37952/0 (socket says 10.20.193.45:37952) 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.386+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/2874718327 learned_addr learned my addr 10.20.193.45:0/2874718327 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.386+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request con 0x7f0cac004900 auth_method 0 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.386+0000 7f0cbf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.386+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.386+0000 7f0cbf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.386+0000 7f0cbf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.386+0000 7f0cbf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:16.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.386+0000 7f0cbf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:16.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.392+0000 7f0cbf7fe640 10 monclient(hunting): handle_auth_done global_id 4102 payload 824 2026-02-17T21:05:16.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.392+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/2874718327 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ca4017970 msgr2=0x7f0cc0156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:16.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.392+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/2874718327 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ca4017970 0x7f0cc0156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.392+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/2874718327 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0cac003ae0 msgr2=0x7f0cc00cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:16.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.392+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/2874718327 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0cac003ae0 0x7f0cc00cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.393+0000 7f0cbf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:16.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.393+0000 7f0cbf7fe640 1 monclient: found mon.noname-b 2026-02-17T21:05:16.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.393+0000 7f0cbf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:16.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.393+0000 7f0cbf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:16.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.393+0000 7f0cbf7fe640 1 -- 10.20.193.45:0/2874718327 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc0155d50 con 0x7f0cac004900 2026-02-17T21:05:16.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.394+0000 7f0cbf7fe640 1 --2- 10.20.193.45:0/2874718327 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac004900 0x7f0cc0146ed0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0070d80 tx=0x7f0cb0003ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:16.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.394+0000 7f0c9f7fe640 10 client.?.objecter ms_handle_connect 0x7f0cac004900 2026-02-17T21:05:16.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.394+0000 7f0c9f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 1 -- 10.20.193.45:0/2874718327 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb004c070 con 0x7f0cac004900 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 10 monclient: dump: 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:16.394 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 1 -- 10.20.193.45:0/2874718327 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb0043460 con 0x7f0cac004900 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 1 -- 10.20.193.45:0/2874718327 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb003e040 con 0x7f0cac004900 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0c9f7fe640 10 monclient: dump: 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:16.395 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cbd7fa640 4 set_mon_vals no callback set 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cc5561640 5 monclient: authenticate success, global_id 4102 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cc5561640 10 monclient: _renew_subs 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cc5561640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cc5561640 1 -- 10.20.193.45:0/2874718327 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc0156030 con 0x7f0cac004900 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cc5561640 10 client.4102.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cc5561640 10 monclient: _renew_subs 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cc5561640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cc5561640 1 -- 10.20.193.45:0/2874718327 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc01565f0 con 0x7f0cac004900 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.401+0000 7f0cc5561640 1 librados: init done 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.402+0000 7f0cc5561640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:16.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.402+0000 7f0cc5561640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:16.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.402+0000 7f0cc5561640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:16.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.402+0000 7f0cc5561640 1 -- 10.20.193.45:0/2874718327 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc00698c0 con 0x7f0cac004900 2026-02-17T21:05:16.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.506+0000 7f0c9f7fe640 1 -- 10.20.193.45:0/2874718327 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f0cb0043810 con 0x7f0cac004900 2026-02-17T21:05:16.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.510+0000 7f0c9f7fe640 1 -- 10.20.193.45:0/2874718327 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0cb0050880 con 0x7f0cac004900 2026-02-17T21:05:16.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.510+0000 7f0c9f7fe640 10 client.4102.objecter ms_dispatch2 0x7f0cc0000b90 osd_map(1..1 src has 1..1) 2026-02-17T21:05:16.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.510+0000 7f0c9f7fe640 3 client.4102.objecter handle_osd_map got epochs [1,1] > 0 2026-02-17T21:05:16.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.510+0000 7f0c9f7fe640 3 client.4102.objecter handle_osd_map decoding full epoch 1 2026-02-17T21:05:16.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.510+0000 7f0c9f7fe640 20 client.4102.objecter dump_active .. 0 homeless 2026-02-17T21:05:16.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.510+0000 7f0c9f7fe640 1 -- 10.20.193.45:0/2874718327 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f0cc00698c0 con 0x7f0cac004900 2026-02-17T21:05:16.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.510+0000 7f0c9f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:16.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.510+0000 7f0c9f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:16.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.540+0000 7f0cc5561640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T21:05:16.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.540+0000 7f0cc5561640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T21:05:16.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.540+0000 7f0cc5561640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:16.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.540+0000 7f0cc5561640 1 -- 10.20.193.45:0/2874718327 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0cc015e080 con 0x7f0cac004900 2026-02-17T21:05:16.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.697+0000 7f0c9f7fe640 1 -- 10.20.193.45:0/2874718327 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0cb0056080 con 0x7f0cac004900 2026-02-17T21:05:16.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.697+0000 7f0c9f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-17T21:05:16.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.697+0000 7f0c9f7fe640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-17T21:05:16.689 INFO:teuthology.orchestra.run.trial045.stderr:adjusted tunables profile to default 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 10 librados: watch_flush enter 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 10 librados: watch_flush exit 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 20 client.4102.objecter shutdown clearing up homeless session... 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 10 client.4102.objecter successfully canceled tick 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 10 monclient: shutdown 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 -- 10.20.193.45:0/2874718327 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac004900 msgr2=0x7f0cc0146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 --2- 10.20.193.45:0/2874718327 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac004900 0x7f0cc0146ed0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0070d80 tx=0x7f0cb0003ef0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 -- 10.20.193.45:0/2874718327 shutdown_connections 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 --2- 10.20.193.45:0/2874718327 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0cac004900 0x7f0cc0146ed0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 --2- 10.20.193.45:0/2874718327 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0cac003ae0 0x7f0cc00cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 --2- 10.20.193.45:0/2874718327 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ca4017970 0x7f0cc0156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 -- 10.20.193.45:0/2874718327 >> 10.20.193.45:0/2874718327 conn(0x7f0cc00c9d40 msgr2=0x7f0cc014e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 -- 10.20.193.45:0/2874718327 shutdown_connections 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 -- 10.20.193.45:0/2874718327 wait complete. 2026-02-17T21:05:16.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:16.698+0000 7f0cc5561640 1 librados: shutdown 2026-02-17T21:05:16.698 INFO:tasks.ceph:check_enable_crimson: False 2026-02-17T21:05:16.698 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-17T21:05:16.699 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:05:16.699 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-17T21:05:16.722 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:05:16.722 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-17T21:05:16.747 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:16.756+0000 7ff9fa43a140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T21:05:16.765 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:16.769+0000 7f8daabcd140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-17T21:05:16.768 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:05:16.768 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-17T21:05:16.833 DEBUG:teuthology.orchestra.run.trial045:> set -ex 2026-02-17T21:05:16.833 DEBUG:teuthology.orchestra.run.trial045:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-17T21:05:16.869 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:16.877+0000 7ff9fa43a140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T21:05:16.887 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:16.890+0000 7f8daabcd140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-17T21:05:16.893 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:05:16.893 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-17T21:05:16.897 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:16.905+0000 7ff9fa43a140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T21:05:16.914 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:16.917+0000 7f8daabcd140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-17T21:05:16.920 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:05:16.920 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-17T21:05:16.930 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:16.938+0000 7ff9fa43a140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T21:05:16.947 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:16.951+0000 7f8daabcd140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-17T21:05:16.953 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:16.962+0000 7ff9fa43a140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T21:05:16.970 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:16.974+0000 7f8daabcd140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-17T21:05:16.980 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:16.988+0000 7ff9fa43a140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T21:05:16.985 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:05:16.986 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-17T21:05:16.997 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.000+0000 7f8daabcd140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-17T21:05:17.036 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.045+0000 7ff9fa43a140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T21:05:17.050 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-17T21:05:17.050 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-17T21:05:17.052 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.056+0000 7f8daabcd140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-17T21:05:17.098 INFO:tasks.ceph.mgr.y.trial045.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T21:05:17.099 INFO:tasks.ceph.mgr.y.trial045.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T21:05:17.099 INFO:tasks.ceph.mgr.y.trial045.stderr: from numpy import show_config as show_numpy_config 2026-02-17T21:05:17.102 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.110+0000 7ff9fa43a140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T21:05:17.114 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:05:17.114 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-17T21:05:17.115 INFO:tasks.ceph.mgr.x.trial138.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-17T21:05:17.115 INFO:tasks.ceph.mgr.x.trial138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-17T21:05:17.115 INFO:tasks.ceph.mgr.x.trial138.stderr: from numpy import show_config as show_numpy_config 2026-02-17T21:05:17.117 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.120+0000 7f8daabcd140 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2026-02-17T21:05:17.127 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.136+0000 7ff9fa43a140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T21:05:17.142 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:05:17.142 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-17T21:05:17.143 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.146+0000 7f8daabcd140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-17T21:05:17.183 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.192+0000 7ff9fa43a140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T21:05:17.197 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.201+0000 7f8daabcd140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-17T21:05:17.205 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:05:17.206 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-17T21:05:17.228 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.236+0000 7ff9fa43a140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T21:05:17.240 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.244+0000 7f8daabcd140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-17T21:05:17.254 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.263+0000 7ff9fa43a140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T21:05:17.266 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.270+0000 7f8daabcd140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-17T21:05:17.270 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T21:05:17.270 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-17T21:05:17.279 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.287+0000 7ff9fa43a140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T21:05:17.291 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.294+0000 7f8daabcd140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-17T21:05:17.305 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.313+0000 7ff9fa43a140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T21:05:17.316 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.319+0000 7f8daabcd140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-17T21:05:17.328 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.336+0000 7ff9fa43a140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T21:05:17.334 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:05:17.334 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-17T21:05:17.338 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.342+0000 7f8daabcd140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-17T21:05:17.360 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:05:17.360 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-17T21:05:17.424 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:05:17.424 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-17T21:05:17.488 DEBUG:teuthology.orchestra.run.trial138:> set -ex 2026-02-17T21:05:17.489 DEBUG:teuthology.orchestra.run.trial138:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-17T21:05:17.525 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.533+0000 7ff9fa43a140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T21:05:17.534 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.537+0000 7f8daabcd140 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2026-02-17T21:05:17.553 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 31830c0d-8e16-47bd-b1a6-546e1944d058 0 2026-02-17T21:05:17.579 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.588+0000 7ff9fa43a140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T21:05:17.590 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.593+0000 7f8daabcd140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-17T21:05:17.602 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.610+0000 7ff9fa43a140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T21:05:17.612 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.616+0000 7f8daabcd140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-17T21:05:17.626 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.634+0000 7ff9fa43a140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T21:05:17.636 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.639+0000 7f8daabcd140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-17T21:05:17.656 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.659+0000 7fc445d6a640 10 monclient: get_monmap_and_config 2026-02-17T21:05:17.656 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.659+0000 7fc445d6a640 10 monclient: build_initial_monmap 2026-02-17T21:05:17.656 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.659+0000 7fc445d6a640 10 monclient: monmap: 2026-02-17T21:05:17.656 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:17.656 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.656 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:17.659722+0000 2026-02-17T21:05:17.656 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:17.659722+0000 2026-02-17T21:05:17.657 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:17.657 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.657 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:17.657 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:17.657 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:17.657 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:17.657 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:17.657 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:17.657 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.660 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.659+0000 7fc445d6a640 1 Processor -- start 2026-02-17T21:05:17.660 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.659+0000 7fc445d6a640 1 -- start start 2026-02-17T21:05:17.660 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.659+0000 7fc445d6a640 10 monclient: init 2026-02-17T21:05:17.660 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 10 monclient: _add_conns ranks=[4,0,1,5,2,3] 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc4401156b0 0x7fc440115a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 10 monclient(hunting): picked mon.noname-b con 0x7fc4401156b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc44011a4e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc44011b060 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc440123e30 con 0x7fc44011a4e0 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc440125030 con 0x7fc44011b060 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc440126230 con 0x7fc4401156b0 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc445d6a640 10 monclient(hunting): authenticate will time out at 898.283128s 2026-02-17T21:05:17.661 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc43f7fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc4401156b0 0x7fc440115a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc43effd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc44011a4e0 0x7fc44011a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.138:50274/0 (socket says 10.20.193.138:50274) 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc43effd640 1 -- 10.20.193.138:0/2355993348 learned_addr learned my addr 10.20.193.138:0/2355993348 (peer_addr_for_me v1:10.20.193.138:0/0) 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc43f7fe640 10 monclient(hunting): get_auth_request con 0x7fc4401156b0 auth_method 0 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc43f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc43f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.660+0000 7fc43f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.661+0000 7fc43f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.661+0000 7fc43f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.661+0000 7fc43f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.662+0000 7fc43f7fe640 10 monclient(hunting): handle_auth_done global_id 4108 payload 274 2026-02-17T21:05:17.662 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.662+0000 7fc43f7fe640 1 -- 10.20.193.138:0/2355993348 >> v1:10.20.193.86:6789/0 conn(0x7fc44011b060 legacy=0x7fc4401225e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:17.663 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.662+0000 7fc43f7fe640 1 -- 10.20.193.138:0/2355993348 >> v1:10.20.193.45:6789/0 conn(0x7fc44011a4e0 legacy=0x7fc44011a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:17.663 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.662+0000 7fc43f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:17.663 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.662+0000 7fc43f7fe640 1 monclient: found mon.noname-b 2026-02-17T21:05:17.663 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.662+0000 7fc43f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:17.663 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.662+0000 7fc43f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:17.663 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.662+0000 7fc43f7fe640 1 -- 10.20.193.138:0/2355993348 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4401263b0 con 0x7fc4401156b0 2026-02-17T21:05:17.670 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.664+0000 7fc43f7fe640 1 --2- 10.20.193.138:0/2355993348 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 0x7fc440115a90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0098a0 tx=0x7fc42c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e1259f1b55546dd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:17.670 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 1 -- 10.20.193.138:0/2355993348 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c03c070 con 0x7fc4401156b0 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 10 monclient: dump: 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:17.671 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc445d6a640 5 monclient: authenticate success, global_id 4108 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc445d6a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 1 -- 10.20.193.138:0/2355993348 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c02fa40 con 0x7fc4401156b0 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 1 -- 10.20.193.138:0/2355993348 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c02fe10 con 0x7fc4401156b0 2026-02-17T21:05:17.672 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc43e7fc640 10 monclient: dump: 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.673 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc445d6a640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.665+0000 7fc445d6a640 4 set_mon_vals no callback set 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient: shutdown 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 -- 10.20.193.138:0/2355993348 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 msgr2=0x7fc440115a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 --2- 10.20.193.138:0/2355993348 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 0x7fc440115a90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0098a0 tx=0x7fc42c02ed80 comp rx=0 tx=0).stop 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 -- 10.20.193.138:0/2355993348 shutdown_connections 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 --2- 10.20.193.138:0/2355993348 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 0x7fc440115a90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 -- 10.20.193.138:0/2355993348 >> 10.20.193.138:0/2355993348 conn(0x7fc44006dff0 msgr2=0x7fc44006e400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 -- 10.20.193.138:0/2355993348 shutdown_connections 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 -- 10.20.193.138:0/2355993348 wait complete. 2026-02-17T21:05:17.674 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient: build_initial_monmap 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient: monmap: 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.675 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 librados: starting msgr at 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 librados: starting objecter 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 Processor -- start 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 -- start start 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 librados: setting wanted keys 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 librados: calling monclient init 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient: init 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 0x7fc4401b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient(hunting): picked mon.noname-b con 0x7fc4401156b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc44011a4e0 0x7fc4401b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient(hunting): picked mon.noname-a con 0x7fc44011a4e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:17.676 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc44011b060 0x7fc4401212a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient(hunting): picked mon.noname-c con 0x7fc44011b060 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc4401256c0 con 0x7fc44011a4e0 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc440125540 con 0x7fc4401156b0 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc440125840 con 0x7fc44011b060 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.666+0000 7fc445d6a640 10 monclient(hunting): authenticate will time out at 898.289832s 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 0x7fc4401b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43effd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc44011a4e0 0x7fc4401b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:17.677 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 0x7fc4401b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.138:43204/0 (socket says 10.20.193.138:43204) 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 1 -- 10.20.193.138:0/2730016744 learned_addr learned my addr 10.20.193.138:0/2730016744 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 10 monclient(hunting): get_auth_request con 0x7fc4401156b0 auth_method 0 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43ffff640 1 --2- 10.20.193.138:0/2730016744 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc44011b060 0x7fc4401212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43effd640 10 monclient(hunting): get_auth_request con 0x7fc44011a4e0 auth_method 0 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:17.678 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43ffff640 10 monclient(hunting): get_auth_request con 0x7fc44011b060 auth_method 0 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.667+0000 7fc43effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 10 monclient(hunting): handle_auth_done global_id 4111 payload 824 2026-02-17T21:05:17.679 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 1 -- 10.20.193.138:0/2730016744 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc44011b060 msgr2=0x7fc4401212a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 1 --2- 10.20.193.138:0/2730016744 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc44011b060 0x7fc4401212a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 1 -- 10.20.193.138:0/2730016744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc44011a4e0 msgr2=0x7fc4401b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 1 --2- 10.20.193.138:0/2730016744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc44011a4e0 0x7fc4401b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 1 monclient: found mon.noname-b 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.668+0000 7fc43f7fe640 1 -- 10.20.193.138:0/2730016744 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc440121b60 con 0x7fc4401156b0 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.669+0000 7fc43f7fe640 1 --2- 10.20.193.138:0/2730016744 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 0x7fc4401b17f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009130 tx=0x7fc42c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.669+0000 7fc41bfff640 10 client.?.objecter ms_handle_connect 0x7fc4401156b0 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.669+0000 7fc41bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:17.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc41bfff640 1 -- 10.20.193.138:0/2730016744 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c046020 con 0x7fc4401156b0 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc41bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc41bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc41bfff640 10 monclient: dump: 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:17.681 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc41bfff640 10 monclient: _finish_auth 0 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc41bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc41bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc445d6a640 5 monclient: authenticate success, global_id 4111 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc445d6a640 10 monclient: _renew_subs 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc445d6a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc445d6a640 1 -- 10.20.193.138:0/2730016744 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc440121df0 con 0x7fc4401156b0 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc445d6a640 10 client.4111.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc445d6a640 10 monclient: _renew_subs 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc445d6a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc445d6a640 1 -- 10.20.193.138:0/2730016744 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4401b8650 con 0x7fc4401156b0 2026-02-17T21:05:17.682 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.670+0000 7fc445d6a640 1 librados: init done 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc445d6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc445d6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc445d6a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc445d6a640 1 -- 10.20.193.138:0/2730016744 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc440115a90 con 0x7fc4401156b0 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc41bfff640 1 -- 10.20.193.138:0/2730016744 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c02fa00 con 0x7fc4401156b0 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc41bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc41bfff640 1 -- 10.20.193.138:0/2730016744 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c03c040 con 0x7fc4401156b0 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc41bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc41bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc41bfff640 10 monclient: dump: 2026-02-17T21:05:17.683 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.684 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.671+0000 7fc43dffb640 4 set_mon_vals no callback set 2026-02-17T21:05:17.685 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.688+0000 7ff9fa43a140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:05:17.690 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.693+0000 7f8daabcd140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:05:17.701 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.709+0000 7ff9fa43a140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T21:05:17.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.709+0000 7fc41bfff640 1 -- 10.20.193.138:0/2730016744 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc42c03f030 con 0x7fc4401156b0 2026-02-17T21:05:17.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.709+0000 7fc41bfff640 1 -- 10.20.193.138:0/2730016744 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fc42c054c50 con 0x7fc4401156b0 2026-02-17T21:05:17.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.709+0000 7fc41bfff640 10 client.4111.objecter ms_dispatch2 0x7fc440000b90 osd_map(2..2 src has 1..2) 2026-02-17T21:05:17.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.709+0000 7fc41bfff640 3 client.4111.objecter handle_osd_map got epochs [2,2] > 0 2026-02-17T21:05:17.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.709+0000 7fc41bfff640 3 client.4111.objecter handle_osd_map decoding full epoch 2 2026-02-17T21:05:17.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.709+0000 7fc41bfff640 20 client.4111.objecter dump_active .. 0 homeless 2026-02-17T21:05:17.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.712+0000 7fc41bfff640 1 -- 10.20.193.138:0/2730016744 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc42c050030 con 0x7fc4401156b0 2026-02-17T21:05:17.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.712+0000 7fc41bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:17.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.712+0000 7fc41bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:17.711 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.714+0000 7f8daabcd140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-17T21:05:17.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.744+0000 7fc445d6a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "31830c0d-8e16-47bd-b1a6-546e1944d058", "id": 0}] 2026-02-17T21:05:17.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.744+0000 7fc445d6a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "31830c0d-8e16-47bd-b1a6-546e1944d058", "id": 0}] 2026-02-17T21:05:17.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.744+0000 7fc445d6a640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:17.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.744+0000 7fc445d6a640 1 -- 10.20.193.138:0/2730016744 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "31830c0d-8e16-47bd-b1a6-546e1944d058", "id": 0} v 0) -- 0x7fc4401b8820 con 0x7fc4401156b0 2026-02-17T21:05:17.754 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:17.762+0000 7ff9fa43a140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:05:17.763 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:17.766+0000 7f8daabcd140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-17T21:05:17.814 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.817+0000 7fc41bfff640 1 -- 10.20.193.138:0/2730016744 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "31830c0d-8e16-47bd-b1a6-546e1944d058", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fc42c035e20 con 0x7fc4401156b0 2026-02-17T21:05:17.814 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.817+0000 7fc41bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "31830c0d-8e16-47bd-b1a6-546e1944d058", "id": 0}] 2026-02-17T21:05:17.814 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.817+0000 7fc41bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:17.815 INFO:teuthology.orchestra.run.trial138.stdout:0 2026-02-17T21:05:17.816 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 10 librados: watch_flush enter 2026-02-17T21:05:17.816 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 10 librados: watch_flush exit 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 20 client.4111.objecter shutdown clearing up homeless session... 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 10 client.4111.objecter successfully canceled tick 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 10 monclient: shutdown 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 -- 10.20.193.138:0/2730016744 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 msgr2=0x7fc4401b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 --2- 10.20.193.138:0/2730016744 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 0x7fc4401b17f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009130 tx=0x7fc42c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 -- 10.20.193.138:0/2730016744 shutdown_connections 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 --2- 10.20.193.138:0/2730016744 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc44011b060 0x7fc4401212a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 --2- 10.20.193.138:0/2730016744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc44011a4e0 0x7fc4401b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 --2- 10.20.193.138:0/2730016744 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc4401156b0 0x7fc4401b17f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 -- 10.20.193.138:0/2730016744 >> 10.20.193.138:0/2730016744 conn(0x7fc44006dff0 msgr2=0x7fc440113530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:17.818 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 -- 10.20.193.138:0/2730016744 shutdown_connections 2026-02-17T21:05:17.818 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 -- 10.20.193.138:0/2730016744 wait complete. 2026-02-17T21:05:17.818 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.818+0000 7fc445d6a640 1 librados: shutdown 2026-02-17T21:05:17.823 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 3ea1022b-6b00-44df-afe7-b679d0637204 1 2026-02-17T21:05:17.928 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient: get_monmap_and_config 2026-02-17T21:05:17.928 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient: build_initial_monmap 2026-02-17T21:05:17.928 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient: monmap: 2026-02-17T21:05:17.928 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:17.928 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.928 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:17.931393+0000 2026-02-17T21:05:17.928 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:17.931393+0000 2026-02-17T21:05:17.928 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:17.929 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.929 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:17.929 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:17.929 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:17.929 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:17.929 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:17.929 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:17.929 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 1 Processor -- start 2026-02-17T21:05:17.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 1 -- start start 2026-02-17T21:05:17.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient: init 2026-02-17T21:05:17.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:17.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient: _add_conns ranks=[4,1,3,0,2,5] 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f13c81156b0 0x7f13c8115a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient(hunting): picked mon.noname-b con 0x7f13c81156b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f13c811a4e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f13c811b060 0x7f13c81225e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient(hunting): picked mon.noname-a con 0x7f13c811b060 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c8122c50 con 0x7f13c811a4e0 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f13c8123e50 con 0x7f13c811b060 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f13c8123fd0 con 0x7f13c81156b0 2026-02-17T21:05:17.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.931+0000 7f13d03dc640 10 monclient(hunting): authenticate will time out at 898.554836s 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f13c81156b0 0x7f13c8115a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce952640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f13c811b060 0x7f13c81225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f13c81156b0 0x7f13c8115a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.138:43206/0 (socket says 10.20.193.138:43206) 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 1 -- 10.20.193.138:0/3470100700 learned_addr learned my addr 10.20.193.138:0/3470100700 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 10 monclient(hunting): get_auth_request con 0x7f13c81156b0 auth_method 0 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce952640 10 monclient(hunting): get_auth_request con 0x7f13c811b060 auth_method 0 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce952640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:17.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce952640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce952640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.932+0000 7f13ce151640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce952640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce952640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce952640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce151640 10 monclient(hunting): handle_auth_done global_id 4114 payload 274 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce151640 1 -- 10.20.193.138:0/3470100700 >> v2:10.20.193.45:3300/0 conn(0x7f13c811b060 msgr2=0x7f13c81225e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce151640 1 --2- 10.20.193.138:0/3470100700 >> v2:10.20.193.45:3300/0 conn(0x7f13c811b060 0x7f13c81225e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce151640 1 -- 10.20.193.138:0/3470100700 >> v1:10.20.193.86:6789/0 conn(0x7f13c811a4e0 legacy=0x7f13c811a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:17.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce151640 10 monclient: _finish_hunting 0 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce151640 1 monclient: found mon.noname-b 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce151640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce151640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.933+0000 7f13ce151640 1 -- 10.20.193.138:0/3470100700 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c8124180 con 0x7f13c81156b0 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.935+0000 7f13ce151640 1 --2- 10.20.193.138:0/3470100700 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13c81156b0 0x7f13c8115a90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13c8116180 tx=0x7f13b802ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b8abea215a8b0ca server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.936+0000 7f13cd14f640 1 -- 10.20.193.138:0/3470100700 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b803c070 con 0x7f13c81156b0 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.936+0000 7f13cd14f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.936+0000 7f13cd14f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.936+0000 7f13cd14f640 10 monclient: dump: 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.937 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.936+0000 7f13cd14f640 10 monclient: _finish_auth 0 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.936+0000 7f13cd14f640 10 monclient: _check_auth_tickets 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.936+0000 7f13cd14f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.936+0000 7f13d03dc640 5 monclient: authenticate success, global_id 4114 2026-02-17T21:05:17.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.936+0000 7f13d03dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:17.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13cd14f640 1 -- 10.20.193.138:0/3470100700 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b802fa80 con 0x7f13c81156b0 2026-02-17T21:05:17.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13cd14f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:17.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13cd14f640 1 -- 10.20.193.138:0/3470100700 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b802fe50 con 0x7f13c81156b0 2026-02-17T21:05:17.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:17.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 4 set_mon_vals no callback set 2026-02-17T21:05:17.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13cd14f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13cd14f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13cd14f640 10 monclient: dump: 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:17.946 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 10 monclient: shutdown 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 -- 10.20.193.138:0/3470100700 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13c81156b0 msgr2=0x7f13c8115a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 --2- 10.20.193.138:0/3470100700 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13c81156b0 0x7f13c8115a90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f13c8116180 tx=0x7f13b802ee10 comp rx=0 tx=0).stop 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 -- 10.20.193.138:0/3470100700 shutdown_connections 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 --2- 10.20.193.138:0/3470100700 >> v2:10.20.193.45:3300/0 conn(0x7f13c811b060 0x7f13c81225e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 --2- 10.20.193.138:0/3470100700 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13c81156b0 0x7f13c8115a90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 -- 10.20.193.138:0/3470100700 >> 10.20.193.138:0/3470100700 conn(0x7f13c806dff0 msgr2=0x7f13c806e400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 -- 10.20.193.138:0/3470100700 shutdown_connections 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 -- 10.20.193.138:0/3470100700 wait complete. 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 10 monclient: build_initial_monmap 2026-02-17T21:05:17.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 10 monclient: monmap: 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 librados: starting msgr at 2026-02-17T21:05:17.948 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 librados: starting objecter 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 Processor -- start 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 -- start start 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 librados: setting wanted keys 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 1 librados: calling monclient init 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.937+0000 7f13d03dc640 10 monclient: init 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f13c81156b0 0x7f13c81aba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient(hunting): picked mon.noname-a con 0x7f13c81156b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f13c811a4e0 0x7f13c81abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient(hunting): picked mon.noname-c con 0x7f13c811a4e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13c811b060 0x7f13c81b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:17.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient(hunting): picked mon.noname-b con 0x7f13c811b060 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81232e0 con 0x7f13c81156b0 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8123160 con 0x7f13c811b060 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8123460 con 0x7f13c811a4e0 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13d03dc640 10 monclient(hunting): authenticate will time out at 898.561085s 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f13c81156b0 0x7f13c81aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13cd950640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f13c811a4e0 0x7f13c81abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f13c81156b0 0x7f13c81aba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39506/0 (socket says 10.20.193.138:39506) 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 1 -- 10.20.193.138:0/3114472025 learned_addr learned my addr 10.20.193.138:0/3114472025 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:17.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 10 monclient(hunting): get_auth_request con 0x7f13c81156b0 auth_method 0 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13cd950640 10 monclient(hunting): get_auth_request con 0x7f13c811a4e0 auth_method 0 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13cd950640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13cd950640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13cd950640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce952640 1 --2- 10.20.193.138:0/3114472025 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13c811b060 0x7f13c81b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce151640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:17.951 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce952640 10 monclient(hunting): get_auth_request con 0x7f13c811b060 auth_method 0 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce952640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce952640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.938+0000 7f13ce952640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.939+0000 7f13cd950640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.939+0000 7f13cd950640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.939+0000 7f13cd950640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.939+0000 7f13ce952640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.939+0000 7f13ce952640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.939+0000 7f13ce952640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 10 monclient(hunting): handle_auth_done global_id 4109 payload 824 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 1 -- 10.20.193.138:0/3114472025 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13c811b060 msgr2=0x7f13c81b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 1 --2- 10.20.193.138:0/3114472025 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13c811b060 0x7f13c81b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.952 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 1 -- 10.20.193.138:0/3114472025 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f13c81156b0 msgr2=0x7f13c81aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 1 --2- 10.20.193.138:0/3114472025 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f13c81156b0 0x7f13c81aba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 10 monclient: _finish_hunting 0 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 1 monclient: found mon.noname-c 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13cd950640 1 -- 10.20.193.138:0/3114472025 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c81b09f0 con 0x7f13c811a4e0 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.940+0000 7f13ce151640 1 --2- 10.20.193.138:0/3114472025 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f13c81156b0 0x7f13c81aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.941+0000 7f13cd950640 1 --2- 10.20.193.138:0/3114472025 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f13c811a4e0 0x7f13c81abf70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00b550 tx=0x7f13bc00ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.941+0000 7f13aeffd640 10 client.?.objecter ms_handle_connect 0x7f13c811a4e0 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.941+0000 7f13aeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 1 -- 10.20.193.138:0/3114472025 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc016070 con 0x7f13c811a4e0 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:17.953 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 10 monclient: dump: 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.954 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 10 monclient: _finish_auth 0 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13d03dc640 5 monclient: authenticate success, global_id 4109 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 1 -- 10.20.193.138:0/3114472025 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc0044e0 con 0x7f13c811a4e0 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 1 -- 10.20.193.138:0/3114472025 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0029c0 con 0x7f13c811a4e0 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13cc94e640 4 set_mon_vals no callback set 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13aeffd640 10 monclient: dump: 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:17.955 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13d03dc640 10 monclient: _renew_subs 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13d03dc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13d03dc640 1 -- 10.20.193.138:0/3114472025 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c81b0ce0 con 0x7f13c811a4e0 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13d03dc640 10 client.4109.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:17.956 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13d03dc640 10 monclient: _renew_subs 2026-02-17T21:05:17.957 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13d03dc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:17.957 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13d03dc640 1 -- 10.20.193.138:0/3114472025 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c81b8570 con 0x7f13c811a4e0 2026-02-17T21:05:17.957 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.943+0000 7f13d03dc640 1 librados: init done 2026-02-17T21:05:17.957 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.944+0000 7f13d03dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:17.957 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.944+0000 7f13d03dc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:17.957 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.944+0000 7f13d03dc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:17.957 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.944+0000 7f13d03dc640 1 -- 10.20.193.138:0/3114472025 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c8115a90 con 0x7f13c811a4e0 2026-02-17T21:05:17.966 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.969+0000 7f13aeffd640 1 -- 10.20.193.138:0/3114472025 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f13bc002b60 con 0x7f13c811a4e0 2026-02-17T21:05:17.966 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.969+0000 7f13aeffd640 1 -- 10.20.193.138:0/3114472025 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f13bc00f790 con 0x7f13c811a4e0 2026-02-17T21:05:17.966 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.969+0000 7f13aeffd640 10 client.4109.objecter ms_dispatch2 0x7f13c8000b90 osd_map(3..3 src has 1..3) 2026-02-17T21:05:17.966 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.969+0000 7f13aeffd640 3 client.4109.objecter handle_osd_map got epochs [3,3] > 0 2026-02-17T21:05:17.966 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.969+0000 7f13aeffd640 3 client.4109.objecter handle_osd_map decoding full epoch 3 2026-02-17T21:05:17.966 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:17.969+0000 7f13aeffd640 20 client.4109.objecter dump_active .. 0 homeless 2026-02-17T21:05:18.018 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.021+0000 7f13aeffd640 1 -- 10.20.193.138:0/3114472025 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f13bc020020 con 0x7f13c811a4e0 2026-02-17T21:05:18.018 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.021+0000 7f13aeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.018 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.021+0000 7f13aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:18.051 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.054+0000 7f13d03dc640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3ea1022b-6b00-44df-afe7-b679d0637204", "id": 1}] 2026-02-17T21:05:18.051 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.054+0000 7f13d03dc640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3ea1022b-6b00-44df-afe7-b679d0637204", "id": 1}] 2026-02-17T21:05:18.051 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.054+0000 7f13d03dc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:18.051 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.054+0000 7f13d03dc640 1 -- 10.20.193.138:0/3114472025 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ea1022b-6b00-44df-afe7-b679d0637204", "id": 1} v 0) -- 0x7f13c811c700 con 0x7f13c811a4e0 2026-02-17T21:05:18.114 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.117+0000 7f13aeffd640 1 -- 10.20.193.138:0/3114472025 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ea1022b-6b00-44df-afe7-b679d0637204", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f13bc00fa60 con 0x7f13c811a4e0 2026-02-17T21:05:18.114 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.117+0000 7f13aeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3ea1022b-6b00-44df-afe7-b679d0637204", "id": 1}] 2026-02-17T21:05:18.115 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.117+0000 7f13aeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:18.115 INFO:teuthology.orchestra.run.trial138.stdout:1 2026-02-17T21:05:18.116 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 10 librados: watch_flush enter 2026-02-17T21:05:18.116 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 10 librados: watch_flush exit 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 20 client.4109.objecter shutdown clearing up homeless session... 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 10 client.4109.objecter successfully canceled tick 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 10 monclient: shutdown 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 -- 10.20.193.138:0/3114472025 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f13c811a4e0 msgr2=0x7f13c81abf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 --2- 10.20.193.138:0/3114472025 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f13c811a4e0 0x7f13c81abf70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00b550 tx=0x7f13bc00ba20 comp rx=0 tx=0).stop 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 -- 10.20.193.138:0/3114472025 shutdown_connections 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 --2- 10.20.193.138:0/3114472025 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13c811b060 0x7f13c81b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 --2- 10.20.193.138:0/3114472025 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f13c811a4e0 0x7f13c81abf70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 --2- 10.20.193.138:0/3114472025 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f13c81156b0 0x7f13c81aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 -- 10.20.193.138:0/3114472025 >> 10.20.193.138:0/3114472025 conn(0x7f13c806dff0 msgr2=0x7f13c81144f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:18.117 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 -- 10.20.193.138:0/3114472025 shutdown_connections 2026-02-17T21:05:18.118 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 -- 10.20.193.138:0/3114472025 wait complete. 2026-02-17T21:05:18.118 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.118+0000 7f13d03dc640 1 librados: shutdown 2026-02-17T21:05:18.124 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new e088fe32-7558-495d-9a84-0dcdf57dd758 2 2026-02-17T21:05:18.144 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:18.152+0000 7ff9fa43a140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T21:05:18.158 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:18.161+0000 7f8daabcd140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-17T21:05:18.167 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:18.175+0000 7ff9fa43a140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T21:05:18.180 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:18.184+0000 7f8daabcd140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-17T21:05:18.189 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.192+0000 7f71dbdbc640 10 monclient: get_monmap_and_config 2026-02-17T21:05:18.189 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.192+0000 7f71dbdbc640 10 monclient: build_initial_monmap 2026-02-17T21:05:18.189 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient: monmap: 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:18.193151+0000 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:18.193151+0000 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:18.190 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:18.191 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 1 Processor -- start 2026-02-17T21:05:18.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 1 -- start start 2026-02-17T21:05:18.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient: init 2026-02-17T21:05:18.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:18.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient: _add_conns ranks=[0,4,1,5,3,2] 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f71d4118450 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f71d40740a0 0x7f71d4124300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient(hunting): picked mon.noname-b con 0x7f71d40740a0 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f71d4124840 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d4128350 con 0x7f71d4118450 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71d4129530 con 0x7f71d4124840 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f71d412a710 con 0x7f71d40740a0 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.193+0000 7f71dbdbc640 10 monclient(hunting): authenticate will time out at 898.816529s 2026-02-17T21:05:18.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.194+0000 7f71da332640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f71d4124840 0x7f71d4126c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.138:60644/0 (socket says 10.20.193.138:60644) 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.194+0000 7f71da332640 1 -- 10.20.193.138:0/997192969 learned_addr learned my addr 10.20.193.138:0/997192969 (peer_addr_for_me v1:10.20.193.138:0/0) 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d9330640 1 --2- 10.20.193.138:0/997192969 >> v2:10.20.193.86:3300/0 conn(0x7f71d40740a0 0x7f71d4124300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d9330640 10 monclient(hunting): get_auth_request con 0x7f71d40740a0 auth_method 0 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d9330640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d9330640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d9330640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d9330640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d9330640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d9330640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d8b2f640 1 -- 10.20.193.138:0/997192969 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406043177 0 0) 0x7f71d4128350 con 0x7f71d4118450 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d8b2f640 10 monclient(hunting): _negotiate 2026-02-17T21:05:18.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d8b2f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d8b2f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.195+0000 7f71d8b2f640 10 monclient(hunting): my global_id is 4116 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d8b2f640 1 -- 10.20.193.138:0/997192969 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71bc003620 con 0x7f71d4118450 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d8b2f640 1 -- 10.20.193.138:0/997192969 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466914048 0 0) 0x7f71d4129530 con 0x7f71d4124840 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d8b2f640 10 monclient(hunting): _negotiate 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d8b2f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d8b2f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d8b2f640 10 monclient(hunting): my global_id is 4120 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d8b2f640 1 -- 10.20.193.138:0/997192969 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d4128350 con 0x7f71d4124840 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d9330640 10 monclient(hunting): handle_auth_done global_id 4123 payload 274 2026-02-17T21:05:18.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d9330640 1 -- 10.20.193.138:0/997192969 >> v1:10.20.193.86:6789/0 conn(0x7f71d4124840 legacy=0x7f71d4126c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d9330640 1 -- 10.20.193.138:0/997192969 >> v1:10.20.193.45:6789/0 conn(0x7f71d4118450 legacy=0x7f71d4073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d9330640 10 monclient: _finish_hunting 0 2026-02-17T21:05:18.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d9330640 1 monclient: found mon.noname-b 2026-02-17T21:05:18.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d9330640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:18.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d9330640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.196+0000 7f71d9330640 1 -- 10.20.193.138:0/997192969 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d412a890 con 0x7f71d40740a0 2026-02-17T21:05:18.203 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.198+0000 7f71d9330640 1 --2- 10.20.193.138:0/997192969 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 0x7f71d4124300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f71c80098a0 tx=0x7f71c802ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3e75e094641d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:18.203 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 1 -- 10.20.193.138:0/997192969 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c803c070 con 0x7f71d40740a0 2026-02-17T21:05:18.203 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.203 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 10 monclient: dump: 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.204 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 10 monclient: _finish_auth 0 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 10 monclient: _check_auth_tickets 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 1 -- 10.20.193.138:0/997192969 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c802fb70 con 0x7f71d40740a0 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 1 -- 10.20.193.138:0/997192969 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c8037440 con 0x7f71d40740a0 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71d8b2f640 10 monclient: dump: 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.205 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 5 monclient: authenticate success, global_id 4123 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 4 set_mon_vals no callback set 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 10 monclient: shutdown 2026-02-17T21:05:18.206 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 -- 10.20.193.138:0/997192969 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 msgr2=0x7f71d4124300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 --2- 10.20.193.138:0/997192969 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 0x7f71d4124300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f71c80098a0 tx=0x7f71c802ee60 comp rx=0 tx=0).stop 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 -- 10.20.193.138:0/997192969 shutdown_connections 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 --2- 10.20.193.138:0/997192969 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 0x7f71d4124300 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 -- 10.20.193.138:0/997192969 >> 10.20.193.138:0/997192969 conn(0x7f71d406f910 msgr2=0x7f71d4071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 -- 10.20.193.138:0/997192969 shutdown_connections 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 -- 10.20.193.138:0/997192969 wait complete. 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 10 monclient: build_initial_monmap 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 10 monclient: monmap: 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:18.207 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 librados: starting msgr at 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 librados: starting objecter 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.200+0000 7f71dbdbc640 1 Processor -- start 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 1 -- start start 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 1 librados: setting wanted keys 2026-02-17T21:05:18.208 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 1 librados: calling monclient init 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient: init 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 0x7f71d41b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient(hunting): picked mon.noname-b con 0x7f71d40740a0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71d4118450 0x7f71d41b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient(hunting): picked mon.noname-a con 0x7f71d4118450 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71d4124840 0x7f71d4116520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient(hunting): picked mon.noname-c con 0x7f71d4124840 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f71d41289a0 con 0x7f71d4118450 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.209 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4128820 con 0x7f71d40740a0 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4128b20 con 0x7f71d4124840 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71dbdbc640 10 monclient(hunting): authenticate will time out at 898.824205s 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 0x7f71d41b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 0x7f71d41b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.138:43244/0 (socket says 10.20.193.138:43244) 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 1 -- 10.20.193.138:0/2931424311 learned_addr learned my addr 10.20.193.138:0/2931424311 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 10 monclient(hunting): get_auth_request con 0x7f71d40740a0 auth_method 0 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.210 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71da332640 1 --2- 10.20.193.138:0/2931424311 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71d4124840 0x7f71d4116520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71d9b31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71da332640 10 monclient(hunting): get_auth_request con 0x7f71d4124840 auth_method 0 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71da332640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71da332640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.201+0000 7f71da332640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.202+0000 7f71da332640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.202+0000 7f71da332640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.202+0000 7f71da332640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.202+0000 7f71d9330640 1 --2- 10.20.193.138:0/2931424311 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71d4118450 0x7f71d41b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 10 monclient(hunting): handle_auth_done global_id 4126 payload 824 2026-02-17T21:05:18.211 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 1 -- 10.20.193.138:0/2931424311 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71d4124840 msgr2=0x7f71d4116520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 1 --2- 10.20.193.138:0/2931424311 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71d4124840 0x7f71d4116520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 1 -- 10.20.193.138:0/2931424311 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71d4118450 msgr2=0x7f71d41b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 1 --2- 10.20.193.138:0/2931424311 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71d4118450 0x7f71d41b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 10 monclient: _finish_hunting 0 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 1 monclient: found mon.noname-b 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.203+0000 7f71d9b31640 1 -- 10.20.193.138:0/2931424311 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d4116de0 con 0x7f71d40740a0 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.204+0000 7f71d9b31640 1 --2- 10.20.193.138:0/2931424311 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 0x7f71d41b5ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f71c400c700 tx=0x7f71c400cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.204+0000 7f71c27fc640 10 client.?.objecter ms_handle_connect 0x7f71d40740a0 2026-02-17T21:05:18.212 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.204+0000 7f71c27fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:18.214 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 1 -- 10.20.193.138:0/2931424311 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c40052d0 con 0x7f71d40740a0 2026-02-17T21:05:18.214 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 10 monclient: dump: 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.215 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 10 monclient: _finish_auth 0 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 10 monclient: _check_auth_tickets 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71dbdbc640 5 monclient: authenticate success, global_id 4126 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 1 -- 10.20.193.138:0/2931424311 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c4005490 con 0x7f71d40740a0 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 1 -- 10.20.193.138:0/2931424311 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c40038d0 con 0x7f71d40740a0 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c3fff640 4 set_mon_vals no callback set 2026-02-17T21:05:18.216 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71c27fc640 10 monclient: dump: 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.207+0000 7f71dbdbc640 10 monclient: _renew_subs 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.217 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 1 -- 10.20.193.138:0/2931424311 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d4117070 con 0x7f71d40740a0 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 10 client.4126.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 10 monclient: _renew_subs 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 1 -- 10.20.193.138:0/2931424311 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d41bc8d0 con 0x7f71d40740a0 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 1 librados: init done 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.208+0000 7f71dbdbc640 1 -- 10.20.193.138:0/2931424311 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d4128f80 con 0x7f71d40740a0 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.209+0000 7f71c27fc640 1 -- 10.20.193.138:0/2931424311 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f71c4003a70 con 0x7f71d40740a0 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.209+0000 7f71c27fc640 1 -- 10.20.193.138:0/2931424311 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f71c4025850 con 0x7f71d40740a0 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.209+0000 7f71c27fc640 10 client.4126.objecter ms_dispatch2 0x7f71d4000b90 osd_map(4..4 src has 1..4) 2026-02-17T21:05:18.218 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.209+0000 7f71c27fc640 3 client.4126.objecter handle_osd_map got epochs [4,4] > 0 2026-02-17T21:05:18.219 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.209+0000 7f71c27fc640 3 client.4126.objecter handle_osd_map decoding full epoch 4 2026-02-17T21:05:18.219 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.209+0000 7f71c27fc640 20 client.4126.objecter dump_active .. 0 homeless 2026-02-17T21:05:18.246 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.249+0000 7f71c27fc640 1 -- 10.20.193.138:0/2931424311 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f71c4003d90 con 0x7f71d40740a0 2026-02-17T21:05:18.246 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.249+0000 7f71c27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.246 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.249+0000 7f71c27fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:18.278 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.281+0000 7f71dbdbc640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e088fe32-7558-495d-9a84-0dcdf57dd758", "id": 2}] 2026-02-17T21:05:18.278 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.281+0000 7f71dbdbc640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e088fe32-7558-495d-9a84-0dcdf57dd758", "id": 2}] 2026-02-17T21:05:18.279 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.281+0000 7f71dbdbc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.279 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.281+0000 7f71dbdbc640 1 -- 10.20.193.138:0/2931424311 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e088fe32-7558-495d-9a84-0dcdf57dd758", "id": 2} v 0) -- 0x7f71d4070e70 con 0x7f71d40740a0 2026-02-17T21:05:18.317 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.319+0000 7f71c27fc640 1 -- 10.20.193.138:0/2931424311 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e088fe32-7558-495d-9a84-0dcdf57dd758", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f71c4025500 con 0x7f71d40740a0 2026-02-17T21:05:18.317 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.319+0000 7f71c27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e088fe32-7558-495d-9a84-0dcdf57dd758", "id": 2}] 2026-02-17T21:05:18.317 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.319+0000 7f71c27fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:18.318 INFO:teuthology.orchestra.run.trial138.stdout:2 2026-02-17T21:05:18.319 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 10 librados: watch_flush enter 2026-02-17T21:05:18.319 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 10 librados: watch_flush exit 2026-02-17T21:05:18.319 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 20 client.4126.objecter shutdown clearing up homeless session... 2026-02-17T21:05:18.319 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 10 client.4126.objecter successfully canceled tick 2026-02-17T21:05:18.319 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 10 monclient: shutdown 2026-02-17T21:05:18.319 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 -- 10.20.193.138:0/2931424311 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 msgr2=0x7f71d41b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 --2- 10.20.193.138:0/2931424311 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 0x7f71d41b5ab0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f71c400c700 tx=0x7f71c400cbd0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 -- 10.20.193.138:0/2931424311 shutdown_connections 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 --2- 10.20.193.138:0/2931424311 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71d4124840 0x7f71d4116520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 --2- 10.20.193.138:0/2931424311 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71d4118450 0x7f71d41b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 --2- 10.20.193.138:0/2931424311 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71d40740a0 0x7f71d41b5ab0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 -- 10.20.193.138:0/2931424311 >> 10.20.193.138:0/2931424311 conn(0x7f71d406f910 msgr2=0x7f71d4126c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 -- 10.20.193.138:0/2931424311 shutdown_connections 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 -- 10.20.193.138:0/2931424311 wait complete. 2026-02-17T21:05:18.320 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.320+0000 7f71dbdbc640 1 librados: shutdown 2026-02-17T21:05:18.325 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new c0726e30-9389-4c16-b752-b4d98891f033 3 2026-02-17T21:05:18.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient: get_monmap_and_config 2026-02-17T21:05:18.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient: build_initial_monmap 2026-02-17T21:05:18.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient: monmap: 2026-02-17T21:05:18.433 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:18.433577+0000 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:18.433577+0000 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:18.434 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 1 Processor -- start 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 1 -- start start 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient: init 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient: _add_conns ranks=[3,5,1,2,4,0] 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc3b0117660 0x7fc3b0117a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient(hunting): picked mon.noname-a con 0x7fc3b0117660 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fc3b0112130 0x7fc3b01125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient(hunting): picked mon.noname-c con 0x7fc3b0112130 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:18.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc3b0112b00 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b0112f70 con 0x7fc3b0112b00 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b0120a50 con 0x7fc3b0117660 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b0120bd0 con 0x7fc3b0112130 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.432+0000 7fc3b4a85640 10 monclient(hunting): authenticate will time out at 899.056971s 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3add74640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fc3b0112130 0x7fc3b01125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3aed76640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fc3b0112b00 0x7fc3b011e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.138:60654/0 (socket says 10.20.193.138:60654) 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3aed76640 1 -- 10.20.193.138:0/2774253091 learned_addr learned my addr 10.20.193.138:0/2774253091 (peer_addr_for_me v1:10.20.193.138:0/0) 2026-02-17T21:05:18.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3ae575640 1 --2- 10.20.193.138:0/2774253091 >> v2:10.20.193.45:3300/0 conn(0x7fc3b0117660 0x7fc3b0117a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3add74640 10 monclient(hunting): get_auth_request con 0x7fc3b0112130 auth_method 0 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3add74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3add74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3add74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3ae575640 10 monclient(hunting): get_auth_request con 0x7fc3b0117660 auth_method 0 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3ae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3add74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3add74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.433+0000 7fc3add74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.437 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3ae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3ad573640 1 -- 10.20.193.138:0/2774253091 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283912140 0 0) 0x7fc3b0112f70 con 0x7fc3b0112b00 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3ad573640 10 monclient(hunting): _negotiate 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3ad573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3ad573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3ad573640 10 monclient(hunting): my global_id is 4129 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3ad573640 1 -- 10.20.193.138:0/2774253091 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc39c003620 con 0x7fc3b0112b00 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3add74640 10 monclient(hunting): handle_auth_done global_id 4115 payload 274 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3add74640 1 -- 10.20.193.138:0/2774253091 >> v2:10.20.193.45:3300/0 conn(0x7fc3b0117660 msgr2=0x7fc3b0117a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3add74640 1 --2- 10.20.193.138:0/2774253091 >> v2:10.20.193.45:3300/0 conn(0x7fc3b0117660 0x7fc3b0117a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3add74640 1 -- 10.20.193.138:0/2774253091 >> v1:10.20.193.86:6789/0 conn(0x7fc3b0112b00 legacy=0x7fc3b011e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.438 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3add74640 10 monclient: _finish_hunting 0 2026-02-17T21:05:18.439 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3add74640 1 monclient: found mon.noname-c 2026-02-17T21:05:18.439 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3add74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:18.439 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3add74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:18.439 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.434+0000 7fc3add74640 1 -- 10.20.193.138:0/2774253091 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b0120d50 con 0x7fc3b0112130 2026-02-17T21:05:18.439 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.435+0000 7fc3add74640 1 --2- 10.20.193.138:0/2774253091 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112130 0x7fc3b01125c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0118010 tx=0x7fc39802ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f68040b2e252ad2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:18.445 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 1 -- 10.20.193.138:0/2774253091 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39803c070 con 0x7fc3b0112130 2026-02-17T21:05:18.445 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.445 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 10 monclient: dump: 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.446 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 10 monclient: _finish_auth 0 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 10 monclient: _check_auth_tickets 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 5 monclient: authenticate success, global_id 4115 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 1 -- 10.20.193.138:0/2774253091 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39802fa60 con 0x7fc3b0112130 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 1 -- 10.20.193.138:0/2774253091 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39802fe10 con 0x7fc3b0112130 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3ad573640 10 monclient: dump: 2026-02-17T21:05:18.447 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 4 set_mon_vals no callback set 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 10 monclient: shutdown 2026-02-17T21:05:18.448 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 1 -- 10.20.193.138:0/2774253091 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112130 msgr2=0x7fc3b01125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 1 --2- 10.20.193.138:0/2774253091 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112130 0x7fc3b01125c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0118010 tx=0x7fc39802ed50 comp rx=0 tx=0).stop 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 1 -- 10.20.193.138:0/2774253091 shutdown_connections 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 1 --2- 10.20.193.138:0/2774253091 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112130 0x7fc3b01125c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 1 --2- 10.20.193.138:0/2774253091 >> v2:10.20.193.45:3300/0 conn(0x7fc3b0117660 0x7fc3b0117a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 1 -- 10.20.193.138:0/2774253091 >> 10.20.193.138:0/2774253091 conn(0x7fc3b006f910 msgr2=0x7fc3b0071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 1 -- 10.20.193.138:0/2774253091 shutdown_connections 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.437+0000 7fc3b4a85640 1 -- 10.20.193.138:0/2774253091 wait complete. 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient: build_initial_monmap 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient: monmap: 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:18.449 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 librados: starting msgr at 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 librados: starting objecter 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 Processor -- start 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 -- start start 2026-02-17T21:05:18.450 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 librados: setting wanted keys 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 librados: calling monclient init 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient: init 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc3b0112130 0x7fc3b01af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient(hunting): picked mon.noname-a con 0x7fc3b0112130 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112b00 0x7fc3b01af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient(hunting): picked mon.noname-c con 0x7fc3b0112b00 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc3b0117660 0x7fc3b0074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient(hunting): picked mon.noname-b con 0x7fc3b0117660 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b011ff00 con 0x7fc3b0112130 2026-02-17T21:05:18.451 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b011fd80 con 0x7fc3b0117660 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b0120080 con 0x7fc3b0112b00 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3b4a85640 10 monclient(hunting): authenticate will time out at 899.062632s 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.438+0000 7fc3ae575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc3b0112130 0x7fc3b01af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112b00 0x7fc3b01af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3aed76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc3b0117660 0x7fc3b0074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112b00 0x7fc3b01af740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.138:46374/0 (socket says 10.20.193.138:46374) 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 1 -- 10.20.193.138:0/256771643 learned_addr learned my addr 10.20.193.138:0/256771643 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 10 monclient(hunting): get_auth_request con 0x7fc3b0112b00 auth_method 0 2026-02-17T21:05:18.452 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3ae575640 10 monclient(hunting): get_auth_request con 0x7fc3b0112130 auth_method 0 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3ae575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3ae575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3ae575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3aed76640 10 monclient(hunting): get_auth_request con 0x7fc3b0117660 auth_method 0 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3aed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3aed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3aed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3aed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3aed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.453 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3aed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3add74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3ae575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3ae575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.439+0000 7fc3ae575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 10 monclient(hunting): handle_auth_done global_id 4132 payload 824 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 1 -- 10.20.193.138:0/256771643 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112b00 msgr2=0x7fc3b01af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 1 --2- 10.20.193.138:0/256771643 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112b00 0x7fc3b01af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 1 -- 10.20.193.138:0/256771643 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc3b0112130 msgr2=0x7fc3b01af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 1 --2- 10.20.193.138:0/256771643 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc3b0112130 0x7fc3b01af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 10 monclient: _finish_hunting 0 2026-02-17T21:05:18.454 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 1 monclient: found mon.noname-b 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.440+0000 7fc3aed76640 1 -- 10.20.193.138:0/256771643 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b0074b30 con 0x7fc3b0117660 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.441+0000 7fc3aed76640 1 --2- 10.20.193.138:0/256771643 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc3b0117660 0x7fc3b0074270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000caa0 tx=0x7fc3a000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.441+0000 7fc396ffd640 10 client.?.objecter ms_handle_connect 0x7fc3b0117660 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.441+0000 7fc396ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 1 -- 10.20.193.138:0/256771643 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000ab70 con 0x7fc3b0117660 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 10 monclient: dump: 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.455 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 10 monclient: _finish_auth 0 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3b4a85640 5 monclient: authenticate success, global_id 4132 2026-02-17T21:05:18.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3b4a85640 10 monclient: _renew_subs 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3b4a85640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3b4a85640 1 -- 10.20.193.138:0/256771643 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b0074e20 con 0x7fc3b0117660 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3b4a85640 10 client.4132.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3b4a85640 10 monclient: _renew_subs 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3b4a85640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3b4a85640 1 -- 10.20.193.138:0/256771643 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b01b5f90 con 0x7fc3b0117660 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3b4a85640 1 librados: init done 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 1 -- 10.20.193.138:0/256771643 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a000ad10 con 0x7fc3b0117660 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 1 -- 10.20.193.138:0/256771643 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a00032a0 con 0x7fc3b0117660 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:18.457 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc396ffd640 10 monclient: dump: 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.442+0000 7fc3acd72640 4 set_mon_vals no callback set 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.443+0000 7fc3b4a85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.458 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.443+0000 7fc3b4a85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.459 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.443+0000 7fc3b4a85640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.459 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.443+0000 7fc3b4a85640 1 -- 10.20.193.138:0/256771643 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b01125c0 con 0x7fc3b0117660 2026-02-17T21:05:18.478 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.481+0000 7fc396ffd640 1 -- 10.20.193.138:0/256771643 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc3a001b600 con 0x7fc3b0117660 2026-02-17T21:05:18.481 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.483+0000 7fc396ffd640 1 -- 10.20.193.138:0/256771643 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fc3a0012400 con 0x7fc3b0117660 2026-02-17T21:05:18.481 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.483+0000 7fc396ffd640 10 client.4132.objecter ms_dispatch2 0x7fc3b0000b90 osd_map(5..5 src has 1..5) 2026-02-17T21:05:18.481 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.483+0000 7fc396ffd640 3 client.4132.objecter handle_osd_map got epochs [5,5] > 0 2026-02-17T21:05:18.481 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.483+0000 7fc396ffd640 3 client.4132.objecter handle_osd_map decoding full epoch 5 2026-02-17T21:05:18.481 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.483+0000 7fc396ffd640 20 client.4132.objecter dump_active .. 0 homeless 2026-02-17T21:05:18.481 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.483+0000 7fc396ffd640 1 -- 10.20.193.138:0/256771643 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc3a0025430 con 0x7fc3b0117660 2026-02-17T21:05:18.482 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.483+0000 7fc396ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.482 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.483+0000 7fc396ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:18.513 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.515+0000 7fc3b4a85640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c0726e30-9389-4c16-b752-b4d98891f033", "id": 3}] 2026-02-17T21:05:18.513 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.515+0000 7fc3b4a85640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c0726e30-9389-4c16-b752-b4d98891f033", "id": 3}] 2026-02-17T21:05:18.513 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.515+0000 7fc3b4a85640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:18.513 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.515+0000 7fc3b4a85640 1 -- 10.20.193.138:0/256771643 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0726e30-9389-4c16-b752-b4d98891f033", "id": 3} v 0) -- 0x7fc3b0119430 con 0x7fc3b0117660 2026-02-17T21:05:18.517 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:18.525+0000 7ff9fa43a140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T21:05:18.525 INFO:tasks.ceph.mgr.x.trial138.stderr:2026-02-17T21:05:18.528+0000 7f8daabcd140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-17T21:05:18.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.581+0000 7fc396ffd640 1 -- 10.20.193.138:0/256771643 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0726e30-9389-4c16-b752-b4d98891f033", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fc3b0119430 con 0x7fc3b0117660 2026-02-17T21:05:18.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.581+0000 7fc396ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c0726e30-9389-4c16-b752-b4d98891f033", "id": 3}] 2026-02-17T21:05:18.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.581+0000 7fc396ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:18.580 INFO:teuthology.orchestra.run.trial138.stdout:3 2026-02-17T21:05:18.581 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 10 librados: watch_flush enter 2026-02-17T21:05:18.581 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 10 librados: watch_flush exit 2026-02-17T21:05:18.581 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 20 client.4132.objecter shutdown clearing up homeless session... 2026-02-17T21:05:18.581 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 10 client.4132.objecter successfully canceled tick 2026-02-17T21:05:18.581 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 10 monclient: shutdown 2026-02-17T21:05:18.581 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:18.581 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 -- 10.20.193.138:0/256771643 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc3b0117660 msgr2=0x7fc3b0074270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.582 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 --2- 10.20.193.138:0/256771643 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc3b0117660 0x7fc3b0074270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000caa0 tx=0x7fc3a000cea0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.582 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 -- 10.20.193.138:0/256771643 shutdown_connections 2026-02-17T21:05:18.582 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 --2- 10.20.193.138:0/256771643 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc3b0117660 0x7fc3b0074270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.582 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 --2- 10.20.193.138:0/256771643 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3b0112b00 0x7fc3b01af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.582 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 --2- 10.20.193.138:0/256771643 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc3b0112130 0x7fc3b01af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.582 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 -- 10.20.193.138:0/256771643 >> 10.20.193.138:0/256771643 conn(0x7fc3b006f910 msgr2=0x7fc3b0072840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:18.582 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 -- 10.20.193.138:0/256771643 shutdown_connections 2026-02-17T21:05:18.582 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 -- 10.20.193.138:0/256771643 wait complete. 2026-02-17T21:05:18.582 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.582+0000 7fc3b4a85640 1 librados: shutdown 2026-02-17T21:05:18.590 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 1b94f7f3-20dc-451d-8972-4ae7544aa40e 4 2026-02-17T21:05:18.654 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.656+0000 7f58c1d2c640 10 monclient: get_monmap_and_config 2026-02-17T21:05:18.654 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.656+0000 7f58c1d2c640 10 monclient: build_initial_monmap 2026-02-17T21:05:18.654 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.656+0000 7f58c1d2c640 10 monclient: monmap: 2026-02-17T21:05:18.654 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:18.657845+0000 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:18.657845+0000 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:18.655 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.657 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 1 Processor -- start 2026-02-17T21:05:18.657 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 1 -- start start 2026-02-17T21:05:18.657 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient: init 2026-02-17T21:05:18.657 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:18.657 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient: _add_conns ranks=[3,5,2,1,0,4] 2026-02-17T21:05:18.657 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f58bc1156b0 0x7f58bc115a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.657 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f58bc1156b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:18.657 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f58bc11a4e0 0x7f58bc11a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.658 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f58bc11a4e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:18.658 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f58bc11ae90 addr v1:10.20.193.92:6789/0 2026-02-17T21:05:18.658 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58bc122cf0 con 0x7f58bc11ae90 2026-02-17T21:05:18.658 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.658 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f58bc123ed0 con 0x7f58bc1156b0 2026-02-17T21:05:18.658 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.658 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f58bc124050 con 0x7f58bc11a4e0 2026-02-17T21:05:18.658 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:18.658 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.657+0000 7f58c1d2c640 10 monclient(hunting): authenticate will time out at 899.281302s 2026-02-17T21:05:18.685 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.688+0000 7f58bb7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f58bc1156b0 0x7f58bc115a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.686 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.688+0000 7f58bb7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f58bc1156b0 0x7f58bc115a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39540/0 (socket says 10.20.193.138:39540) 2026-02-17T21:05:18.686 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.688+0000 7f58bb7fe640 1 -- 10.20.193.138:0/1514517855 learned_addr learned my addr 10.20.193.138:0/1514517855 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:18.686 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.688+0000 7f58bb7fe640 10 monclient(hunting): get_auth_request con 0x7f58bc1156b0 auth_method 0 2026-02-17T21:05:18.686 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.688+0000 7f58bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.686 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.688+0000 7f58bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.687 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.688+0000 7f58bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.687 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.689+0000 7f58bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.687 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.689+0000 7f58bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.687 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.689+0000 7f58bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.688 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.690+0000 7f58bb7fe640 10 monclient(hunting): handle_auth_done global_id 4125 payload 274 2026-02-17T21:05:18.688 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.690+0000 7f58bb7fe640 1 -- 10.20.193.138:0/1514517855 >> v2:10.20.193.92:3300/0 conn(0x7f58bc11a4e0 msgr2=0x7f58bc11a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:18.688 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.690+0000 7f58bb7fe640 1 --2- 10.20.193.138:0/1514517855 >> v2:10.20.193.92:3300/0 conn(0x7f58bc11a4e0 0x7f58bc11a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.688 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.690+0000 7f58bb7fe640 1 -- 10.20.193.138:0/1514517855 >> v1:10.20.193.92:6789/0 conn(0x7f58bc11ae90 legacy=0x7f58bc1215d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:18.688 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.690+0000 7f58bb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:18.689 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.690+0000 7f58bb7fe640 1 monclient: found mon.noname-a 2026-02-17T21:05:18.689 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.690+0000 7f58bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:18.689 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.690+0000 7f58bb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:18.689 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.690+0000 7f58bb7fe640 1 -- 10.20.193.138:0/1514517855 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc1241d0 con 0x7f58bc1156b0 2026-02-17T21:05:18.689 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.691+0000 7f58bb7fe640 1 --2- 10.20.193.138:0/1514517855 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 0x7f58bc115a90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f58bc116090 tx=0x7f58a802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afcfe50e346ac67 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:18.694 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.692+0000 7f58ba7fc640 1 -- 10.20.193.138:0/1514517855 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a803c070 con 0x7f58bc1156b0 2026-02-17T21:05:18.694 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.692+0000 7f58ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.694 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.692+0000 7f58ba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:18.694 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.692+0000 7f58ba7fc640 10 monclient: dump: 2026-02-17T21:05:18.694 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.694 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.694 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.694 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.692+0000 7f58ba7fc640 10 monclient: _finish_auth 0 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.692+0000 7f58ba7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.692+0000 7f58ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.692+0000 7f58c1d2c640 5 monclient: authenticate success, global_id 4125 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.692+0000 7f58c1d2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:18.695 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58ba7fc640 1 -- 10.20.193.138:0/1514517855 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a802fa90 con 0x7f58bc1156b0 2026-02-17T21:05:18.696 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58ba7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:18.696 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58ba7fc640 1 -- 10.20.193.138:0/1514517855 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a802fe60 con 0x7f58bc1156b0 2026-02-17T21:05:18.696 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.696 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58ba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:18.696 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58ba7fc640 10 monclient: dump: 2026-02-17T21:05:18.696 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.696 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.696 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.696 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 4 set_mon_vals no callback set 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 10 monclient: shutdown 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 1 -- 10.20.193.138:0/1514517855 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 msgr2=0x7f58bc115a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 1 --2- 10.20.193.138:0/1514517855 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 0x7f58bc115a90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f58bc116090 tx=0x7f58a802ee60 comp rx=0 tx=0).stop 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 1 -- 10.20.193.138:0/1514517855 shutdown_connections 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 1 --2- 10.20.193.138:0/1514517855 >> v2:10.20.193.92:3300/0 conn(0x7f58bc11a4e0 0x7f58bc11a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 1 --2- 10.20.193.138:0/1514517855 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 0x7f58bc115a90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 1 -- 10.20.193.138:0/1514517855 >> 10.20.193.138:0/1514517855 conn(0x7f58bc06dff0 msgr2=0x7f58bc06e400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 1 -- 10.20.193.138:0/1514517855 shutdown_connections 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 1 -- 10.20.193.138:0/1514517855 wait complete. 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 10 monclient: build_initial_monmap 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.693+0000 7f58c1d2c640 10 monclient: monmap: 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:18.697 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 librados: starting msgr at 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 librados: starting objecter 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 Processor -- start 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 -- start start 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 librados: setting wanted keys 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 librados: calling monclient init 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient: init 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 0x7f58bc1ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f58bc1156b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58bc11a4e0 0x7f58bc1abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient(hunting): picked mon.noname-b con 0x7f58bc11a4e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58bc11ae90 0x7f58bc1b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f58bc11ae90 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc123350 con 0x7f58bc1156b0 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1231d0 con 0x7f58bc11a4e0 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1234d0 con 0x7f58bc11ae90 2026-02-17T21:05:18.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58c1d2c640 10 monclient(hunting): authenticate will time out at 899.318308s 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58bb7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 0x7f58bc1ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58bb7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 0x7f58bc1ab9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39546/0 (socket says 10.20.193.138:39546) 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58bb7fe640 1 -- 10.20.193.138:0/2774724764 learned_addr learned my addr 10.20.193.138:0/2774724764 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58bb7fe640 10 monclient(hunting): get_auth_request con 0x7f58bc1156b0 auth_method 0 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.694+0000 7f58bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.695+0000 7f58bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.695+0000 7f58bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.695+0000 7f58bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 10 monclient(hunting): handle_auth_done global_id 4128 payload 824 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 1 -- 10.20.193.138:0/2774724764 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58bc11ae90 msgr2=0x7f58bc1b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 1 --2- 10.20.193.138:0/2774724764 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58bc11ae90 0x7f58bc1b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 1 -- 10.20.193.138:0/2774724764 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58bc11a4e0 msgr2=0x7f58bc1abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 1 --2- 10.20.193.138:0/2774724764 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58bc11a4e0 0x7f58bc1abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 1 monclient: found mon.noname-a 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:18.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.696+0000 7f58bb7fe640 1 -- 10.20.193.138:0/2774724764 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc1b0970 con 0x7f58bc1156b0 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.697+0000 7f58bb7fe640 1 --2- 10.20.193.138:0/2774724764 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 0x7f58bc1ab9b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58a8002410 tx=0x7f58a80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.697+0000 7f5897fff640 10 client.?.objecter ms_handle_connect 0x7f58bc1156b0 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.697+0000 7f5897fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.698+0000 7f5897fff640 1 -- 10.20.193.138:0/2774724764 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8044070 con 0x7f58bc1156b0 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.698+0000 7f5897fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.698+0000 7f5897fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.698+0000 7f5897fff640 10 monclient: dump: 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.698+0000 7f5897fff640 10 monclient: _finish_auth 0 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.698+0000 7f5897fff640 10 monclient: _check_auth_tickets 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.698+0000 7f5897fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 5 monclient: authenticate success, global_id 4128 2026-02-17T21:05:18.700 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 10 monclient: _renew_subs 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 1 -- 10.20.193.138:0/2774724764 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58bc1b0c00 con 0x7f58bc1156b0 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f5897fff640 1 -- 10.20.193.138:0/2774724764 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a8040630 con 0x7f58bc1156b0 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f5897fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f5897fff640 1 -- 10.20.193.138:0/2774724764 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a803c040 con 0x7f58bc1156b0 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f5897fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f5897fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f5897fff640 10 monclient: dump: 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58b9ffb640 4 set_mon_vals no callback set 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 10 client.4128.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 10 monclient: _renew_subs 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 1 -- 10.20.193.138:0/2774724764 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58bc1b84f0 con 0x7f58bc1156b0 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 1 librados: init done 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:18.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.699+0000 7f58c1d2c640 1 -- 10.20.193.138:0/2774724764 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58bc115a90 con 0x7f58bc1156b0 2026-02-17T21:05:18.746 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.749+0000 7f5897fff640 1 -- 10.20.193.138:0/2774724764 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7f58a803f050 con 0x7f58bc1156b0 2026-02-17T21:05:18.753 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.756+0000 7f5897fff640 1 -- 10.20.193.138:0/2774724764 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f58a8035de0 con 0x7f58bc1156b0 2026-02-17T21:05:18.753 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.756+0000 7f5897fff640 10 client.4128.objecter ms_dispatch2 0x7f58bc000b90 osd_map(6..6 src has 1..6) 2026-02-17T21:05:18.753 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.756+0000 7f5897fff640 3 client.4128.objecter handle_osd_map got epochs [6,6] > 0 2026-02-17T21:05:18.753 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.756+0000 7f5897fff640 3 client.4128.objecter handle_osd_map decoding full epoch 6 2026-02-17T21:05:18.753 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.756+0000 7f5897fff640 20 client.4128.objecter dump_active .. 0 homeless 2026-02-17T21:05:18.753 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.756+0000 7f5897fff640 1 -- 10.20.193.138:0/2774724764 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f58a8040a20 con 0x7f58bc1156b0 2026-02-17T21:05:18.753 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.756+0000 7f5897fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.753 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.756+0000 7f5897fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:18.786 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.788+0000 7f58c1d2c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "1b94f7f3-20dc-451d-8972-4ae7544aa40e", "id": 4}] 2026-02-17T21:05:18.786 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.788+0000 7f58c1d2c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "1b94f7f3-20dc-451d-8972-4ae7544aa40e", "id": 4}] 2026-02-17T21:05:18.786 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.788+0000 7f58c1d2c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:18.786 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.788+0000 7f58c1d2c640 1 -- 10.20.193.138:0/2774724764 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b94f7f3-20dc-451d-8972-4ae7544aa40e", "id": 4} v 0) -- 0x7f58bc1b86c0 con 0x7f58bc1156b0 2026-02-17T21:05:18.862 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f5897fff640 1 -- 10.20.193.138:0/2774724764 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b94f7f3-20dc-451d-8972-4ae7544aa40e", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f58a8058020 con 0x7f58bc1156b0 2026-02-17T21:05:18.862 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f5897fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "1b94f7f3-20dc-451d-8972-4ae7544aa40e", "id": 4}] 2026-02-17T21:05:18.862 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f5897fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:18.862 INFO:teuthology.orchestra.run.trial138.stdout:4 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 10 librados: watch_flush enter 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 10 librados: watch_flush exit 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 20 client.4128.objecter shutdown clearing up homeless session... 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 10 client.4128.objecter successfully canceled tick 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 10 monclient: shutdown 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 1 -- 10.20.193.138:0/2774724764 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 msgr2=0x7f58bc1ab9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 1 --2- 10.20.193.138:0/2774724764 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 0x7f58bc1ab9b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f58a8002410 tx=0x7f58a80047c0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 1 -- 10.20.193.138:0/2774724764 shutdown_connections 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 1 --2- 10.20.193.138:0/2774724764 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58bc11ae90 0x7f58bc1b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 1 --2- 10.20.193.138:0/2774724764 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58bc11a4e0 0x7f58bc1abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 1 --2- 10.20.193.138:0/2774724764 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58bc1156b0 0x7f58bc1ab9b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.865+0000 7f58c1d2c640 1 -- 10.20.193.138:0/2774724764 >> 10.20.193.138:0/2774724764 conn(0x7f58bc06dff0 msgr2=0x7f58bc118860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.866+0000 7f58c1d2c640 1 -- 10.20.193.138:0/2774724764 shutdown_connections 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.866+0000 7f58c1d2c640 1 -- 10.20.193.138:0/2774724764 wait complete. 2026-02-17T21:05:18.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.866+0000 7f58c1d2c640 1 librados: shutdown 2026-02-17T21:05:18.871 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new c438b338-6996-487e-a503-2da9045e8da3 5 2026-02-17T21:05:18.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient: get_monmap_and_config 2026-02-17T21:05:18.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient: build_initial_monmap 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient: monmap: 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:18.937558+0000 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:18.937558+0000 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 1 Processor -- start 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 1 -- start start 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient: init 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient: _add_conns ranks=[2,0,4,5,1,3] 2026-02-17T21:05:18.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f71dc073d90 addr v1:10.20.193.92:6789/0 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f71dc11b500 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f71dc11f010 0x7f71dc121400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient(hunting): picked mon.noname-b con 0x7f71dc11f010 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71dc121b20 con 0x7f71dc11b500 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71dc122d40 con 0x7f71dc073d90 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f71dc123f40 con 0x7f71dc11f010 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.936+0000 7f71e19a1640 10 monclient(hunting): authenticate will time out at 899.560964s 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.937+0000 7f71daffd640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f71dc073d90 0x7f71dc074170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.138:49404/0 (socket says 10.20.193.138:49404) 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.937+0000 7f71daffd640 1 -- 10.20.193.138:0/1918458757 learned_addr learned my addr 10.20.193.138:0/1918458757 (peer_addr_for_me v1:10.20.193.138:0/0) 2026-02-17T21:05:18.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.938+0000 7f71db7fe640 1 --2- 10.20.193.138:0/1918458757 >> v2:10.20.193.86:3300/0 conn(0x7f71dc11f010 0x7f71dc121400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.938+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382786960 0 0) 0x7f71dc122d40 con 0x7f71dc073d90 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.938+0000 7f71d9ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.938+0000 7f71d9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.938+0000 7f71d9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.938+0000 7f71d9ffb640 10 monclient(hunting): my global_id is 4139 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.938+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71c8003620 con 0x7f71dc073d90 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.939+0000 7f71db7fe640 10 monclient(hunting): get_auth_request con 0x7f71dc11f010 auth_method 0 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.939+0000 7f71db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.939+0000 7f71db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.936 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.939+0000 7f71db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 <== mon.2 v1:10.20.193.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3316979304 0 0) 0x7f71c8003620 con 0x7f71dc073d90 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 >> v2:10.20.193.86:3300/0 conn(0x7f71dc11f010 msgr2=0x7f71dc121400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 --2- 10.20.193.138:0/1918458757 >> v2:10.20.193.86:3300/0 conn(0x7f71dc11f010 0x7f71dc121400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 >> v1:10.20.193.45:6789/0 conn(0x7f71dc11b500 legacy=0x7f71dc11d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient: _finish_hunting 0 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.92:6789/0 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 --> v1:10.20.193.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71dc1240c0 con 0x7f71dc073d90 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 <== mon.2 v1:10.20.193.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f71d0002f00 con 0x7f71dc073d90 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient: dump: 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] but i'm connected to v1:10.20.193.92:6789/0, reconnecting 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 >> v1:10.20.193.92:6789/0 conn(0x7f71dc073d90 legacy=0x7f71dc074170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71c8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient(hunting): picked mon.c con 0x7f71c8003ba0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71c8004900 0x7f71c8004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient(hunting): picked mon.a con 0x7f71c8004900 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71c8005510 0x7f71c800bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient(hunting): picked mon.b con 0x7f71c8005510 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.938 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc123f40 con 0x7f71c8004900 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f71c800c420 con 0x7f71c8005510 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f71c800c620 con 0x7f71c8003ba0 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.940+0000 7f71d9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.941+0000 7f71da7fc640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71c8004900 0x7f71c8004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.941+0000 7f71db7fe640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71c8005510 0x7f71c800bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71daffd640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71c8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71da7fc640 10 monclient(hunting): get_auth_request con 0x7f71c8004900 auth_method 0 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71da7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71daffd640 10 monclient(hunting): get_auth_request con 0x7f71c8003ba0 auth_method 0 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.939 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.940 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71daffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:18.940 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71db7fe640 10 monclient(hunting): get_auth_request con 0x7f71c8005510 auth_method 0 2026-02-17T21:05:18.940 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.940 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.940 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71db7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:05:18.940 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.940 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.940 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.942+0000 7f71daffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:05:18.940 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 10 monclient(hunting): handle_auth_done global_id 4139 payload 293 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 1 -- 10.20.193.138:0/1918458757 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71c8005510 msgr2=0x7f71c800bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71c8005510 0x7f71c800bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 1 -- 10.20.193.138:0/1918458757 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71c8004900 msgr2=0x7f71c8004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71c8004900 0x7f71c8004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 1 monclient: found mon.c 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 1 -- 10.20.193.138:0/1918458757 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c8003620 con 0x7f71c8003ba0 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71db7fe640 1 -- 10.20.193.138:0/1918458757 reap_dead start 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 10 monclient: _finish_auth 0 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 10 monclient: _check_auth_tickets 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71e19a1640 5 monclient: authenticate success, global_id 4139 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.943+0000 7f71e19a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:18.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.944+0000 7f71daffd640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71c8003fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c2a0 tx=0x7f71d002f5e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c7903c027e7fc99 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0007de0 con 0x7f71c8003ba0 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 10 monclient: dump: 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.943 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d0005bd0 con 0x7f71c8003ba0 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 1 -- 10.20.193.138:0/1918458757 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0007070 con 0x7f71c8003ba0 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 4 set_mon_vals no callback set 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71d9ffb640 10 monclient: dump: 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 10 monclient: shutdown 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 -- 10.20.193.138:0/1918458757 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 msgr2=0x7f71c8003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71c8003fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c2a0 tx=0x7f71d002f5e0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 -- 10.20.193.138:0/1918458757 shutdown_connections 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 --2- 10.20.193.138:0/1918458757 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71c8003fa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.944 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 -- 10.20.193.138:0/1918458757 >> 10.20.193.138:0/1918458757 conn(0x7f71dc06f910 msgr2=0x7f71dc071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 -- 10.20.193.138:0/1918458757 shutdown_connections 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 -- 10.20.193.138:0/1918458757 wait complete. 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 10 monclient: build_initial_monmap 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 10 monclient: monmap: 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 librados: starting msgr at 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 librados: starting objecter 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 Processor -- start 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 -- start start 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 librados: setting wanted keys 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 1 librados: calling monclient init 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.946+0000 7f71e19a1640 10 monclient: init 2026-02-17T21:05:18.945 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71dc1b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient(hunting): picked mon.noname-c con 0x7f71c8003ba0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71dc1b1870 0x7f71dc1ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient(hunting): picked mon.noname-b con 0x7f71dc1b1870 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71dc1ab870 0x7f71dc1abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient(hunting): picked mon.noname-a con 0x7f71dc1ab870 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc0745c0 con 0x7f71dc1ab870 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc074440 con 0x7f71dc1b1870 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc121cf0 con 0x7f71c8003ba0 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71e19a1640 10 monclient(hunting): authenticate will time out at 899.571150s 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71dc1b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71dc1b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.138:46394/0 (socket says 10.20.193.138:46394) 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 1 -- 10.20.193.138:0/1909562674 learned_addr learned my addr 10.20.193.138:0/1909562674 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 10 monclient(hunting): get_auth_request con 0x7f71c8003ba0 auth_method 0 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.947+0000 7f71daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71da7fc640 1 --2- 10.20.193.138:0/1909562674 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71dc1b1870 0x7f71dc1ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71da7fc640 10 monclient(hunting): get_auth_request con 0x7f71dc1b1870 auth_method 0 2026-02-17T21:05:18.946 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 10 monclient(hunting): handle_auth_done global_id 4142 payload 824 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 1 -- 10.20.193.138:0/1909562674 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71dc1b1870 msgr2=0x7f71dc1ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 1 --2- 10.20.193.138:0/1909562674 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71dc1b1870 0x7f71dc1ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 1 -- 10.20.193.138:0/1909562674 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71dc1ab870 msgr2=0x7f71dc1abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 1 --2- 10.20.193.138:0/1909562674 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71dc1ab870 0x7f71dc1abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 1 monclient: found mon.noname-c 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.949+0000 7f71daffd640 1 -- 10.20.193.138:0/1909562674 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71dc1b8100 con 0x7f71c8003ba0 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.950+0000 7f71daffd640 1 --2- 10.20.193.138:0/1909562674 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71dc1b12a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c2a0 tx=0x7f71d0003140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.950+0000 7f71b3fff640 10 client.?.objecter ms_handle_connect 0x7f71c8003ba0 2026-02-17T21:05:18.947 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.950+0000 7f71b3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:18.948 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 1 -- 10.20.193.138:0/1909562674 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0003430 con 0x7f71c8003ba0 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 10 monclient: dump: 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 10 monclient: _finish_auth 0 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 5 monclient: authenticate success, global_id 4142 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 10 monclient: _renew_subs 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 1 -- 10.20.193.138:0/1909562674 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71dc1b8330 con 0x7f71c8003ba0 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 10 client.4142.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 10 monclient: _renew_subs 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 1 -- 10.20.193.138:0/1909562674 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71dc1b8850 con 0x7f71c8003ba0 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 1 librados: init done 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 1 -- 10.20.193.138:0/1909562674 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d0004ae0 con 0x7f71c8003ba0 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 1 -- 10.20.193.138:0/1909562674 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d0007de0 con 0x7f71c8003ba0 2026-02-17T21:05:18.949 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71d97fa640 4 set_mon_vals no callback set 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71b3fff640 10 monclient: dump: 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.951+0000 7f71e19a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.952+0000 7f71e19a1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.952+0000 7f71e19a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:18.950 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.952+0000 7f71e19a1640 1 -- 10.20.193.138:0/1909562674 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71dc122080 con 0x7f71c8003ba0 2026-02-17T21:05:18.954 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.957+0000 7f71b3fff640 1 -- 10.20.193.138:0/1909562674 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7f71d002fce0 con 0x7f71c8003ba0 2026-02-17T21:05:18.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.958+0000 7f71b3fff640 1 -- 10.20.193.138:0/1909562674 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f71d004bd50 con 0x7f71c8003ba0 2026-02-17T21:05:18.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.958+0000 7f71b3fff640 10 client.4142.objecter ms_dispatch2 0x7f71dc000b90 osd_map(7..7 src has 1..7) 2026-02-17T21:05:18.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.958+0000 7f71b3fff640 3 client.4142.objecter handle_osd_map got epochs [7,7] > 0 2026-02-17T21:05:18.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.958+0000 7f71b3fff640 3 client.4142.objecter handle_osd_map decoding full epoch 7 2026-02-17T21:05:18.955 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.958+0000 7f71b3fff640 20 client.4142.objecter dump_active .. 0 homeless 2026-02-17T21:05:18.996 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.999+0000 7f71b3fff640 1 -- 10.20.193.138:0/1909562674 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f71d0051080 con 0x7f71c8003ba0 2026-02-17T21:05:18.996 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.999+0000 7f71b3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:18.996 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:18.999+0000 7f71b3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:19.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.031+0000 7f71e19a1640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c438b338-6996-487e-a503-2da9045e8da3", "id": 5}] 2026-02-17T21:05:19.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.031+0000 7f71e19a1640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c438b338-6996-487e-a503-2da9045e8da3", "id": 5}] 2026-02-17T21:05:19.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.031+0000 7f71e19a1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:19.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.031+0000 7f71e19a1640 1 -- 10.20.193.138:0/1909562674 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c438b338-6996-487e-a503-2da9045e8da3", "id": 5} v 0) -- 0x7f71dc11ca60 con 0x7f71c8003ba0 2026-02-17T21:05:19.089 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.091+0000 7f71b3fff640 1 -- 10.20.193.138:0/1909562674 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c438b338-6996-487e-a503-2da9045e8da3", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f71d000b0d0 con 0x7f71c8003ba0 2026-02-17T21:05:19.089 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.091+0000 7f71b3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c438b338-6996-487e-a503-2da9045e8da3", "id": 5}] 2026-02-17T21:05:19.089 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.091+0000 7f71b3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:19.090 INFO:teuthology.orchestra.run.trial138.stdout:5 2026-02-17T21:05:19.091 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 10 librados: watch_flush enter 2026-02-17T21:05:19.091 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 10 librados: watch_flush exit 2026-02-17T21:05:19.091 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 20 client.4142.objecter shutdown clearing up homeless session... 2026-02-17T21:05:19.091 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 10 client.4142.objecter successfully canceled tick 2026-02-17T21:05:19.091 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 10 monclient: shutdown 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 -- 10.20.193.138:0/1909562674 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 msgr2=0x7f71dc1b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 --2- 10.20.193.138:0/1909562674 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71dc1b12a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f71d000c2a0 tx=0x7f71d0003140 comp rx=0 tx=0).stop 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 -- 10.20.193.138:0/1909562674 shutdown_connections 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 --2- 10.20.193.138:0/1909562674 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71dc1ab870 0x7f71dc1abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 --2- 10.20.193.138:0/1909562674 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71dc1b1870 0x7f71dc1ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 --2- 10.20.193.138:0/1909562674 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71c8003ba0 0x7f71dc1b12a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 -- 10.20.193.138:0/1909562674 >> 10.20.193.138:0/1909562674 conn(0x7f71dc06f910 msgr2=0x7f71dc11a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 -- 10.20.193.138:0/1909562674 shutdown_connections 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 -- 10.20.193.138:0/1909562674 wait complete. 2026-02-17T21:05:19.092 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.092+0000 7f71e19a1640 1 librados: shutdown 2026-02-17T21:05:19.100 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new e1204a4b-7cb0-4508-ae52-f3058f2b4322 6 2026-02-17T21:05:19.179 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.165+0000 7f318bb96640 10 monclient: get_monmap_and_config 2026-02-17T21:05:19.179 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.165+0000 7f318bb96640 10 monclient: build_initial_monmap 2026-02-17T21:05:19.179 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.165+0000 7f318bb96640 10 monclient: monmap: 2026-02-17T21:05:19.179 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:19.179 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.179 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:19.166936+0000 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:19.166936+0000 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.180 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 1 Processor -- start 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 1 -- start start 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient: init 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient: _add_conns ranks=[0,4,5,1,3,2] 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3184073d90 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f318411b500 0x7f318411d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient(hunting): picked mon.noname-b con 0x7f318411b500 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f318411de30 0x7f3184120220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient(hunting): picked mon.noname-c con 0x7f318411de30 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3184120940 con 0x7f3184073d90 2026-02-17T21:05:19.181 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3184121b60 con 0x7f318411b500 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3184121ce0 con 0x7f318411de30 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318bb96640 10 monclient(hunting): authenticate will time out at 899.790343s 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318990b640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f3184073d90 0x7f3184074170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.138:50304/0 (socket says 10.20.193.138:50304) 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318990b640 1 -- 10.20.193.138:0/90153109 learned_addr learned my addr 10.20.193.138:0/90153109 (peer_addr_for_me v1:10.20.193.138:0/0) 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318910a640 1 --2- 10.20.193.138:0/90153109 >> v2:10.20.193.86:3300/0 conn(0x7f318411b500 0x7f318411d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318a10c640 1 --2- 10.20.193.138:0/90153109 >> v2:10.20.193.92:3300/0 conn(0x7f318411de30 0x7f3184120220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318910a640 10 monclient(hunting): get_auth_request con 0x7f318411b500 auth_method 0 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318910a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318910a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.182 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.166+0000 7f318910a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318a10c640 10 monclient(hunting): get_auth_request con 0x7f318411de30 auth_method 0 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318a10c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318a10c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318a10c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318910a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318910a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318910a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318a10c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318a10c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.167+0000 7f318a10c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 10 monclient(hunting): handle_auth_done global_id 4141 payload 274 2026-02-17T21:05:19.183 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f3188909640 1 -- 10.20.193.138:0/90153109 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1792080113 0 0) 0x7f3184120940 con 0x7f3184073d90 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 1 -- 10.20.193.138:0/90153109 >> v2:10.20.193.92:3300/0 conn(0x7f318411de30 msgr2=0x7f3184120220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 1 --2- 10.20.193.138:0/90153109 >> v2:10.20.193.92:3300/0 conn(0x7f318411de30 0x7f3184120220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 1 -- 10.20.193.138:0/90153109 >> v1:10.20.193.45:6789/0 conn(0x7f3184073d90 legacy=0x7f3184074170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 10 monclient: _finish_hunting 0 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 1 monclient: found mon.noname-b 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 1 -- 10.20.193.138:0/90153109 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3184121e90 con 0x7f318411b500 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f3188909640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.168+0000 7f318910a640 1 --2- 10.20.193.138:0/90153109 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411b500 0x7f318411d8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3184074a30 tx=0x7f317802ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=569b0bb75fd1a8fa server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 1 -- 10.20.193.138:0/90153109 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317803c070 con 0x7f318411b500 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.184 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 10 monclient: dump: 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.185 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 10 monclient: _finish_auth 0 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 10 monclient: _check_auth_tickets 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 5 monclient: authenticate success, global_id 4141 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 1 -- 10.20.193.138:0/90153109 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317802fa60 con 0x7f318411b500 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 1 -- 10.20.193.138:0/90153109 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317802fe30 con 0x7f318411b500 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f3188909640 10 monclient: dump: 2026-02-17T21:05:19.186 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.187 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:19.188 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 4 set_mon_vals no callback set 2026-02-17T21:05:19.188 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 10 monclient: shutdown 2026-02-17T21:05:19.188 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:19.188 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 1 -- 10.20.193.138:0/90153109 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411b500 msgr2=0x7f318411d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.188 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 1 --2- 10.20.193.138:0/90153109 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411b500 0x7f318411d8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3184074a30 tx=0x7f317802ed50 comp rx=0 tx=0).stop 2026-02-17T21:05:19.188 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 1 -- 10.20.193.138:0/90153109 shutdown_connections 2026-02-17T21:05:19.189 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.170+0000 7f318bb96640 1 --2- 10.20.193.138:0/90153109 >> v2:10.20.193.92:3300/0 conn(0x7f318411de30 0x7f3184120220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.189 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 --2- 10.20.193.138:0/90153109 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411b500 0x7f318411d8f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.189 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 -- 10.20.193.138:0/90153109 >> 10.20.193.138:0/90153109 conn(0x7f318406f910 msgr2=0x7f3184071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:19.189 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 -- 10.20.193.138:0/90153109 shutdown_connections 2026-02-17T21:05:19.189 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 -- 10.20.193.138:0/90153109 wait complete. 2026-02-17T21:05:19.189 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient: build_initial_monmap 2026-02-17T21:05:19.190 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient: monmap: 2026-02-17T21:05:19.190 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:19.190 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:19.190 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:19.190 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:19.190 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:19.191 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.191 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:19.191 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:19.191 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:19.191 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.191 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 librados: starting msgr at 2026-02-17T21:05:19.192 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 librados: starting objecter 2026-02-17T21:05:19.192 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 Processor -- start 2026-02-17T21:05:19.192 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 -- start start 2026-02-17T21:05:19.192 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 librados: setting wanted keys 2026-02-17T21:05:19.192 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 librados: calling monclient init 2026-02-17T21:05:19.192 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient: init 2026-02-17T21:05:19.193 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:19.193 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:05:19.193 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3184073d90 0x7f31841b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.193 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient(hunting): picked mon.noname-a con 0x7f3184073d90 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:19.193 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f318411b500 0x7f31841b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.193 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient(hunting): picked mon.noname-c con 0x7f318411b500 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:19.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411de30 0x7f31841ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient(hunting): picked mon.noname-b con 0x7f318411de30 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:19.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3184120fd0 con 0x7f3184073d90 2026-02-17T21:05:19.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.194 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3184120e50 con 0x7f318411de30 2026-02-17T21:05:19.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3184121150 con 0x7f318411b500 2026-02-17T21:05:19.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:19.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318bb96640 10 monclient(hunting): authenticate will time out at 899.795635s 2026-02-17T21:05:19.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318a10c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411de30 0x7f31841ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.195 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.171+0000 7f318990b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3184073d90 0x7f31841b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318910a640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f318411b500 0x7f31841b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318a10c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411de30 0x7f31841ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.138:43294/0 (socket says 10.20.193.138:43294) 2026-02-17T21:05:19.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318a10c640 1 -- 10.20.193.138:0/3042502715 learned_addr learned my addr 10.20.193.138:0/3042502715 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:19.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318a10c640 10 monclient(hunting): get_auth_request con 0x7f318411de30 auth_method 0 2026-02-17T21:05:19.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318a10c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318a10c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.196 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318a10c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318910a640 10 monclient(hunting): get_auth_request con 0x7f318411b500 auth_method 0 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318910a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318910a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318910a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318990b640 10 monclient(hunting): get_auth_request con 0x7f3184073d90 auth_method 0 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318990b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318990b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318990b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318a10c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318a10c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318a10c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318910a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.197 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318910a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318910a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318990b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318990b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.172+0000 7f318990b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 10 monclient(hunting): handle_auth_done global_id 4144 payload 824 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 1 -- 10.20.193.138:0/3042502715 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f318411b500 msgr2=0x7f31841b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 1 --2- 10.20.193.138:0/3042502715 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f318411b500 0x7f31841b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 1 -- 10.20.193.138:0/3042502715 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3184073d90 msgr2=0x7f31841b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 1 --2- 10.20.193.138:0/3042502715 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3184073d90 0x7f31841b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 10 monclient: _finish_hunting 0 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 1 monclient: found mon.noname-b 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:19.198 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.173+0000 7f318a10c640 1 -- 10.20.193.138:0/3042502715 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31841abd40 con 0x7f318411de30 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.174+0000 7f318a10c640 1 --2- 10.20.193.138:0/3042502715 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411de30 0x7f31841ab480 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f318000efc0 tx=0x7f318000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.174+0000 7f31727fc640 10 client.?.objecter ms_handle_connect 0x7f318411de30 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.174+0000 7f31727fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f31727fc640 1 -- 10.20.193.138:0/3042502715 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180018020 con 0x7f318411de30 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f31727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f31727fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f31727fc640 10 monclient: dump: 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.199 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.200 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.200 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.200 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.200 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.200 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f31727fc640 10 monclient: _finish_auth 0 2026-02-17T21:05:19.200 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f31727fc640 10 monclient: _check_auth_tickets 2026-02-17T21:05:19.200 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f31727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:19.201 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f318bb96640 5 monclient: authenticate success, global_id 4144 2026-02-17T21:05:19.201 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f318bb96640 10 monclient: _renew_subs 2026-02-17T21:05:19.201 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f318bb96640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:19.201 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f318bb96640 1 -- 10.20.193.138:0/3042502715 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31841abfd0 con 0x7f318411de30 2026-02-17T21:05:19.201 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f318bb96640 10 client.4144.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:19.201 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f318bb96640 10 monclient: _renew_subs 2026-02-17T21:05:19.201 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f318bb96640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:19.201 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f318bb96640 1 -- 10.20.193.138:0/3042502715 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31841b8360 con 0x7f318411de30 2026-02-17T21:05:19.202 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.175+0000 7f318bb96640 1 librados: init done 2026-02-17T21:05:19.202 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f31727fc640 1 -- 10.20.193.138:0/3042502715 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3180009b10 con 0x7f318411de30 2026-02-17T21:05:19.202 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f31727fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:19.202 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f3173fff640 4 set_mon_vals no callback set 2026-02-17T21:05:19.202 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f318bb96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:19.202 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f31727fc640 1 -- 10.20.193.138:0/3042502715 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180014680 con 0x7f318411de30 2026-02-17T21:05:19.202 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f318bb96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:19.202 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f318bb96640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f318bb96640 1 -- 10.20.193.138:0/3042502715 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3184121560 con 0x7f318411de30 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f31727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f31727fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.176+0000 7f31727fc640 10 monclient: dump: 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.203 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.217 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.220+0000 7f31727fc640 1 -- 10.20.193.138:0/3042502715 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7f3180014820 con 0x7f318411de30 2026-02-17T21:05:19.221 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.223+0000 7f31727fc640 1 -- 10.20.193.138:0/3042502715 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3180014d20 con 0x7f318411de30 2026-02-17T21:05:19.221 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.223+0000 7f31727fc640 10 client.4144.objecter ms_dispatch2 0x7f3184000b90 osd_map(8..8 src has 1..8) 2026-02-17T21:05:19.221 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.223+0000 7f31727fc640 3 client.4144.objecter handle_osd_map got epochs [8,8] > 0 2026-02-17T21:05:19.221 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.223+0000 7f31727fc640 3 client.4144.objecter handle_osd_map decoding full epoch 8 2026-02-17T21:05:19.221 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.223+0000 7f31727fc640 20 client.4144.objecter dump_active .. 0 homeless 2026-02-17T21:05:19.221 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.223+0000 7f31727fc640 1 -- 10.20.193.138:0/3042502715 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f3180022070 con 0x7f318411de30 2026-02-17T21:05:19.221 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.223+0000 7f31727fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:19.221 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.223+0000 7f31727fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:19.253 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.255+0000 7f318bb96640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e1204a4b-7cb0-4508-ae52-f3058f2b4322", "id": 6}] 2026-02-17T21:05:19.254 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.255+0000 7f318bb96640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e1204a4b-7cb0-4508-ae52-f3058f2b4322", "id": 6}] 2026-02-17T21:05:19.254 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.255+0000 7f318bb96640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:19.254 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.255+0000 7f318bb96640 1 -- 10.20.193.138:0/3042502715 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e1204a4b-7cb0-4508-ae52-f3058f2b4322", "id": 6} v 0) -- 0x7f318411ae80 con 0x7f318411de30 2026-02-17T21:05:19.322 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f31727fc640 1 -- 10.20.193.138:0/3042502715 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1204a4b-7cb0-4508-ae52-f3058f2b4322", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3180010040 con 0x7f318411de30 2026-02-17T21:05:19.322 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f31727fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e1204a4b-7cb0-4508-ae52-f3058f2b4322", "id": 6}] 2026-02-17T21:05:19.322 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f31727fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:19.323 INFO:teuthology.orchestra.run.trial138.stdout:6 2026-02-17T21:05:19.324 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 10 librados: watch_flush enter 2026-02-17T21:05:19.324 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 10 librados: watch_flush exit 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 20 client.4144.objecter shutdown clearing up homeless session... 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 10 client.4144.objecter successfully canceled tick 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 10 monclient: shutdown 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 -- 10.20.193.138:0/3042502715 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411de30 msgr2=0x7f31841ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 --2- 10.20.193.138:0/3042502715 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411de30 0x7f31841ab480 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f318000efc0 tx=0x7f318000c490 comp rx=0 tx=0).stop 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 -- 10.20.193.138:0/3042502715 shutdown_connections 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 --2- 10.20.193.138:0/3042502715 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f318411de30 0x7f31841ab480 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 --2- 10.20.193.138:0/3042502715 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f318411b500 0x7f31841b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 --2- 10.20.193.138:0/3042502715 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3184073d90 0x7f31841b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.325 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 -- 10.20.193.138:0/3042502715 >> 10.20.193.138:0/3042502715 conn(0x7f318406f910 msgr2=0x7f318411e450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:19.326 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 -- 10.20.193.138:0/3042502715 shutdown_connections 2026-02-17T21:05:19.326 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 -- 10.20.193.138:0/3042502715 wait complete. 2026-02-17T21:05:19.326 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.324+0000 7f318bb96640 1 librados: shutdown 2026-02-17T21:05:19.330 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 9cb3ad9d-88bb-47b1-a4b4-8614b9804e84 7 2026-02-17T21:05:19.399 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.397+0000 7f30fd67c640 10 monclient: get_monmap_and_config 2026-02-17T21:05:19.399 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.397+0000 7f30fd67c640 10 monclient: build_initial_monmap 2026-02-17T21:05:19.400 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient: monmap: 2026-02-17T21:05:19.400 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:19.400 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.400 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:19.399166+0000 2026-02-17T21:05:19.400 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:19.399166+0000 2026-02-17T21:05:19.401 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:19.401 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.401 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:19.401 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:19.401 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:19.401 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:19.402 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:19.402 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:19.402 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.402 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 1 Processor -- start 2026-02-17T21:05:19.402 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 1 -- start start 2026-02-17T21:05:19.402 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient: init 2026-02-17T21:05:19.403 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:19.403 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient: _add_conns ranks=[3,2,1,4,0,5] 2026-02-17T21:05:19.403 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f30f8118450 0x7f30f8073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.403 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient(hunting): picked mon.noname-a con 0x7f30f8118450 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:19.403 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f30f8073ed0 addr v1:10.20.193.92:6789/0 2026-02-17T21:05:19.403 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f30f80744e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:19.403 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f8128300 con 0x7f30f80744e0 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f8129520 con 0x7f30f8073ed0 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f30f812a720 con 0x7f30f8118450 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30fd67c640 10 monclient(hunting): authenticate will time out at 900.022545s 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30f6ffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f30f8118450 0x7f30f8073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30f77fe640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f30f80744e0 0x7f30f8126a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.138:60662/0 (socket says 10.20.193.138:60662) 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.398+0000 7f30f77fe640 1 -- 10.20.193.138:0/3607105989 learned_addr learned my addr 10.20.193.138:0/3607105989 (peer_addr_for_me v1:10.20.193.138:0/0) 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.399+0000 7f30f6ffd640 10 monclient(hunting): get_auth_request con 0x7f30f8118450 auth_method 0 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.399+0000 7f30f6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.399+0000 7f30f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.404 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.399+0000 7f30f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.399+0000 7f30f6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.399+0000 7f30f6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.399+0000 7f30f6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f5ffb640 1 -- 10.20.193.138:0/3607105989 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659559345 0 0) 0x7f30f8128300 con 0x7f30f80744e0 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f5ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f5ffb640 10 monclient(hunting): my global_id is 4147 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f5ffb640 1 -- 10.20.193.138:0/3607105989 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30e4003620 con 0x7f30f80744e0 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f6ffd640 10 monclient(hunting): handle_auth_done global_id 4143 payload 274 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f6ffd640 1 -- 10.20.193.138:0/3607105989 >> v1:10.20.193.92:6789/0 conn(0x7f30f8073ed0 legacy=0x7f30f81232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.405 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f6ffd640 1 -- 10.20.193.138:0/3607105989 >> v1:10.20.193.86:6789/0 conn(0x7f30f80744e0 legacy=0x7f30f8126a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.406 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:19.406 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f6ffd640 1 monclient: found mon.noname-a 2026-02-17T21:05:19.406 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:19.406 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:19.406 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.400+0000 7f30f6ffd640 1 -- 10.20.193.138:0/3607105989 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f812a8a0 con 0x7f30f8118450 2026-02-17T21:05:19.406 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.401+0000 7f30f6ffd640 1 --2- 10.20.193.138:0/3607105989 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f8118450 0x7f30f8073990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0098a0 tx=0x7f30ec02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714d965e74618f48 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:19.413 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 1 -- 10.20.193.138:0/3607105989 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec03c070 con 0x7f30f8118450 2026-02-17T21:05:19.413 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.413 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:19.413 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 10 monclient: dump: 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.414 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:05:19.415 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:05:19.415 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:19.415 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 1 -- 10.20.193.138:0/3607105989 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec02fb70 con 0x7f30f8118450 2026-02-17T21:05:19.415 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30fd67c640 5 monclient: authenticate success, global_id 4143 2026-02-17T21:05:19.415 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30fd67c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:19.415 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:19.415 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 1 -- 10.20.193.138:0/3607105989 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec037440 con 0x7f30f8118450 2026-02-17T21:05:19.415 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.416 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:19.416 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30f5ffb640 10 monclient: dump: 2026-02-17T21:05:19.416 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.416 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.416 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.416 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.416 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.417 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.417 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.417 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.417 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.417 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.417 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30fd67c640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:19.418 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.402+0000 7f30fd67c640 4 set_mon_vals no callback set 2026-02-17T21:05:19.418 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient: shutdown 2026-02-17T21:05:19.418 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:19.418 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 -- 10.20.193.138:0/3607105989 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f8118450 msgr2=0x7f30f8073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.418 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 --2- 10.20.193.138:0/3607105989 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f8118450 0x7f30f8073990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0098a0 tx=0x7f30ec02ee60 comp rx=0 tx=0).stop 2026-02-17T21:05:19.418 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 -- 10.20.193.138:0/3607105989 shutdown_connections 2026-02-17T21:05:19.419 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 --2- 10.20.193.138:0/3607105989 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f8118450 0x7f30f8073990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.419 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 -- 10.20.193.138:0/3607105989 >> 10.20.193.138:0/3607105989 conn(0x7f30f806f910 msgr2=0x7f30f8071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:19.419 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 -- 10.20.193.138:0/3607105989 shutdown_connections 2026-02-17T21:05:19.419 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 -- 10.20.193.138:0/3607105989 wait complete. 2026-02-17T21:05:19.419 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient: build_initial_monmap 2026-02-17T21:05:19.419 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient: monmap: 2026-02-17T21:05:19.420 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:19.420 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:19.420 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:19.420 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:19.420 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:19.420 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.421 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:19.421 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:19.421 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:19.421 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.421 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 librados: starting msgr at 2026-02-17T21:05:19.421 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 librados: starting objecter 2026-02-17T21:05:19.422 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 Processor -- start 2026-02-17T21:05:19.422 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 -- start start 2026-02-17T21:05:19.422 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 librados: setting wanted keys 2026-02-17T21:05:19.422 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 librados: calling monclient init 2026-02-17T21:05:19.422 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient: init 2026-02-17T21:05:19.422 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:19.422 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:05:19.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f30f8073ed0 0x7f30f8116650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient(hunting): picked mon.noname-c con 0x7f30f8073ed0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:19.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f80744e0 0x7f30f8116cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient(hunting): picked mon.noname-a con 0x7f30f80744e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:19.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f30f8118450 0x7f30f81bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient(hunting): picked mon.noname-b con 0x7f30f8118450 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:19.424 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.424 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8129b70 con 0x7f30f80744e0 2026-02-17T21:05:19.424 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.424 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81299f0 con 0x7f30f8118450 2026-02-17T21:05:19.424 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.424 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8129cf0 con 0x7f30f8073ed0 2026-02-17T21:05:19.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:19.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.403+0000 7f30fd67c640 10 monclient(hunting): authenticate will time out at 900.027859s 2026-02-17T21:05:19.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f80744e0 0x7f30f8116cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f80744e0 0x7f30f8116cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39566/0 (socket says 10.20.193.138:39566) 2026-02-17T21:05:19.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 1 -- 10.20.193.138:0/3047738017 learned_addr learned my addr 10.20.193.138:0/3047738017 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:19.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 10 monclient(hunting): get_auth_request con 0x7f30f80744e0 auth_method 0 2026-02-17T21:05:19.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f6ffd640 1 --2- 10.20.193.138:0/3047738017 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f30f8073ed0 0x7f30f8116650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f77fe640 1 --2- 10.20.193.138:0/3047738017 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f30f8118450 0x7f30f81bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f6ffd640 10 monclient(hunting): get_auth_request con 0x7f30f8073ed0 auth_method 0 2026-02-17T21:05:19.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f77fe640 10 monclient(hunting): get_auth_request con 0x7f30f8118450 auth_method 0 2026-02-17T21:05:19.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.404+0000 7f30f77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 10 monclient(hunting): handle_auth_done global_id 4146 payload 824 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 1 -- 10.20.193.138:0/3047738017 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f30f8073ed0 msgr2=0x7f30f8116650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 1 --2- 10.20.193.138:0/3047738017 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f30f8073ed0 0x7f30f8116650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 1 -- 10.20.193.138:0/3047738017 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f30f8118450 msgr2=0x7f30f81bb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 1 --2- 10.20.193.138:0/3047738017 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f30f8118450 0x7f30f81bb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 10 monclient: _finish_hunting 0 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 1 monclient: found mon.noname-a 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.405+0000 7f30f67fc640 1 -- 10.20.193.138:0/3047738017 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f81bbfb0 con 0x7f30f80744e0 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.406+0000 7f30f67fc640 1 --2- 10.20.193.138:0/3047738017 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f80744e0 0x7f30f8116cc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c700 tx=0x7f30e000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:19.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.406+0000 7f30d77fe640 10 client.?.objecter ms_handle_connect 0x7f30f80744e0 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.406+0000 7f30d77fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 1 -- 10.20.193.138:0/3047738017 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e00052d0 con 0x7f30f80744e0 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 10 monclient: dump: 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.430 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 10 monclient: _finish_auth 0 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 1 -- 10.20.193.138:0/3047738017 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e0005470 con 0x7f30f80744e0 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 1 -- 10.20.193.138:0/3047738017 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e00038d0 con 0x7f30f80744e0 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30f57fa640 4 set_mon_vals no callback set 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30d77fe640 10 monclient: dump: 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.431 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 5 monclient: authenticate success, global_id 4146 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 10 monclient: _renew_subs 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 1 -- 10.20.193.138:0/3047738017 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f81bc240 con 0x7f30f80744e0 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 10 client.4146.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 10 monclient: _renew_subs 2026-02-17T21:05:19.432 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:19.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 1 -- 10.20.193.138:0/3047738017 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f81bc710 con 0x7f30f80744e0 2026-02-17T21:05:19.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 1 librados: init done 2026-02-17T21:05:19.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:19.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:19.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:19.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.408+0000 7f30fd67c640 1 -- 10.20.193.138:0/3047738017 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f8073990 con 0x7f30f80744e0 2026-02-17T21:05:19.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.414+0000 7f30d77fe640 1 -- 10.20.193.138:0/3047738017 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7f30e0003a70 con 0x7f30f80744e0 2026-02-17T21:05:19.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.457+0000 7f30d77fe640 1 -- 10.20.193.138:0/3047738017 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f30e000ada0 con 0x7f30f80744e0 2026-02-17T21:05:19.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.457+0000 7f30d77fe640 10 client.4146.objecter ms_dispatch2 0x7f30f8000b90 osd_map(9..9 src has 1..9) 2026-02-17T21:05:19.455 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.457+0000 7f30d77fe640 3 client.4146.objecter handle_osd_map got epochs [9,9] > 0 2026-02-17T21:05:19.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.457+0000 7f30d77fe640 3 client.4146.objecter handle_osd_map decoding full epoch 9 2026-02-17T21:05:19.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.457+0000 7f30d77fe640 20 client.4146.objecter dump_active .. 0 homeless 2026-02-17T21:05:19.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.457+0000 7f30d77fe640 1 -- 10.20.193.138:0/3047738017 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f30e000a640 con 0x7f30f80744e0 2026-02-17T21:05:19.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.457+0000 7f30d77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:19.456 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.457+0000 7f30d77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:19.487 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.489+0000 7f30fd67c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9cb3ad9d-88bb-47b1-a4b4-8614b9804e84", "id": 7}] 2026-02-17T21:05:19.488 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.489+0000 7f30fd67c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9cb3ad9d-88bb-47b1-a4b4-8614b9804e84", "id": 7}] 2026-02-17T21:05:19.488 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.489+0000 7f30fd67c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:19.488 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.489+0000 7f30fd67c640 1 -- 10.20.193.138:0/3047738017 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9cb3ad9d-88bb-47b1-a4b4-8614b9804e84", "id": 7} v 0) -- 0x7f30f8124450 con 0x7f30f80744e0 2026-02-17T21:05:19.501 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.503+0000 7f30d77fe640 1 -- 10.20.193.138:0/3047738017 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9cb3ad9d-88bb-47b1-a4b4-8614b9804e84", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f30e0024d00 con 0x7f30f80744e0 2026-02-17T21:05:19.502 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.503+0000 7f30d77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9cb3ad9d-88bb-47b1-a4b4-8614b9804e84", "id": 7}] 2026-02-17T21:05:19.502 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.503+0000 7f30d77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:19.502 INFO:teuthology.orchestra.run.trial138.stdout:7 2026-02-17T21:05:19.503 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 10 librados: watch_flush enter 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 10 librados: watch_flush exit 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 20 client.4146.objecter shutdown clearing up homeless session... 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 10 client.4146.objecter successfully canceled tick 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 10 monclient: shutdown 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 -- 10.20.193.138:0/3047738017 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f80744e0 msgr2=0x7f30f8116cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 --2- 10.20.193.138:0/3047738017 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f80744e0 0x7f30f8116cc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c700 tx=0x7f30e000cbd0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 -- 10.20.193.138:0/3047738017 shutdown_connections 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 --2- 10.20.193.138:0/3047738017 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f30f8118450 0x7f30f81bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.504 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 --2- 10.20.193.138:0/3047738017 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f30f80744e0 0x7f30f8116cc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.505 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 --2- 10.20.193.138:0/3047738017 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f30f8073ed0 0x7f30f8116650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.505 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 -- 10.20.193.138:0/3047738017 >> 10.20.193.138:0/3047738017 conn(0x7f30f806f910 msgr2=0x7f30f8070470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:19.505 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 -- 10.20.193.138:0/3047738017 shutdown_connections 2026-02-17T21:05:19.505 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 -- 10.20.193.138:0/3047738017 wait complete. 2026-02-17T21:05:19.505 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.504+0000 7f30fd67c640 1 librados: shutdown 2026-02-17T21:05:19.509 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new d62163e3-9a75-4bef-b3df-7e87f1e24cb7 8 2026-02-17T21:05:19.574 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.574+0000 7fdf816c9640 10 monclient: get_monmap_and_config 2026-02-17T21:05:19.574 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.574+0000 7fdf816c9640 10 monclient: build_initial_monmap 2026-02-17T21:05:19.574 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.574+0000 7fdf816c9640 10 monclient: monmap: 2026-02-17T21:05:19.574 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:19.574 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.574 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:19.575617+0000 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:19.575617+0000 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.574+0000 7fdf816c9640 1 Processor -- start 2026-02-17T21:05:19.575 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.574+0000 7fdf816c9640 1 -- start start 2026-02-17T21:05:19.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.574+0000 7fdf816c9640 10 monclient: init 2026-02-17T21:05:19.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:19.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 10 monclient: _add_conns ranks=[3,5,0,4,2,1] 2026-02-17T21:05:19.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fdf7c073d90 0x7fdf7c074170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 10 monclient(hunting): picked mon.noname-a con 0x7fdf7c073d90 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:19.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fdf7c118470 0x7fdf7c118920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 10 monclient(hunting): picked mon.noname-c con 0x7fdf7c118470 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:19.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdf7c118e60 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:19.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf7c074860 con 0x7fdf7c118e60 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7c121c50 con 0x7fdf7c073d90 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7c121dd0 con 0x7fdf7c118470 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf816c9640 10 monclient(hunting): authenticate will time out at 900.199091s 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf7a7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fdf7c118470 0x7fdf7c118920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf7a7fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fdf7c118470 0x7fdf7c118920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.138:46446/0 (socket says 10.20.193.138:46446) 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf7a7fc640 1 -- 10.20.193.138:0/662405749 learned_addr learned my addr 10.20.193.138:0/662405749 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf7a7fc640 10 monclient(hunting): get_auth_request con 0x7fdf7c118470 auth_method 0 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.577 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.575+0000 7fdf7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.578 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.578 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.578 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 10 monclient(hunting): handle_auth_done global_id 4157 payload 274 2026-02-17T21:05:19.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 1 -- 10.20.193.138:0/662405749 >> v2:10.20.193.45:3300/0 conn(0x7fdf7c073d90 msgr2=0x7fdf7c074170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:19.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 1 --2- 10.20.193.138:0/662405749 >> v2:10.20.193.45:3300/0 conn(0x7fdf7c073d90 0x7fdf7c074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 1 -- 10.20.193.138:0/662405749 >> v1:10.20.193.45:6789/0 conn(0x7fdf7c118e60 legacy=0x7fdf7c11f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:19.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:05:19.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 1 monclient: found mon.noname-c 2026-02-17T21:05:19.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:19.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:19.579 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.576+0000 7fdf7a7fc640 1 -- 10.20.193.138:0/662405749 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c121f50 con 0x7fdf7c118470 2026-02-17T21:05:19.593 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.596+0000 7fdf7a7fc640 1 --2- 10.20.193.138:0/662405749 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 0x7fdf7c118920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c074740 tx=0x7fdf6402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6fae2d126993be2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:19.600 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 1 -- 10.20.193.138:0/662405749 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6403c070 con 0x7fdf7c118470 2026-02-17T21:05:19.600 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.600 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 10 monclient: dump: 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.601 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 10 monclient: _finish_auth 0 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 1 -- 10.20.193.138:0/662405749 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf6402fa90 con 0x7fdf7c118470 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf816c9640 5 monclient: authenticate success, global_id 4157 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 1 -- 10.20.193.138:0/662405749 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6402fe60 con 0x7fdf7c118470 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf79ffb640 10 monclient: dump: 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.602 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf816c9640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:19.603 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.598+0000 7fdf816c9640 4 set_mon_vals no callback set 2026-02-17T21:05:19.604 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient: shutdown 2026-02-17T21:05:19.604 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:19.604 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 -- 10.20.193.138:0/662405749 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 msgr2=0x7fdf7c118920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.604 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 --2- 10.20.193.138:0/662405749 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 0x7fdf7c118920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c074740 tx=0x7fdf6402ee60 comp rx=0 tx=0).stop 2026-02-17T21:05:19.604 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 -- 10.20.193.138:0/662405749 shutdown_connections 2026-02-17T21:05:19.604 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 --2- 10.20.193.138:0/662405749 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 0x7fdf7c118920 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.605 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 --2- 10.20.193.138:0/662405749 >> v2:10.20.193.45:3300/0 conn(0x7fdf7c073d90 0x7fdf7c074170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.605 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 -- 10.20.193.138:0/662405749 >> 10.20.193.138:0/662405749 conn(0x7fdf7c06f910 msgr2=0x7fdf7c071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:19.605 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 -- 10.20.193.138:0/662405749 shutdown_connections 2026-02-17T21:05:19.605 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 -- 10.20.193.138:0/662405749 wait complete. 2026-02-17T21:05:19.605 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient: build_initial_monmap 2026-02-17T21:05:19.605 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient: monmap: 2026-02-17T21:05:19.606 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:19.606 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:19.606 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:19.606 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:19.606 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:19.606 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.607 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:19.607 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:19.607 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:19.607 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.607 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 librados: starting msgr at 2026-02-17T21:05:19.607 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 librados: starting objecter 2026-02-17T21:05:19.608 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 Processor -- start 2026-02-17T21:05:19.608 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 -- start start 2026-02-17T21:05:19.608 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 librados: setting wanted keys 2026-02-17T21:05:19.608 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 librados: calling monclient init 2026-02-17T21:05:19.608 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient: init 2026-02-17T21:05:19.608 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:19.608 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:05:19.609 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdf7c073d90 0x7fdf7c1121d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.609 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient(hunting): picked mon.noname-b con 0x7fdf7c073d90 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:19.609 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 0x7fdf7c112710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.609 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient(hunting): picked mon.noname-c con 0x7fdf7c118470 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:19.609 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdf7c118e60 0x7fdf7c112c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.609 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient(hunting): picked mon.noname-a con 0x7fdf7c118e60 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:19.610 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.610 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c121100 con 0x7fdf7c118e60 2026-02-17T21:05:19.610 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.610 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c120f80 con 0x7fdf7c073d90 2026-02-17T21:05:19.610 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:19.610 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c121280 con 0x7fdf7c118470 2026-02-17T21:05:19.611 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:19.611 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.599+0000 7fdf816c9640 10 monclient(hunting): authenticate will time out at 900.223992s 2026-02-17T21:05:19.611 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 0x7fdf7c112710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.611 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7affd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdf7c073d90 0x7fdf7c1121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.611 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 0x7fdf7c112710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.138:46458/0 (socket says 10.20.193.138:46458) 2026-02-17T21:05:19.611 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 1 -- 10.20.193.138:0/231391484 learned_addr learned my addr 10.20.193.138:0/231391484 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:19.612 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 10 monclient(hunting): get_auth_request con 0x7fdf7c118470 auth_method 0 2026-02-17T21:05:19.612 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.612 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.612 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.612 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7affd640 10 monclient(hunting): get_auth_request con 0x7fdf7c073d90 auth_method 0 2026-02-17T21:05:19.612 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.600+0000 7fdf7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 10 monclient(hunting): handle_auth_done global_id 4160 payload 824 2026-02-17T21:05:19.613 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 1 -- 10.20.193.138:0/231391484 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdf7c073d90 msgr2=0x7fdf7c1121d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdf7c073d90 0x7fdf7c1121d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 1 -- 10.20.193.138:0/231391484 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdf7c118e60 msgr2=0x7fdf7c112c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdf7c118e60 0x7fdf7c112c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 1 monclient: found mon.noname-c 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.601+0000 7fdf7a7fc640 1 -- 10.20.193.138:0/231391484 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c1b7b00 con 0x7fdf7c118470 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.602+0000 7fdf7a7fc640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 0x7fdf7c112710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf64002410 tx=0x7fdf640047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.602+0000 7fdf5b7fe640 10 client.?.objecter ms_handle_connect 0x7fdf7c118470 2026-02-17T21:05:19.614 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.602+0000 7fdf5b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:19.618 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 1 -- 10.20.193.138:0/231391484 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf64044070 con 0x7fdf7c118470 2026-02-17T21:05:19.618 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.618 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:19.618 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 10 monclient: dump: 2026-02-17T21:05:19.618 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.619 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.619 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.619 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.619 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.619 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.619 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.619 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.619 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 5 monclient: authenticate success, global_id 4160 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 10 monclient: _renew_subs 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7c1b7d90 con 0x7fdf7c118470 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 10 client.4160.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 10 monclient: _renew_subs 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:19.620 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7c1b8300 con 0x7fdf7c118470 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 1 librados: init done 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 1 -- 10.20.193.138:0/231391484 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf6402fa90 con 0x7fdf7c118470 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 1 -- 10.20.193.138:0/231391484 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6404e060 con 0x7fdf7c118470 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf5b7fe640 10 monclient: dump: 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:19.621 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:19.622 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:19.622 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:19.622 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:19.622 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:19.622 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf797fa640 4 set_mon_vals no callback set 2026-02-17T21:05:19.622 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:19.622 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:19.622 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:19.622 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.604+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf7c074170 con 0x7fdf7c118470 2026-02-17T21:05:19.644 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.646+0000 7fdf5b7fe640 1 -- 10.20.193.138:0/231391484 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 2) ==== 50143+0+0 (secure 0 0 0) 0x7fdf6403f050 con 0x7fdf7c118470 2026-02-17T21:05:19.647 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.649+0000 7fdf5b7fe640 1 -- 10.20.193.138:0/231391484 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fdf6403fe00 con 0x7fdf7c118470 2026-02-17T21:05:19.648 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.649+0000 7fdf5b7fe640 10 client.4160.objecter ms_dispatch2 0x7fdf7c000b90 osd_map(10..10 src has 1..10) 2026-02-17T21:05:19.648 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.649+0000 7fdf5b7fe640 3 client.4160.objecter handle_osd_map got epochs [10,10] > 0 2026-02-17T21:05:19.648 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.649+0000 7fdf5b7fe640 3 client.4160.objecter handle_osd_map decoding full epoch 10 2026-02-17T21:05:19.648 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.649+0000 7fdf5b7fe640 20 client.4160.objecter dump_active .. 0 homeless 2026-02-17T21:05:19.648 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.649+0000 7fdf5b7fe640 1 -- 10.20.193.138:0/231391484 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fdf64035ce0 con 0x7fdf7c118470 2026-02-17T21:05:19.648 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.649+0000 7fdf5b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:19.648 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.649+0000 7fdf5b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:19.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.682+0000 7fdf816c9640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d62163e3-9a75-4bef-b3df-7e87f1e24cb7", "id": 8}] 2026-02-17T21:05:19.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.682+0000 7fdf816c9640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d62163e3-9a75-4bef-b3df-7e87f1e24cb7", "id": 8}] 2026-02-17T21:05:19.680 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.682+0000 7fdf816c9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:19.681 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.682+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d62163e3-9a75-4bef-b3df-7e87f1e24cb7", "id": 8} v 0) -- 0x7fdf7c11a5e0 con 0x7fdf7c118470 2026-02-17T21:05:19.822 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:19.829+0000 7ff917be7640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-17T21:05:19.863 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.865+0000 7fdf5b7fe640 1 -- 10.20.193.138:0/231391484 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mgrmap(e 3) ==== 100083+0+0 (secure 0 0 0) 0x7fdf64040a00 con 0x7fdf7c118470 2026-02-17T21:05:19.864 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.866+0000 7fdf5b7fe640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdf48079820 0x7fdf4807bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:19.864 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.866+0000 7fdf7affd640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdf48079820 0x7fdf4807bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:19.864 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.866+0000 7fdf7affd640 10 monclient: get_auth_request con 0x7fdf48079820 auth_method 0 2026-02-17T21:05:19.864 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.866+0000 7fdf7affd640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdf48079820 0x7fdf4807bc10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c113310 tx=0x7fdf70009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:19.864 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.866+0000 7fdf5b7fe640 10 client.4160.objecter ms_handle_connect 0x7fdf48079820 2026-02-17T21:05:19.895 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:05:19.903+0000 7ff917be7640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-17T21:05:19.929 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf5b7fe640 1 -- 10.20.193.138:0/231391484 <== mon.2 v2:10.20.193.92:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d62163e3-9a75-4bef-b3df-7e87f1e24cb7", "id": 8}]=0 v11) ==== 112+0+2 (secure 0 0 0) 0x7fdf6408a7e0 con 0x7fdf7c118470 2026-02-17T21:05:19.929 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf5b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d62163e3-9a75-4bef-b3df-7e87f1e24cb7", "id": 8}] 2026-02-17T21:05:19.929 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf5b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:19.930 INFO:teuthology.orchestra.run.trial138.stdout:8 2026-02-17T21:05:19.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 10 librados: watch_flush enter 2026-02-17T21:05:19.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 10 librados: watch_flush exit 2026-02-17T21:05:19.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 20 client.4160.objecter shutdown clearing up homeless session... 2026-02-17T21:05:19.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 10 client.4160.objecter successfully canceled tick 2026-02-17T21:05:19.933 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdf48079820 msgr2=0x7fdf4807bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdf48079820 0x7fdf4807bc10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c113310 tx=0x7fdf70009210 comp rx=0 tx=0).stop 2026-02-17T21:05:19.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 10 monclient: shutdown 2026-02-17T21:05:19.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:19.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 msgr2=0x7fdf7c112710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:19.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 0x7fdf7c112710 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf64002410 tx=0x7fdf640047c0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.934 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 shutdown_connections 2026-02-17T21:05:19.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdf48079820 0x7fdf4807bc10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdf7c118e60 0x7fdf7c112c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf7c118470 0x7fdf7c112710 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 --2- 10.20.193.138:0/231391484 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdf7c073d90 0x7fdf7c1121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:19.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 >> 10.20.193.138:0/231391484 conn(0x7fdf7c06f910 msgr2=0x7fdf7c1168f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:19.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 shutdown_connections 2026-02-17T21:05:19.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 -- 10.20.193.138:0/231391484 wait complete. 2026-02-17T21:05:19.935 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:19.931+0000 7fdf816c9640 1 librados: shutdown 2026-02-17T21:05:19.939 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 16273fd7-3b1b-4112-8e88-b5affbf4bc8a 9 2026-02-17T21:05:20.008 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient: get_monmap_and_config 2026-02-17T21:05:20.008 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient: build_initial_monmap 2026-02-17T21:05:20.008 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient: monmap: 2026-02-17T21:05:20.008 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:20.009 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.009 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:20.007554+0000 2026-02-17T21:05:20.009 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:20.007554+0000 2026-02-17T21:05:20.009 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:20.009 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.009 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:20.009 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:20.009 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:20.009 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 1 Processor -- start 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 1 -- start start 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient: init 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient: _add_conns ranks=[0,3,1,2,5,4] 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5488073d90 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f548811b500 0x7f548811d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.010 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient(hunting): picked mon.noname-a con 0x7f548811b500 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f548811de30 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5488121b20 con 0x7f5488073d90 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5488122d40 con 0x7f548811de30 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f5488123f40 con 0x7f548811b500 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.006+0000 7f548dfef640 10 monclient(hunting): authenticate will time out at 900.630948s 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.007+0000 7f5487fff640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f548811de30 0x7f5488120220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.138:60674/0 (socket says 10.20.193.138:60674) 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.007+0000 7f5487fff640 1 -- 10.20.193.138:0/2562740602 learned_addr learned my addr 10.20.193.138:0/2562740602 (peer_addr_for_me v1:10.20.193.138:0/0) 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.007+0000 7f5486ffd640 1 --2- 10.20.193.138:0/2562740602 >> v2:10.20.193.45:3300/0 conn(0x7f548811b500 0x7f548811d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.007+0000 7f5486ffd640 10 monclient(hunting): get_auth_request con 0x7f548811b500 auth_method 0 2026-02-17T21:05:20.011 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.007+0000 7f5486ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.007+0000 7f5486ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.007+0000 7f5486ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.008+0000 7f5486ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.008+0000 7f5486ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.008+0000 7f5486ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.008+0000 7f54867fc640 1 -- 10.20.193.138:0/2562740602 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577232100 0 0) 0x7f5488122d40 con 0x7f548811de30 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.008+0000 7f54867fc640 10 monclient(hunting): _negotiate 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.008+0000 7f54867fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.008+0000 7f54867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.008+0000 7f54867fc640 10 monclient(hunting): my global_id is 4156 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.008+0000 7f54867fc640 1 -- 10.20.193.138:0/2562740602 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f546c003620 con 0x7f548811de30 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.009+0000 7f5486ffd640 10 monclient(hunting): handle_auth_done global_id 4149 payload 274 2026-02-17T21:05:20.012 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.009+0000 7f5486ffd640 1 -- 10.20.193.138:0/2562740602 >> v1:10.20.193.86:6789/0 conn(0x7f548811de30 legacy=0x7f5488120220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.009+0000 7f5486ffd640 1 -- 10.20.193.138:0/2562740602 >> v1:10.20.193.45:6789/0 conn(0x7f5488073d90 legacy=0x7f5488074170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.009+0000 7f5486ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:20.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.009+0000 7f5486ffd640 1 monclient: found mon.noname-a 2026-02-17T21:05:20.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.009+0000 7f5486ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:20.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.009+0000 7f5486ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:20.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.009+0000 7f5486ffd640 1 -- 10.20.193.138:0/2562740602 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54881240c0 con 0x7f548811b500 2026-02-17T21:05:20.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.011+0000 7f5486ffd640 1 --2- 10.20.193.138:0/2562740602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f548811b500 0x7f548811d8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54780098a0 tx=0x7f547802edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8321c95531cd039f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:20.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 1 -- 10.20.193.138:0/2562740602 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547803c070 con 0x7f548811b500 2026-02-17T21:05:20.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:20.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 10 monclient: dump: 2026-02-17T21:05:20.023 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.023 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.023 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.024 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.024 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.024 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.024 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.024 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.024 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.025 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 10 monclient: _finish_auth 0 2026-02-17T21:05:20.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 10 monclient: _check_auth_tickets 2026-02-17T21:05:20.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:20.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 1 -- 10.20.193.138:0/2562740602 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f547802fae0 con 0x7f548811b500 2026-02-17T21:05:20.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:20.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f548dfef640 5 monclient: authenticate success, global_id 4149 2026-02-17T21:05:20.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 1 -- 10.20.193.138:0/2562740602 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478037440 con 0x7f548811b500 2026-02-17T21:05:20.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f548dfef640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:20.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f548dfef640 4 set_mon_vals no callback set 2026-02-17T21:05:20.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:20.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.012+0000 7f54867fc640 10 monclient: dump: 2026-02-17T21:05:20.027 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.027 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.027 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.027 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.027 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.028 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.028 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.028 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.028 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.028 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.028 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient: shutdown 2026-02-17T21:05:20.028 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:20.028 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 -- 10.20.193.138:0/2562740602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f548811b500 msgr2=0x7f548811d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 --2- 10.20.193.138:0/2562740602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f548811b500 0x7f548811d8f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f54780098a0 tx=0x7f547802edd0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 -- 10.20.193.138:0/2562740602 shutdown_connections 2026-02-17T21:05:20.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 --2- 10.20.193.138:0/2562740602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f548811b500 0x7f548811d8f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 -- 10.20.193.138:0/2562740602 >> 10.20.193.138:0/2562740602 conn(0x7f548806f910 msgr2=0x7f5488071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:20.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 -- 10.20.193.138:0/2562740602 shutdown_connections 2026-02-17T21:05:20.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 -- 10.20.193.138:0/2562740602 wait complete. 2026-02-17T21:05:20.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient: build_initial_monmap 2026-02-17T21:05:20.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient: monmap: 2026-02-17T21:05:20.030 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:20.030 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:20.030 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:20.030 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:20.031 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:20.031 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.031 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:20.031 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:20.031 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:20.031 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.032 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 librados: starting msgr at 2026-02-17T21:05:20.032 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 librados: starting objecter 2026-02-17T21:05:20.032 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 Processor -- start 2026-02-17T21:05:20.032 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 -- start start 2026-02-17T21:05:20.032 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 librados: setting wanted keys 2026-02-17T21:05:20.032 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 librados: calling monclient init 2026-02-17T21:05:20.032 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient: init 2026-02-17T21:05:20.032 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:20.032 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5488073d90 0x7f54881b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient(hunting): picked mon.noname-b con 0x7f5488073d90 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f548811b500 0x7f54881b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient(hunting): picked mon.noname-a con 0x7f548811b500 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f548811de30 0x7f54881ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient(hunting): picked mon.noname-c con 0x7f548811de30 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54881221b0 con 0x7f548811b500 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5488122030 con 0x7f5488073d90 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.033 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5488122330 con 0x7f548811de30 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.013+0000 7f548dfef640 10 monclient(hunting): authenticate will time out at 900.637993s 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5488073d90 0x7f54881b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5486ffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f548811b500 0x7f54881b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5488073d90 0x7f54881b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.138:43328/0 (socket says 10.20.193.138:43328) 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 1 -- 10.20.193.138:0/4219472242 learned_addr learned my addr 10.20.193.138:0/4219472242 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 10 monclient(hunting): get_auth_request con 0x7f5488073d90 auth_method 0 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.034 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5487fff640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f548811de30 0x7f54881ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5486ffd640 10 monclient(hunting): get_auth_request con 0x7f548811b500 auth_method 0 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5486ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5486ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5486ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f54877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5487fff640 10 monclient(hunting): get_auth_request con 0x7f548811de30 auth_method 0 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5487fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5487fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5487fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.035 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5486ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5486ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5486ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5487fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.014+0000 7f5487fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f5487fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 10 monclient(hunting): handle_auth_done global_id 4159 payload 824 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 1 -- 10.20.193.138:0/4219472242 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f548811de30 msgr2=0x7f54881ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f548811de30 0x7f54881ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 1 -- 10.20.193.138:0/4219472242 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f548811b500 msgr2=0x7f54881b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f548811b500 0x7f54881b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 1 monclient: found mon.noname-b 2026-02-17T21:05:20.036 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.015+0000 7f54877fe640 1 -- 10.20.193.138:0/4219472242 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54881abda0 con 0x7f5488073d90 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.016+0000 7f54877fe640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5488073d90 0x7f54881b1430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f547400c700 tx=0x7f547400cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.016+0000 7f5463fff640 10 client.?.objecter ms_handle_connect 0x7f5488073d90 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.016+0000 7f5463fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 1 -- 10.20.193.138:0/4219472242 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54740052d0 con 0x7f5488073d90 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 10 monclient: dump: 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.037 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 10 monclient: _finish_auth 0 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 10 monclient: _check_auth_tickets 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 5 monclient: authenticate success, global_id 4159 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 10 monclient: _renew_subs 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:20.038 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54881ac030 con 0x7f5488073d90 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 10 client.4159.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 10 monclient: _renew_subs 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54881b83c0 con 0x7f5488073d90 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 1 librados: init done 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 1 -- 10.20.193.138:0/4219472242 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5474005470 con 0x7f5488073d90 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 1 -- 10.20.193.138:0/4219472242 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54740038b0 con 0x7f5488073d90 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5463fff640 10 monclient: dump: 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.039 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f5485ffb640 4 set_mon_vals no callback set 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:20.040 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.018+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5488122790 con 0x7f5488073d90 2026-02-17T21:05:20.120 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.122+0000 7f5463fff640 1 -- 10.20.193.138:0/4219472242 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 3) ==== 100083+0+0 (secure 0 0 0) 0x7f5474003a50 con 0x7f5488073d90 2026-02-17T21:05:20.122 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.123+0000 7f5463fff640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54580790d0 0x7f545807b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.122 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.123+0000 7f5486ffd640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54580790d0 0x7f545807b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.122 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.123+0000 7f5486ffd640 10 monclient: get_auth_request con 0x7f54580790d0 auth_method 0 2026-02-17T21:05:20.122 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.124+0000 7f5463fff640 10 client.4159.objecter ms_handle_connect 0x7f54580790d0 2026-02-17T21:05:20.123 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.124+0000 7f5486ffd640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54580790d0 0x7f545807b590 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5478039000 tx=0x7f5478033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:20.128 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.130+0000 7f5463fff640 1 -- 10.20.193.138:0/4219472242 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1760+0+0 (secure 0 0 0) 0x7f547405e3d0 con 0x7f5488073d90 2026-02-17T21:05:20.128 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.130+0000 7f5463fff640 10 client.4159.objecter ms_dispatch2 0x7f5488000b90 osd_map(11..11 src has 1..11) 2026-02-17T21:05:20.129 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.130+0000 7f5463fff640 3 client.4159.objecter handle_osd_map got epochs [11,11] > 0 2026-02-17T21:05:20.129 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.130+0000 7f5463fff640 3 client.4159.objecter handle_osd_map decoding full epoch 11 2026-02-17T21:05:20.129 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.130+0000 7f5463fff640 20 client.4159.objecter dump_active .. 0 homeless 2026-02-17T21:05:20.130 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.131+0000 7f5463fff640 1 -- 10.20.193.138:0/4219472242 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5474062390 con 0x7f5488073d90 2026-02-17T21:05:20.130 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.131+0000 7f5463fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:20.130 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.131+0000 7f5463fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:20.219 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.221+0000 7f548dfef640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "16273fd7-3b1b-4112-8e88-b5affbf4bc8a", "id": 9}] 2026-02-17T21:05:20.219 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.221+0000 7f548dfef640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "16273fd7-3b1b-4112-8e88-b5affbf4bc8a", "id": 9}] 2026-02-17T21:05:20.219 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.221+0000 7f548dfef640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:20.220 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.221+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "16273fd7-3b1b-4112-8e88-b5affbf4bc8a", "id": 9} v 0) -- 0x7f5488118a20 con 0x7f5488073d90 2026-02-17T21:05:20.291 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.293+0000 7f5463fff640 1 -- 10.20.193.138:0/4219472242 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16273fd7-3b1b-4112-8e88-b5affbf4bc8a", "id": 9}]=0 v12) ==== 112+0+2 (secure 0 0 0) 0x7f5474066690 con 0x7f5488073d90 2026-02-17T21:05:20.291 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.293+0000 7f5463fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "16273fd7-3b1b-4112-8e88-b5affbf4bc8a", "id": 9}] 2026-02-17T21:05:20.291 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.293+0000 7f5463fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:20.292 INFO:teuthology.orchestra.run.trial138.stdout:9 2026-02-17T21:05:20.293 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 10 librados: watch_flush enter 2026-02-17T21:05:20.293 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 10 librados: watch_flush exit 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 20 client.4159.objecter shutdown clearing up homeless session... 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 10 client.4159.objecter successfully canceled tick 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54580790d0 msgr2=0x7f545807b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54580790d0 0x7f545807b590 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5478039000 tx=0x7f5478033000 comp rx=0 tx=0).stop 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 10 monclient: shutdown 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5488073d90 msgr2=0x7f54881b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5488073d90 0x7f54881b1430 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f547400c700 tx=0x7f547400cbd0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 shutdown_connections 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54580790d0 0x7f545807b590 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.294 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f548811de30 0x7f54881ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.295 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f548811b500 0x7f54881b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.295 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 --2- 10.20.193.138:0/4219472242 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5488073d90 0x7f54881b1430 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.295 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 >> 10.20.193.138:0/4219472242 conn(0x7f548806f910 msgr2=0x7f548811e210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:20.295 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 shutdown_connections 2026-02-17T21:05:20.295 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 -- 10.20.193.138:0/4219472242 wait complete. 2026-02-17T21:05:20.295 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.294+0000 7f548dfef640 1 librados: shutdown 2026-02-17T21:05:20.300 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new c758558e-ee89-43fe-9807-a7b36f6b654a 10 2026-02-17T21:05:20.367 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.366+0000 7f35653d6640 10 monclient: get_monmap_and_config 2026-02-17T21:05:20.367 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.366+0000 7f35653d6640 10 monclient: build_initial_monmap 2026-02-17T21:05:20.367 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.366+0000 7f35653d6640 10 monclient: monmap: 2026-02-17T21:05:20.367 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:20.367 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.367 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:20.368136+0000 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:20.368136+0000 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 1 Processor -- start 2026-02-17T21:05:20.368 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 1 -- start start 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient: init 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient: _add_conns ranks=[5,1,4,2,3,0] 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3560112820 0x7f3560112c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient(hunting): picked mon.noname-c con 0x7f3560112820 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f35601171b0 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3560117d30 0x7f3560120420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient(hunting): picked mon.noname-b con 0x7f3560117d30 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35601209f0 con 0x7f35601171b0 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3560121bd0 con 0x7f3560117d30 2026-02-17T21:05:20.369 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3560121d50 con 0x7f3560112820 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.367+0000 7f35653d6640 10 monclient(hunting): authenticate will time out at 900.991754s 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3560112820 0x7f3560112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3560112820 0x7f3560112c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.138:46484/0 (socket says 10.20.193.138:46484) 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 1 -- 10.20.193.138:0/2448809953 learned_addr learned my addr 10.20.193.138:0/2448809953 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 10 monclient(hunting): get_auth_request con 0x7f3560112820 auth_method 0 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.370 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.368+0000 7f355effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.371 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.369+0000 7f355effd640 10 monclient(hunting): handle_auth_done global_id 4166 payload 274 2026-02-17T21:05:20.371 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.369+0000 7f355effd640 1 -- 10.20.193.138:0/2448809953 >> v2:10.20.193.86:3300/0 conn(0x7f3560117d30 msgr2=0x7f3560120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:20.371 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.369+0000 7f355effd640 1 --2- 10.20.193.138:0/2448809953 >> v2:10.20.193.86:3300/0 conn(0x7f3560117d30 0x7f3560120420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.371 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.369+0000 7f355effd640 1 -- 10.20.193.138:0/2448809953 >> v1:10.20.193.86:6789/0 conn(0x7f35601171b0 legacy=0x7f3560117620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:20.371 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.369+0000 7f355effd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:20.371 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.369+0000 7f355effd640 1 monclient: found mon.noname-c 2026-02-17T21:05:20.371 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.369+0000 7f355effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:20.371 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.369+0000 7f355effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:20.372 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.369+0000 7f355effd640 1 -- 10.20.193.138:0/2448809953 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3560121ed0 con 0x7f3560112820 2026-02-17T21:05:20.384 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.370+0000 7f355effd640 1 --2- 10.20.193.138:0/2448809953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 0x7f3560112c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f35601134f0 tx=0x7f355402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60cc77ba9c8e5c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:20.384 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 1 -- 10.20.193.138:0/2448809953 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355403c070 con 0x7f3560112820 2026-02-17T21:05:20.384 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.385 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:20.385 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 10 monclient: dump: 2026-02-17T21:05:20.385 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.385 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.385 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.385 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.385 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.385 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 10 monclient: _finish_auth 0 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 1 -- 10.20.193.138:0/2448809953 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355402fa90 con 0x7f3560112820 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f35653d6640 5 monclient: authenticate success, global_id 4166 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 1 -- 10.20.193.138:0/2448809953 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355402fe60 con 0x7f3560112820 2026-02-17T21:05:20.386 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f35653d6640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f35653d6640 4 set_mon_vals no callback set 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.371+0000 7f355dffb640 10 monclient: dump: 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.387 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 10 monclient: shutdown 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 -- 10.20.193.138:0/2448809953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 msgr2=0x7f3560112c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 --2- 10.20.193.138:0/2448809953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 0x7f3560112c00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f35601134f0 tx=0x7f355402ee60 comp rx=0 tx=0).stop 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 -- 10.20.193.138:0/2448809953 shutdown_connections 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 --2- 10.20.193.138:0/2448809953 >> v2:10.20.193.86:3300/0 conn(0x7f3560117d30 0x7f3560120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 --2- 10.20.193.138:0/2448809953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 0x7f3560112c00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 -- 10.20.193.138:0/2448809953 >> 10.20.193.138:0/2448809953 conn(0x7f3560071620 msgr2=0x7f3560073a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:20.388 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 -- 10.20.193.138:0/2448809953 shutdown_connections 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 -- 10.20.193.138:0/2448809953 wait complete. 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 10 monclient: build_initial_monmap 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 10 monclient: monmap: 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:20.389 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 librados: starting msgr at 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 librados: starting objecter 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 Processor -- start 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 -- start start 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 librados: setting wanted keys 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 1 librados: calling monclient init 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.372+0000 7f35653d6640 10 monclient: init 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 0x7f35601b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient(hunting): picked mon.noname-c con 0x7f3560112820 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f35601171b0 0x7f35601b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.390 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient(hunting): picked mon.noname-b con 0x7f35601171b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3560117d30 0x7f35601ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient(hunting): picked mon.noname-a con 0x7f3560117d30 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3560121040 con 0x7f3560117d30 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3560120ec0 con 0x7f35601171b0 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f35601211c0 con 0x7f3560112820 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f35653d6640 10 monclient(hunting): authenticate will time out at 900.997179s 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355f7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3560117d30 0x7f35601ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.391 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355effd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 0x7f35601b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355effd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 0x7f35601b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.138:46492/0 (socket says 10.20.193.138:46492) 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355f7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3560117d30 0x7f35601ab5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39606/0 (socket says 10.20.193.138:39606) 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355effd640 1 -- 10.20.193.138:0/567264695 learned_addr learned my addr 10.20.193.138:0/567264695 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355effd640 10 monclient(hunting): get_auth_request con 0x7f3560112820 auth_method 0 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355f7fe640 10 monclient(hunting): get_auth_request con 0x7f3560117d30 auth_method 0 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.373+0000 7f355f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.392 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.374+0000 7f355effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.374+0000 7f355effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.374+0000 7f355effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.374+0000 7f355f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.374+0000 7f355f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.374+0000 7f355f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 10 monclient(hunting): handle_auth_done global_id 4169 payload 824 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 1 -- 10.20.193.138:0/567264695 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f35601171b0 msgr2=0x7f35601b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f35601171b0 0x7f35601b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 1 -- 10.20.193.138:0/567264695 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3560117d30 msgr2=0x7f35601ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3560117d30 0x7f35601ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 1 monclient: found mon.noname-c 2026-02-17T21:05:20.393 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.375+0000 7f355effd640 1 -- 10.20.193.138:0/567264695 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35601abe60 con 0x7f3560112820 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.376+0000 7f355effd640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 0x7f35601b14b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3554002410 tx=0x7f35540047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.376+0000 7f353f7fe640 10 client.?.objecter ms_handle_connect 0x7f3560112820 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.376+0000 7f353f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 1 -- 10.20.193.138:0/567264695 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554046020 con 0x7f3560112820 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 10 monclient: dump: 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.394 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.395 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.395 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.395 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.395 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.395 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.395 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.395 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.396 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.396 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:05:20.396 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:05:20.396 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:20.396 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 5 monclient: authenticate success, global_id 4169 2026-02-17T21:05:20.397 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 10 monclient: _renew_subs 2026-02-17T21:05:20.397 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:20.397 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35601ac0f0 con 0x7f3560112820 2026-02-17T21:05:20.397 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 10 client.4169.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:20.397 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 10 monclient: _renew_subs 2026-02-17T21:05:20.397 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:20.398 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35601b84a0 con 0x7f3560112820 2026-02-17T21:05:20.398 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 1 librados: init done 2026-02-17T21:05:20.398 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:20.398 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:20.398 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:20.398 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3560112c00 con 0x7f3560112820 2026-02-17T21:05:20.399 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 1 -- 10.20.193.138:0/567264695 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355402fa90 con 0x7f3560112820 2026-02-17T21:05:20.399 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:20.399 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 1 -- 10.20.193.138:0/567264695 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355403c040 con 0x7f3560112820 2026-02-17T21:05:20.399 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.399 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:20.399 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f353f7fe640 10 monclient: dump: 2026-02-17T21:05:20.399 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.400 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.400 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.400 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.400 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.400 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.400 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.400 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.401 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.401 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.401 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.377+0000 7f355d7fa640 4 set_mon_vals no callback set 2026-02-17T21:05:20.480 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.481+0000 7f353f7fe640 1 -- 10.20.193.138:0/567264695 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 3) ==== 100083+0+0 (secure 0 0 0) 0x7f355403f030 con 0x7f3560112820 2026-02-17T21:05:20.480 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.482+0000 7f353f7fe640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f352c0790d0 0x7f352c07b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.480 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.482+0000 7f355e7fc640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f352c0790d0 0x7f352c07b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.480 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.482+0000 7f355e7fc640 10 monclient: get_auth_request con 0x7f352c0790d0 auth_method 0 2026-02-17T21:05:20.481 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.483+0000 7f353f7fe640 10 client.4169.objecter ms_handle_connect 0x7f352c0790d0 2026-02-17T21:05:20.481 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.483+0000 7f355e7fc640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f352c0790d0 0x7f352c07b590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3548006fd0 tx=0x7f3548006d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:20.486 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.488+0000 7f353f7fe640 1 -- 10.20.193.138:0/567264695 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 1875+0+0 (secure 0 0 0) 0x7f3554083850 con 0x7f3560112820 2026-02-17T21:05:20.486 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.488+0000 7f353f7fe640 10 client.4169.objecter ms_dispatch2 0x7f3560000b90 osd_map(12..12 src has 1..12) 2026-02-17T21:05:20.487 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.488+0000 7f353f7fe640 3 client.4169.objecter handle_osd_map got epochs [12,12] > 0 2026-02-17T21:05:20.487 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.488+0000 7f353f7fe640 3 client.4169.objecter handle_osd_map decoding full epoch 12 2026-02-17T21:05:20.487 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.488+0000 7f353f7fe640 20 client.4169.objecter dump_active .. 0 homeless 2026-02-17T21:05:20.487 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.488+0000 7f353f7fe640 1 -- 10.20.193.138:0/567264695 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3554050030 con 0x7f3560112820 2026-02-17T21:05:20.487 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.489+0000 7f353f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:20.487 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.489+0000 7f353f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:20.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.578+0000 7f35653d6640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c758558e-ee89-43fe-9807-a7b36f6b654a", "id": 10}] 2026-02-17T21:05:20.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.578+0000 7f35653d6640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c758558e-ee89-43fe-9807-a7b36f6b654a", "id": 10}] 2026-02-17T21:05:20.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.578+0000 7f35653d6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:20.576 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.578+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c758558e-ee89-43fe-9807-a7b36f6b654a", "id": 10} v 0) -- 0x7f35601b8670 con 0x7f3560112820 2026-02-17T21:05:20.621 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.623+0000 7f353f7fe640 1 -- 10.20.193.138:0/567264695 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c758558e-ee89-43fe-9807-a7b36f6b654a", "id": 10}]=0 v13) ==== 113+0+3 (secure 0 0 0) 0x7f3554087f10 con 0x7f3560112820 2026-02-17T21:05:20.621 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.623+0000 7f353f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c758558e-ee89-43fe-9807-a7b36f6b654a", "id": 10}] 2026-02-17T21:05:20.622 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.623+0000 7f353f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:20.622 INFO:teuthology.orchestra.run.trial138.stdout:10 2026-02-17T21:05:20.624 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 10 librados: watch_flush enter 2026-02-17T21:05:20.624 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 10 librados: watch_flush exit 2026-02-17T21:05:20.624 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 20 client.4169.objecter shutdown clearing up homeless session... 2026-02-17T21:05:20.624 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 10 client.4169.objecter successfully canceled tick 2026-02-17T21:05:20.624 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f352c0790d0 msgr2=0x7f352c07b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.624 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f352c0790d0 0x7f352c07b590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3548006fd0 tx=0x7f3548006d40 comp rx=0 tx=0).stop 2026-02-17T21:05:20.624 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 10 monclient: shutdown 2026-02-17T21:05:20.624 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:20.624 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 msgr2=0x7f35601b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 0x7f35601b14b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3554002410 tx=0x7f35540047c0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 shutdown_connections 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f352c0790d0 0x7f352c07b590 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3560117d30 0x7f35601ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f35601171b0 0x7f35601b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.624+0000 7f35653d6640 1 --2- 10.20.193.138:0/567264695 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3560112820 0x7f35601b14b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.625+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 >> 10.20.193.138:0/567264695 conn(0x7f3560071620 msgr2=0x7f356011d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.625+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 shutdown_connections 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.625+0000 7f35653d6640 1 -- 10.20.193.138:0/567264695 wait complete. 2026-02-17T21:05:20.625 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.625+0000 7f35653d6640 1 librados: shutdown 2026-02-17T21:05:20.630 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 513dc329-f3f0-4aab-99d6-d527f1ef950d 11 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.697+0000 7f0389c7c640 10 monclient: get_monmap_and_config 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.697+0000 7f0389c7c640 10 monclient: build_initial_monmap 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.697+0000 7f0389c7c640 10 monclient: monmap: 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:20.698888+0000 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:20.698888+0000 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:20.695 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:20.696 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 1 Processor -- start 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 1 -- start start 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient: init 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient: _add_conns ranks=[0,5,3,1,4,2] 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0384073a50 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f038411d910 0x7f038411fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient(hunting): picked mon.noname-c con 0x7f038411d910 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0384120240 0x7f0384122630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient(hunting): picked mon.noname-a con 0x7f0384120240 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0384122c00 con 0x7f0384073a50 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0384123e00 con 0x7f0384120240 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0384123f80 con 0x7f038411d910 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0389c7c640 10 monclient(hunting): authenticate will time out at 901.322289s 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f03837fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f0384073a50 0x7f0384073e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.138:50332/0 (socket says 10.20.193.138:50332) 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f03837fe640 1 -- 10.20.193.138:0/2073950692 learned_addr learned my addr 10.20.193.138:0/2073950692 (peer_addr_for_me v1:10.20.193.138:0/0) 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.698+0000 7f0382ffd640 1 --2- 10.20.193.138:0/2073950692 >> v2:10.20.193.92:3300/0 conn(0x7f038411d910 0x7f038411fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0382ffd640 10 monclient(hunting): get_auth_request con 0x7f038411d910 auth_method 0 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0382ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.697 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0383fff640 1 --2- 10.20.193.138:0/2073950692 >> v2:10.20.193.45:3300/0 conn(0x7f0384120240 0x7f0384122630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0383fff640 10 monclient(hunting): get_auth_request con 0x7f0384120240 auth_method 0 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.699+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.700+0000 7f0382ffd640 10 monclient(hunting): handle_auth_done global_id 4172 payload 274 2026-02-17T21:05:20.698 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.700+0000 7f0382ffd640 1 -- 10.20.193.138:0/2073950692 >> v2:10.20.193.45:3300/0 conn(0x7f0384120240 msgr2=0x7f0384122630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:20.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.700+0000 7f0382ffd640 1 --2- 10.20.193.138:0/2073950692 >> v2:10.20.193.45:3300/0 conn(0x7f0384120240 0x7f0384122630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.700+0000 7f0382ffd640 1 -- 10.20.193.138:0/2073950692 >> v1:10.20.193.45:6789/0 conn(0x7f0384073a50 legacy=0x7f0384073e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.700+0000 7f0382ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:20.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.700+0000 7f0382ffd640 1 monclient: found mon.noname-c 2026-02-17T21:05:20.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.700+0000 7f0382ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:20.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.700+0000 7f0382ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:20.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.700+0000 7f0382ffd640 1 -- 10.20.193.138:0/2073950692 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0384124130 con 0x7f038411d910 2026-02-17T21:05:20.699 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.701+0000 7f0382ffd640 1 --2- 10.20.193.138:0/2073950692 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f038411d910 0x7f038411fd00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0384074600 tx=0x7f037402ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b3ba423643e0789 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 1 -- 10.20.193.138:0/2073950692 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037403c070 con 0x7f038411d910 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 10 monclient: dump: 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 10 monclient: _finish_auth 0 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 10 monclient: _check_auth_tickets 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 1 -- 10.20.193.138:0/2073950692 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037402fa60 con 0x7f038411d910 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 5 monclient: authenticate success, global_id 4172 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 1 -- 10.20.193.138:0/2073950692 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037402fe30 con 0x7f038411d910 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 4 set_mon_vals no callback set 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.701 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f03827fc640 10 monclient: dump: 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 10 monclient: shutdown 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 -- 10.20.193.138:0/2073950692 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f038411d910 msgr2=0x7f038411fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 --2- 10.20.193.138:0/2073950692 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f038411d910 0x7f038411fd00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0384074600 tx=0x7f037402ed50 comp rx=0 tx=0).stop 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 -- 10.20.193.138:0/2073950692 shutdown_connections 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 --2- 10.20.193.138:0/2073950692 >> v2:10.20.193.45:3300/0 conn(0x7f0384120240 0x7f0384122630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 --2- 10.20.193.138:0/2073950692 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f038411d910 0x7f038411fd00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 -- 10.20.193.138:0/2073950692 >> 10.20.193.138:0/2073950692 conn(0x7f038406f910 msgr2=0x7f0384071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 -- 10.20.193.138:0/2073950692 shutdown_connections 2026-02-17T21:05:20.702 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 -- 10.20.193.138:0/2073950692 wait complete. 2026-02-17T21:05:20.705 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 10 monclient: build_initial_monmap 2026-02-17T21:05:20.705 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 10 monclient: monmap: 2026-02-17T21:05:20.705 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:20.705 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 librados: starting msgr at 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.703+0000 7f0389c7c640 1 librados: starting objecter 2026-02-17T21:05:20.706 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 Processor -- start 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 -- start start 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 librados: setting wanted keys 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 librados: calling monclient init 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient: init 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0384073a50 0x7f03841aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient(hunting): picked mon.noname-b con 0x7f0384073a50 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f038411d910 0x7f03841abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient(hunting): picked mon.noname-a con 0x7f038411d910 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0384120240 0x7f03841b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.707 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient(hunting): picked mon.noname-c con 0x7f0384120240 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0384123290 con 0x7f038411d910 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0384123110 con 0x7f0384073a50 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0384123410 con 0x7f0384120240 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0389c7c640 10 monclient(hunting): authenticate will time out at 901.328239s 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f038411d910 0x7f03841abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0383fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0384120240 0x7f03841b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f038411d910 0x7f03841abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39628/0 (socket says 10.20.193.138:39628) 2026-02-17T21:05:20.708 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 1 -- 10.20.193.138:0/3389708794 learned_addr learned my addr 10.20.193.138:0/3389708794 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 10 monclient(hunting): get_auth_request con 0x7f038411d910 auth_method 0 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f03837fe640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0384073a50 0x7f03841aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0383fff640 10 monclient(hunting): get_auth_request con 0x7f0384120240 auth_method 0 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f0382ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.709 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f03837fe640 10 monclient(hunting): get_auth_request con 0x7f0384073a50 auth_method 0 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f03837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f03837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.704+0000 7f03837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.705+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.705+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.705+0000 7f0383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.705+0000 7f03837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.705+0000 7f03837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.705+0000 7f03837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 10 monclient(hunting): handle_auth_done global_id 4167 payload 824 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 1 -- 10.20.193.138:0/3389708794 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0384120240 msgr2=0x7f03841b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.710 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0384120240 0x7f03841b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 1 -- 10.20.193.138:0/3389708794 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0384073a50 msgr2=0x7f03841aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0384073a50 0x7f03841aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 1 monclient: found mon.noname-a 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.706+0000 7f0382ffd640 1 -- 10.20.193.138:0/3389708794 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03841b09e0 con 0x7f038411d910 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.707+0000 7f0382ffd640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f038411d910 0x7f03841abf60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0374009130 tx=0x7f03740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.707+0000 7f035ffff640 10 client.?.objecter ms_handle_connect 0x7f038411d910 2026-02-17T21:05:20.711 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.707+0000 7f035ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:20.713 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 1 -- 10.20.193.138:0/3389708794 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037403c040 con 0x7f038411d910 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 10 monclient: dump: 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.714 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 10 monclient: _finish_auth 0 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 5 monclient: authenticate success, global_id 4167 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 10 monclient: _renew_subs 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03841b0c70 con 0x7f038411d910 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 10 client.4167.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:20.715 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 10 monclient: _renew_subs 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03841b8560 con 0x7f038411d910 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 1 librados: init done 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 1 -- 10.20.193.138:0/3389708794 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f037402fa60 con 0x7f038411d910 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 1 -- 10.20.193.138:0/3389708794 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374042650 con 0x7f038411d910 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0381ffb640 4 set_mon_vals no callback set 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f035ffff640 10 monclient: dump: 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:20.716 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.708+0000 7f0389c7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.709+0000 7f0389c7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.709+0000 7f0389c7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:20.717 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.709+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0384123820 con 0x7f038411d910 2026-02-17T21:05:20.815 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.817+0000 7f035ffff640 1 -- 10.20.193.138:0/3389708794 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 3) ==== 100083+0+0 (secure 0 0 0) 0x7f03740427f0 con 0x7f038411d910 2026-02-17T21:05:20.816 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.818+0000 7f035ffff640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f03540790d0 0x7f035407b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:20.816 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.818+0000 7f03837fe640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f03540790d0 0x7f035407b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:20.816 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.818+0000 7f03837fe640 10 monclient: get_auth_request con 0x7f03540790d0 auth_method 0 2026-02-17T21:05:20.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.819+0000 7f03837fe640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f03540790d0 0x7f035407b590 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0370002770 tx=0x7f0370002930 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:20.817 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.819+0000 7f035ffff640 10 client.4167.objecter ms_handle_connect 0x7f03540790d0 2026-02-17T21:05:20.822 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.824+0000 7f035ffff640 1 -- 10.20.193.138:0/3389708794 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 1990+0+0 (secure 0 0 0) 0x7f0374083990 con 0x7f038411d910 2026-02-17T21:05:20.823 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.824+0000 7f035ffff640 10 client.4167.objecter ms_dispatch2 0x7f0384000b90 osd_map(13..13 src has 1..13) 2026-02-17T21:05:20.823 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.824+0000 7f035ffff640 3 client.4167.objecter handle_osd_map got epochs [13,13] > 0 2026-02-17T21:05:20.823 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.824+0000 7f035ffff640 3 client.4167.objecter handle_osd_map decoding full epoch 13 2026-02-17T21:05:20.823 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.824+0000 7f035ffff640 20 client.4167.objecter dump_active .. 0 homeless 2026-02-17T21:05:20.823 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.825+0000 7f035ffff640 1 -- 10.20.193.138:0/3389708794 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0374087950 con 0x7f038411d910 2026-02-17T21:05:20.823 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.825+0000 7f035ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:20.823 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.825+0000 7f035ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:20.911 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.913+0000 7f0389c7c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "513dc329-f3f0-4aab-99d6-d527f1ef950d", "id": 11}] 2026-02-17T21:05:20.911 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.913+0000 7f0389c7c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "513dc329-f3f0-4aab-99d6-d527f1ef950d", "id": 11}] 2026-02-17T21:05:20.911 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.913+0000 7f0389c7c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:20.911 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.913+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "513dc329-f3f0-4aab-99d6-d527f1ef950d", "id": 11} v 0) -- 0x7f0384072590 con 0x7f038411d910 2026-02-17T21:05:20.928 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.930+0000 7f035ffff640 1 -- 10.20.193.138:0/3389708794 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "513dc329-f3f0-4aab-99d6-d527f1ef950d", "id": 11}]=0 v14) ==== 113+0+3 (secure 0 0 0) 0x7f037408bc50 con 0x7f038411d910 2026-02-17T21:05:20.928 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.930+0000 7f035ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "513dc329-f3f0-4aab-99d6-d527f1ef950d", "id": 11}] 2026-02-17T21:05:20.928 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.930+0000 7f035ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:20.928 INFO:teuthology.orchestra.run.trial138.stdout:11 2026-02-17T21:05:20.930 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 10 librados: watch_flush enter 2026-02-17T21:05:20.930 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 10 librados: watch_flush exit 2026-02-17T21:05:20.930 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 20 client.4167.objecter shutdown clearing up homeless session... 2026-02-17T21:05:20.930 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 10 client.4167.objecter successfully canceled tick 2026-02-17T21:05:20.930 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f03540790d0 msgr2=0x7f035407b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.930 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f03540790d0 0x7f035407b590 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0370002770 tx=0x7f0370002930 comp rx=0 tx=0).stop 2026-02-17T21:05:20.930 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 10 monclient: shutdown 2026-02-17T21:05:20.930 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f038411d910 msgr2=0x7f03841abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f038411d910 0x7f03841abf60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0374009130 tx=0x7f03740047c0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 shutdown_connections 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f03540790d0 0x7f035407b590 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0384120240 0x7f03841b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f038411d910 0x7f03841abf60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 --2- 10.20.193.138:0/3389708794 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0384073a50 0x7f03841aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 >> 10.20.193.138:0/3389708794 conn(0x7f038406f910 msgr2=0x7f038406fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 shutdown_connections 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 -- 10.20.193.138:0/3389708794 wait complete. 2026-02-17T21:05:20.931 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:20.931+0000 7f0389c7c640 1 librados: shutdown 2026-02-17T21:05:20.936 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 142201fe-4459-4101-8a4f-f0de73cef308 12 2026-02-17T21:05:21.001 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.002+0000 7f1882205640 10 monclient: get_monmap_and_config 2026-02-17T21:05:21.001 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.002+0000 7f1882205640 10 monclient: build_initial_monmap 2026-02-17T21:05:21.001 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.002+0000 7f1882205640 10 monclient: monmap: 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:21.003739+0000 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:21.003739+0000 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:21.002 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.002+0000 7f1882205640 1 Processor -- start 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.002+0000 7f1882205640 1 -- start start 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.002+0000 7f1882205640 10 monclient: init 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 10 monclient: _add_conns ranks=[1,4,5,0,3,2] 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f187c073a50 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f187c11d910 0x7f187c11fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 10 monclient(hunting): picked mon.noname-b con 0x7f187c11d910 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f187c120240 0x7f187c122630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.003 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 10 monclient(hunting): picked mon.noname-c con 0x7f187c120240 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f187c122c00 con 0x7f187c073a50 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f187c123e00 con 0x7f187c11d910 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f187c123f80 con 0x7f187c120240 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f1882205640 10 monclient(hunting): authenticate will time out at 901.627121s 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f187bfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f187c120240 0x7f187c122630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f187bfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f187c120240 0x7f187c122630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.138:46522/0 (socket says 10.20.193.138:46522) 2026-02-17T21:05:21.004 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f187bfff640 1 -- 10.20.193.138:0/1126107471 learned_addr learned my addr 10.20.193.138:0/1126107471 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:21.005 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f187bfff640 10 monclient(hunting): get_auth_request con 0x7f187c120240 auth_method 0 2026-02-17T21:05:21.005 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f187bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.005 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f187bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.005 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.003+0000 7f187bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.004+0000 7f187bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.004+0000 7f187bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.004+0000 7f187bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.004+0000 7f187bfff640 10 monclient(hunting): handle_auth_done global_id 4178 payload 274 2026-02-17T21:05:21.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.004+0000 7f187bfff640 1 -- 10.20.193.138:0/1126107471 >> v2:10.20.193.86:3300/0 conn(0x7f187c11d910 msgr2=0x7f187c11fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:21.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.004+0000 7f187bfff640 1 --2- 10.20.193.138:0/1126107471 >> v2:10.20.193.86:3300/0 conn(0x7f187c11d910 0x7f187c11fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.004+0000 7f187bfff640 1 -- 10.20.193.138:0/1126107471 >> v1:10.20.193.86:6789/0 conn(0x7f187c073a50 legacy=0x7f187c073e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:21.013 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.005+0000 7f187bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.005+0000 7f187bfff640 1 monclient: found mon.noname-c 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.005+0000 7f187bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.005+0000 7f187bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.005+0000 7f187bfff640 1 -- 10.20.193.138:0/1126107471 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c124130 con 0x7f187c120240 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.005+0000 7f187bfff640 1 --2- 10.20.193.138:0/1126107471 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c120240 0x7f187c122630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f187c074600 tx=0x7f187002f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6dffc115abe4846 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.006+0000 7f187a7fc640 1 -- 10.20.193.138:0/1126107471 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187002fc40 con 0x7f187c120240 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.006+0000 7f187a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.006+0000 7f187a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.006+0000 7f187a7fc640 10 monclient: dump: 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.014 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.006+0000 7f187a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.006+0000 7f187a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.006+0000 7f187a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.006+0000 7f1882205640 5 monclient: authenticate success, global_id 4178 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.006+0000 7f1882205640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:21.015 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f187a7fc640 1 -- 10.20.193.138:0/1126107471 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187002fde0 con 0x7f187c120240 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f187a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f187a7fc640 1 -- 10.20.193.138:0/1126107471 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870037610 con 0x7f187c120240 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 4 set_mon_vals no callback set 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f187a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f187a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f187a7fc640 10 monclient: dump: 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.016 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 10 monclient: shutdown 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 1 -- 10.20.193.138:0/1126107471 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c120240 msgr2=0x7f187c122630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 1 --2- 10.20.193.138:0/1126107471 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c120240 0x7f187c122630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f187c074600 tx=0x7f187002f1e0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 1 -- 10.20.193.138:0/1126107471 shutdown_connections 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 1 --2- 10.20.193.138:0/1126107471 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c120240 0x7f187c122630 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 1 --2- 10.20.193.138:0/1126107471 >> v2:10.20.193.86:3300/0 conn(0x7f187c11d910 0x7f187c11fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.017 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.007+0000 7f1882205640 1 -- 10.20.193.138:0/1126107471 >> 10.20.193.138:0/1126107471 conn(0x7f187c06f910 msgr2=0x7f187c071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 -- 10.20.193.138:0/1126107471 shutdown_connections 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 -- 10.20.193.138:0/1126107471 wait complete. 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient: build_initial_monmap 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient: monmap: 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:21.018 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 librados: starting msgr at 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 librados: starting objecter 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 Processor -- start 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 -- start start 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 librados: setting wanted keys 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 librados: calling monclient init 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient: init 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c073a50 0x7f187c1ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.019 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient(hunting): picked mon.noname-c con 0x7f187c073a50 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f187c11d910 0x7f187c1abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient(hunting): picked mon.noname-a con 0x7f187c11d910 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f187c120240 0x7f187c1b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient(hunting): picked mon.noname-b con 0x7f187c120240 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f187c123230 con 0x7f187c11d910 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1230b0 con 0x7f187c120240 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f187c1233b0 con 0x7f187c073a50 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f1882205640 10 monclient(hunting): authenticate will time out at 901.632611s 2026-02-17T21:05:21.020 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f187b7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c073a50 0x7f187c1ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.008+0000 7f187bfff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f187c120240 0x7f187c1b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187affd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f187c11d910 0x7f187c1abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187b7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c073a50 0x7f187c1ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.138:46532/0 (socket says 10.20.193.138:46532) 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187b7fe640 1 -- 10.20.193.138:0/1445605307 learned_addr learned my addr 10.20.193.138:0/1445605307 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187b7fe640 10 monclient(hunting): get_auth_request con 0x7f187c073a50 auth_method 0 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187bfff640 10 monclient(hunting): get_auth_request con 0x7f187c120240 auth_method 0 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.021 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187affd640 10 monclient(hunting): get_auth_request con 0x7f187c11d910 auth_method 0 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.022 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.009+0000 7f187affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 10 monclient(hunting): handle_auth_done global_id 4181 payload 824 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 1 -- 10.20.193.138:0/1445605307 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f187c120240 msgr2=0x7f187c1b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f187c120240 0x7f187c1b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 1 -- 10.20.193.138:0/1445605307 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f187c11d910 msgr2=0x7f187c1abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f187c11d910 0x7f187c1abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 1 monclient: found mon.noname-c 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187b7fe640 1 -- 10.20.193.138:0/1445605307 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c1b08f0 con 0x7f187c073a50 2026-02-17T21:05:21.023 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.010+0000 7f187bfff640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f187c120240 0x7f187c1b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.011+0000 7f187b7fe640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c073a50 0x7f187c1ab940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f186800b570 tx=0x7f186800ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.011+0000 7f1857fff640 10 client.?.objecter ms_handle_connect 0x7f187c073a50 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.011+0000 7f1857fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 1 -- 10.20.193.138:0/1445605307 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868013020 con 0x7f187c073a50 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 10 monclient: dump: 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.024 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 10 monclient: _finish_auth 0 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 10 monclient: _check_auth_tickets 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 1 -- 10.20.193.138:0/1445605307 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18680044a0 con 0x7f187c073a50 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 5 monclient: authenticate success, global_id 4181 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 10 monclient: _renew_subs 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:21.025 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f187c1b0be0 con 0x7f187c073a50 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 1 -- 10.20.193.138:0/1445605307 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18680029c0 con 0x7f187c073a50 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1879ffb640 4 set_mon_vals no callback set 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1857fff640 10 monclient: dump: 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.026 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 10 client.4181.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 10 monclient: _renew_subs 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f187c1b8360 con 0x7f187c073a50 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 1 librados: init done 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:21.027 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.013+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f187c1237d0 con 0x7f187c073a50 2026-02-17T21:05:21.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.024+0000 7f1857fff640 1 -- 10.20.193.138:0/1445605307 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 3) ==== 100083+0+0 (secure 0 0 0) 0x7f1868002b60 con 0x7f187c073a50 2026-02-17T21:05:21.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f1857fff640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f184c079120 0x7f184c07b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f187affd640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f184c079120 0x7f184c07b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.029 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f187affd640 10 monclient: get_auth_request con 0x7f184c079120 auth_method 0 2026-02-17T21:05:21.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f187affd640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f184c079120 0x7f184c07b5e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f187c075100 tx=0x7f186c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:21.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f1857fff640 10 client.4181.objecter ms_handle_connect 0x7f184c079120 2026-02-17T21:05:21.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f1857fff640 1 -- 10.20.193.138:0/1445605307 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2105+0+0 (secure 0 0 0) 0x7f186805e2c0 con 0x7f187c073a50 2026-02-17T21:05:21.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f1857fff640 10 client.4181.objecter ms_dispatch2 0x7f187c000b90 osd_map(14..14 src has 1..14) 2026-02-17T21:05:21.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f1857fff640 3 client.4181.objecter handle_osd_map got epochs [14,14] > 0 2026-02-17T21:05:21.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f1857fff640 3 client.4181.objecter handle_osd_map decoding full epoch 14 2026-02-17T21:05:21.030 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.025+0000 7f1857fff640 20 client.4181.objecter dump_active .. 0 homeless 2026-02-17T21:05:21.120 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.123+0000 7f1857fff640 1 -- 10.20.193.138:0/1445605307 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f186801d020 con 0x7f187c073a50 2026-02-17T21:05:21.121 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.123+0000 7f1857fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:21.121 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.123+0000 7f1857fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:21.220 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.222+0000 7f1882205640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "142201fe-4459-4101-8a4f-f0de73cef308", "id": 12}] 2026-02-17T21:05:21.220 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.222+0000 7f1882205640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "142201fe-4459-4101-8a4f-f0de73cef308", "id": 12}] 2026-02-17T21:05:21.220 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.222+0000 7f1882205640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:21.220 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.222+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "142201fe-4459-4101-8a4f-f0de73cef308", "id": 12} v 0) -- 0x7f187c072590 con 0x7f187c073a50 2026-02-17T21:05:21.269 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.272+0000 7f1857fff640 1 -- 10.20.193.138:0/1445605307 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "142201fe-4459-4101-8a4f-f0de73cef308", "id": 12}]=0 v15) ==== 113+0+3 (secure 0 0 0) 0x7f1868062280 con 0x7f187c073a50 2026-02-17T21:05:21.270 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.272+0000 7f1857fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "142201fe-4459-4101-8a4f-f0de73cef308", "id": 12}] 2026-02-17T21:05:21.270 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.272+0000 7f1857fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:21.270 INFO:teuthology.orchestra.run.trial138.stdout:12 2026-02-17T21:05:21.272 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 10 librados: watch_flush enter 2026-02-17T21:05:21.272 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 10 librados: watch_flush exit 2026-02-17T21:05:21.272 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 20 client.4181.objecter shutdown clearing up homeless session... 2026-02-17T21:05:21.272 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 10 client.4181.objecter successfully canceled tick 2026-02-17T21:05:21.272 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f184c079120 msgr2=0x7f184c07b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.272 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f184c079120 0x7f184c07b5e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f187c075100 tx=0x7f186c009210 comp rx=0 tx=0).stop 2026-02-17T21:05:21.272 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 10 monclient: shutdown 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c073a50 msgr2=0x7f187c1ab940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c073a50 0x7f187c1ab940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f186800b570 tx=0x7f186800ba40 comp rx=0 tx=0).stop 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 shutdown_connections 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f184c079120 0x7f184c07b5e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f187c120240 0x7f187c1b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f187c11d910 0x7f187c1abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 --2- 10.20.193.138:0/1445605307 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f187c073a50 0x7f187c1ab940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 >> 10.20.193.138:0/1445605307 conn(0x7f187c06f910 msgr2=0x7f187c06fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 shutdown_connections 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 -- 10.20.193.138:0/1445605307 wait complete. 2026-02-17T21:05:21.273 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.273+0000 7f1882205640 1 librados: shutdown 2026-02-17T21:05:21.279 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 013e64fd-3420-45b4-ba7d-565e30e81cea 13 2026-02-17T21:05:21.346 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient: get_monmap_and_config 2026-02-17T21:05:21.347 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient: build_initial_monmap 2026-02-17T21:05:21.347 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient: monmap: 2026-02-17T21:05:21.347 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:21.347 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.347 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:21.348560+0000 2026-02-17T21:05:21.347 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:21.348560+0000 2026-02-17T21:05:21.347 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:21.347 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.347 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 1 Processor -- start 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 1 -- start start 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient: init 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:21.348 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient: _add_conns ranks=[3,1,4,5,0,2] 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fa68c118450 0x7fa68c073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient(hunting): picked mon.noname-a con 0x7fa68c118450 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa68c073ed0 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa68c0744e0 0x7fa68c126a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient(hunting): picked mon.noname-b con 0x7fa68c0744e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa68c127120 con 0x7fa68c073ed0 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fa68c128340 con 0x7fa68c118450 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa68c1284c0 con 0x7fa68c0744e0 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:21.349 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.347+0000 7fa691a5e640 10 monclient(hunting): authenticate will time out at 901.971948s 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.348+0000 7fa68affd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fa68c118450 0x7fa68c073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.348+0000 7fa68affd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fa68c118450 0x7fa68c073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39648/0 (socket says 10.20.193.138:39648) 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.348+0000 7fa68affd640 1 -- 10.20.193.138:0/1735015345 learned_addr learned my addr 10.20.193.138:0/1735015345 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.348+0000 7fa68affd640 10 monclient(hunting): get_auth_request con 0x7fa68c118450 auth_method 0 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.348+0000 7fa68affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.348+0000 7fa68affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.348+0000 7fa68affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.348+0000 7fa68affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.348+0000 7fa68affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.350 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.352 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68b7fe640 1 --2- 10.20.193.138:0/1735015345 >> v2:10.20.193.86:3300/0 conn(0x7fa68c0744e0 0x7fa68c126a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.352 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 10 monclient(hunting): handle_auth_done global_id 4173 payload 274 2026-02-17T21:05:21.352 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 1 -- 10.20.193.138:0/1735015345 >> v2:10.20.193.86:3300/0 conn(0x7fa68c0744e0 msgr2=0x7fa68c126a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:21.352 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 1 --2- 10.20.193.138:0/1735015345 >> v2:10.20.193.86:3300/0 conn(0x7fa68c0744e0 0x7fa68c126a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.352 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 1 -- 10.20.193.138:0/1735015345 >> v1:10.20.193.86:6789/0 conn(0x7fa68c073ed0 legacy=0x7fa68c1232f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:21.352 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:21.352 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 1 monclient: found mon.noname-a 2026-02-17T21:05:21.353 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:21.353 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:21.353 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.349+0000 7fa68affd640 1 -- 10.20.193.138:0/1735015345 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c128670 con 0x7fa68c118450 2026-02-17T21:05:21.353 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.354+0000 7fa68affd640 1 --2- 10.20.193.138:0/1735015345 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c118450 0x7fa68c073990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0744b0 tx=0x7fa68002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469a253549bfa1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:21.417 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.419+0000 7fa689ffb640 1 -- 10.20.193.138:0/1735015345 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68003c070 con 0x7fa68c118450 2026-02-17T21:05:21.417 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.419+0000 7fa689ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.417 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.419+0000 7fa689ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:21.417 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.419+0000 7fa689ffb640 10 monclient: dump: 2026-02-17T21:05:21.417 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.419+0000 7fa689ffb640 10 monclient: _finish_auth 0 2026-02-17T21:05:21.418 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.419+0000 7fa689ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:05:21.419 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.419+0000 7fa689ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:21.419 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.419+0000 7fa691a5e640 5 monclient: authenticate success, global_id 4173 2026-02-17T21:05:21.419 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.419+0000 7fa691a5e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:21.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.420+0000 7fa689ffb640 1 -- 10.20.193.138:0/1735015345 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68002fb40 con 0x7fa68c118450 2026-02-17T21:05:21.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.420+0000 7fa689ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:21.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.420+0000 7fa689ffb640 1 -- 10.20.193.138:0/1735015345 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680037440 con 0x7fa68c118450 2026-02-17T21:05:21.423 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.420+0000 7fa689ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.420+0000 7fa689ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.420+0000 7fa689ffb640 10 monclient: dump: 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.424 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.420+0000 7fa691a5e640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.420+0000 7fa691a5e640 4 set_mon_vals no callback set 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 10 monclient: shutdown 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 -- 10.20.193.138:0/1735015345 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c118450 msgr2=0x7fa68c073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 --2- 10.20.193.138:0/1735015345 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c118450 0x7fa68c073990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0744b0 tx=0x7fa68002eed0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 -- 10.20.193.138:0/1735015345 shutdown_connections 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 --2- 10.20.193.138:0/1735015345 >> v2:10.20.193.86:3300/0 conn(0x7fa68c0744e0 0x7fa68c126a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 --2- 10.20.193.138:0/1735015345 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c118450 0x7fa68c073990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.425 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 -- 10.20.193.138:0/1735015345 >> 10.20.193.138:0/1735015345 conn(0x7fa68c06f910 msgr2=0x7fa68c071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 -- 10.20.193.138:0/1735015345 shutdown_connections 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 -- 10.20.193.138:0/1735015345 wait complete. 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 10 monclient: build_initial_monmap 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 10 monclient: monmap: 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:21.426 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 librados: starting msgr at 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.421+0000 7fa691a5e640 1 librados: starting objecter 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 Processor -- start 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 -- start start 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 librados: setting wanted keys 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 librados: calling monclient init 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient: init 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa68c073ed0 0x7fa68c1aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient(hunting): picked mon.noname-c con 0x7fa68c073ed0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:21.427 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c0744e0 0x7fa68c1b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient(hunting): picked mon.noname-a con 0x7fa68c0744e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa68c118450 0x7fa68c1b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient(hunting): picked mon.noname-b con 0x7fa68c118450 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c127770 con 0x7fa68c0744e0 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c1275f0 con 0x7fa68c118450 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c1278f0 con 0x7fa68c073ed0 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa691a5e640 10 monclient(hunting): authenticate will time out at 902.046404s 2026-02-17T21:05:21.428 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa68a7fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c0744e0 0x7fa68c1b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa68a7fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c0744e0 0x7fa68c1b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39662/0 (socket says 10.20.193.138:39662) 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa68a7fc640 1 -- 10.20.193.138:0/2611336929 learned_addr learned my addr 10.20.193.138:0/2611336929 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa68a7fc640 10 monclient(hunting): get_auth_request con 0x7fa68c0744e0 auth_method 0 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa68a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa68a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.422+0000 7fa68a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.423+0000 7fa68a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.423+0000 7fa68a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.423+0000 7fa68a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 10 monclient(hunting): handle_auth_done global_id 4176 payload 824 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 1 -- 10.20.193.138:0/2611336929 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa68c073ed0 msgr2=0x7fa68c1aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa68c073ed0 0x7fa68c1aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.429 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 1 -- 10.20.193.138:0/2611336929 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa68c118450 msgr2=0x7fa68c1b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa68c118450 0x7fa68c1b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:05:21.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 1 monclient: found mon.noname-a 2026-02-17T21:05:21.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:21.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:21.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.424+0000 7fa68a7fc640 1 -- 10.20.193.138:0/2611336929 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c1b4ef0 con 0x7fa68c0744e0 2026-02-17T21:05:21.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.425+0000 7fa68a7fc640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c0744e0 0x7fa68c1b0590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c5d0 tx=0x7fa67400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:21.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.425+0000 7fa663fff640 10 client.?.objecter ms_handle_connect 0x7fa68c0744e0 2026-02-17T21:05:21.430 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.425+0000 7fa663fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:21.432 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa663fff640 1 -- 10.20.193.138:0/2611336929 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674016020 con 0x7fa68c0744e0 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa663fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa663fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa663fff640 10 monclient: dump: 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.433 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa663fff640 10 monclient: _finish_auth 0 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa663fff640 10 monclient: _check_auth_tickets 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa663fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa691a5e640 5 monclient: authenticate success, global_id 4176 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa691a5e640 10 monclient: _renew_subs 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa691a5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68c1b51e0 con 0x7fa68c0744e0 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa691a5e640 10 client.4176.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:21.434 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa691a5e640 10 monclient: _renew_subs 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa691a5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68c1bc960 con 0x7fa68c0744e0 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.426+0000 7fa691a5e640 1 librados: init done 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa663fff640 1 -- 10.20.193.138:0/2611336929 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6740068d0 con 0x7fa68c0744e0 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa663fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa663fff640 1 -- 10.20.193.138:0/2611336929 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa674003a70 con 0x7fa68c0744e0 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa663fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa663fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa6897fa640 4 set_mon_vals no callback set 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa663fff640 10 monclient: dump: 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.435 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa691a5e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa691a5e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa691a5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:21.436 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.427+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68c073990 con 0x7fa68c0744e0 2026-02-17T21:05:21.534 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.536+0000 7fa663fff640 1 -- 10.20.193.138:0/2611336929 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7fa674012830 con 0x7fa68c0744e0 2026-02-17T21:05:21.535 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.537+0000 7fa663fff640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa65c0791f0 0x7fa65c07b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.535 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.537+0000 7fa68affd640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa65c0791f0 0x7fa65c07b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.535 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.537+0000 7fa68affd640 10 monclient: get_auth_request con 0x7fa65c0791f0 auth_method 0 2026-02-17T21:05:21.536 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.537+0000 7fa663fff640 10 client.4176.objecter ms_handle_connect 0x7fa65c0791f0 2026-02-17T21:05:21.536 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.537+0000 7fa68affd640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa65c0791f0 0x7fa65c07b6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0743c0 tx=0x7fa680031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:21.536 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.538+0000 7fa663fff640 1 -- 10.20.193.138:0/2611336929 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2220+0+0 (secure 0 0 0) 0x7fa674006d00 con 0x7fa68c0744e0 2026-02-17T21:05:21.536 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.538+0000 7fa663fff640 10 client.4176.objecter ms_dispatch2 0x7fa68c000b90 osd_map(15..15 src has 1..15) 2026-02-17T21:05:21.536 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.538+0000 7fa663fff640 3 client.4176.objecter handle_osd_map got epochs [15,15] > 0 2026-02-17T21:05:21.536 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.538+0000 7fa663fff640 3 client.4176.objecter handle_osd_map decoding full epoch 15 2026-02-17T21:05:21.536 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.538+0000 7fa663fff640 20 client.4176.objecter dump_active .. 0 homeless 2026-02-17T21:05:21.543 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.545+0000 7fa663fff640 1 -- 10.20.193.138:0/2611336929 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa674020030 con 0x7fa68c0744e0 2026-02-17T21:05:21.543 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.545+0000 7fa663fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:21.543 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.545+0000 7fa663fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:21.632 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.634+0000 7fa691a5e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "013e64fd-3420-45b4-ba7d-565e30e81cea", "id": 13}] 2026-02-17T21:05:21.633 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.634+0000 7fa691a5e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "013e64fd-3420-45b4-ba7d-565e30e81cea", "id": 13}] 2026-02-17T21:05:21.633 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.634+0000 7fa691a5e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:21.633 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.634+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "013e64fd-3420-45b4-ba7d-565e30e81cea", "id": 13} v 0) -- 0x7fa68c1bcbf0 con 0x7fa68c0744e0 2026-02-17T21:05:21.649 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa663fff640 1 -- 10.20.193.138:0/2611336929 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "013e64fd-3420-45b4-ba7d-565e30e81cea", "id": 13}]=0 v16) ==== 113+0+3 (secure 0 0 0) 0x7fa674062a00 con 0x7fa68c0744e0 2026-02-17T21:05:21.649 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa663fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "013e64fd-3420-45b4-ba7d-565e30e81cea", "id": 13}] 2026-02-17T21:05:21.649 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa663fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:21.650 INFO:teuthology.orchestra.run.trial138.stdout:13 2026-02-17T21:05:21.651 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 10 librados: watch_flush enter 2026-02-17T21:05:21.651 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 10 librados: watch_flush exit 2026-02-17T21:05:21.651 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 20 client.4176.objecter shutdown clearing up homeless session... 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 10 client.4176.objecter successfully canceled tick 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa65c0791f0 msgr2=0x7fa65c07b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa65c0791f0 0x7fa65c07b6b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0743c0 tx=0x7fa680031000 comp rx=0 tx=0).stop 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 10 monclient: shutdown 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c0744e0 msgr2=0x7fa68c1b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c0744e0 0x7fa68c1b0590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa67400c5d0 tx=0x7fa67400caa0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 shutdown_connections 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa65c0791f0 0x7fa65c07b6b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa68c118450 0x7fa68c1b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.652 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa68c0744e0 0x7fa68c1b0590 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.653 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.652+0000 7fa691a5e640 1 --2- 10.20.193.138:0/2611336929 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa68c073ed0 0x7fa68c1aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.653 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.653+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 >> 10.20.193.138:0/2611336929 conn(0x7fa68c06f910 msgr2=0x7fa68c1242f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:21.653 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.653+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 shutdown_connections 2026-02-17T21:05:21.653 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.653+0000 7fa691a5e640 1 -- 10.20.193.138:0/2611336929 wait complete. 2026-02-17T21:05:21.653 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.653+0000 7fa691a5e640 1 librados: shutdown 2026-02-17T21:05:21.658 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new 0b5448b4-8299-481b-aa32-4912c651ef12 14 2026-02-17T21:05:21.721 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient: get_monmap_and_config 2026-02-17T21:05:21.722 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient: build_initial_monmap 2026-02-17T21:05:21.722 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient: monmap: 2026-02-17T21:05:21.722 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:21.722 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.722 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:21.725300+0000 2026-02-17T21:05:21.722 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:21.725300+0000 2026-02-17T21:05:21.722 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:21.722 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.722 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:21.723 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:21.723 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:21.723 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:21.723 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:21.723 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:21.723 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.731 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 1 Processor -- start 2026-02-17T21:05:21.731 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 1 -- start start 2026-02-17T21:05:21.731 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient: init 2026-02-17T21:05:21.731 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:21.731 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient: _add_conns ranks=[4,5,3,1,2,0] 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fe0d006dd90 0x7fe0d006e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient(hunting): picked mon.noname-b con 0x7fe0d006dd90 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fe0d006e6b0 0x7fe0d011e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient(hunting): picked mon.noname-c con 0x7fe0d006e6b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe0d011eea0 0x7fe0d0121360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient(hunting): picked mon.noname-a con 0x7fe0d011eea0 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d0121ab0 con 0x7fe0d011eea0 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d0121c30 con 0x7fe0d006dd90 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.732 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d0121de0 con 0x7fe0d006e6b0 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.724+0000 7fe0d5c45640 10 monclient(hunting): authenticate will time out at 902.348907s 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fe0d006dd90 0x7fe0d006e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0ceffd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fe0d006e6b0 0x7fe0d011e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fe0d006dd90 0x7fe0d006e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.138:43406/0 (socket says 10.20.193.138:43406) 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 1 -- 10.20.193.138:0/3376795202 learned_addr learned my addr 10.20.193.138:0/3376795202 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 10 monclient(hunting): get_auth_request con 0x7fe0d006dd90 auth_method 0 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0ceffd640 10 monclient(hunting): get_auth_request con 0x7fe0d006e6b0 auth_method 0 2026-02-17T21:05:21.733 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.725+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_done global_id 4168 payload 274 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 1 -- 10.20.193.138:0/3376795202 >> v2:10.20.193.92:3300/0 conn(0x7fe0d006e6b0 msgr2=0x7fe0d011e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 1 --2- 10.20.193.138:0/3376795202 >> v2:10.20.193.92:3300/0 conn(0x7fe0d006e6b0 0x7fe0d011e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 1 -- 10.20.193.138:0/3376795202 >> v2:10.20.193.45:3300/0 conn(0x7fe0d011eea0 msgr2=0x7fe0d0121360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:21.734 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 1 --2- 10.20.193.138:0/3376795202 >> v2:10.20.193.45:3300/0 conn(0x7fe0d011eea0 0x7fe0d0121360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 1 monclient: found mon.noname-b 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.726+0000 7fe0cf7fe640 1 -- 10.20.193.138:0/3376795202 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d0121f90 con 0x7fe0d006dd90 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.727+0000 7fe0cf7fe640 1 --2- 10.20.193.138:0/3376795202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 0x7fe0d006e170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0d006ebe0 tx=0x7fe0bc02edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe875a0656353099 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 1 -- 10.20.193.138:0/3376795202 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc03c070 con 0x7fe0d006dd90 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 10 monclient: dump: 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.735 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 10 monclient: _finish_auth 0 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 5 monclient: authenticate success, global_id 4168 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 1 -- 10.20.193.138:0/3376795202 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0bc02fab0 con 0x7fe0d006dd90 2026-02-17T21:05:21.736 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 1 -- 10.20.193.138:0/3376795202 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc037440 con 0x7fe0d006dd90 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 4 set_mon_vals no callback set 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0ce7fc640 10 monclient: dump: 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.737 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 10 monclient: shutdown 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 -- 10.20.193.138:0/3376795202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 msgr2=0x7fe0d006e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/3376795202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 0x7fe0d006e170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0d006ebe0 tx=0x7fe0bc02edf0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.738 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 -- 10.20.193.138:0/3376795202 shutdown_connections 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/3376795202 >> v2:10.20.193.45:3300/0 conn(0x7fe0d011eea0 0x7fe0d0121360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/3376795202 >> v2:10.20.193.92:3300/0 conn(0x7fe0d006e6b0 0x7fe0d011e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/3376795202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 0x7fe0d006e170 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 -- 10.20.193.138:0/3376795202 >> 10.20.193.138:0/3376795202 conn(0x7fe0d00715f0 msgr2=0x7fe0d0073a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 -- 10.20.193.138:0/3376795202 shutdown_connections 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 -- 10.20.193.138:0/3376795202 wait complete. 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 10 monclient: build_initial_monmap 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 10 monclient: monmap: 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:21.739 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 librados: starting msgr at 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 librados: starting objecter 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 Processor -- start 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 -- start start 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 librados: setting wanted keys 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 1 librados: calling monclient init 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 10 monclient: init 2026-02-17T21:05:21.740 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.729+0000 7fe0d5c45640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 0x7fe0d01b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 10 monclient(hunting): picked mon.noname-b con 0x7fe0d006dd90 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe0d006e6b0 0x7fe0d01b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 10 monclient(hunting): picked mon.noname-a con 0x7fe0d006e6b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe0d011eea0 0x7fe0d01ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 10 monclient(hunting): picked mon.noname-c con 0x7fe0d011eea0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d0122660 con 0x7fe0d006e6b0 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d01224e0 con 0x7fe0d006dd90 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:21.741 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d01227e0 con 0x7fe0d011eea0 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0d5c45640 10 monclient(hunting): authenticate will time out at 902.354038s 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 0x7fe0d01b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 0x7fe0d01b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.138:43414/0 (socket says 10.20.193.138:43414) 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 1 -- 10.20.193.138:0/2228656581 learned_addr learned my addr 10.20.193.138:0/2228656581 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 10 monclient(hunting): get_auth_request con 0x7fe0d006dd90 auth_method 0 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cffff640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe0d011eea0 0x7fe0d01ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cffff640 10 monclient(hunting): get_auth_request con 0x7fe0d011eea0 auth_method 0 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:21.742 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.730+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 10 monclient(hunting): handle_auth_done global_id 4171 payload 824 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 1 -- 10.20.193.138:0/2228656581 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe0d011eea0 msgr2=0x7fe0d01ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe0d011eea0 0x7fe0d01ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 1 -- 10.20.193.138:0/2228656581 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe0d006e6b0 msgr2=0x7fe0d01b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.743 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe0d006e6b0 0x7fe0d01b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.744 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:21.744 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 1 monclient: found mon.noname-b 2026-02-17T21:05:21.744 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:21.744 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:21.744 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.731+0000 7fe0cf7fe640 1 -- 10.20.193.138:0/2228656581 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d01abde0 con 0x7fe0d006dd90 2026-02-17T21:05:21.744 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.733+0000 7fe0cf7fe640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 0x7fe0d01b1470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc002410 tx=0x7fe0bc0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:21.744 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.733+0000 7fe0abfff640 10 client.?.objecter ms_handle_connect 0x7fe0d006dd90 2026-02-17T21:05:21.744 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.733+0000 7fe0abfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:21.746 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 1 -- 10.20.193.138:0/2228656581 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc046020 con 0x7fe0d006dd90 2026-02-17T21:05:21.746 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 10 monclient: dump: 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.747 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 10 monclient: _finish_auth 0 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 10 monclient: _check_auth_tickets 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 1 -- 10.20.193.138:0/2228656581 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0bc042640 con 0x7fe0d006dd90 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 5 monclient: authenticate success, global_id 4171 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 1 -- 10.20.193.138:0/2228656581 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc03c040 con 0x7fe0d006dd90 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0cdffb640 4 set_mon_vals no callback set 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0abfff640 10 monclient: dump: 2026-02-17T21:05:21.748 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 10 monclient: _renew_subs 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d01ac010 con 0x7fe0d006dd90 2026-02-17T21:05:21.749 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 10 client.4171.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:21.750 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 10 monclient: _renew_subs 2026-02-17T21:05:21.750 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:21.750 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d01b8220 con 0x7fe0d006dd90 2026-02-17T21:05:21.750 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 1 librados: init done 2026-02-17T21:05:21.750 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:21.750 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:21.750 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:21.750 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.740+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d006e170 con 0x7fe0d006dd90 2026-02-17T21:05:21.842 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.845+0000 7fe0abfff640 1 -- 10.20.193.138:0/2228656581 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7fe0bc03f030 con 0x7fe0d006dd90 2026-02-17T21:05:21.843 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.845+0000 7fe0abfff640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe0a0079240 0x7fe0a007b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:21.844 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.845+0000 7fe0ceffd640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe0a0079240 0x7fe0a007b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:21.844 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.845+0000 7fe0ceffd640 10 monclient: get_auth_request con 0x7fe0a0079240 auth_method 0 2026-02-17T21:05:21.844 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.846+0000 7fe0ceffd640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe0a0079240 0x7fe0a007b700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0006b90 tx=0x7fe0c0006b20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:21.844 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.846+0000 7fe0abfff640 10 client.4171.objecter ms_handle_connect 0x7fe0a0079240 2026-02-17T21:05:21.851 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.854+0000 7fe0abfff640 1 -- 10.20.193.138:0/2228656581 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2335+0+0 (secure 0 0 0) 0x7fe0bc02f930 con 0x7fe0d006dd90 2026-02-17T21:05:21.851 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.854+0000 7fe0abfff640 10 client.4171.objecter ms_dispatch2 0x7fe0d0000b90 osd_map(16..16 src has 1..16) 2026-02-17T21:05:21.852 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.854+0000 7fe0abfff640 3 client.4171.objecter handle_osd_map got epochs [16,16] > 0 2026-02-17T21:05:21.852 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.854+0000 7fe0abfff640 3 client.4171.objecter handle_osd_map decoding full epoch 16 2026-02-17T21:05:21.852 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.854+0000 7fe0abfff640 20 client.4171.objecter dump_active .. 0 homeless 2026-02-17T21:05:21.852 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.854+0000 7fe0abfff640 1 -- 10.20.193.138:0/2228656581 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe0bc050030 con 0x7fe0d006dd90 2026-02-17T21:05:21.852 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.854+0000 7fe0abfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:21.852 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.854+0000 7fe0abfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:21.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.943+0000 7fe0d5c45640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0b5448b4-8299-481b-aa32-4912c651ef12", "id": 14}] 2026-02-17T21:05:21.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.943+0000 7fe0d5c45640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0b5448b4-8299-481b-aa32-4912c651ef12", "id": 14}] 2026-02-17T21:05:21.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.943+0000 7fe0d5c45640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:21.941 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.943+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b5448b4-8299-481b-aa32-4912c651ef12", "id": 14} v 0) -- 0x7fe0d01199b0 con 0x7fe0d006dd90 2026-02-17T21:05:21.990 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.992+0000 7fe0abfff640 1 -- 10.20.193.138:0/2228656581 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b5448b4-8299-481b-aa32-4912c651ef12", "id": 14}]=0 v17) ==== 113+0+3 (secure 0 0 0) 0x7fe0bc087b40 con 0x7fe0d006dd90 2026-02-17T21:05:21.990 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.992+0000 7fe0abfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0b5448b4-8299-481b-aa32-4912c651ef12", "id": 14}] 2026-02-17T21:05:21.990 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.992+0000 7fe0abfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:21.991 INFO:teuthology.orchestra.run.trial138.stdout:14 2026-02-17T21:05:21.993 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 10 librados: watch_flush enter 2026-02-17T21:05:21.993 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 10 librados: watch_flush exit 2026-02-17T21:05:21.993 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 20 client.4171.objecter shutdown clearing up homeless session... 2026-02-17T21:05:21.993 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 10 client.4171.objecter successfully canceled tick 2026-02-17T21:05:21.993 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe0a0079240 msgr2=0x7fe0a007b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.993 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe0a0079240 0x7fe0a007b700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0006b90 tx=0x7fe0c0006b20 comp rx=0 tx=0).stop 2026-02-17T21:05:21.993 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 10 monclient: shutdown 2026-02-17T21:05:21.993 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:21.993 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 msgr2=0x7fe0d01b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 0x7fe0d01b1470 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc002410 tx=0x7fe0bc0047c0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 shutdown_connections 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe0a0079240 0x7fe0a007b700 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe0d011eea0 0x7fe0d01ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe0d006e6b0 0x7fe0d01b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 --2- 10.20.193.138:0/2228656581 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe0d006dd90 0x7fe0d01b1470 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 >> 10.20.193.138:0/2228656581 conn(0x7fe0d00715f0 msgr2=0x7fe0d0072360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 shutdown_connections 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.993+0000 7fe0d5c45640 1 -- 10.20.193.138:0/2228656581 wait complete. 2026-02-17T21:05:21.994 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:21.994+0000 7fe0d5c45640 1 librados: shutdown 2026-02-17T21:05:22.001 DEBUG:teuthology.orchestra.run.trial138:> sudo ceph --cluster ceph osd new a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad 15 2026-02-17T21:05:22.078 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient: get_monmap_and_config 2026-02-17T21:05:22.078 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient: build_initial_monmap 2026-02-17T21:05:22.079 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient: monmap: 2026-02-17T21:05:22.079 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:22.079 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.079 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:05:22.078286+0000 2026-02-17T21:05:22.079 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:05:22.078286+0000 2026-02-17T21:05:22.079 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:22.079 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:22.079 INFO:teuthology.orchestra.run.trial138.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:22.079 INFO:teuthology.orchestra.run.trial138.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 1 Processor -- start 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 1 -- start start 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient: init 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient: _add_conns ranks=[4,3,1,2,5,0] 2026-02-17T21:05:22.080 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fece8073d90 0x7fece8074170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient(hunting): picked mon.noname-b con 0x7fece8073d90 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fece8118470 0x7fece8118920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient(hunting): picked mon.noname-a con 0x7fece8118470 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fece8118e60 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fece8074860 con 0x7fece8118e60 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fece8121c50 con 0x7fece8118470 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fece8121dd0 con 0x7fece8073d90 2026-02-17T21:05:22.081 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.077+0000 7fecee75e640 10 monclient(hunting): authenticate will time out at 902.701683s 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece7fff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fece8073d90 0x7fece8074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fece8118470 0x7fece8118920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fece8118470 0x7fece8118920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39692/0 (socket says 10.20.193.138:39692) 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fececcd4640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fece8118e60 0x7fece811f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.138:60714/0 (socket says 10.20.193.138:60714) 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 1 -- 10.20.193.138:0/248263179 learned_addr learned my addr 10.20.193.138:0/248263179 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 10 monclient(hunting): get_auth_request con 0x7fece8118470 auth_method 0 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.082 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece7fff640 10 monclient(hunting): get_auth_request con 0x7fece8073d90 auth_method 0 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.078+0000 7fece7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.079+0000 7fece77fe640 10 monclient(hunting): handle_auth_done global_id 4179 payload 274 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.079+0000 7fece77fe640 1 -- 10.20.193.138:0/248263179 >> v2:10.20.193.86:3300/0 conn(0x7fece8073d90 msgr2=0x7fece8074170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:22.083 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.079+0000 7fece77fe640 1 --2- 10.20.193.138:0/248263179 >> v2:10.20.193.86:3300/0 conn(0x7fece8073d90 0x7fece8074170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.084 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.079+0000 7fece77fe640 1 -- 10.20.193.138:0/248263179 >> v1:10.20.193.86:6789/0 conn(0x7fece8118e60 legacy=0x7fece811f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.084 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.079+0000 7fece77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:22.084 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.079+0000 7fece77fe640 1 monclient: found mon.noname-a 2026-02-17T21:05:22.084 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.079+0000 7fece77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:22.084 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.079+0000 7fece77fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:22.084 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.079+0000 7fece77fe640 1 -- 10.20.193.138:0/248263179 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece8121f50 con 0x7fece8118470 2026-02-17T21:05:22.084 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.080+0000 7fece77fe640 1 --2- 10.20.193.138:0/248263179 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8118470 0x7fece8118920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fece806a2b0 tx=0x7fecd802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4110641ab1f7c87f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:22.094 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 1 -- 10.20.193.138:0/248263179 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd803c070 con 0x7fece8118470 2026-02-17T21:05:22.094 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:22.094 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:22.094 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 10 monclient: dump: 2026-02-17T21:05:22.094 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:22.094 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.094 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:05:22.095 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 1 -- 10.20.193.138:0/248263179 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd802fb30 con 0x7fece8118470 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fecee75e640 5 monclient: authenticate success, global_id 4179 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fecee75e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 1 -- 10.20.193.138:0/248263179 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8037440 con 0x7fece8118470 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fecee75e640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fecee75e640 4 set_mon_vals no callback set 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:22.096 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.081+0000 7fece6ffd640 10 monclient: dump: 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:22.097 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient: shutdown 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 -- 10.20.193.138:0/248263179 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8118470 msgr2=0x7fece8118920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 --2- 10.20.193.138:0/248263179 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8118470 0x7fece8118920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fece806a2b0 tx=0x7fecd802ee60 comp rx=0 tx=0).stop 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 -- 10.20.193.138:0/248263179 shutdown_connections 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 --2- 10.20.193.138:0/248263179 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8118470 0x7fece8118920 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 --2- 10.20.193.138:0/248263179 >> v2:10.20.193.86:3300/0 conn(0x7fece8073d90 0x7fece8074170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 -- 10.20.193.138:0/248263179 >> 10.20.193.138:0/248263179 conn(0x7fece806f910 msgr2=0x7fece8071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 -- 10.20.193.138:0/248263179 shutdown_connections 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 -- 10.20.193.138:0/248263179 wait complete. 2026-02-17T21:05:22.098 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient: build_initial_monmap 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient: monmap: 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:epoch 0 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 0.000000 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:created 0.000000 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:22.099 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 librados: starting msgr at 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 librados: starting objecter 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 Processor -- start 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 -- start start 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 librados: setting wanted keys 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 librados: calling monclient init 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient: init 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8073d90 0x7fece81af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient(hunting): picked mon.noname-a con 0x7fece8073d90 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:22.100 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fece8118470 0x7fece81af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient(hunting): picked mon.noname-b con 0x7fece8118470 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fece8118e60 0x7fece81a9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient(hunting): picked mon.noname-c con 0x7fece8118e60 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fece8121100 con 0x7fece8073d90 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fece8120f80 con 0x7fece8118470 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fece8121280 con 0x7fece8118e60 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:22.101 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.082+0000 7fecee75e640 10 monclient(hunting): authenticate will time out at 902.706978s 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8073d90 0x7fece81af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fececcd4640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fece8118e60 0x7fece81a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8073d90 0x7fece81af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.138:39704/0 (socket says 10.20.193.138:39704) 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 1 -- 10.20.193.138:0/194652730 learned_addr learned my addr 10.20.193.138:0/194652730 (peer_addr_for_me v2:10.20.193.138:0/0) 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 10 monclient(hunting): get_auth_request con 0x7fece8073d90 auth_method 0 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:22.102 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:22.103 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fececcd4640 10 monclient(hunting): get_auth_request con 0x7fece8118e60 auth_method 0 2026-02-17T21:05:22.103 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fececcd4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:22.103 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fececcd4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.103 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fececcd4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.103 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.083+0000 7fece77fe640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fece8118470 0x7fece81af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.103 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fececcd4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:22.103 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fececcd4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:22.103 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fececcd4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece77fe640 10 monclient(hunting): get_auth_request con 0x7fece8118470 auth_method 0 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 10 monclient(hunting): handle_auth_done global_id 4182 payload 824 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 1 -- 10.20.193.138:0/194652730 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fece8118e60 msgr2=0x7fece81a9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.104 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fece8118e60 0x7fece81a9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 1 -- 10.20.193.138:0/194652730 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fece8118470 msgr2=0x7fece81af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fece8118470 0x7fece81af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 10 monclient: _finish_hunting 0 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 1 monclient: found mon.noname-a 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.084+0000 7fece7fff640 1 -- 10.20.193.138:0/194652730 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece81a9c40 con 0x7fece8073d90 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.085+0000 7fece7fff640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8073d90 0x7fece81af2d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fecd400ebe0 tx=0x7fecd400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.085+0000 7fece4ff9640 10 client.?.objecter ms_handle_connect 0x7fece8073d90 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.085+0000 7fece4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:22.105 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 1 -- 10.20.193.138:0/194652730 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4017070 con 0x7fece8073d90 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 10 monclient: dump: 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:22.106 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 10 monclient: _finish_auth 0 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 5 monclient: authenticate success, global_id 4182 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 10 monclient: _renew_subs 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece81a9ed0 con 0x7fece8073d90 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 10 client.4182.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 10 monclient: _renew_subs 2026-02-17T21:05:22.107 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece81b6260 con 0x7fece8073d90 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 1 librados: init done 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 1 -- 10.20.193.138:0/194652730 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd400cc40 con 0x7fece8073d90 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece67fc640 4 set_mon_vals no callback set 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 1 -- 10.20.193.138:0/194652730 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4021060 con 0x7fece8073d90 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fece4ff9640 10 monclient: dump: 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:epoch 1 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.108 INFO:teuthology.orchestra.run.trial138.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr:election_strategy: 1 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:22.109 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.087+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece8074170 con 0x7fece8073d90 2026-02-17T21:05:22.111 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.098+0000 7fece4ff9640 1 -- 10.20.193.138:0/194652730 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7fecd4024060 con 0x7fece8073d90 2026-02-17T21:05:22.111 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece4ff9640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fecb80791f0 0x7fecb807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.111 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece77fe640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fecb80791f0 0x7fecb807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.111 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece77fe640 10 monclient: get_auth_request con 0x7fecb80791f0 auth_method 0 2026-02-17T21:05:22.111 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece4ff9640 1 -- 10.20.193.138:0/194652730 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2450+0+0 (secure 0 0 0) 0x7fecd4097c50 con 0x7fece8073d90 2026-02-17T21:05:22.111 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece4ff9640 10 client.4182.objecter ms_dispatch2 0x7fece8000b90 osd_map(17..17 src has 1..17) 2026-02-17T21:05:22.111 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece4ff9640 3 client.4182.objecter handle_osd_map got epochs [17,17] > 0 2026-02-17T21:05:22.111 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece4ff9640 3 client.4182.objecter handle_osd_map decoding full epoch 17 2026-02-17T21:05:22.111 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece4ff9640 20 client.4182.objecter dump_active .. 0 homeless 2026-02-17T21:05:22.112 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece77fe640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fecb80791f0 0x7fecb807b6b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fece8074830 tx=0x7fecd8039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:22.112 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.099+0000 7fece4ff9640 10 client.4182.objecter ms_handle_connect 0x7fecb80791f0 2026-02-17T21:05:22.200 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.202+0000 7fece4ff9640 1 -- 10.20.193.138:0/194652730 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fecd40621b0 con 0x7fece8073d90 2026-02-17T21:05:22.200 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.202+0000 7fece4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:22.200 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.202+0000 7fece4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:22.286 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.288+0000 7fecee75e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad", "id": 15}] 2026-02-17T21:05:22.286 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.288+0000 7fecee75e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad", "id": 15}] 2026-02-17T21:05:22.286 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.288+0000 7fecee75e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:22.286 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.288+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad", "id": 15} v 0) -- 0x7fece811a5e0 con 0x7fece8073d90 2026-02-17T21:05:22.303 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.305+0000 7fece4ff9640 1 -- 10.20.193.138:0/194652730 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad", "id": 15}]=0 v18) ==== 113+0+3 (secure 0 0 0) 0x7fecd40664b0 con 0x7fece8073d90 2026-02-17T21:05:22.303 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.305+0000 7fece4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad", "id": 15}] 2026-02-17T21:05:22.303 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.305+0000 7fece4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:22.303 INFO:teuthology.orchestra.run.trial138.stdout:15 2026-02-17T21:05:22.305 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 10 librados: watch_flush enter 2026-02-17T21:05:22.305 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 10 librados: watch_flush exit 2026-02-17T21:05:22.305 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 20 client.4182.objecter shutdown clearing up homeless session... 2026-02-17T21:05:22.305 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 10 client.4182.objecter successfully canceled tick 2026-02-17T21:05:22.305 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fecb80791f0 msgr2=0x7fecb807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.305 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fecb80791f0 0x7fecb807b6b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fece8074830 tx=0x7fecd8039040 comp rx=0 tx=0).stop 2026-02-17T21:05:22.305 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 10 monclient: shutdown 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8073d90 msgr2=0x7fece81af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8073d90 0x7fece81af2d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fecd400ebe0 tx=0x7fecd400c520 comp rx=0 tx=0).stop 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 shutdown_connections 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fecb80791f0 0x7fecb807b6b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fece8118e60 0x7fece81a9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fece8118470 0x7fece81af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 --2- 10.20.193.138:0/194652730 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fece8073d90 0x7fece81af2d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 >> 10.20.193.138:0/194652730 conn(0x7fece806f910 msgr2=0x7fece8116940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 shutdown_connections 2026-02-17T21:05:22.306 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 -- 10.20.193.138:0/194652730 wait complete. 2026-02-17T21:05:22.307 INFO:teuthology.orchestra.run.trial138.stderr:2026-02-17T21:05:22.306+0000 7fecee75e640 1 librados: shutdown 2026-02-17T21:05:22.311 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.312 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-17T21:05:22.312 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-17T21:05:22.314 INFO:tasks.ceph.osd.0:Started 2026-02-17T21:05:22.314 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.314 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-17T21:05:22.315 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-17T21:05:22.368 INFO:tasks.ceph.osd.4:Started 2026-02-17T21:05:22.368 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.368 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-17T21:05:22.368 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-17T21:05:22.370 INFO:tasks.ceph.osd.8:Started 2026-02-17T21:05:22.370 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.370 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-17T21:05:22.371 DEBUG:teuthology.orchestra.run.trial045:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-17T21:05:22.372 INFO:tasks.ceph.osd.12:Started 2026-02-17T21:05:22.372 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.372 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-17T21:05:22.373 DEBUG:teuthology.orchestra.run.trial086:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-17T21:05:22.374 INFO:tasks.ceph.osd.1:Started 2026-02-17T21:05:22.374 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.374 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-17T21:05:22.375 DEBUG:teuthology.orchestra.run.trial086:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-17T21:05:22.376 INFO:tasks.ceph.osd.5:Started 2026-02-17T21:05:22.376 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.376 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-17T21:05:22.376 DEBUG:teuthology.orchestra.run.trial086:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-17T21:05:22.378 INFO:tasks.ceph.osd.9:Started 2026-02-17T21:05:22.378 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.378 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-17T21:05:22.378 DEBUG:teuthology.orchestra.run.trial086:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-17T21:05:22.380 INFO:tasks.ceph.osd.13:Started 2026-02-17T21:05:22.380 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.381 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-17T21:05:22.381 DEBUG:teuthology.orchestra.run.trial092:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-17T21:05:22.383 INFO:tasks.ceph.osd.2:Started 2026-02-17T21:05:22.383 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.383 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-17T21:05:22.383 DEBUG:teuthology.orchestra.run.trial092:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-17T21:05:22.385 INFO:tasks.ceph.osd.6:Started 2026-02-17T21:05:22.385 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.386 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-17T21:05:22.386 DEBUG:teuthology.orchestra.run.trial092:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-17T21:05:22.388 INFO:tasks.ceph.osd.10:Started 2026-02-17T21:05:22.388 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.388 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-17T21:05:22.388 DEBUG:teuthology.orchestra.run.trial092:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-17T21:05:22.390 INFO:tasks.ceph.osd.14:Started 2026-02-17T21:05:22.390 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.390 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-17T21:05:22.390 DEBUG:teuthology.orchestra.run.trial138:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-17T21:05:22.393 INFO:tasks.ceph.osd.3:Started 2026-02-17T21:05:22.393 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.393 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-17T21:05:22.393 DEBUG:teuthology.orchestra.run.trial138:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-17T21:05:22.396 INFO:tasks.ceph.osd.7:Started 2026-02-17T21:05:22.396 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.396 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-17T21:05:22.396 DEBUG:teuthology.orchestra.run.trial138:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-17T21:05:22.398 INFO:tasks.ceph.osd.11:Started 2026-02-17T21:05:22.399 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-17T21:05:22.399 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-17T21:05:22.399 DEBUG:teuthology.orchestra.run.trial138:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-17T21:05:22.401 INFO:tasks.ceph.osd.15:Started 2026-02-17T21:05:22.401 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T21:05:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.475+0000 7fe204cea640 10 monclient: get_monmap_and_config 2026-02-17T21:05:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.475+0000 7fe204cea640 10 monclient: build_initial_monmap 2026-02-17T21:05:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.475+0000 7fe204cea640 10 monclient: monmap: 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:05:22.476631+0000 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:05:22.476631+0000 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:22.468 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:22.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.476+0000 7fe204cea640 1 Processor -- start 2026-02-17T21:05:22.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.476+0000 7fe204cea640 1 -- start start 2026-02-17T21:05:22.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.476+0000 7fe204cea640 10 monclient: init 2026-02-17T21:05:22.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.476+0000 7fe204cea640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.476+0000 7fe204cea640 10 monclient: _add_conns ranks=[0,5,1,3,2,4] 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.476+0000 7fe204cea640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe20015d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe204cea640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fe2000c92b0 0x7fe20015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe204cea640 10 monclient(hunting): picked mon.noname-c con 0x7fe2000c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe204cea640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe2000748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe204cea640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2000c5860 con 0x7fe20015d1e0 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe204cea640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2000c5580 con 0x7fe2000748e0 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe204cea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe204cea640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe2000c7de0 con 0x7fe2000c92b0 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe204cea640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe204cea640 10 monclient(hunting): authenticate will time out at 906.107042s 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe1fe575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe20015d1e0 0x7fe2000c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:57604/0 (socket says 10.20.193.45:57604) 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe1fe575640 1 -- 10.20.193.45:0/2635817162 learned_addr learned my addr 10.20.193.45:0/2635817162 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:05:22.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe1fdd74640 1 --2- 10.20.193.45:0/2635817162 >> v2:10.20.193.92:3300/0 conn(0x7fe2000c92b0 0x7fe20015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe1fdd74640 10 monclient(hunting): get_auth_request con 0x7fe2000c92b0 auth_method 0 2026-02-17T21:05:22.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe1fdd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:22.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe1fdd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.477+0000 7fe1fdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.478+0000 7fe1fdd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:22.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.478+0000 7fe1fdd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:22.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.478+0000 7fe1fdd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:22.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fd573640 1 -- 10.20.193.45:0/2635817162 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969933659 0 0) 0x7fe2000c5860 con 0x7fe20015d1e0 2026-02-17T21:05:22.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fd573640 10 monclient(hunting): _negotiate 2026-02-17T21:05:22.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fd573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fd573640 10 monclient(hunting): my global_id is 4185 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fd573640 1 -- 10.20.193.45:0/2635817162 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1ec003620 con 0x7fe20015d1e0 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fdd74640 10 monclient(hunting): handle_auth_done global_id 4193 payload 274 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fdd74640 1 -- 10.20.193.45:0/2635817162 >> v1:10.20.193.86:6789/0 conn(0x7fe2000748e0 legacy=0x7fe200153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fd573640 1 -- 10.20.193.45:0/2635817162 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664115208 0 0) 0x7fe2000c5580 con 0x7fe2000748e0 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fdd74640 1 -- 10.20.193.45:0/2635817162 >> v1:10.20.193.45:6789/0 conn(0x7fe20015d1e0 legacy=0x7fe2000c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fdd74640 10 monclient: _finish_hunting 0 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fdd74640 1 monclient: found mon.noname-c 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fdd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fdd74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fdd74640 1 -- 10.20.193.45:0/2635817162 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2000c80c0 con 0x7fe2000c92b0 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.479+0000 7fe1fd573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:05:22.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.480+0000 7fe1fdd74640 1 --2- 10.20.193.45:0/2635817162 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000c92b0 0x7fe20015d5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80098d0 tx=0x7fe1e802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fa8ffffe1dbcb31 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:22.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 1 -- 10.20.193.45:0/2635817162 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e803c070 con 0x7fe2000c92b0 2026-02-17T21:05:22.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:22.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:22.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 10 monclient: dump: 2026-02-17T21:05:22.478 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:05:22.478 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 10 monclient: _finish_auth 0 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 10 monclient: _check_auth_tickets 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 5 monclient: authenticate success, global_id 4193 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 1 -- 10.20.193.45:0/2635817162 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e802fba0 con 0x7fe2000c92b0 2026-02-17T21:05:22.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 1 -- 10.20.193.45:0/2635817162 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8037440 con 0x7fe2000c92b0 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 4 set_mon_vals no callback set 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe1fd573640 10 monclient: dump: 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:22.480 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 10 monclient: shutdown 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 -- 10.20.193.45:0/2635817162 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000c92b0 msgr2=0x7fe20015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 --2- 10.20.193.45:0/2635817162 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000c92b0 0x7fe20015d5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80098d0 tx=0x7fe1e802eed0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 -- 10.20.193.45:0/2635817162 shutdown_connections 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 --2- 10.20.193.45:0/2635817162 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000c92b0 0x7fe20015d5c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 -- 10.20.193.45:0/2635817162 >> 10.20.193.45:0/2635817162 conn(0x7fe2000c9d40 msgr2=0x7fe2000ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 -- 10.20.193.45:0/2635817162 shutdown_connections 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 -- 10.20.193.45:0/2635817162 wait complete. 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 10 monclient: build_initial_monmap 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 10 monclient: monmap: 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:05:22.481 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 librados: starting msgr at 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 librados: starting objecter 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.482+0000 7fe204cea640 1 Processor -- start 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 1 -- start start 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 1 librados: setting wanted keys 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 1 librados: calling monclient init 2026-02-17T21:05:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient: init 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000748e0 0x7fe200074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient(hunting): picked mon.noname-c con 0x7fe2000748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe2000c92b0 0x7fe2001ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient(hunting): picked mon.noname-b con 0x7fe2000c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe20015d1e0 0x7fe2001f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient(hunting): picked mon.noname-a con 0x7fe20015d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe200074d30 con 0x7fe20015d1e0 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe2000c8680 con 0x7fe2000c92b0 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe200153d20 con 0x7fe2000748e0 2026-02-17T21:05:22.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe204cea640 10 monclient(hunting): authenticate will time out at 906.113401s 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fed76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe20015d1e0 0x7fe2001f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fe575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000748e0 0x7fe200074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fdd74640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe2000c92b0 0x7fe2001ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fed76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe20015d1e0 0x7fe2001f5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:45256/0 (socket says 10.20.193.45:45256) 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fed76640 1 -- 10.20.193.45:0/4279834928 learned_addr learned my addr 10.20.193.45:0/4279834928 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fed76640 10 monclient(hunting): get_auth_request con 0x7fe20015d1e0 auth_method 0 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fe575640 10 monclient(hunting): get_auth_request con 0x7fe2000748e0 auth_method 0 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fe575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fe575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.483+0000 7fe1fe575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fdd74640 10 monclient(hunting): get_auth_request con 0x7fe2000c92b0 auth_method 0 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fdd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fdd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fdd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fe575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fe575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fe575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fdd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fdd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.484+0000 7fe1fdd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 10 monclient(hunting): handle_auth_done global_id 4196 payload 824 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 1 -- 10.20.193.45:0/4279834928 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe2000c92b0 msgr2=0x7fe2001ea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe2000c92b0 0x7fe2001ea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 1 -- 10.20.193.45:0/4279834928 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe20015d1e0 msgr2=0x7fe2001f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe20015d1e0 0x7fe2001f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 10 monclient: _finish_hunting 0 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 1 monclient: found mon.noname-c 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.485+0000 7fe1fe575640 1 -- 10.20.193.45:0/4279834928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2001f4840 con 0x7fe2000748e0 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.486+0000 7fe1fe575640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000748e0 0x7fe200074270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400c400 tx=0x7fe1f400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.486+0000 7fe1e6ffd640 10 client.?.objecter ms_handle_connect 0x7fe2000748e0 2026-02-17T21:05:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.486+0000 7fe1e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe1e6ffd640 1 -- 10.20.193.45:0/4279834928 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4017070 con 0x7fe2000748e0 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe1e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe1e6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe1e6ffd640 10 monclient: dump: 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:22.488 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe1e6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe1e6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe1e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 5 monclient: authenticate success, global_id 4196 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 10 monclient: _renew_subs 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2001f5160 con 0x7fe2000748e0 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 10 client.4196.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 10 monclient: _renew_subs 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2001f5720 con 0x7fe2000748e0 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 1 librados: init done 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:22.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.487+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20015d5c0 con 0x7fe2000748e0 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.488+0000 7fe1e6ffd640 1 -- 10.20.193.45:0/4279834928 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1f4005de0 con 0x7fe2000748e0 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.488+0000 7fe1e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.488+0000 7fe1e6ffd640 1 -- 10.20.193.45:0/4279834928 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4021060 con 0x7fe2000748e0 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.488+0000 7fe1e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.488+0000 7fe1e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.488+0000 7fe1fcd72640 4 set_mon_vals no callback set 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.488+0000 7fe1e6ffd640 10 monclient: dump: 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:05:22.490 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:22.491 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:22.491 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:22.491 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:05:22.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.599+0000 7fe1e6ffd640 1 -- 10.20.193.45:0/4279834928 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7fe1f4024080 con 0x7fe2000748e0 2026-02-17T21:05:22.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.599+0000 7fe1e6ffd640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1cc0791f0 0x7fe1cc07b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:22.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.599+0000 7fe1fdd74640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1cc0791f0 0x7fe1cc07b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:22.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.599+0000 7fe1fdd74640 10 monclient: get_auth_request con 0x7fe1cc0791f0 auth_method 0 2026-02-17T21:05:22.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.599+0000 7fe1fdd74640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1cc0791f0 0x7fe1cc07b6b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8039000 tx=0x7fe1e8033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:22.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.599+0000 7fe1e6ffd640 10 client.4196.objecter ms_handle_connect 0x7fe1cc0791f0 2026-02-17T21:05:22.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.613+0000 7fe1e6ffd640 1 -- 10.20.193.45:0/4279834928 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fe1f405d850 con 0x7fe2000748e0 2026-02-17T21:05:22.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.613+0000 7fe1e6ffd640 10 client.4196.objecter ms_dispatch2 0x7fe200000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:05:22.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.613+0000 7fe1e6ffd640 3 client.4196.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:05:22.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.613+0000 7fe1e6ffd640 3 client.4196.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:05:22.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.613+0000 7fe1e6ffd640 20 client.4196.objecter dump_active .. 0 homeless 2026-02-17T21:05:22.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.613+0000 7fe1e6ffd640 1 -- 10.20.193.45:0/4279834928 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe1f4061810 con 0x7fe2000748e0 2026-02-17T21:05:22.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.613+0000 7fe1e6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:22.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.613+0000 7fe1e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:22.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.702+0000 7fe204cea640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:22.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.702+0000 7fe204cea640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:22.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.702+0000 7fe204cea640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:22.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.702+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2001573a0 con 0x7fe2000748e0 2026-02-17T21:05:22.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.731+0000 7fe1e6ffd640 1 -- 10.20.193.45:0/4279834928 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fe1f4065b10 con 0x7fe2000748e0 2026-02-17T21:05:22.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.731+0000 7fe1e6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:22.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.731+0000 7fe1e6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:22.723 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:05:22.724 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:05:22.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 10 librados: watch_flush enter 2026-02-17T21:05:22.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 10 librados: watch_flush exit 2026-02-17T21:05:22.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 20 client.4196.objecter shutdown clearing up homeless session... 2026-02-17T21:05:22.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 10 client.4196.objecter successfully canceled tick 2026-02-17T21:05:22.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1cc0791f0 msgr2=0x7fe1cc07b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1cc0791f0 0x7fe1cc07b6b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8039000 tx=0x7fe1e8033000 comp rx=0 tx=0).stop 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 10 monclient: shutdown 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000748e0 msgr2=0x7fe200074270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000748e0 0x7fe200074270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400c400 tx=0x7fe1f400c8d0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 shutdown_connections 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1cc0791f0 0x7fe1cc07b6b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe20015d1e0 0x7fe2001f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe2000c92b0 0x7fe2001ea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 --2- 10.20.193.45:0/4279834928 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe2000748e0 0x7fe200074270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 >> 10.20.193.45:0/4279834928 conn(0x7fe2000c9d40 msgr2=0x7fe200151e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:22.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 shutdown_connections 2026-02-17T21:05:22.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 -- 10.20.193.45:0/4279834928 wait complete. 2026-02-17T21:05:22.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:05:22.733+0000 7fe204cea640 1 librados: shutdown 2026-02-17T21:05:22.735 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-17T21:05:22.736 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-17T21:05:24.348 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:05:24.412 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.418+0000 7f8a4a7fe640 10 monclient: get_monmap_and_config 2026-02-17T21:05:24.412 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.418+0000 7f8a4a7fe640 10 monclient: build_initial_monmap 2026-02-17T21:05:24.412 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.418+0000 7f8a4a7fe640 10 monclient: monmap: 2026-02-17T21:05:24.412 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:24.412 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:24.412 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:05:24.420588+0000 2026-02-17T21:05:24.413 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:05:24.420588+0000 2026-02-17T21:05:24.413 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:24.413 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:24.413 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:24.413 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:24.413 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:24.413 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:24.413 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:24.413 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:24.414 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:24.414 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 1 Processor -- start 2026-02-17T21:05:24.414 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 1 -- start start 2026-02-17T21:05:24.414 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient: init 2026-02-17T21:05:24.416 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient: _add_conns ranks=[5,0,4,2,3,1] 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f8a44153bf0 0x7f8a44153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8a44153bf0 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8a440c7dd0 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f8a4415b950 0x7f8a440c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8a4415b950 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a440c8810 con 0x7f8a440c7dd0 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f8a440c9700 con 0x7f8a4415b950 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f8a440c8af0 con 0x7f8a44153bf0 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.419+0000 7f8a4a7fe640 10 monclient(hunting): authenticate will time out at 908.050770s 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a437fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f8a440c7dd0 0x7f8a4415b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:57614/0 (socket says 10.20.193.45:57614) 2026-02-17T21:05:24.417 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a437fe640 1 -- 10.20.193.45:0/3886965748 learned_addr learned my addr 10.20.193.45:0/3886965748 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a48d74640 1 --2- 10.20.193.45:0/3886965748 >> v2:10.20.193.86:3300/0 conn(0x7f8a4415b950 0x7f8a440c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a43fff640 1 --2- 10.20.193.45:0/3886965748 >> v2:10.20.193.92:3300/0 conn(0x7f8a44153bf0 0x7f8a44153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a48d74640 10 monclient(hunting): get_auth_request con 0x7f8a4415b950 auth_method 0 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a48d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a48d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a48d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a43fff640 10 monclient(hunting): get_auth_request con 0x7f8a44153bf0 auth_method 0 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a43fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a48d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a48d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a48d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.420+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.421+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:24.418 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.421+0000 7f8a42ffd640 1 -- 10.20.193.45:0/3886965748 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600808448 0 0) 0x7f8a440c8810 con 0x7f8a440c7dd0 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.421+0000 7f8a42ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.421+0000 7f8a42ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.421+0000 7f8a42ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.421+0000 7f8a42ffd640 10 monclient(hunting): my global_id is 4191 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.421+0000 7f8a42ffd640 1 -- 10.20.193.45:0/3886965748 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a28003620 con 0x7f8a440c7dd0 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.422+0000 7f8a48d74640 10 monclient(hunting): handle_auth_done global_id 4189 payload 274 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.422+0000 7f8a48d74640 1 -- 10.20.193.45:0/3886965748 >> v2:10.20.193.92:3300/0 conn(0x7f8a44153bf0 msgr2=0x7f8a44153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.422+0000 7f8a48d74640 1 --2- 10.20.193.45:0/3886965748 >> v2:10.20.193.92:3300/0 conn(0x7f8a44153bf0 0x7f8a44153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.422+0000 7f8a48d74640 1 -- 10.20.193.45:0/3886965748 >> v1:10.20.193.45:6789/0 conn(0x7f8a440c7dd0 legacy=0x7f8a4415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.422+0000 7f8a48d74640 10 monclient: _finish_hunting 0 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.422+0000 7f8a48d74640 1 monclient: found mon.noname-b 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.422+0000 7f8a48d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.422+0000 7f8a48d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.422+0000 7f8a48d74640 1 -- 10.20.193.45:0/3886965748 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a440c8dd0 con 0x7f8a4415b950 2026-02-17T21:05:24.419 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.423+0000 7f8a48d74640 1 --2- 10.20.193.45:0/3886965748 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 0x7f8a440c52d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a44072210 tx=0x7f8a3802f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f16cb0d167ea1ad6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:24.423 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.424+0000 7f8a42ffd640 1 -- 10.20.193.45:0/3886965748 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3803c070 con 0x7f8a4415b950 2026-02-17T21:05:24.423 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.424+0000 7f8a42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:24.423 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.424+0000 7f8a42ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:24.423 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.424+0000 7f8a42ffd640 10 monclient: dump: 2026-02-17T21:05:24.423 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:24.423 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.424+0000 7f8a42ffd640 10 monclient: _finish_auth 0 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.424+0000 7f8a42ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.424+0000 7f8a42ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.424+0000 7f8a4a7fe640 5 monclient: authenticate success, global_id 4189 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.424+0000 7f8a4a7fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a42ffd640 1 -- 10.20.193.45:0/3886965748 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a38037440 con 0x7f8a4415b950 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a42ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a42ffd640 1 -- 10.20.193.45:0/3886965748 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a380377f0 con 0x7f8a4415b950 2026-02-17T21:05:24.424 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a42ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a42ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a42ffd640 10 monclient: dump: 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 4 set_mon_vals no callback set 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 10 monclient: shutdown 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/3886965748 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 msgr2=0x7f8a440c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:24.425 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 --2- 10.20.193.45:0/3886965748 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 0x7f8a440c52d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a44072210 tx=0x7f8a3802f1c0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/3886965748 shutdown_connections 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 --2- 10.20.193.45:0/3886965748 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 0x7f8a440c52d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 --2- 10.20.193.45:0/3886965748 >> v2:10.20.193.92:3300/0 conn(0x7f8a44153bf0 0x7f8a44153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/3886965748 >> 10.20.193.45:0/3886965748 conn(0x7f8a440c9ed0 msgr2=0x7f8a440ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/3886965748 shutdown_connections 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/3886965748 wait complete. 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 10 monclient: build_initial_monmap 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 10 monclient: monmap: 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:24.426 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 librados: starting msgr at 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.425+0000 7f8a4a7fe640 1 librados: starting objecter 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 Processor -- start 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 -- start start 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 librados: setting wanted keys 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 librados: calling monclient init 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient: init 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8a440c7dd0 0x7f8a441f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient(hunting): picked mon.noname-a con 0x7f8a440c7dd0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a44153bf0 0x7f8a441f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient(hunting): picked mon.noname-c con 0x7f8a44153bf0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 0x7f8a44073660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f8a4415b950 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8a440c8240 con 0x7f8a440c7dd0 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:24.427 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8a440c9390 con 0x7f8a4415b950 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a440c83c0 con 0x7f8a44153bf0 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a4a7fe640 10 monclient(hunting): authenticate will time out at 908.057474s 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a43fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8a440c7dd0 0x7f8a441f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a48d74640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 0x7f8a44073660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a43fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8a440c7dd0 0x7f8a441f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:45268/0 (socket says 10.20.193.45:45268) 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a48d74640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 0x7f8a44073660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:54416/0 (socket says 10.20.193.45:54416) 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a43fff640 1 -- 10.20.193.45:0/191901460 learned_addr learned my addr 10.20.193.45:0/191901460 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a43fff640 10 monclient(hunting): get_auth_request con 0x7f8a440c7dd0 auth_method 0 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a43fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a43fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a43fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a48d74640 10 monclient(hunting): get_auth_request con 0x7f8a4415b950 auth_method 0 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a48d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a48d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a48d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:24.428 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.426+0000 7f8a437fe640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a44153bf0 0x7f8a441f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a48d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a48d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a48d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a437fe640 10 monclient(hunting): get_auth_request con 0x7f8a44153bf0 auth_method 0 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a43fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.427+0000 7f8a437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 10 monclient(hunting): handle_auth_done global_id 4192 payload 824 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 1 -- 10.20.193.45:0/191901460 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a44153bf0 msgr2=0x7f8a441f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a44153bf0 0x7f8a441f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 1 -- 10.20.193.45:0/191901460 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8a440c7dd0 msgr2=0x7f8a441f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8a440c7dd0 0x7f8a441f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.429 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 10 monclient: _finish_hunting 0 2026-02-17T21:05:24.430 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 1 monclient: found mon.noname-b 2026-02-17T21:05:24.430 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:24.430 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:24.430 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.428+0000 7f8a48d74640 1 -- 10.20.193.45:0/191901460 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a441f45c0 con 0x7f8a4415b950 2026-02-17T21:05:24.430 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.429+0000 7f8a48d74640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 0x7f8a44073660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a38036000 tx=0x7f8a38004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:24.430 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.429+0000 7f8a40ff9640 10 client.?.objecter ms_handle_connect 0x7f8a4415b950 2026-02-17T21:05:24.430 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.429+0000 7f8a40ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 1 -- 10.20.193.45:0/191901460 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3803c050 con 0x7f8a4415b950 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 10 monclient: dump: 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:24.431 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 10 monclient: _finish_auth 0 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 1 -- 10.20.193.45:0/191901460 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a38048070 con 0x7f8a4415b950 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 1 -- 10.20.193.45:0/191901460 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38009450 con 0x7f8a4415b950 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a427fc640 4 set_mon_vals no callback set 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a40ff9640 10 monclient: dump: 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:24.432 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a4a7fe640 5 monclient: authenticate success, global_id 4192 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a4a7fe640 10 monclient: _renew_subs 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a4a7fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4414b400 con 0x7f8a4415b950 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a4a7fe640 10 client.4192.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a4a7fe640 10 monclient: _renew_subs 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a4a7fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4414b9c0 con 0x7f8a4415b950 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.431+0000 7f8a4a7fe640 1 librados: init done 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.432+0000 7f8a4a7fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.432+0000 7f8a4a7fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.432+0000 7f8a4a7fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:24.433 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.432+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a440c7aa0 con 0x7f8a4415b950 2026-02-17T21:05:24.435 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.443+0000 7f8a40ff9640 1 -- 10.20.193.45:0/191901460 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7f8a38004040 con 0x7f8a4415b950 2026-02-17T21:05:24.436 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.443+0000 7f8a40ff9640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8a14079240 0x7f8a1407b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:24.436 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.443+0000 7f8a43fff640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8a14079240 0x7f8a1407b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:24.436 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.443+0000 7f8a43fff640 10 monclient: get_auth_request con 0x7f8a14079240 auth_method 0 2026-02-17T21:05:24.436 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.444+0000 7f8a43fff640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8a14079240 0x7f8a1407b700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009c60 tx=0x7f8a30009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:24.436 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.444+0000 7f8a40ff9640 10 client.4192.objecter ms_handle_connect 0x7f8a14079240 2026-02-17T21:05:24.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.551+0000 7f8a40ff9640 1 -- 10.20.193.45:0/191901460 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f8a38084320 con 0x7f8a4415b950 2026-02-17T21:05:24.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.551+0000 7f8a40ff9640 10 client.4192.objecter ms_dispatch2 0x7f8a44000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:05:24.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.551+0000 7f8a40ff9640 3 client.4192.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:05:24.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.551+0000 7f8a40ff9640 3 client.4192.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:05:24.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.551+0000 7f8a40ff9640 20 client.4192.objecter dump_active .. 0 homeless 2026-02-17T21:05:24.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.551+0000 7f8a40ff9640 1 -- 10.20.193.45:0/191901460 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8a440c7aa0 con 0x7f8a4415b950 2026-02-17T21:05:24.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.551+0000 7f8a40ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:24.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.551+0000 7f8a40ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:24.631 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.638+0000 7f8a4a7fe640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:24.631 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.638+0000 7f8a4a7fe640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:24.632 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.638+0000 7f8a4a7fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:24.632 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.638+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a44153fd0 con 0x7f8a4415b950 2026-02-17T21:05:24.656 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.663+0000 7f8a40ff9640 1 -- 10.20.193.45:0/191901460 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f8a441f45c0 con 0x7f8a4415b950 2026-02-17T21:05:24.656 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.663+0000 7f8a40ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:24.656 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.663+0000 7f8a40ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:24.657 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:05:24.657 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:05:24.660 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 10 librados: watch_flush enter 2026-02-17T21:05:24.660 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 10 librados: watch_flush exit 2026-02-17T21:05:24.660 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 20 client.4192.objecter shutdown clearing up homeless session... 2026-02-17T21:05:24.660 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 10 client.4192.objecter successfully canceled tick 2026-02-17T21:05:24.661 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8a14079240 msgr2=0x7f8a1407b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:24.661 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8a14079240 0x7f8a1407b700 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009c60 tx=0x7f8a30009290 comp rx=0 tx=0).stop 2026-02-17T21:05:24.661 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 10 monclient: shutdown 2026-02-17T21:05:24.661 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:24.661 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 msgr2=0x7f8a44073660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:24.661 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 0x7f8a44073660 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a38036000 tx=0x7f8a38004b40 comp rx=0 tx=0).stop 2026-02-17T21:05:24.662 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 shutdown_connections 2026-02-17T21:05:24.662 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8a14079240 0x7f8a1407b700 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.662 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8a4415b950 0x7f8a44073660 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.662 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a44153bf0 0x7f8a441f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.662 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 --2- 10.20.193.45:0/191901460 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8a440c7dd0 0x7f8a441f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:24.662 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 >> 10.20.193.45:0/191901460 conn(0x7f8a440c9ed0 msgr2=0x7f8a440c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:24.662 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 shutdown_connections 2026-02-17T21:05:24.663 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 -- 10.20.193.45:0/191901460 wait complete. 2026-02-17T21:05:24.663 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:24.665+0000 7f8a4a7fe640 1 librados: shutdown 2026-02-17T21:05:24.666 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:05:32.281 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:05:32.343 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.351+0000 7f5b9bfff640 10 monclient: get_monmap_and_config 2026-02-17T21:05:32.343 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.351+0000 7f5b9bfff640 10 monclient: build_initial_monmap 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.351+0000 7f5b9bfff640 10 monclient: monmap: 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:05:32.352536+0000 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:05:32.352536+0000 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:32.344 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:32.345 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:32.345 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:32.345 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:32.345 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:32.348 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 1 Processor -- start 2026-02-17T21:05:32.348 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 1 -- start start 2026-02-17T21:05:32.348 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient: init 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient: _add_conns ranks=[2,4,3,1,0,5] 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5b9c15d210 addr v1:10.20.193.92:6789/0 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5b9c15d5f0 0x7f5b9c0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f5b9c15d5f0 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5b9c0c4bb0 0x7f5b9c0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f5b9c0c4bb0 addr v2:10.20.193.45:3300/0 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9c0c51f0 con 0x7f5b9c15d210 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:32.349 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f5b9c0c57b0 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5b9c0c54d0 con 0x7f5b9c15d5f0 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.352+0000 7f5b9bfff640 10 monclient(hunting): authenticate will time out at 915.982739s 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9b7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5b9c0c4bb0 0x7f5b9c0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9a7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5b9c15d5f0 0x7f5b9c0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9affd640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f5b9c15d210 0x7f5b9c070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:43680/0 (socket says 10.20.193.45:43680) 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9affd640 1 -- 10.20.193.45:0/2323922837 learned_addr learned my addr 10.20.193.45:0/2323922837 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9b7fe640 10 monclient(hunting): get_auth_request con 0x7f5b9c0c4bb0 auth_method 0 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:32.350 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9a7fc640 10 monclient(hunting): get_auth_request con 0x7f5b9c15d5f0 auth_method 0 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:32.351 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.353+0000 7f5b9a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b99ffb640 1 -- 10.20.193.45:0/2323922837 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515735195 0 0) 0x7f5b9c0c51f0 con 0x7f5b9c15d210 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b99ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b99ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b99ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b99ffb640 10 monclient(hunting): my global_id is 4205 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b99ffb640 1 -- 10.20.193.45:0/2323922837 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b88003620 con 0x7f5b9c15d210 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b9b7fe640 10 monclient(hunting): handle_auth_done global_id 4197 payload 274 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b9b7fe640 1 -- 10.20.193.45:0/2323922837 >> v2:10.20.193.86:3300/0 conn(0x7f5b9c15d5f0 msgr2=0x7f5b9c0c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b9b7fe640 1 --2- 10.20.193.45:0/2323922837 >> v2:10.20.193.86:3300/0 conn(0x7f5b9c15d5f0 0x7f5b9c0c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:32.352 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b9b7fe640 1 -- 10.20.193.45:0/2323922837 >> v1:10.20.193.92:6789/0 conn(0x7f5b9c15d210 legacy=0x7f5b9c070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:32.353 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b9b7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:05:32.353 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b9b7fe640 1 monclient: found mon.noname-a 2026-02-17T21:05:32.353 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b9b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:32.353 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b9b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:32.353 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.354+0000 7f5b9b7fe640 1 -- 10.20.193.45:0/2323922837 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c0c7d20 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.353 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.356+0000 7f5b9b7fe640 1 --2- 10.20.193.45:0/2323922837 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 0x7f5b9c0c87e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0c9bb0 tx=0x7f5b8c02f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b0b855fb6c061c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:32.359 INFO:tasks.ceph.osd.3.trial138.stderr:--00:00:00:09.910 27174-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.360 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.357+0000 7f5b99ffb640 1 -- 10.20.193.45:0/2323922837 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c03c070 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.357+0000 7f5b99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.357+0000 7f5b99ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.357+0000 7f5b99ffb640 10 monclient: dump: 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:32.361 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b99ffb640 10 monclient: _finish_auth 0 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b99ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b99ffb640 1 -- 10.20.193.45:0/2323922837 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8c02fe40 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 5 monclient: authenticate success, global_id 4197 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b99ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:32.362 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b99ffb640 1 -- 10.20.193.45:0/2323922837 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c037660 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 4 set_mon_vals no callback set 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b99ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b99ffb640 10 monclient: dump: 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:32.363 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 10 monclient: shutdown 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 -- 10.20.193.45:0/2323922837 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 msgr2=0x7f5b9c0c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 --2- 10.20.193.45:0/2323922837 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 0x7f5b9c0c87e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0c9bb0 tx=0x7f5b8c02f130 comp rx=0 tx=0).stop 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 -- 10.20.193.45:0/2323922837 shutdown_connections 2026-02-17T21:05:32.364 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 --2- 10.20.193.45:0/2323922837 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 0x7f5b9c0c87e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 --2- 10.20.193.45:0/2323922837 >> v2:10.20.193.86:3300/0 conn(0x7f5b9c15d5f0 0x7f5b9c0c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 -- 10.20.193.45:0/2323922837 >> 10.20.193.45:0/2323922837 conn(0x7f5b9c0c9cf0 msgr2=0x7f5b9c0ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 -- 10.20.193.45:0/2323922837 shutdown_connections 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 -- 10.20.193.45:0/2323922837 wait complete. 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 10 monclient: build_initial_monmap 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 10 monclient: monmap: 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:05:32.365 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 librados: starting msgr at 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 librados: starting objecter 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 Processor -- start 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 -- start start 2026-02-17T21:05:32.366 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 librados: setting wanted keys 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 1 librados: calling monclient init 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.358+0000 7f5b9bfff640 10 monclient: init 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 0x7f5b9c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient(hunting): picked mon.noname-a con 0x7f5b9c0c4bb0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b9c15d210 0x7f5b9c1f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient(hunting): picked mon.noname-c con 0x7f5b9c15d210 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b9c15d5f0 0x7f5b9c1f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient(hunting): picked mon.noname-b con 0x7f5b9c15d5f0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:32.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c070e50 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c0c82e0 con 0x7f5b9c15d5f0 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c0c8d20 con 0x7f5b9c15d210 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9bfff640 10 monclient(hunting): authenticate will time out at 915.989344s 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 0x7f5b9c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 0x7f5b9c06d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:49198/0 (socket says 10.20.193.45:49198) 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 1 -- 10.20.193.45:0/3690543925 learned_addr learned my addr 10.20.193.45:0/3690543925 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 10 monclient(hunting): get_auth_request con 0x7f5b9c0c4bb0 auth_method 0 2026-02-17T21:05:32.368 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9b7fe640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b9c15d5f0 0x7f5b9c1f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9a7fc640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b9c15d210 0x7f5b9c1f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9b7fe640 10 monclient(hunting): get_auth_request con 0x7f5b9c15d5f0 auth_method 0 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9a7fc640 10 monclient(hunting): get_auth_request con 0x7f5b9c15d210 auth_method 0 2026-02-17T21:05:32.369 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.359+0000 7f5b9a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.360+0000 7f5b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.360+0000 7f5b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.360+0000 7f5b9b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.360+0000 7f5b9a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.360+0000 7f5b9a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.360+0000 7f5b9a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 10 monclient(hunting): handle_auth_done global_id 4200 payload 824 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 1 -- 10.20.193.45:0/3690543925 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b9c15d210 msgr2=0x7f5b9c1f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b9c15d210 0x7f5b9c1f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:32.370 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 1 -- 10.20.193.45:0/3690543925 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b9c15d5f0 msgr2=0x7f5b9c1f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b9c15d5f0 0x7f5b9c1f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 10 monclient: _finish_hunting 0 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 1 monclient: found mon.noname-a 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.361+0000 7f5b9affd640 1 -- 10.20.193.45:0/3690543925 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c06db50 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.362+0000 7f5b9affd640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 0x7f5b9c06d210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c730 tx=0x7f5b9000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.362+0000 7f5b7b7fe640 10 client.?.objecter ms_handle_connect 0x7f5b9c0c4bb0 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.362+0000 7f5b7b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 1 -- 10.20.193.45:0/3690543925 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90017070 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:32.371 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 10 monclient: dump: 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:05:32.372 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 1 -- 10.20.193.45:0/3690543925 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b90005bb0 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b9bfff640 5 monclient: authenticate success, global_id 4200 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b9bfff640 10 monclient: _renew_subs 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b9bfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c06de30 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 1 -- 10.20.193.45:0/3690543925 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90007070 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b997fa640 4 set_mon_vals no callback set 2026-02-17T21:05:32.373 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b7b7fe640 10 monclient: dump: 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b9bfff640 10 client.4200.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:32.374 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b9bfff640 10 monclient: _renew_subs 2026-02-17T21:05:32.375 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b9bfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:32.375 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9c06e3f0 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.375 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.364+0000 7f5b9bfff640 1 librados: init done 2026-02-17T21:05:32.375 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.365+0000 7f5b9bfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:32.375 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.365+0000 7f5b9bfff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:32.375 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.365+0000 7f5b9bfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:32.375 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.365+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9c0c90b0 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.383 INFO:tasks.ceph.osd.12.trial045.stderr:--00:00:00:09.965 27120-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.384 INFO:tasks.ceph.osd.4.trial045.stderr:--00:00:00:10.022 27045-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.385 INFO:tasks.ceph.osd.0.trial045.stderr:--00:00:00:10.025 27044-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.393 INFO:tasks.ceph.osd.6.trial092.stderr:--00:00:00:09.961 26539-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.394 INFO:tasks.ceph.osd.5.trial086.stderr:--00:00:00:09.971 26844-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.394 INFO:tasks.ceph.osd.2.trial092.stderr:--00:00:00:09.964 26538-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.394 INFO:tasks.ceph.osd.1.trial086.stderr:--00:00:00:09.975 26843-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.395 INFO:tasks.ceph.osd.13.trial086.stderr:--00:00:00:09.969 26846-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.395 INFO:tasks.ceph.osd.9.trial086.stderr:--00:00:00:09.971 26845-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.396 INFO:tasks.ceph.osd.14.trial092.stderr:--00:00:00:09.959 26541-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.415 INFO:tasks.ceph.osd.7.trial138.stderr:--00:00:00:09.968 27175-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.416 INFO:tasks.ceph.osd.15.trial138.stderr:--00:00:00:09.969 27177-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.417 INFO:tasks.ceph.osd.11.trial138.stderr:--00:00:00:09.970 27176-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.448 INFO:tasks.ceph.osd.8.trial045.stderr:--00:00:00:10.032 27118-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.474 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.482+0000 7f5b7b7fe640 1 -- 10.20.193.45:0/3690543925 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7f5b90007210 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.475 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.483+0000 7f5b7b7fe640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5b68079240 0x7f5b6807b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:32.475 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.483+0000 7f5b9a7fc640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5b68079240 0x7f5b6807b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:32.476 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.483+0000 7f5b9a7fc640 10 monclient: get_auth_request con 0x7f5b68079240 auth_method 0 2026-02-17T21:05:32.476 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.483+0000 7f5b7b7fe640 10 client.4200.objecter ms_handle_connect 0x7f5b68079240 2026-02-17T21:05:32.476 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.483+0000 7f5b9a7fc640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5b68079240 0x7f5b6807b700 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c1edbe0 tx=0x7f5b84009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:32.484 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.491+0000 7f5b7b7fe640 1 -- 10.20.193.45:0/3690543925 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f5b9005d7d0 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.484 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.491+0000 7f5b7b7fe640 10 client.4200.objecter ms_dispatch2 0x7f5b9c000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:05:32.484 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.491+0000 7f5b7b7fe640 3 client.4200.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:05:32.484 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.491+0000 7f5b7b7fe640 3 client.4200.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:05:32.484 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.491+0000 7f5b7b7fe640 20 client.4200.objecter dump_active .. 0 homeless 2026-02-17T21:05:32.484 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.491+0000 7f5b7b7fe640 1 -- 10.20.193.45:0/3690543925 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5b90021020 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.484 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.491+0000 7f5b7b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:32.485 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.491+0000 7f5b7b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:32.520 INFO:tasks.ceph.osd.10.trial092.stderr:--00:00:00:10.086 26540-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/ab/2114999d04f691e1bcbf7a3f5dd9368051ad8f.debug 2026-02-17T21:05:32.574 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.582+0000 7f5b9bfff640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:32.574 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.582+0000 7f5b9bfff640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:32.574 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.582+0000 7f5b9bfff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:05:32.574 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.582+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b9c06a2d0 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.602 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.610+0000 7f5b7b7fe640 1 -- 10.20.193.45:0/3690543925 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f5b90061790 con 0x7f5b9c0c4bb0 2026-02-17T21:05:32.602 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.610+0000 7f5b7b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:32.602 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.610+0000 7f5b7b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:32.602 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:05:32.603 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:05:32.605 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.612+0000 7f5b9bfff640 10 librados: watch_flush enter 2026-02-17T21:05:32.605 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 10 librados: watch_flush exit 2026-02-17T21:05:32.605 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 20 client.4200.objecter shutdown clearing up homeless session... 2026-02-17T21:05:32.605 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 10 client.4200.objecter successfully canceled tick 2026-02-17T21:05:32.605 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5b68079240 msgr2=0x7f5b6807b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:32.605 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5b68079240 0x7f5b6807b700 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c1edbe0 tx=0x7f5b84009290 comp rx=0 tx=0).stop 2026-02-17T21:05:32.605 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 10 monclient: shutdown 2026-02-17T21:05:32.605 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:32.605 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 msgr2=0x7f5b9c06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 0x7f5b9c06d210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c730 tx=0x7f5b9000cc00 comp rx=0 tx=0).stop 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 shutdown_connections 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5b68079240 0x7f5b6807b700 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b9c15d5f0 0x7f5b9c1f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b9c15d210 0x7f5b9c1f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 --2- 10.20.193.45:0/3690543925 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b9c0c4bb0 0x7f5b9c06d210 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 >> 10.20.193.45:0/3690543925 conn(0x7f5b9c0c9cf0 msgr2=0x7f5b9c14b730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 shutdown_connections 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 -- 10.20.193.45:0/3690543925 wait complete. 2026-02-17T21:05:32.606 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:32.613+0000 7f5b9bfff640 1 librados: shutdown 2026-02-17T21:05:32.614 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:05:36.898 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:14.451 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.904 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:14.542 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.906 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:14.488 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.945 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:14.522 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.945 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:14.526 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.946 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:14.521 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.946 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:14.586 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.987 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:14.560 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.990 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:14.543 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.992 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:14.576 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.996 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:14.558 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:36.996 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:14.564 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.006 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:14.559 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.033 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:14.587 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.046 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:14.615 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.105 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:14.672 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.185 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:14.738 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.197 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:14.835 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.202 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:14.784 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.213 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:14.766 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.222 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:14.804 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.230 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:14.870 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.232 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:14.807 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.236 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:14.817 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.236 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:14.813 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.246 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:14.828 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.253 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:14.829 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.254 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:14.894 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.257 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:14.838 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.273 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:14.847 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.276 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:14.829 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.281 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:14.843 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.283 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:14.866 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.285 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:14.853 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.291 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:14.872 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.303 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:14.856 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.304 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:14.877 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.305 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:14.889 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.307 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:14.870 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.307 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:14.876 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.309 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:14.862 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.324 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:14.897 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.327 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:14.881 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.331 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:14.915 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.336 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:14.889 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.336 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:14.906 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.356 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:14.926 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.373 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:14.942 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.395 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:14.962 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.420 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:14.986 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.461 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:15.099 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.477 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:15.030 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.499 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:15.077 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.510 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:15.092 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.526 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:15.166 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.527 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:15.105 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.527 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:15.103 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.537 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:15.119 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.552 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:15.134 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.557 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:15.138 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.571 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:15.133 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.571 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:15.139 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.573 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:15.126 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.589 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:15.162 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.595 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:15.148 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.597 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:15.180 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.601 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:15.154 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.636 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:15.206 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.683 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:15.250 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.727 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:15.365 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.741 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:15.294 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.791 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:15.431 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.793 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:15.368 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.798 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:15.375 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.832 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:15.413 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.834 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:15.403 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.835 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:15.397 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.837 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:15.390 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.847 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:15.428 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.866 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:15.440 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.867 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:15.420 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.868 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:15.451 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.875 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:15.428 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.881 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:15.455 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.883 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:15.466 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.902 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:15.472 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.918 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:15.488 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.956 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:15.523 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:37.990 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:15.628 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.010 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:15.563 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.025 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:15.578 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.062 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:15.638 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.065 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:15.706 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.076 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:15.654 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.077 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:15.653 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.080 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:15.720 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.082 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-17T21:05:38.087+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.092 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:15.670 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.103 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:15.656 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.103 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:15.666 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.109 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:15.677 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.118 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:15.671 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.118 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:15.681 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.123 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:15.692 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.141 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:15.694 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.147 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:15.700 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.161 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:15.715 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.228 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:15.795 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.243 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:15.809 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.257 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:15.895 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.272 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:15.910 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.374 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:05:38.371+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.413 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:15.966 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.415 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-17T21:05:38.420+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.421 INFO:tasks.ceph.osd.13.trial086.stderr:2026-02-17T21:05:38.418+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.428 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:15.982 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:38.446 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:05:38.450+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.552 INFO:tasks.ceph.osd.3.trial138.stderr:2026-02-17T21:05:38.551+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.606 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:05:38.603+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.615 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:05:38.619+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.624 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:05:38.622+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.644 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:05:38.647+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.645 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:05:38.644+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.669 INFO:tasks.ceph.osd.6.trial092.stderr:2026-02-17T21:05:38.673+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.712 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:05:38.712+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.785 INFO:tasks.ceph.osd.10.trial092.stderr:2026-02-17T21:05:38.788+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.801 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-17T21:05:38.806+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:38.956 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:05:38.955+0000 77b6940 -1 Falling back to public interface 2026-02-17T21:05:40.229 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:05:40.299 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.306+0000 7f5fb3d2c640 10 monclient: get_monmap_and_config 2026-02-17T21:05:40.299 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.306+0000 7f5fb3d2c640 10 monclient: build_initial_monmap 2026-02-17T21:05:40.299 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.306+0000 7f5fb3d2c640 10 monclient: monmap: 2026-02-17T21:05:40.299 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:40.299 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:40.299 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:05:40.307692+0000 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:05:40.307692+0000 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 1 Processor -- start 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 1 -- start start 2026-02-17T21:05:40.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 10 monclient: init 2026-02-17T21:05:40.303 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:40.303 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 10 monclient: _add_conns ranks=[2,5,1,0,3,4] 2026-02-17T21:05:40.303 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5fac153bf0 addr v1:10.20.193.92:6789/0 2026-02-17T21:05:40.303 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f5fac153fd0 0x7f5fac15b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:40.303 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f5fac153fd0 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:40.303 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5fac15b780 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:40.303 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fac15bbd0 con 0x7f5fac15b780 2026-02-17T21:05:40.303 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fac0c8810 con 0x7f5fac153bf0 2026-02-17T21:05:40.303 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5fac0c9700 con 0x7f5fac153fd0 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.307+0000 7f5fb3d2c640 10 monclient(hunting): authenticate will time out at 923.937814s 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.308+0000 7f5fb22a2640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f5fac15b780 0x7f5fac0c52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:38340/0 (socket says 10.20.193.45:38340) 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.308+0000 7f5fb22a2640 1 -- 10.20.193.45:0/1542555012 learned_addr learned my addr 10.20.193.45:0/1542555012 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.308+0000 7f5fb12a0640 1 --2- 10.20.193.45:0/1542555012 >> v2:10.20.193.92:3300/0 conn(0x7f5fac153fd0 0x7f5fac15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.308+0000 7f5fb12a0640 10 monclient(hunting): get_auth_request con 0x7f5fac153fd0 auth_method 0 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.308+0000 7f5fb12a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.308+0000 7f5fb12a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.308+0000 7f5fb12a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:40.304 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.309+0000 7f5fb12a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:40.305 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.309+0000 7f5fb12a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:40.305 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.309+0000 7f5fb12a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:40.305 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.309+0000 7f5fb0a9f640 1 -- 10.20.193.45:0/1542555012 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778100445 0 0) 0x7f5fac15bbd0 con 0x7f5fac15b780 2026-02-17T21:05:40.305 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.309+0000 7f5fb0a9f640 10 monclient(hunting): _negotiate 2026-02-17T21:05:40.305 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.309+0000 7f5fb0a9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:40.305 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.309+0000 7f5fb0a9f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:40.305 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.309+0000 7f5fb0a9f640 10 monclient(hunting): my global_id is 4246 2026-02-17T21:05:40.305 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.309+0000 7f5fb0a9f640 1 -- 10.20.193.45:0/1542555012 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f94003620 con 0x7f5fac15b780 2026-02-17T21:05:40.306 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.311+0000 7f5fb12a0640 10 monclient(hunting): handle_auth_done global_id 4271 payload 274 2026-02-17T21:05:40.306 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.311+0000 7f5fb12a0640 1 -- 10.20.193.45:0/1542555012 >> v1:10.20.193.92:6789/0 conn(0x7f5fac153bf0 legacy=0x7f5fac0c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:40.306 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.311+0000 7f5fb12a0640 1 -- 10.20.193.45:0/1542555012 >> v1:10.20.193.86:6789/0 conn(0x7f5fac15b780 legacy=0x7f5fac0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:40.306 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.311+0000 7f5fb12a0640 10 monclient: _finish_hunting 0 2026-02-17T21:05:40.306 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.311+0000 7f5fb12a0640 1 monclient: found mon.noname-c 2026-02-17T21:05:40.306 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.311+0000 7f5fb12a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:40.307 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.311+0000 7f5fb12a0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:40.307 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.311+0000 7f5fb12a0640 1 -- 10.20.193.45:0/1542555012 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac0c8af0 con 0x7f5fac153fd0 2026-02-17T21:05:40.307 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.313+0000 7f5fb12a0640 1 --2- 10.20.193.45:0/1542555012 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac153fd0 0x7f5fac15b240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00098a0 tx=0x7f5fa002ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce7bdb87114ad52 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:40.311 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.315+0000 7f5fb0a9f640 1 -- 10.20.193.45:0/1542555012 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa003c070 con 0x7f5fac153fd0 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.315+0000 7f5fb0a9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 10 monclient: dump: 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:40.312 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 10 monclient: _finish_auth 0 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 10 monclient: _check_auth_tickets 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 1 -- 10.20.193.45:0/1542555012 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa002fb70 con 0x7f5fac153fd0 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 1 -- 10.20.193.45:0/1542555012 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0037440 con 0x7f5fac153fd0 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 5 monclient: authenticate success, global_id 4271 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 4 set_mon_vals no callback set 2026-02-17T21:05:40.313 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb0a9f640 10 monclient: dump: 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:40.314 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 10 monclient: shutdown 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/1542555012 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac153fd0 msgr2=0x7f5fac15b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 1 --2- 10.20.193.45:0/1542555012 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac153fd0 0x7f5fac15b240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00098a0 tx=0x7f5fa002ee60 comp rx=0 tx=0).stop 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/1542555012 shutdown_connections 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 1 --2- 10.20.193.45:0/1542555012 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac153fd0 0x7f5fac15b240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/1542555012 >> 10.20.193.45:0/1542555012 conn(0x7f5fac0c9ed0 msgr2=0x7f5fac0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/1542555012 shutdown_connections 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/1542555012 wait complete. 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 10 monclient: build_initial_monmap 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 10 monclient: monmap: 2026-02-17T21:05:40.315 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 1 librados: starting msgr at 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.316+0000 7f5fb3d2c640 1 librados: starting objecter 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 Processor -- start 2026-02-17T21:05:40.316 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 -- start start 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 librados: setting wanted keys 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 librados: calling monclient init 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient: init 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5fac153bf0 0x7f5fac146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f5fac153bf0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5fac153fd0 0x7f5fac155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient(hunting): picked mon.noname-b con 0x7f5fac153fd0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac15b780 0x7f5fac1f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f5fac15b780 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:40.317 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac0c9390 con 0x7f5fac153bf0 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac0c90b0 con 0x7f5fac153fd0 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac0c84e0 con 0x7f5fac15b780 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb3d2c640 10 monclient(hunting): authenticate will time out at 923.947486s 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb22a2640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac15b780 0x7f5fac1f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb12a0640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5fac153fd0 0x7f5fac155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.317+0000 7f5fb1aa1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5fac153bf0 0x7f5fac146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb12a0640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5fac153fd0 0x7f5fac155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:45948/0 (socket says 10.20.193.45:45948) 2026-02-17T21:05:40.318 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb12a0640 1 -- 10.20.193.45:0/3371903412 learned_addr learned my addr 10.20.193.45:0/3371903412 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb22a2640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac15b780 0x7f5fac1f1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:41354/0 (socket says 10.20.193.45:41354) 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb12a0640 10 monclient(hunting): get_auth_request con 0x7f5fac153fd0 auth_method 0 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb12a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb12a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb12a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb22a2640 10 monclient(hunting): get_auth_request con 0x7f5fac15b780 auth_method 0 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb22a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb22a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb22a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb1aa1640 10 monclient(hunting): get_auth_request con 0x7f5fac153bf0 auth_method 0 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb1aa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb1aa1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:40.319 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb1aa1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:40.320 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb12a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:40.320 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb12a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:40.320 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb12a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:40.320 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb22a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:40.320 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb22a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:40.320 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb22a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:40.320 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb1aa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:40.320 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb1aa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:40.320 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.318+0000 7f5fb1aa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 10 monclient(hunting): handle_auth_done global_id 4249 payload 824 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 1 -- 10.20.193.45:0/3371903412 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac15b780 msgr2=0x7f5fac1f1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac15b780 0x7f5fac1f1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 1 -- 10.20.193.45:0/3371903412 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5fac153bf0 msgr2=0x7f5fac146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5fac153bf0 0x7f5fac146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 10 monclient: _finish_hunting 0 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 1 monclient: found mon.noname-b 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.320+0000 7f5fb12a0640 1 -- 10.20.193.45:0/3371903412 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac1466c0 con 0x7f5fac153fd0 2026-02-17T21:05:40.323 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.321+0000 7f5fb12a0640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5fac153fd0 0x7f5fac155b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009130 tx=0x7f5fa00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.321+0000 7f5f9a7fc640 10 client.?.objecter ms_handle_connect 0x7f5fac153fd0 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.321+0000 7f5f9a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.322+0000 7f5f9a7fc640 1 -- 10.20.193.45:0/3371903412 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa003c040 con 0x7f5fac153fd0 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.322+0000 7f5f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 10 monclient: dump: 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:40.324 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:40.325 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:40.325 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:40.325 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:40.325 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:40.325 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:05:40.325 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:05:40.325 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:40.325 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 5 monclient: authenticate success, global_id 4249 2026-02-17T21:05:40.325 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 10 monclient: _renew_subs 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fac154520 con 0x7f5fac153fd0 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 10 client.4249.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 10 monclient: _renew_subs 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fac154ae0 con 0x7f5fac153fd0 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 1 librados: init done 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 1 -- 10.20.193.45:0/3371903412 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa002fab0 con 0x7f5fac153fd0 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 1 -- 10.20.193.45:0/3371903412 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0042810 con 0x7f5fac153fd0 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:05:40.326 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9a7fc640 10 monclient: dump: 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5f9bfff640 4 set_mon_vals no callback set 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:40.327 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:40.328 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:40.328 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.323+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fac15b240 con 0x7f5fac153fd0 2026-02-17T21:05:40.329 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.335+0000 7f5f9a7fc640 1 -- 10.20.193.45:0/3371903412 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7f5fa00429b0 con 0x7f5fac153fd0 2026-02-17T21:05:40.329 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.336+0000 7f5f9a7fc640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5f7c0791f0 0x7f5f7c07b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:40.329 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.336+0000 7f5fb1aa1640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5f7c0791f0 0x7f5f7c07b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:40.329 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.336+0000 7f5fb1aa1640 10 monclient: get_auth_request con 0x7f5f7c0791f0 auth_method 0 2026-02-17T21:05:40.329 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.336+0000 7f5f9a7fc640 10 client.4249.objecter ms_handle_connect 0x7f5f7c0791f0 2026-02-17T21:05:40.329 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.336+0000 7f5fb1aa1640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5f7c0791f0 0x7f5f7c07b6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c002770 tx=0x7f5f9c007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:40.330 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.337+0000 7f5f9a7fc640 1 -- 10.20.193.45:0/3371903412 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f5fa00bc6e0 con 0x7f5fac153fd0 2026-02-17T21:05:40.330 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.337+0000 7f5f9a7fc640 10 client.4249.objecter ms_dispatch2 0x7f5fac000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:05:40.330 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.337+0000 7f5f9a7fc640 3 client.4249.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:05:40.330 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.337+0000 7f5f9a7fc640 3 client.4249.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:05:40.330 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.338+0000 7f5f9a7fc640 20 client.4249.objecter dump_active .. 0 homeless 2026-02-17T21:05:40.434 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.442+0000 7f5f9a7fc640 1 -- 10.20.193.45:0/3371903412 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5fa0051080 con 0x7f5fac153fd0 2026-02-17T21:05:40.434 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.442+0000 7f5f9a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:40.434 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.442+0000 7f5f9a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:40.521 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.529+0000 7f5fb3d2c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:40.521 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.529+0000 7f5fb3d2c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:40.521 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.529+0000 7f5fb3d2c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:05:40.521 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.529+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fac157650 con 0x7f5fac153fd0 2026-02-17T21:05:40.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.549+0000 7f5f9a7fc640 1 -- 10.20.193.45:0/3371903412 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f5fac1466c0 con 0x7f5fac153fd0 2026-02-17T21:05:40.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.549+0000 7f5f9a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:40.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.549+0000 7f5f9a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:40.541 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:05:40.542 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:05:40.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 10 librados: watch_flush enter 2026-02-17T21:05:40.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 10 librados: watch_flush exit 2026-02-17T21:05:40.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 20 client.4249.objecter shutdown clearing up homeless session... 2026-02-17T21:05:40.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 10 client.4249.objecter successfully canceled tick 2026-02-17T21:05:40.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5f7c0791f0 msgr2=0x7f5f7c07b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:40.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5f7c0791f0 0x7f5f7c07b6b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c002770 tx=0x7f5f9c007ef0 comp rx=0 tx=0).stop 2026-02-17T21:05:40.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 10 monclient: shutdown 2026-02-17T21:05:40.544 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5fac153fd0 msgr2=0x7f5fac155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5fac153fd0 0x7f5fac155b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0009130 tx=0x7f5fa00047c0 comp rx=0 tx=0).stop 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 shutdown_connections 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5f7c0791f0 0x7f5f7c07b6b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5fac15b780 0x7f5fac1f1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5fac153fd0 0x7f5fac155b80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 --2- 10.20.193.45:0/3371903412 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5fac153bf0 0x7f5fac146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 >> 10.20.193.45:0/3371903412 conn(0x7f5fac0c9ed0 msgr2=0x7f5fac151940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 shutdown_connections 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 -- 10.20.193.45:0/3371903412 wait complete. 2026-02-17T21:05:40.545 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:40.551+0000 7f5fb3d2c640 1 librados: shutdown 2026-02-17T21:05:40.552 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:05:42.873 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:20.455 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.199 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:20.781 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.220 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:20.802 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.278 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:20.862 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.311 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:20.885 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.404 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:20.973 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.468 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:21.046 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.469 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:21.044 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.473 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:21.026 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.482 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:21.064 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.487 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:21.128 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.532 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:21.114 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.576 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:21.130 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.588 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:21.171 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.619 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:21.192 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.621 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:21.184 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.628 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:21.196 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.632 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:21.270 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.640 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:21.193 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.714 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:21.283 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.746 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:21.328 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.753 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:21.319 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.777 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:21.355 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.778 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:21.353 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.781 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:21.335 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.811 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:21.451 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.844 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:21.425 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.874 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:21.457 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.886 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:21.439 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.904 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:21.458 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.910 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:21.484 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.931 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:21.493 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.945 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:21.583 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.946 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:21.514 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:43.957 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:21.511 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.009 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:21.591 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.019 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:21.589 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.066 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:21.632 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.066 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:21.620 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.087 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:21.664 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.090 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:21.666 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.118 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:21.758 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.121 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:21.703 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.145 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:21.728 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.174 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:21.747 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.192 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:21.746 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.220 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:21.773 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.229 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:21.868 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.236 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:21.799 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.240 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:21.808 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.273 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:21.855 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.274 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:21.827 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.297 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:21.866 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.330 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:21.883 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.350 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:21.917 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.364 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:21.942 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.369 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:21.945 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.397 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:22.037 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.402 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:21.983 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.423 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:22.006 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.437 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:22.010 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.477 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:22.031 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.494 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:22.132 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.503 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:22.072 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.525 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:22.087 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.532 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:22.085 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.539 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:22.121 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.549 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:22.103 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.570 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:22.140 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.594 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:22.147 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.617 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:22.184 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.641 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:22.219 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.651 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:22.227 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.674 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:22.315 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.682 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:22.264 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.693 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:22.277 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.709 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:22.282 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.751 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:22.304 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.758 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:22.396 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.767 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:22.335 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.803 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:22.385 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.805 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:22.368 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.806 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:22.359 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.836 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:22.389 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.845 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:22.415 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.863 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:22.416 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.884 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:22.451 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.915 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:22.493 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.932 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:22.508 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.949 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:22.589 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.962 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:22.543 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.968 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:22.552 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:44.979 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:22.552 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.025 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:22.663 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.027 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:22.581 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.030 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:22.599 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.067 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:22.649 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.079 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:22.642 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.080 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:22.634 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.114 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:22.667 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.119 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:22.688 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.135 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:22.688 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.150 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:22.717 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.189 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:22.767 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.215 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:22.791 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.224 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:22.864 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.235 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:22.818 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.242 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:22.824 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.247 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:22.820 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.288 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:22.926 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.294 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:22.863 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.302 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:22.855 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.357 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:22.919 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.358 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:22.912 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.395 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:22.964 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.397 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:22.950 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.401 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:22.954 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.421 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:22.988 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.424 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:23.006 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.463 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:23.041 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.492 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:23.068 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.510 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:23.150 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.515 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:23.098 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.519 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:23.092 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.522 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:23.104 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.551 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:23.189 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.557 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:23.125 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.576 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:23.130 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.630 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:23.193 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.632 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:23.186 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.670 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:23.240 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.671 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:23.224 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.676 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:23.230 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.688 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:23.254 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.710 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:23.292 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.737 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:23.315 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.766 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:23.342 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.788 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:23.429 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.820 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:23.388 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.832 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:23.470 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.850 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:23.403 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.874 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:23.457 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.890 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:23.463 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.905 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:23.467 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.906 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:23.459 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.906 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:23.488 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.910 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:23.493 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.932 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:23.515 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.947 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:23.520 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.952 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:23.533 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.954 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:23.537 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.954 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:23.507 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.959 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:23.542 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.960 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:23.527 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.973 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:23.555 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.988 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:23.570 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:45.995 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:23.577 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.000 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:23.582 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.005 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:23.587 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.009 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:23.592 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.028 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:23.582 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.044 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:23.614 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.072 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:23.625 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.087 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:23.657 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.095 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:23.649 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.119 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:23.689 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.125 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:23.703 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.140 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:23.710 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.145 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:23.714 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.151 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:23.726 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.163 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:23.803 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.178 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:23.746 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.184 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:23.761 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.190 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:23.744 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.200 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:23.776 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.205 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:23.783 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.209 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:23.847 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.210 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:23.850 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.223 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:23.777 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.226 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:23.802 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.227 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:23.800 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.234 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:23.812 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.240 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:23.817 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.267 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:23.840 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.271 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:23.824 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.272 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:23.846 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.286 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:23.848 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.304 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:23.858 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.334 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:23.887 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.337 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:23.903 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.338 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:23.891 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.342 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:23.896 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.371 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:23.924 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.375 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:23.929 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.380 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:23.934 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.402 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:23.955 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.471 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:24.040 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.498 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:24.066 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.501 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:24.141 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.507 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:24.082 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.512 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:24.088 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.518 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:24.156 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.523 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:24.091 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.528 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:24.097 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.552 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:24.191 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.567 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:24.121 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.585 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:24.148 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.587 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:24.225 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.592 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:24.230 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.621 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:24.183 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.634 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:24.188 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.636 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:24.203 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.650 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:24.212 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.655 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:24.217 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.663 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:24.216 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.680 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:24.233 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.684 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:24.238 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.795 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:24.435 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.801 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:24.441 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.919 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:24.486 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.955 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:24.508 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:46.959 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:24.513 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:47.207 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:24.773 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:47.212 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:24.778 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:48.165 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:05:48.228 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.235+0000 7f9c2ae6d640 10 monclient: get_monmap_and_config 2026-02-17T21:05:48.228 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.235+0000 7f9c2ae6d640 10 monclient: build_initial_monmap 2026-02-17T21:05:48.228 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.235+0000 7f9c2ae6d640 10 monclient: monmap: 2026-02-17T21:05:48.228 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:48.228 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:48.228 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:05:48.236428+0000 2026-02-17T21:05:48.228 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:05:48.236428+0000 2026-02-17T21:05:48.228 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:48.228 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.235+0000 7f9c2ae6d640 1 Processor -- start 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 1 -- start start 2026-02-17T21:05:48.229 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient: init 2026-02-17T21:05:48.233 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:48.233 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient: _add_conns ranks=[4,0,5,2,1,3] 2026-02-17T21:05:48.233 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f9c24155dc0 0x7f9c240c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:48.233 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient(hunting): picked mon.noname-b con 0x7f9c24155dc0 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:48.233 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9c241561a0 addr v1:10.20.193.45:6789/0 2026-02-17T21:05:48.233 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9c2415f590 0x7f9c2415f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:48.233 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient(hunting): picked mon.noname-c con 0x7f9c2415f590 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:48.233 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c240c4580 con 0x7f9c241561a0 2026-02-17T21:05:48.233 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f9c240c9840 con 0x7f9c24155dc0 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f9c240c84c0 con 0x7f9c2415f590 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c2ae6d640 10 monclient(hunting): authenticate will time out at 931.866547s 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c1bfff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9c241561a0 0x7f9c2415d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:50348/0 (socket says 10.20.193.45:50348) 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.236+0000 7f9c1bfff640 1 -- 10.20.193.45:0/1957041047 learned_addr learned my addr 10.20.193.45:0/1957041047 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c28be2640 1 --2- 10.20.193.45:0/1957041047 >> v2:10.20.193.86:3300/0 conn(0x7f9c24155dc0 0x7f9c240c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c293e3640 1 --2- 10.20.193.45:0/1957041047 >> v2:10.20.193.92:3300/0 conn(0x7f9c2415f590 0x7f9c2415f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c28be2640 10 monclient(hunting): get_auth_request con 0x7f9c24155dc0 auth_method 0 2026-02-17T21:05:48.234 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c28be2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c28be2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c28be2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c293e3640 10 monclient(hunting): get_auth_request con 0x7f9c2415f590 auth_method 0 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c293e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c293e3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c293e3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c28be2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c28be2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c28be2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c293e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:48.235 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c293e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.237+0000 7f9c293e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c1b7fe640 1 -- 10.20.193.45:0/1957041047 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846586160 0 0) 0x7f9c240c4580 con 0x7f9c241561a0 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c1b7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c1b7fe640 10 monclient(hunting): my global_id is 4236 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c1b7fe640 1 -- 10.20.193.45:0/1957041047 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c10003620 con 0x7f9c241561a0 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c293e3640 10 monclient(hunting): handle_auth_done global_id 4280 payload 274 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c293e3640 1 -- 10.20.193.45:0/1957041047 >> v2:10.20.193.86:3300/0 conn(0x7f9c24155dc0 msgr2=0x7f9c240c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c293e3640 1 --2- 10.20.193.45:0/1957041047 >> v2:10.20.193.86:3300/0 conn(0x7f9c24155dc0 0x7f9c240c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c293e3640 1 -- 10.20.193.45:0/1957041047 >> v1:10.20.193.45:6789/0 conn(0x7f9c241561a0 legacy=0x7f9c2415d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:48.236 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c293e3640 10 monclient: _finish_hunting 0 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c293e3640 1 monclient: found mon.noname-c 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c293e3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c293e3640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.238+0000 7f9c293e3640 1 -- 10.20.193.45:0/1957041047 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c240c87a0 con 0x7f9c2415f590 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.239+0000 7f9c293e3640 1 --2- 10.20.193.45:0/1957041047 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c2415f590 0x7f9c2415f970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c240cd3f0 tx=0x7f9c2002f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d969cdd27ceba5d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 1 -- 10.20.193.45:0/1957041047 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2003c070 con 0x7f9c2415f590 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 10 monclient: dump: 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:48.237 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c2ae6d640 5 monclient: authenticate success, global_id 4280 2026-02-17T21:05:48.238 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c2ae6d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:05:48.245 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 1 -- 10.20.193.45:0/1957041047 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c20037440 con 0x7f9c2415f590 2026-02-17T21:05:48.245 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:48.245 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 1 -- 10.20.193.45:0/1957041047 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c200377f0 con 0x7f9c2415f590 2026-02-17T21:05:48.245 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:48.245 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:48.245 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c1b7fe640 10 monclient: dump: 2026-02-17T21:05:48.245 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c2ae6d640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.241+0000 7f9c2ae6d640 4 set_mon_vals no callback set 2026-02-17T21:05:48.246 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 10 monclient: shutdown 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/1957041047 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c2415f590 msgr2=0x7f9c2415f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 1 --2- 10.20.193.45:0/1957041047 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c2415f590 0x7f9c2415f970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c240cd3f0 tx=0x7f9c2002f1c0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/1957041047 shutdown_connections 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 1 --2- 10.20.193.45:0/1957041047 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c2415f590 0x7f9c2415f970 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 1 --2- 10.20.193.45:0/1957041047 >> v2:10.20.193.86:3300/0 conn(0x7f9c24155dc0 0x7f9c240c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/1957041047 >> 10.20.193.45:0/1957041047 conn(0x7f9c240c9ed0 msgr2=0x7f9c240ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/1957041047 shutdown_connections 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/1957041047 wait complete. 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 10 monclient: build_initial_monmap 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.242+0000 7f9c2ae6d640 10 monclient: monmap: 2026-02-17T21:05:48.247 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 librados: starting msgr at 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 librados: starting objecter 2026-02-17T21:05:48.248 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 Processor -- start 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 -- start start 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 librados: setting wanted keys 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 librados: calling monclient init 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient: init 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c24155dc0 0x7f9c241592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient(hunting): picked mon.noname-c con 0x7f9c24155dc0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c241561a0 0x7f9c241f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient(hunting): picked mon.noname-b con 0x7f9c241561a0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c2415f590 0x7f9c24150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient(hunting): picked mon.noname-a con 0x7f9c2415f590 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:48.249 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9c240c9040 con 0x7f9c2415f590 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9c240c8d60 con 0x7f9c241561a0 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c240c9320 con 0x7f9c24155dc0 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.243+0000 7f9c2ae6d640 10 monclient(hunting): authenticate will time out at 931.873816s 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c2415f590 0x7f9c24150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c28be2640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c24155dc0 0x7f9c241592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c2415f590 0x7f9c24150d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:56604/0 (socket says 10.20.193.45:56604) 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 1 -- 10.20.193.45:0/716632972 learned_addr learned my addr 10.20.193.45:0/716632972 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 10 monclient(hunting): get_auth_request con 0x7f9c2415f590 auth_method 0 2026-02-17T21:05:48.250 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c1bfff640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c241561a0 0x7f9c241f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c28be2640 10 monclient(hunting): get_auth_request con 0x7f9c24155dc0 auth_method 0 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c28be2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c28be2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c28be2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request con 0x7f9c241561a0 auth_method 0 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c1bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c1bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c1bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:48.251 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c293e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c28be2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c28be2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c28be2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.244+0000 7f9c1bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 10 monclient(hunting): handle_auth_done global_id 4283 payload 824 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 1 -- 10.20.193.45:0/716632972 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c241561a0 msgr2=0x7f9c241f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c241561a0 0x7f9c241f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.252 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 1 -- 10.20.193.45:0/716632972 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c2415f590 msgr2=0x7f9c24150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c2415f590 0x7f9c24150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 10 monclient: _finish_hunting 0 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 1 monclient: found mon.noname-c 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.246+0000 7f9c28be2640 1 -- 10.20.193.45:0/716632972 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c24159800 con 0x7f9c24155dc0 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.247+0000 7f9c28be2640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c24155dc0 0x7f9c241592c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400e8a0 tx=0x7f9c1400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.247+0000 7f9c197fa640 10 client.?.objecter ms_handle_connect 0x7f9c24155dc0 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.247+0000 7f9c197fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 1 -- 10.20.193.45:0/716632972 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14017070 con 0x7f9c24155dc0 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:48.253 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 10 monclient: dump: 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 10 monclient: _finish_auth 0 2026-02-17T21:05:48.254 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 10 monclient: _check_auth_tickets 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c2ae6d640 5 monclient: authenticate success, global_id 4283 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c2ae6d640 10 monclient: _renew_subs 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c2ae6d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c241f4540 con 0x7f9c24155dc0 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c2ae6d640 10 client.4283.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c2ae6d640 10 monclient: _renew_subs 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c2ae6d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c240c5120 con 0x7f9c24155dc0 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c2ae6d640 1 librados: init done 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 1 -- 10.20.193.45:0/716632972 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c14005a90 con 0x7f9c24155dc0 2026-02-17T21:05:48.255 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 1 -- 10.20.193.45:0/716632972 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c14021060 con 0x7f9c24155dc0 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c197fa640 10 monclient: dump: 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:48.256 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:48.257 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:48.257 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:48.257 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.248+0000 7f9c1affd640 4 set_mon_vals no callback set 2026-02-17T21:05:48.257 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.249+0000 7f9c2ae6d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:48.257 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.249+0000 7f9c2ae6d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:48.257 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.249+0000 7f9c2ae6d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:48.257 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.249+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2406e690 con 0x7f9c24155dc0 2026-02-17T21:05:48.258 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.260+0000 7f9c197fa640 1 -- 10.20.193.45:0/716632972 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7f9c14024060 con 0x7f9c24155dc0 2026-02-17T21:05:48.258 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.260+0000 7f9c197fa640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9bf40791f0 0x7f9bf407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:48.259 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.261+0000 7f9c1bfff640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9bf40791f0 0x7f9bf407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:48.259 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.261+0000 7f9c1bfff640 10 monclient: get_auth_request con 0x7f9bf40791f0 auth_method 0 2026-02-17T21:05:48.259 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.261+0000 7f9c1bfff640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9bf40791f0 0x7f9bf407b6b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c007b60 tx=0x7f9c0c007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:48.259 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.261+0000 7f9c197fa640 10 client.4283.objecter ms_handle_connect 0x7f9bf40791f0 2026-02-17T21:05:48.259 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.262+0000 7f9c197fa640 1 -- 10.20.193.45:0/716632972 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f9c14097b60 con 0x7f9c24155dc0 2026-02-17T21:05:48.259 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.262+0000 7f9c197fa640 10 client.4283.objecter ms_dispatch2 0x7f9c24000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:05:48.259 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.262+0000 7f9c197fa640 3 client.4283.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:05:48.259 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.262+0000 7f9c197fa640 3 client.4283.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:05:48.259 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.262+0000 7f9c197fa640 20 client.4283.objecter dump_active .. 0 homeless 2026-02-17T21:05:48.357 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.365+0000 7f9c197fa640 1 -- 10.20.193.45:0/716632972 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9c2406e690 con 0x7f9c24155dc0 2026-02-17T21:05:48.357 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.365+0000 7f9c197fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:48.357 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.365+0000 7f9c197fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:48.443 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.450+0000 7f9c2ae6d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:48.443 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.450+0000 7f9c2ae6d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:48.443 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.450+0000 7f9c2ae6d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:48.443 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.450+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c240c7dd0 con 0x7f9c24155dc0 2026-02-17T21:05:48.454 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.462+0000 7f9c197fa640 1 -- 10.20.193.45:0/716632972 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f9c14062030 con 0x7f9c24155dc0 2026-02-17T21:05:48.454 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.462+0000 7f9c197fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:48.454 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.462+0000 7f9c197fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:48.454 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:05:48.454 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:05:48.457 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 10 librados: watch_flush enter 2026-02-17T21:05:48.457 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 10 librados: watch_flush exit 2026-02-17T21:05:48.457 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 20 client.4283.objecter shutdown clearing up homeless session... 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 10 client.4283.objecter successfully canceled tick 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9bf40791f0 msgr2=0x7f9bf407b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9bf40791f0 0x7f9bf407b6b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c007b60 tx=0x7f9c0c007ab0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 10 monclient: shutdown 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c24155dc0 msgr2=0x7f9c241592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c24155dc0 0x7f9c241592c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400e8a0 tx=0x7f9c1400ed70 comp rx=0 tx=0).stop 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 shutdown_connections 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9bf40791f0 0x7f9bf407b6b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c2415f590 0x7f9c24150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.458 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c241561a0 0x7f9c241f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.459 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 --2- 10.20.193.45:0/716632972 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c24155dc0 0x7f9c241592c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:48.459 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 >> 10.20.193.45:0/716632972 conn(0x7f9c240c9ed0 msgr2=0x7f9c2406e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:48.459 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 shutdown_connections 2026-02-17T21:05:48.459 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 -- 10.20.193.45:0/716632972 wait complete. 2026-02-17T21:05:48.459 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:48.464+0000 7f9c2ae6d640 1 librados: shutdown 2026-02-17T21:05:48.467 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:05:56.079 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:05:56.143 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.151+0000 7fab904bd640 10 monclient: get_monmap_and_config 2026-02-17T21:05:56.143 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.151+0000 7fab904bd640 10 monclient: build_initial_monmap 2026-02-17T21:05:56.143 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.151+0000 7fab904bd640 10 monclient: monmap: 2026-02-17T21:05:56.143 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:56.143 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:56.143 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:05:56.152068+0000 2026-02-17T21:05:56.143 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:05:56.152068+0000 2026-02-17T21:05:56.144 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:56.144 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:56.144 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:05:56.144 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:05:56.144 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:05:56.144 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:05:56.144 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:05:56.144 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:05:56.144 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:56.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.151+0000 7fab904bd640 1 Processor -- start 2026-02-17T21:05:56.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.151+0000 7fab904bd640 1 -- start start 2026-02-17T21:05:56.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.151+0000 7fab904bd640 10 monclient: init 2026-02-17T21:05:56.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:56.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 10 monclient: _add_conns ranks=[1,5,4,2,0,3] 2026-02-17T21:05:56.147 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fab8815f600 addr v1:10.20.193.86:6789/0 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fab88160040 0x7fab8815f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 10 monclient(hunting): picked mon.noname-c con 0x7fab88160040 addr v2:10.20.193.92:3300/0 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fab880d2420 0x7fab880d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 10 monclient(hunting): picked mon.noname-b con 0x7fab880d2420 addr v2:10.20.193.86:3300/0 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab880ca2c0 con 0x7fab8815f600 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fab880d2870 con 0x7fab880d2420 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fab880cf9a0 con 0x7fab88160040 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:56.148 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.152+0000 7fab904bd640 10 monclient(hunting): authenticate will time out at 939.782456s 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8da31640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fab88160040 0x7fab8815f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8e232640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fab8815f600 0x7fab880c9780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:33160/0 (socket says 10.20.193.45:33160) 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8ea33640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fab880d2420 0x7fab880d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8e232640 1 -- 10.20.193.45:0/769856926 learned_addr learned my addr 10.20.193.45:0/769856926 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8da31640 10 monclient(hunting): get_auth_request con 0x7fab88160040 auth_method 0 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8da31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8da31640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8da31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8ea33640 10 monclient(hunting): get_auth_request con 0x7fab880d2420 auth_method 0 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8ea33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8ea33640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8ea33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:56.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8da31640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8da31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.153+0000 7fab8da31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.154+0000 7fab8ea33640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.154+0000 7fab8ea33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.154+0000 7fab8ea33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.155+0000 7fab8da31640 10 monclient(hunting): handle_auth_done global_id 4286 payload 274 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.155+0000 7fab8da31640 1 -- 10.20.193.45:0/769856926 >> v2:10.20.193.86:3300/0 conn(0x7fab880d2420 msgr2=0x7fab880d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.155+0000 7fab8da31640 1 --2- 10.20.193.45:0/769856926 >> v2:10.20.193.86:3300/0 conn(0x7fab880d2420 0x7fab880d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.155+0000 7fab8da31640 1 -- 10.20.193.45:0/769856926 >> v1:10.20.193.86:6789/0 conn(0x7fab8815f600 legacy=0x7fab880c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.155+0000 7fab8da31640 10 monclient: _finish_hunting 0 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.155+0000 7fab8da31640 1 monclient: found mon.noname-c 2026-02-17T21:05:56.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.155+0000 7fab8da31640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:56.151 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.155+0000 7fab8da31640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:56.151 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.155+0000 7fab8da31640 1 -- 10.20.193.45:0/769856926 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab880cfc80 con 0x7fab88160040 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.156+0000 7fab8da31640 1 --2- 10.20.193.45:0/769856926 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 0x7fab8815f9e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab8806fa90 tx=0x7fab7c02eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e89328c6888dfdd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 1 -- 10.20.193.45:0/769856926 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c03c070 con 0x7fab88160040 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 10 monclient: dump: 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:56.156 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:56.157 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:56.157 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:56.157 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:56.157 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:56.157 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:56.157 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 10 monclient: _finish_auth 0 2026-02-17T21:05:56.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 10 monclient: _check_auth_tickets 2026-02-17T21:05:56.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:56.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 1 -- 10.20.193.45:0/769856926 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c02fb80 con 0x7fab88160040 2026-02-17T21:05:56.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:56.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 1 -- 10.20.193.45:0/769856926 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c037440 con 0x7fab88160040 2026-02-17T21:05:56.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 5 monclient: authenticate success, global_id 4286 2026-02-17T21:05:56.158 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 10 monclient: get_monmap_and_config success 2026-02-17T21:05:56.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 4 set_mon_vals no callback set 2026-02-17T21:05:56.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:56.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:56.159 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab8d230640 10 monclient: dump: 2026-02-17T21:05:56.159 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:56.160 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:56.160 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:56.160 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:56.160 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:56.160 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:56.160 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:56.160 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:56.161 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:56.161 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:56.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 10 monclient: shutdown 2026-02-17T21:05:56.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:56.161 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 -- 10.20.193.45:0/769856926 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 msgr2=0x7fab8815f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:56.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 --2- 10.20.193.45:0/769856926 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 0x7fab8815f9e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab8806fa90 tx=0x7fab7c02eeb0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 -- 10.20.193.45:0/769856926 shutdown_connections 2026-02-17T21:05:56.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 --2- 10.20.193.45:0/769856926 >> v2:10.20.193.86:3300/0 conn(0x7fab880d2420 0x7fab880d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 --2- 10.20.193.45:0/769856926 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 0x7fab8815f9e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 -- 10.20.193.45:0/769856926 >> 10.20.193.45:0/769856926 conn(0x7fab880d1900 msgr2=0x7fab880d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:56.162 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 -- 10.20.193.45:0/769856926 shutdown_connections 2026-02-17T21:05:56.163 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 -- 10.20.193.45:0/769856926 wait complete. 2026-02-17T21:05:56.163 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 10 monclient: build_initial_monmap 2026-02-17T21:05:56.163 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 10 monclient: monmap: 2026-02-17T21:05:56.163 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:05:56.163 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:05:56.163 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:05:56.164 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:05:56.164 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:05:56.164 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:56.164 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:05:56.164 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:05:56.164 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:05:56.165 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:56.165 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 librados: starting msgr at 2026-02-17T21:05:56.165 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.158+0000 7fab904bd640 1 librados: starting objecter 2026-02-17T21:05:56.165 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 Processor -- start 2026-02-17T21:05:56.165 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 -- start start 2026-02-17T21:05:56.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 librados: setting wanted keys 2026-02-17T21:05:56.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 librados: calling monclient init 2026-02-17T21:05:56.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient: init 2026-02-17T21:05:56.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:05:56.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:05:56.166 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fab880d2420 0x7fab88145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:56.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient(hunting): picked mon.noname-a con 0x7fab880d2420 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:05:56.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fab8815f600 0x7fab88143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:56.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient(hunting): picked mon.noname-b con 0x7fab8815f600 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:05:56.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 0x7fab881f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:56.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient(hunting): picked mon.noname-c con 0x7fab88160040 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:05:56.167 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:56.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fab880c9e90 con 0x7fab880d2420 2026-02-17T21:05:56.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:56.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fab880d0240 con 0x7fab8815f600 2026-02-17T21:05:56.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:05:56.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab880ca010 con 0x7fab88160040 2026-02-17T21:05:56.168 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:05:56.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab904bd640 10 monclient(hunting): authenticate will time out at 939.789462s 2026-02-17T21:05:56.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab8da31640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fab8815f600 0x7fab88143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:56.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab8ea33640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 0x7fab881f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:56.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab8da31640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fab8815f600 0x7fab88143570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:33680/0 (socket says 10.20.193.45:33680) 2026-02-17T21:05:56.169 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab8da31640 1 -- 10.20.193.45:0/173250223 learned_addr learned my addr 10.20.193.45:0/173250223 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:05:56.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab8da31640 10 monclient(hunting): get_auth_request con 0x7fab8815f600 auth_method 0 2026-02-17T21:05:56.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab8da31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:56.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab8da31640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:56.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab8da31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:56.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.159+0000 7fab8e232640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fab880d2420 0x7fab88145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:56.170 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8ea33640 10 monclient(hunting): get_auth_request con 0x7fab88160040 auth_method 0 2026-02-17T21:05:56.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8ea33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:56.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8ea33640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:56.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8ea33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:56.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8da31640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:56.171 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8da31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:56.172 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8da31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:56.172 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8e232640 10 monclient(hunting): get_auth_request con 0x7fab880d2420 auth_method 0 2026-02-17T21:05:56.172 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8e232640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:05:56.172 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8e232640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:05:56.172 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8e232640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:05:56.172 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8ea33640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:56.173 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8ea33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:56.173 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8ea33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:56.173 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8e232640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:05:56.173 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8e232640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:05:56.173 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.160+0000 7fab8e232640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:05:56.173 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 10 monclient(hunting): handle_auth_done global_id 4289 payload 824 2026-02-17T21:05:56.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 1 -- 10.20.193.45:0/173250223 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fab8815f600 msgr2=0x7fab88143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:56.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fab8815f600 0x7fab88143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 1 -- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fab880d2420 msgr2=0x7fab88145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:56.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fab880d2420 0x7fab88145080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 10 monclient: _finish_hunting 0 2026-02-17T21:05:56.174 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 1 monclient: found mon.noname-c 2026-02-17T21:05:56.175 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:05:56.175 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:05:56.175 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.161+0000 7fab8ea33640 1 -- 10.20.193.45:0/173250223 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab88143c60 con 0x7fab88160040 2026-02-17T21:05:56.175 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.162+0000 7fab8ea33640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 0x7fab881f43a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab8400eba0 tx=0x7fab8400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:56.175 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.162+0000 7fab6effd640 10 client.?.objecter ms_handle_connect 0x7fab88160040 2026-02-17T21:05:56.176 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.162+0000 7fab6effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:05:56.180 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 1 -- 10.20.193.45:0/173250223 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84018020 con 0x7fab88160040 2026-02-17T21:05:56.181 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:56.181 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:05:56.181 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 10 monclient: dump: 2026-02-17T21:05:56.181 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:56.181 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:56.181 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:56.182 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:56.182 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:56.182 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:56.182 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:56.182 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:56.182 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:56.182 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:56.183 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 10 monclient: _finish_auth 0 2026-02-17T21:05:56.183 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 10 monclient: _check_auth_tickets 2026-02-17T21:05:56.183 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:05:56.183 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab904bd640 5 monclient: authenticate success, global_id 4289 2026-02-17T21:05:56.183 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 1 -- 10.20.193.45:0/173250223 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8400cd30 con 0x7fab88160040 2026-02-17T21:05:56.183 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:05:56.183 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 1 -- 10.20.193.45:0/173250223 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab840146c0 con 0x7fab88160040 2026-02-17T21:05:56.184 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:05:56.184 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab8ca2f640 4 set_mon_vals no callback set 2026-02-17T21:05:56.184 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:05:56.184 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab6effd640 10 monclient: dump: 2026-02-17T21:05:56.184 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:05:56.184 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:05:56.184 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:56.185 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:05:56.185 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:05:56.185 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:05:56.185 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:05:56.185 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:05:56.185 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:05:56.185 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:05:56.186 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab904bd640 10 monclient: _renew_subs 2026-02-17T21:05:56.186 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab904bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:56.186 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab88143f40 con 0x7fab88160040 2026-02-17T21:05:56.186 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab904bd640 10 client.4289.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:05:56.186 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab904bd640 10 monclient: _renew_subs 2026-02-17T21:05:56.186 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab904bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:56.186 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab88144500 con 0x7fab88160040 2026-02-17T21:05:56.186 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.164+0000 7fab904bd640 1 librados: init done 2026-02-17T21:05:56.187 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.165+0000 7fab904bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:56.187 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.165+0000 7fab904bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:56.187 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.165+0000 7fab904bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:56.187 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.165+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8815f9e0 con 0x7fab88160040 2026-02-17T21:05:56.187 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.177+0000 7fab6effd640 1 -- 10.20.193.45:0/173250223 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7fab84014860 con 0x7fab88160040 2026-02-17T21:05:56.187 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.177+0000 7fab6effd640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fab58079220 0x7fab5807b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:05:56.187 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.178+0000 7fab8e232640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fab58079220 0x7fab5807b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:05:56.187 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.178+0000 7fab8e232640 10 monclient: get_auth_request con 0x7fab58079220 auth_method 0 2026-02-17T21:05:56.188 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.178+0000 7fab8e232640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fab58079220 0x7fab5807b6e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fab78002770 tx=0x7fab78009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:05:56.188 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.178+0000 7fab6effd640 10 client.4289.objecter ms_handle_connect 0x7fab58079220 2026-02-17T21:05:56.188 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.180+0000 7fab6effd640 1 -- 10.20.193.45:0/173250223 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fab8405f110 con 0x7fab88160040 2026-02-17T21:05:56.188 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.180+0000 7fab6effd640 10 client.4289.objecter ms_dispatch2 0x7fab88000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:05:56.188 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.180+0000 7fab6effd640 3 client.4289.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:05:56.188 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.180+0000 7fab6effd640 3 client.4289.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:05:56.188 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.180+0000 7fab6effd640 20 client.4289.objecter dump_active .. 0 homeless 2026-02-17T21:05:56.277 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.285+0000 7fab6effd640 1 -- 10.20.193.45:0/173250223 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fab84022030 con 0x7fab88160040 2026-02-17T21:05:56.277 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.285+0000 7fab6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:05:56.277 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.285+0000 7fab6effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:05:56.366 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.374+0000 7fab904bd640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:56.366 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.374+0000 7fab904bd640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:56.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.374+0000 7fab904bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:05:56.367 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.374+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab88150290 con 0x7fab88160040 2026-02-17T21:05:56.378 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.386+0000 7fab6effd640 1 -- 10.20.193.45:0/173250223 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fab84010040 con 0x7fab88160040 2026-02-17T21:05:56.378 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.386+0000 7fab6effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:05:56.378 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.386+0000 7fab6effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:05:56.379 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:05:56.379 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.388+0000 7fab904bd640 10 librados: watch_flush enter 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.388+0000 7fab904bd640 10 librados: watch_flush exit 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.388+0000 7fab904bd640 20 client.4289.objecter shutdown clearing up homeless session... 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.388+0000 7fab904bd640 10 client.4289.objecter successfully canceled tick 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fab58079220 msgr2=0x7fab5807b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fab58079220 0x7fab5807b6e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fab78002770 tx=0x7fab78009040 comp rx=0 tx=0).stop 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 10 monclient: shutdown 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 msgr2=0x7fab881f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:05:56.382 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 0x7fab881f43a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab8400eba0 tx=0x7fab8400c490 comp rx=0 tx=0).stop 2026-02-17T21:05:56.383 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 shutdown_connections 2026-02-17T21:05:56.383 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fab58079220 0x7fab5807b6e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.383 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fab88160040 0x7fab881f43a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.383 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fab8815f600 0x7fab88143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.383 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 --2- 10.20.193.45:0/173250223 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fab880d2420 0x7fab88145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:05:56.383 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 >> 10.20.193.45:0/173250223 conn(0x7fab880d1900 msgr2=0x7fab880d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:05:56.383 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 shutdown_connections 2026-02-17T21:05:56.383 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 -- 10.20.193.45:0/173250223 wait complete. 2026-02-17T21:05:56.383 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:05:56.389+0000 7fab904bd640 1 librados: shutdown 2026-02-17T21:05:56.390 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:05:57.636 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:35.218 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:57.660 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:35.244 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:57.716 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:35.297 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:57.948 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:35.518 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.034 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:35.607 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.034 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:35.612 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.090 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:35.643 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.142 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:35.695 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.290 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:35.928 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.310 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:35.886 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.462 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:36.031 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.486 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:36.126 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.495 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:36.048 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.578 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:36.140 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:58.751 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:36.305 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:05:59.176 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:36.743 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.272 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:37.854 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.309 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:37.891 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.312 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:37.895 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.329 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:37.911 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.351 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:37.935 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.378 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:37.959 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.381 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:37.962 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.386 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:37.969 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.389 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:37.973 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.599 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:38.169 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.682 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:38.260 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.687 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:38.241 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.729 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:38.303 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.776 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:38.349 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.779 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:38.353 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.863 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:38.433 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.867 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:38.436 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.867 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:38.421 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.906 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:38.459 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.909 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:38.462 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.945 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:38.521 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.954 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:38.532 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.954 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:38.507 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.957 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:38.510 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.957 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:38.535 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:00.973 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:38.611 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.071 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:38.639 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.097 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:38.737 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.102 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:38.670 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.105 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:38.673 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.125 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:38.679 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.127 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:38.767 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.130 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:38.770 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.208 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:38.770 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.219 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:38.795 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.222 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:38.798 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.238 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:38.801 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.241 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:38.804 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.259 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:38.897 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.262 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:38.900 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.375 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:38.929 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.412 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:38.965 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.415 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:38.968 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.670 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:39.223 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.673 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:39.226 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:01.898 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:39.464 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.136 INFO:tasks.ceph.osd.12.trial045.stderr:==00:00:00:39.718 27120== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.138 INFO:tasks.ceph.osd.1.trial086.stderr:==00:00:00:39.719 26843== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.172 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:39.739 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.175 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:39.742 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.194 INFO:tasks.ceph.osd.8.trial045.stderr:==00:00:00:39.778 27118== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.502 INFO:tasks.ceph.osd.3.trial138.stderr:==00:00:00:40.055 27174== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.564 INFO:tasks.ceph.osd.13.trial086.stderr:==00:00:00:40.138 26846== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.632 INFO:tasks.ceph.osd.7.trial138.stderr:==00:00:00:40.185 27175== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.655 INFO:tasks.ceph.osd.5.trial086.stderr:==00:00:00:40.233 26844== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.669 INFO:tasks.ceph.osd.2.trial092.stderr:==00:00:00:40.238 26538== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.800 INFO:tasks.ceph.osd.0.trial045.stderr:==00:00:00:40.440 27044== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.801 INFO:tasks.ceph.osd.9.trial086.stderr:==00:00:00:40.377 26845== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.816 INFO:tasks.ceph.osd.6.trial092.stderr:==00:00:00:40.384 26539== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:02.937 INFO:tasks.ceph.osd.4.trial045.stderr:==00:00:00:40.575 27045== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:03.025 INFO:tasks.ceph.osd.15.trial138.stderr:==00:00:00:40.578 27177== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:03.066 INFO:tasks.ceph.osd.14.trial092.stderr:==00:00:00:40.628 26541== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:03.353 INFO:tasks.ceph.osd.11.trial138.stderr:==00:00:00:40.906 27176== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:03.981 INFO:tasks.ceph.osd.10.trial092.stderr:==00:00:00:41.547 26540== Warning: unimplemented fcntl command: 1038 2026-02-17T21:06:04.002 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:06:04.065 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.073+0000 7f2dc05f7640 10 monclient: get_monmap_and_config 2026-02-17T21:06:04.065 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.073+0000 7f2dc05f7640 10 monclient: build_initial_monmap 2026-02-17T21:06:04.065 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.073+0000 7f2dc05f7640 10 monclient: monmap: 2026-02-17T21:06:04.065 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:04.065 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:04.065 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:06:04.073889+0000 2026-02-17T21:06:04.065 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:06:04.073889+0000 2026-02-17T21:06:04.065 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:04.066 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:04.066 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:06:04.066 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:06:04.066 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:06:04.066 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:06:04.066 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:06:04.066 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:06:04.066 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.073+0000 7f2dc05f7640 1 Processor -- start 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.073+0000 7f2dc05f7640 1 -- start start 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.073+0000 7f2dc05f7640 10 monclient: init 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.073+0000 7f2dc05f7640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.073+0000 7f2dc05f7640 10 monclient: _add_conns ranks=[5,0,4,3,1,2] 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f2db815f600 0x7f2db815f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 10 monclient(hunting): picked mon.noname-c con 0x7f2db815f600 addr v2:10.20.193.92:3300/0 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2db8160040 addr v1:10.20.193.45:6789/0 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f2db80d2420 0x7f2db80d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:04.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 10 monclient(hunting): picked mon.noname-b con 0x7f2db80d2420 addr v2:10.20.193.86:3300/0 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2db80ca2c0 con 0x7f2db8160040 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f2db80d2870 con 0x7f2db80d2420 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f2db80cf9a0 con 0x7f2db815f600 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dc05f7640 10 monclient(hunting): authenticate will time out at 947.704065s 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbdb6b640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f2db8160040 0x7f2db80c9780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58928/0 (socket says 10.20.193.45:58928) 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbdb6b640 1 -- 10.20.193.45:0/1803569897 learned_addr learned my addr 10.20.193.45:0/1803569897 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbe36c640 1 --2- 10.20.193.45:0/1803569897 >> v2:10.20.193.92:3300/0 conn(0x7f2db815f600 0x7f2db815f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbeb6d640 1 --2- 10.20.193.45:0/1803569897 >> v2:10.20.193.86:3300/0 conn(0x7f2db80d2420 0x7f2db80d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:04.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbe36c640 10 monclient(hunting): get_auth_request con 0x7f2db815f600 auth_method 0 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbe36c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbe36c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbe36c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbeb6d640 10 monclient(hunting): get_auth_request con 0x7f2db80d2420 auth_method 0 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbeb6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbeb6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.074+0000 7f2dbeb6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbe36c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbe36c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbe36c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbeb6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:04.072 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbeb6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbeb6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbd36a640 1 -- 10.20.193.45:0/1803569897 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785534185 0 0) 0x7f2db80ca2c0 con 0x7f2db8160040 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbd36a640 10 monclient(hunting): _negotiate 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbd36a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbd36a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbd36a640 10 monclient(hunting): my global_id is 4245 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.075+0000 7f2dbd36a640 1 -- 10.20.193.45:0/1803569897 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2da0003620 con 0x7f2db8160040 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.076+0000 7f2dbe36c640 10 monclient(hunting): handle_auth_done global_id 4292 payload 274 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.076+0000 7f2dbe36c640 1 -- 10.20.193.45:0/1803569897 >> v2:10.20.193.86:3300/0 conn(0x7f2db80d2420 msgr2=0x7f2db80d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.076+0000 7f2dbe36c640 1 --2- 10.20.193.45:0/1803569897 >> v2:10.20.193.86:3300/0 conn(0x7f2db80d2420 0x7f2db80d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.076+0000 7f2dbe36c640 1 -- 10.20.193.45:0/1803569897 >> v1:10.20.193.45:6789/0 conn(0x7f2db8160040 legacy=0x7f2db80c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.076+0000 7f2dbe36c640 10 monclient: _finish_hunting 0 2026-02-17T21:06:04.073 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.076+0000 7f2dbe36c640 1 monclient: found mon.noname-c 2026-02-17T21:06:04.074 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.076+0000 7f2dbe36c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:04.074 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.076+0000 7f2dbe36c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:06:04.074 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.076+0000 7f2dbe36c640 1 -- 10.20.193.45:0/1803569897 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db80cfc80 con 0x7f2db815f600 2026-02-17T21:06:04.074 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.077+0000 7f2dbe36c640 1 --2- 10.20.193.45:0/1803569897 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2db815f600 0x7f2db815f9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2db808f1a0 tx=0x7f2da802eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffd7304191e991a5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:04.080 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 1 -- 10.20.193.45:0/1803569897 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da803c070 con 0x7f2db815f600 2026-02-17T21:06:04.080 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 10 monclient: dump: 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:04.081 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 10 monclient: _finish_auth 0 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 10 monclient: _check_auth_tickets 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 1 -- 10.20.193.45:0/1803569897 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da802fb80 con 0x7f2db815f600 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 1 -- 10.20.193.45:0/1803569897 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da8037440 con 0x7f2db815f600 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 5 monclient: authenticate success, global_id 4292 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 10 monclient: get_monmap_and_config success 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 4 set_mon_vals no callback set 2026-02-17T21:06:04.082 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dbd36a640 10 monclient: dump: 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:04.083 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 10 monclient: shutdown 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 1 -- 10.20.193.45:0/1803569897 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2db815f600 msgr2=0x7f2db815f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 1 --2- 10.20.193.45:0/1803569897 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2db815f600 0x7f2db815f9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2db808f1a0 tx=0x7f2da802eeb0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 1 -- 10.20.193.45:0/1803569897 shutdown_connections 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 1 --2- 10.20.193.45:0/1803569897 >> v2:10.20.193.86:3300/0 conn(0x7f2db80d2420 0x7f2db80d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 1 --2- 10.20.193.45:0/1803569897 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2db815f600 0x7f2db815f9e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 1 -- 10.20.193.45:0/1803569897 >> 10.20.193.45:0/1803569897 conn(0x7f2db80d1900 msgr2=0x7f2db80d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 1 -- 10.20.193.45:0/1803569897 shutdown_connections 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.079+0000 7f2dc05f7640 1 -- 10.20.193.45:0/1803569897 wait complete. 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient: build_initial_monmap 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient: monmap: 2026-02-17T21:06:04.084 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 librados: starting msgr at 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 librados: starting objecter 2026-02-17T21:06:04.085 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 Processor -- start 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 -- start start 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 librados: setting wanted keys 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 librados: calling monclient init 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient: init 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2db80d2420 0x7f2db81f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient(hunting): picked mon.noname-b con 0x7f2db80d2420 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2db815f600 0x7f2db806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient(hunting): picked mon.noname-c con 0x7f2db815f600 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2db8160040 0x7f2db81f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient(hunting): picked mon.noname-a con 0x7f2db8160040 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:06:04.086 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80c9e90 con 0x7f2db8160040 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80d0240 con 0x7f2db80d2420 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2db80ca010 con 0x7f2db815f600 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.080+0000 7f2dc05f7640 10 monclient(hunting): authenticate will time out at 947.710788s 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2db8160040 0x7f2db81f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbe36c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2db80d2420 0x7f2db81f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbdb6b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2db815f600 0x7f2db806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2db8160040 0x7f2db81f5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:55692/0 (socket says 10.20.193.45:55692) 2026-02-17T21:06:04.087 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 1 -- 10.20.193.45:0/942543705 learned_addr learned my addr 10.20.193.45:0/942543705 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 10 monclient(hunting): get_auth_request con 0x7f2db8160040 auth_method 0 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbe36c640 10 monclient(hunting): get_auth_request con 0x7f2db80d2420 auth_method 0 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbe36c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbe36c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbe36c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbdb6b640 10 monclient(hunting): get_auth_request con 0x7f2db815f600 auth_method 0 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbdb6b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbdb6b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:04.088 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbdb6b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbeb6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbe36c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbe36c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbe36c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbdb6b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbdb6b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.081+0000 7f2dbdb6b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 10 monclient(hunting): handle_auth_done global_id 4248 payload 824 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 1 -- 10.20.193.45:0/942543705 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2db815f600 msgr2=0x7f2db806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2db815f600 0x7f2db806dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.089 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 1 -- 10.20.193.45:0/942543705 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2db80d2420 msgr2=0x7f2db81f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2db80d2420 0x7f2db81f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 10 monclient: _finish_hunting 0 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 1 monclient: found mon.noname-a 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.083+0000 7f2dbeb6d640 1 -- 10.20.193.45:0/942543705 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db81574a0 con 0x7f2db8160040 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.084+0000 7f2dbeb6d640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2db8160040 0x7f2db81f5280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009d30 tx=0x7f2db400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.084+0000 7f2d9effd640 10 client.?.objecter ms_handle_connect 0x7f2db8160040 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.084+0000 7f2d9effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2d9effd640 1 -- 10.20.193.45:0/942543705 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4018020 con 0x7f2db8160040 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2d9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2d9effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:06:04.090 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2d9effd640 10 monclient: dump: 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2d9effd640 10 monclient: _finish_auth 0 2026-02-17T21:06:04.091 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2d9effd640 10 monclient: _check_auth_tickets 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2d9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 5 monclient: authenticate success, global_id 4248 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 10 monclient: _renew_subs 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db8157780 con 0x7f2db8160040 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 10 client.4248.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 10 monclient: _renew_subs 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db8157d40 con 0x7f2db8160040 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 1 librados: init done 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:04.092 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.085+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db81604e0 con 0x7f2db8160040 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.086+0000 7f2d9effd640 1 -- 10.20.193.45:0/942543705 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db4014480 con 0x7f2db8160040 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.086+0000 7f2d9effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.086+0000 7f2d9effd640 1 -- 10.20.193.45:0/942543705 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4014830 con 0x7f2db8160040 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.086+0000 7f2d9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.086+0000 7f2d9effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.086+0000 7f2d9effd640 10 monclient: dump: 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:04.093 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:04.094 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:04.094 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:04.094 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:04.094 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:04.094 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.086+0000 7f2dbcb69640 4 set_mon_vals no callback set 2026-02-17T21:06:04.190 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.198+0000 7f2d9effd640 1 -- 10.20.193.45:0/942543705 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7f2db40149d0 con 0x7f2db8160040 2026-02-17T21:06:04.191 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.199+0000 7f2d9effd640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d880791f0 0x7f2d8807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:04.191 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.199+0000 7f2dbe36c640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d880791f0 0x7f2d8807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:04.192 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.199+0000 7f2dbe36c640 10 monclient: get_auth_request con 0x7f2d880791f0 auth_method 0 2026-02-17T21:06:04.192 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.199+0000 7f2dbe36c640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d880791f0 0x7f2d8807b6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2da8039000 tx=0x7f2da8033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:04.192 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.199+0000 7f2d9effd640 10 client.4248.objecter ms_handle_connect 0x7f2d880791f0 2026-02-17T21:06:04.201 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.208+0000 7f2d9effd640 1 -- 10.20.193.45:0/942543705 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f2db405f3c0 con 0x7f2db8160040 2026-02-17T21:06:04.201 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.208+0000 7f2d9effd640 10 client.4248.objecter ms_dispatch2 0x7f2db8000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:06:04.201 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.208+0000 7f2d9effd640 3 client.4248.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:06:04.201 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.208+0000 7f2d9effd640 3 client.4248.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:06:04.201 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.208+0000 7f2d9effd640 20 client.4248.objecter dump_active .. 0 homeless 2026-02-17T21:06:04.201 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.208+0000 7f2d9effd640 1 -- 10.20.193.45:0/942543705 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2db81604e0 con 0x7f2db8160040 2026-02-17T21:06:04.201 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.208+0000 7f2d9effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:04.201 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.208+0000 7f2d9effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:06:04.285 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.292+0000 7f2dc05f7640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:04.285 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.292+0000 7f2dc05f7640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:04.285 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.292+0000 7f2dc05f7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:04.285 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.292+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2db815f9e0 con 0x7f2db8160040 2026-02-17T21:06:04.297 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.305+0000 7f2d9effd640 1 -- 10.20.193.45:0/942543705 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f2db4022070 con 0x7f2db8160040 2026-02-17T21:06:04.297 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.305+0000 7f2d9effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:04.297 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.305+0000 7f2d9effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:06:04.298 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:06:04.298 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:06:04.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 10 librados: watch_flush enter 2026-02-17T21:06:04.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 10 librados: watch_flush exit 2026-02-17T21:06:04.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 20 client.4248.objecter shutdown clearing up homeless session... 2026-02-17T21:06:04.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 10 client.4248.objecter successfully canceled tick 2026-02-17T21:06:04.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d880791f0 msgr2=0x7f2d8807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:04.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d880791f0 0x7f2d8807b6b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2da8039000 tx=0x7f2da8033000 comp rx=0 tx=0).stop 2026-02-17T21:06:04.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 10 monclient: shutdown 2026-02-17T21:06:04.300 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2db8160040 msgr2=0x7f2db81f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2db8160040 0x7f2db81f5280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2db4009d30 tx=0x7f2db400c490 comp rx=0 tx=0).stop 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 shutdown_connections 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d880791f0 0x7f2d8807b6b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2db8160040 0x7f2db81f5280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2db815f600 0x7f2db806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 --2- 10.20.193.45:0/942543705 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2db80d2420 0x7f2db81f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 >> 10.20.193.45:0/942543705 conn(0x7f2db80d1900 msgr2=0x7f2db80d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 shutdown_connections 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 -- 10.20.193.45:0/942543705 wait complete. 2026-02-17T21:06:04.301 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:04.307+0000 7f2dc05f7640 1 librados: shutdown 2026-02-17T21:06:04.307 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:06:09.697 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:16.910 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:09.728 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:16.942 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:09.747 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:01:16.956 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:09.750 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:01:16.924 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:09.775 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:01:16.984 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:09.778 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:01:16.952 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:09.847 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:17.060 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:09.896 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:01:17.105 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:09.899 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:01:17.073 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:11.920 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:06:11.985 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.993+0000 7ffae3605640 10 monclient: get_monmap_and_config 2026-02-17T21:06:11.986 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.993+0000 7ffae3605640 10 monclient: build_initial_monmap 2026-02-17T21:06:11.986 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.993+0000 7ffae3605640 10 monclient: monmap: 2026-02-17T21:06:11.986 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:11.986 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:11.986 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:06:11.994448+0000 2026-02-17T21:06:11.986 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:06:11.994448+0000 2026-02-17T21:06:11.986 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:11.986 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:11.987 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:06:11.987 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:06:11.987 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:06:11.987 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:06:11.987 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:06:11.987 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:06:11.987 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:11.990 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 1 Processor -- start 2026-02-17T21:06:11.991 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 1 -- start start 2026-02-17T21:06:11.991 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 10 monclient: init 2026-02-17T21:06:11.991 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:11.991 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 10 monclient: _add_conns ranks=[4,0,2,1,3,5] 2026-02-17T21:06:11.991 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ffadc153bf0 0x7ffadc153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:11.991 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 10 monclient(hunting): picked mon.noname-b con 0x7ffadc153bf0 addr v2:10.20.193.86:3300/0 2026-02-17T21:06:11.991 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ffadc0c7dd0 addr v1:10.20.193.45:6789/0 2026-02-17T21:06:11.991 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ffadc15b950 addr v1:10.20.193.92:6789/0 2026-02-17T21:06:11.991 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffadc0c8810 con 0x7ffadc0c7dd0 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffadc0c8af0 con 0x7ffadc15b950 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ffadc0c9700 con 0x7ffadc153bf0 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae3605640 10 monclient(hunting): authenticate will time out at 955.624652s 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae0b79640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7ffadc0c7dd0 0x7ffadc15b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:41998/0 (socket says 10.20.193.45:41998) 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.994+0000 7ffae0b79640 1 -- 10.20.193.45:0/1585013558 learned_addr learned my addr 10.20.193.45:0/1585013558 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.995+0000 7ffae137a640 1 --2- 10.20.193.45:0/1585013558 >> v2:10.20.193.86:3300/0 conn(0x7ffadc153bf0 0x7ffadc153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.995+0000 7ffae137a640 10 monclient(hunting): get_auth_request con 0x7ffadc153bf0 auth_method 0 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.995+0000 7ffae137a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.995+0000 7ffae137a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:11.992 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.995+0000 7ffae137a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.995+0000 7ffae137a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.995+0000 7ffae137a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.995+0000 7ffae137a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.996+0000 7ffacbfff640 1 -- 10.20.193.45:0/1585013558 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994158783 0 0) 0x7ffadc0c8810 con 0x7ffadc0c7dd0 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.996+0000 7ffacbfff640 10 monclient(hunting): _negotiate 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.996+0000 7ffacbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.996+0000 7ffacbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.996+0000 7ffacbfff640 10 monclient(hunting): my global_id is 4251 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.996+0000 7ffacbfff640 1 -- 10.20.193.45:0/1585013558 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffac4003620 con 0x7ffadc0c7dd0 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffacbfff640 1 -- 10.20.193.45:0/1585013558 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565273710 0 0) 0x7ffadc0c8af0 con 0x7ffadc15b950 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffacbfff640 10 monclient(hunting): _negotiate 2026-02-17T21:06:11.993 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffacbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffacbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffacbfff640 10 monclient(hunting): my global_id is 4298 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffacbfff640 1 -- 10.20.193.45:0/1585013558 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffadc0c8810 con 0x7ffadc15b950 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffae137a640 10 monclient(hunting): handle_auth_done global_id 4273 payload 274 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffae137a640 1 -- 10.20.193.45:0/1585013558 >> v1:10.20.193.92:6789/0 conn(0x7ffadc15b950 legacy=0x7ffadc0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffae137a640 1 -- 10.20.193.45:0/1585013558 >> v1:10.20.193.45:6789/0 conn(0x7ffadc0c7dd0 legacy=0x7ffadc15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffae137a640 10 monclient: _finish_hunting 0 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffae137a640 1 monclient: found mon.noname-b 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffae137a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffae137a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.997+0000 7ffae137a640 1 -- 10.20.193.45:0/1585013558 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffadc0c8dd0 con 0x7ffadc153bf0 2026-02-17T21:06:11.994 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.998+0000 7ffae137a640 1 --2- 10.20.193.45:0/1585013558 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc153bf0 0x7ffadc153fd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0098a0 tx=0x7ffacc02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20a69b9c31ca73e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:12.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.999+0000 7ffacbfff640 1 -- 10.20.193.45:0/1585013558 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc03c070 con 0x7ffadc153bf0 2026-02-17T21:06:12.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.999+0000 7ffacbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:12.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.999+0000 7ffacbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.999+0000 7ffacbfff640 10 monclient: dump: 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:12.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.999+0000 7ffacbfff640 10 monclient: _finish_auth 0 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.999+0000 7ffacbfff640 10 monclient: _check_auth_tickets 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.999+0000 7ffacbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.999+0000 7ffae3605640 5 monclient: authenticate success, global_id 4273 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:11.999+0000 7ffae3605640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffacbfff640 1 -- 10.20.193.45:0/1585013558 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffacc02fb70 con 0x7ffadc153bf0 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffacbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffacbfff640 1 -- 10.20.193.45:0/1585013558 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffacc037440 con 0x7ffadc153bf0 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffacbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffacbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffacbfff640 10 monclient: dump: 2026-02-17T21:06:12.002 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 10 monclient: get_monmap_and_config success 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 4 set_mon_vals no callback set 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 10 monclient: shutdown 2026-02-17T21:06:12.003 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 1 -- 10.20.193.45:0/1585013558 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc153bf0 msgr2=0x7ffadc153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 1 --2- 10.20.193.45:0/1585013558 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc153bf0 0x7ffadc153fd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0098a0 tx=0x7ffacc02ee60 comp rx=0 tx=0).stop 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 1 -- 10.20.193.45:0/1585013558 shutdown_connections 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 1 --2- 10.20.193.45:0/1585013558 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc153bf0 0x7ffadc153fd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 1 -- 10.20.193.45:0/1585013558 >> 10.20.193.45:0/1585013558 conn(0x7ffadc0c9ed0 msgr2=0x7ffadc0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 1 -- 10.20.193.45:0/1585013558 shutdown_connections 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 1 -- 10.20.193.45:0/1585013558 wait complete. 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 10 monclient: build_initial_monmap 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.001+0000 7ffae3605640 10 monclient: monmap: 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:06:12.004 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 librados: starting msgr at 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 librados: starting objecter 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 Processor -- start 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 -- start start 2026-02-17T21:06:12.005 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 librados: setting wanted keys 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 librados: calling monclient init 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient: init 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffadc0c7dd0 0x7ffadc0731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient(hunting): picked mon.noname-a con 0x7ffadc0c7dd0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffadc153bf0 0x7ffadc0cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient(hunting): picked mon.noname-c con 0x7ffadc153bf0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc15b950 0x7ffadc1f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient(hunting): picked mon.noname-b con 0x7ffadc15b950 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc0c59e0 con 0x7ffadc0c7dd0 2026-02-17T21:06:12.006 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc0c9390 con 0x7ffadc15b950 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffadc0c5b60 con 0x7ffadc153bf0 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae3605640 10 monclient(hunting): authenticate will time out at 955.632638s 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.002+0000 7ffae137a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffadc0c7dd0 0x7ffadc0731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc15b950 0x7ffadc1f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae0b79640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffadc153bf0 0x7ffadc0cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc15b950 0x7ffadc1f4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:41048/0 (socket says 10.20.193.45:41048) 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 1 -- 10.20.193.45:0/1379659582 learned_addr learned my addr 10.20.193.45:0/1379659582 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 10 monclient(hunting): get_auth_request con 0x7ffadc15b950 auth_method 0 2026-02-17T21:06:12.007 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae137a640 10 monclient(hunting): get_auth_request con 0x7ffadc0c7dd0 auth_method 0 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae137a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae137a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae137a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae0b79640 10 monclient(hunting): get_auth_request con 0x7ffadc153bf0 auth_method 0 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae0b79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae0b79640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae0b79640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae1b7b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:12.008 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae137a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae137a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae137a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae0b79640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae0b79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.003+0000 7ffae0b79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 10 monclient(hunting): handle_auth_done global_id 4276 payload 824 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 1 -- 10.20.193.45:0/1379659582 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffadc153bf0 msgr2=0x7ffadc0cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffadc153bf0 0x7ffadc0cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 1 -- 10.20.193.45:0/1379659582 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffadc0c7dd0 msgr2=0x7ffadc0731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffadc0c7dd0 0x7ffadc0731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 10 monclient: _finish_hunting 0 2026-02-17T21:06:12.009 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 1 monclient: found mon.noname-b 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.005+0000 7ffae1b7b640 1 -- 10.20.193.45:0/1379659582 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffadc0cb360 con 0x7ffadc15b950 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.006+0000 7ffae1b7b640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc15b950 0x7ffadc1f4de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffad800cc20 tx=0x7ffad800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.006+0000 7ffac9ffb640 10 client.?.objecter ms_handle_connect 0x7ffadc15b950 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.006+0000 7ffac9ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffac9ffb640 1 -- 10.20.193.45:0/1379659582 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad800ce40 con 0x7ffadc15b950 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffac9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffac9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffac9ffb640 10 monclient: dump: 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:12.010 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffac9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffac9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffac9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffae3605640 5 monclient: authenticate success, global_id 4276 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffae3605640 10 monclient: _renew_subs 2026-02-17T21:06:12.011 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffae3605640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffadc0cb640 con 0x7ffadc15b950 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffae3605640 10 client.4276.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffae3605640 10 monclient: _renew_subs 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffae3605640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffadc0cbc00 con 0x7ffadc15b950 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.007+0000 7ffae3605640 1 librados: init done 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffae3605640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffae3605640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffae3605640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffadc0c8240 con 0x7ffadc15b950 2026-02-17T21:06:12.012 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffac9ffb640 1 -- 10.20.193.45:0/1379659582 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffad8003a70 con 0x7ffadc15b950 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffac9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffac9ffb640 1 -- 10.20.193.45:0/1379659582 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad80034f0 con 0x7ffadc15b950 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffac9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffac9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffac9ffb640 10 monclient: dump: 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:12.013 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:12.014 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:12.014 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:12.014 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:12.014 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.008+0000 7ffacb7fe640 4 set_mon_vals no callback set 2026-02-17T21:06:12.111 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.119+0000 7ffac9ffb640 1 -- 10.20.193.45:0/1379659582 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7ffad80050d0 con 0x7ffadc15b950 2026-02-17T21:06:12.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.120+0000 7ffac9ffb640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffaac0791f0 0x7ffaac07b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:12.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.120+0000 7ffae137a640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffaac0791f0 0x7ffaac07b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:12.112 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.120+0000 7ffae137a640 10 monclient: get_auth_request con 0x7ffaac0791f0 auth_method 0 2026-02-17T21:06:12.113 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.120+0000 7ffac9ffb640 10 client.4276.objecter ms_handle_connect 0x7ffaac0791f0 2026-02-17T21:06:12.113 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.120+0000 7ffae137a640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffaac0791f0 0x7ffaac07b6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffacc039000 tx=0x7ffacc033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:12.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.123+0000 7ffac9ffb640 1 -- 10.20.193.45:0/1379659582 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7ffad805eaa0 con 0x7ffadc15b950 2026-02-17T21:06:12.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.123+0000 7ffac9ffb640 10 client.4276.objecter ms_dispatch2 0x7ffadc000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:06:12.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.123+0000 7ffac9ffb640 3 client.4276.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:06:12.115 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.123+0000 7ffac9ffb640 3 client.4276.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:06:12.116 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.123+0000 7ffac9ffb640 20 client.4276.objecter dump_active .. 0 homeless 2026-02-17T21:06:12.121 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.129+0000 7ffac9ffb640 1 -- 10.20.193.45:0/1379659582 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ffad8062a60 con 0x7ffadc15b950 2026-02-17T21:06:12.121 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.129+0000 7ffac9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:12.121 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.129+0000 7ffac9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:06:12.211 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.218+0000 7ffae3605640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:12.211 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.218+0000 7ffae3605640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:12.211 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.218+0000 7ffae3605640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:12.211 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.218+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffadc150b00 con 0x7ffadc15b950 2026-02-17T21:06:12.222 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.230+0000 7ffac9ffb640 1 -- 10.20.193.45:0/1379659582 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7ffad8066d60 con 0x7ffadc15b950 2026-02-17T21:06:12.222 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.230+0000 7ffac9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:12.222 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.230+0000 7ffac9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:06:12.222 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:06:12.223 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:06:12.225 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 10 librados: watch_flush enter 2026-02-17T21:06:12.225 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 10 librados: watch_flush exit 2026-02-17T21:06:12.225 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 20 client.4276.objecter shutdown clearing up homeless session... 2026-02-17T21:06:12.225 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 10 client.4276.objecter successfully canceled tick 2026-02-17T21:06:12.225 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffaac0791f0 msgr2=0x7ffaac07b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:12.225 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffaac0791f0 0x7ffaac07b6b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffacc039000 tx=0x7ffacc033000 comp rx=0 tx=0).stop 2026-02-17T21:06:12.225 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 10 monclient: shutdown 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc15b950 msgr2=0x7ffadc1f4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc15b950 0x7ffadc1f4de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffad800cc20 tx=0x7ffad800a430 comp rx=0 tx=0).stop 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 shutdown_connections 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffaac0791f0 0x7ffaac07b6b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffadc15b950 0x7ffadc1f4de0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffadc153bf0 0x7ffadc0cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 --2- 10.20.193.45:0/1379659582 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffadc0c7dd0 0x7ffadc0731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 >> 10.20.193.45:0/1379659582 conn(0x7ffadc0c9ed0 msgr2=0x7ffadc15bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 shutdown_connections 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 -- 10.20.193.45:0/1379659582 wait complete. 2026-02-17T21:06:12.226 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:12.232+0000 7ffae3605640 1 librados: shutdown 2026-02-17T21:06:12.233 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:06:19.844 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:06:19.907 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.914+0000 7fe6523f8640 10 monclient: get_monmap_and_config 2026-02-17T21:06:19.907 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.914+0000 7fe6523f8640 10 monclient: build_initial_monmap 2026-02-17T21:06:19.907 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.914+0000 7fe6523f8640 10 monclient: monmap: 2026-02-17T21:06:19.907 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:06:19.915659+0000 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:06:19.915659+0000 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:06:19.908 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:19.909 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 1 Processor -- start 2026-02-17T21:06:19.909 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 1 -- start start 2026-02-17T21:06:19.909 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient: init 2026-02-17T21:06:19.911 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient: _add_conns ranks=[5,0,3,2,4,1] 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fe64c153bf0 0x7fe64c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient(hunting): picked mon.noname-c con 0x7fe64c153bf0 addr v2:10.20.193.92:3300/0 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe64c0c7dd0 addr v1:10.20.193.45:6789/0 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe64c15b950 0x7fe64c0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient(hunting): picked mon.noname-a con 0x7fe64c15b950 addr v2:10.20.193.45:3300/0 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe64c0c8810 con 0x7fe64c0c7dd0 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe64c0c9700 con 0x7fe64c15b950 2026-02-17T21:06:19.912 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe64c0c8af0 con 0x7fe64c153bf0 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.915+0000 7fe6523f8640 10 monclient(hunting): authenticate will time out at 963.545785s 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe64bfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fe64c153bf0 0x7fe64c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe65096e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe64c15b950 0x7fe64c0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe64b7fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe64c0c7dd0 0x7fe64c15b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:36226/0 (socket says 10.20.193.45:36226) 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe64b7fe640 1 -- 10.20.193.45:0/664056409 learned_addr learned my addr 10.20.193.45:0/664056409 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe64bfff640 10 monclient(hunting): get_auth_request con 0x7fe64c153bf0 auth_method 0 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe64bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe64bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe64bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:19.913 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe65096e640 10 monclient(hunting): get_auth_request con 0x7fe64c15b950 auth_method 0 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe65096e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe65096e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.916+0000 7fe65096e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.917+0000 7fe64bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.917+0000 7fe64bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.917+0000 7fe64bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.917+0000 7fe65096e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.917+0000 7fe65096e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.917+0000 7fe65096e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.918+0000 7fe64bfff640 10 monclient(hunting): handle_auth_done global_id 4304 payload 274 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.918+0000 7fe64bfff640 1 -- 10.20.193.45:0/664056409 >> v2:10.20.193.45:3300/0 conn(0x7fe64c15b950 msgr2=0x7fe64c0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:06:19.914 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.918+0000 7fe64bfff640 1 --2- 10.20.193.45:0/664056409 >> v2:10.20.193.45:3300/0 conn(0x7fe64c15b950 0x7fe64c0c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:19.915 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.918+0000 7fe64bfff640 1 -- 10.20.193.45:0/664056409 >> v1:10.20.193.45:6789/0 conn(0x7fe64c0c7dd0 legacy=0x7fe64c15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:19.915 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.918+0000 7fe64bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:06:19.915 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.918+0000 7fe64bfff640 1 monclient: found mon.noname-c 2026-02-17T21:06:19.915 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.918+0000 7fe64bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:19.915 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.918+0000 7fe64bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:06:19.915 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.918+0000 7fe64bfff640 1 -- 10.20.193.45:0/664056409 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c0c8dd0 con 0x7fe64c153bf0 2026-02-17T21:06:19.920 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.920+0000 7fe64bfff640 1 --2- 10.20.193.45:0/664056409 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe64c153bf0 0x7fe64c153fd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe64c072210 tx=0x7fe63802ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e92a9e0c3545396 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:19.920 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 1 -- 10.20.193.45:0/664056409 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63803c070 con 0x7fe64c153bf0 2026-02-17T21:06:19.920 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:19.920 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:06:19.920 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 10 monclient: dump: 2026-02-17T21:06:19.920 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:19.920 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:19.920 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 10 monclient: _finish_auth 0 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 10 monclient: _check_auth_tickets 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 1 -- 10.20.193.45:0/664056409 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63802faf0 con 0x7fe64c153bf0 2026-02-17T21:06:19.921 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 5 monclient: authenticate success, global_id 4304 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 1 -- 10.20.193.45:0/664056409 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe638037440 con 0x7fe64c153bf0 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 10 monclient: get_monmap_and_config success 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 4 set_mon_vals no callback set 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe64affd640 10 monclient: dump: 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:19.922 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 10 monclient: shutdown 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 1 -- 10.20.193.45:0/664056409 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe64c153bf0 msgr2=0x7fe64c153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 1 --2- 10.20.193.45:0/664056409 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe64c153bf0 0x7fe64c153fd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe64c072210 tx=0x7fe63802ede0 comp rx=0 tx=0).stop 2026-02-17T21:06:19.923 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 1 -- 10.20.193.45:0/664056409 shutdown_connections 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 1 --2- 10.20.193.45:0/664056409 >> v2:10.20.193.45:3300/0 conn(0x7fe64c15b950 0x7fe64c0c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 1 --2- 10.20.193.45:0/664056409 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe64c153bf0 0x7fe64c153fd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 1 -- 10.20.193.45:0/664056409 >> 10.20.193.45:0/664056409 conn(0x7fe64c0c9ed0 msgr2=0x7fe64c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.922+0000 7fe6523f8640 1 -- 10.20.193.45:0/664056409 shutdown_connections 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 1 -- 10.20.193.45:0/664056409 wait complete. 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 10 monclient: build_initial_monmap 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 10 monclient: monmap: 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:19.924 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 1 librados: starting msgr at 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 1 librados: starting objecter 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 1 Processor -- start 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 1 -- start start 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 1 librados: setting wanted keys 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 1 librados: calling monclient init 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.923+0000 7fe6523f8640 10 monclient: init 2026-02-17T21:06:19.925 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe64c0c7dd0 0x7fe64c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient(hunting): picked mon.noname-c con 0x7fe64c0c7dd0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe64c153bf0 0x7fe64c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient(hunting): picked mon.noname-a con 0x7fe64c153bf0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe64c15b950 0x7fe64c0c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient(hunting): picked mon.noname-b con 0x7fe64c15b950 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c0c8240 con 0x7fe64c153bf0 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c0c9390 con 0x7fe64c15b950 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:19.926 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c0c83c0 con 0x7fe64c0c7dd0 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe6523f8640 10 monclient(hunting): authenticate will time out at 963.554126s 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe64c153bf0 0x7fe64c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64bfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe64c0c7dd0 0x7fe64c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe64c153bf0 0x7fe64c0cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36338/0 (socket says 10.20.193.45:36338) 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 1 -- 10.20.193.45:0/2266137649 learned_addr learned my addr 10.20.193.45:0/2266137649 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 10 monclient(hunting): get_auth_request con 0x7fe64c153bf0 auth_method 0 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:19.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe65096e640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe64c15b950 0x7fe64c0c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64bfff640 10 monclient(hunting): get_auth_request con 0x7fe64c0c7dd0 auth_method 0 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe65096e640 10 monclient(hunting): get_auth_request con 0x7fe64c15b950 auth_method 0 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe65096e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe65096e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe65096e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:19.928 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.924+0000 7fe64bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.925+0000 7fe65096e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.925+0000 7fe65096e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.925+0000 7fe65096e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 10 monclient(hunting): handle_auth_done global_id 4260 payload 824 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 1 -- 10.20.193.45:0/2266137649 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe64c0c7dd0 msgr2=0x7fe64c0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe64c0c7dd0 0x7fe64c0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 1 -- 10.20.193.45:0/2266137649 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe64c15b950 msgr2=0x7fe64c0c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe64c15b950 0x7fe64c0c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 1 monclient: found mon.noname-a 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:19.929 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:06:19.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.926+0000 7fe64b7fe640 1 -- 10.20.193.45:0/2266137649 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c06f1e0 con 0x7fe64c153bf0 2026-02-17T21:06:19.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.927+0000 7fe64b7fe640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe64c153bf0 0x7fe64c0cc8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c4d0 tx=0x7fe63c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:19.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.927+0000 7fe648ff9640 10 client.?.objecter ms_handle_connect 0x7fe64c153bf0 2026-02-17T21:06:19.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.927+0000 7fe648ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:06:19.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 1 -- 10.20.193.45:0/2266137649 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c017070 con 0x7fe64c153bf0 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 10 monclient: dump: 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:19.932 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 10 monclient: _finish_auth 0 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 1 -- 10.20.193.45:0/2266137649 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c005de0 con 0x7fe64c153bf0 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe6523f8640 5 monclient: authenticate success, global_id 4260 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe6523f8640 10 monclient: _renew_subs 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe6523f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64c0cb2d0 con 0x7fe64c153bf0 2026-02-17T21:06:19.933 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 1 -- 10.20.193.45:0/2266137649 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c007290 con 0x7fe64c153bf0 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe64a7fc640 4 set_mon_vals no callback set 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe648ff9640 10 monclient: dump: 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:19.934 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe6523f8640 10 client.4260.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe6523f8640 10 monclient: _renew_subs 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe6523f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64c0cb890 con 0x7fe64c153bf0 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.929+0000 7fe6523f8640 1 librados: init done 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.930+0000 7fe6523f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.930+0000 7fe6523f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.930+0000 7fe6523f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:19.935 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.930+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64c153fd0 con 0x7fe64c153bf0 2026-02-17T21:06:19.936 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.943+0000 7fe648ff9640 1 -- 10.20.193.45:0/2266137649 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7fe63c007430 con 0x7fe64c153bf0 2026-02-17T21:06:19.936 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.943+0000 7fe648ff9640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe61c079220 0x7fe61c07b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:19.937 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.943+0000 7fe64bfff640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe61c079220 0x7fe61c07b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:19.937 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.943+0000 7fe64bfff640 10 monclient: get_auth_request con 0x7fe61c079220 auth_method 0 2026-02-17T21:06:19.937 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.944+0000 7fe648ff9640 10 client.4260.objecter ms_handle_connect 0x7fe61c079220 2026-02-17T21:06:19.937 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.944+0000 7fe64bfff640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe61c079220 0x7fe61c07b6e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe638039000 tx=0x7fe638033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:19.938 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.946+0000 7fe648ff9640 1 -- 10.20.193.45:0/2266137649 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fe63c007750 con 0x7fe64c153bf0 2026-02-17T21:06:19.938 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.946+0000 7fe648ff9640 10 client.4260.objecter ms_dispatch2 0x7fe64c000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:06:19.938 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.946+0000 7fe648ff9640 3 client.4260.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:06:19.938 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.946+0000 7fe648ff9640 3 client.4260.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:06:19.939 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:19.946+0000 7fe648ff9640 20 client.4260.objecter dump_active .. 0 homeless 2026-02-17T21:06:20.046 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.054+0000 7fe648ff9640 1 -- 10.20.193.45:0/2266137649 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe63c021020 con 0x7fe64c153bf0 2026-02-17T21:06:20.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.054+0000 7fe648ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:20.047 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.054+0000 7fe648ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:06:20.134 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.142+0000 7fe6523f8640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:20.134 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.142+0000 7fe6523f8640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:20.135 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.142+0000 7fe6523f8640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:20.135 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.142+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe64c150850 con 0x7fe64c153bf0 2026-02-17T21:06:20.145 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.153+0000 7fe648ff9640 1 -- 10.20.193.45:0/2266137649 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fe63c0616e0 con 0x7fe64c153bf0 2026-02-17T21:06:20.145 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.153+0000 7fe648ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:20.145 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.153+0000 7fe648ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:06:20.146 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:06:20.146 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 10 librados: watch_flush enter 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 10 librados: watch_flush exit 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 20 client.4260.objecter shutdown clearing up homeless session... 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 10 client.4260.objecter successfully canceled tick 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe61c079220 msgr2=0x7fe61c07b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe61c079220 0x7fe61c07b6e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe638039000 tx=0x7fe638033000 comp rx=0 tx=0).stop 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 10 monclient: shutdown 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe64c153bf0 msgr2=0x7fe64c0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:20.149 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe64c153bf0 0x7fe64c0cc8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00c4d0 tx=0x7fe63c00c9a0 comp rx=0 tx=0).stop 2026-02-17T21:06:20.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 shutdown_connections 2026-02-17T21:06:20.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe61c079220 0x7fe61c07b6e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:20.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe64c15b950 0x7fe64c0c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:20.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe64c153bf0 0x7fe64c0cc8b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:20.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 --2- 10.20.193.45:0/2266137649 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe64c0c7dd0 0x7fe64c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:20.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 >> 10.20.193.45:0/2266137649 conn(0x7fe64c0c9ed0 msgr2=0x7fe64c0ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:20.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 shutdown_connections 2026-02-17T21:06:20.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 -- 10.20.193.45:0/2266137649 wait complete. 2026-02-17T21:06:20.150 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:20.156+0000 7fe6523f8640 1 librados: shutdown 2026-02-17T21:06:20.156 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:06:27.767 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:06:27.831 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.839+0000 7fbe7a485640 10 monclient: get_monmap_and_config 2026-02-17T21:06:27.831 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.839+0000 7fbe7a485640 10 monclient: build_initial_monmap 2026-02-17T21:06:27.831 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.839+0000 7fbe7a485640 10 monclient: monmap: 2026-02-17T21:06:27.831 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:27.831 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:06:27.839954+0000 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:06:27.839954+0000 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:06:27.832 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:27.836 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.839+0000 7fbe7a485640 1 Processor -- start 2026-02-17T21:06:27.836 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.839+0000 7fbe7a485640 1 -- start start 2026-02-17T21:06:27.836 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.839+0000 7fbe7a485640 10 monclient: init 2026-02-17T21:06:27.836 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:27.836 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 10 monclient: _add_conns ranks=[4,5,0,3,2,1] 2026-02-17T21:06:27.836 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fbe7415f600 0x7fbe7415f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:27.836 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 10 monclient(hunting): picked mon.noname-b con 0x7fbe7415f600 addr v2:10.20.193.86:3300/0 2026-02-17T21:06:27.836 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fbe74160040 0x7fbe740d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 10 monclient(hunting): picked mon.noname-c con 0x7fbe74160040 addr v2:10.20.193.92:3300/0 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbe740c9780 addr v1:10.20.193.45:6789/0 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe740ca2c0 con 0x7fbe740c9780 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fbe740cf9a0 con 0x7fbe7415f600 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fbe740cfc80 con 0x7fbe74160040 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe7a485640 10 monclient(hunting): authenticate will time out at 971.470388s 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe789fb640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fbe740c9780 0x7fbe740d0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:36230/0 (socket says 10.20.193.45:36230) 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe789fb640 1 -- 10.20.193.45:0/2555354876 learned_addr learned my addr 10.20.193.45:0/2555354876 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:06:27.837 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.840+0000 7fbe73fff640 1 --2- 10.20.193.45:0/2555354876 >> v2:10.20.193.86:3300/0 conn(0x7fbe7415f600 0x7fbe7415f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe737fe640 1 --2- 10.20.193.45:0/2555354876 >> v2:10.20.193.92:3300/0 conn(0x7fbe74160040 0x7fbe740d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe73fff640 10 monclient(hunting): get_auth_request con 0x7fbe7415f600 auth_method 0 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe73fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe737fe640 10 monclient(hunting): get_auth_request con 0x7fbe74160040 auth_method 0 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:27.838 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.841+0000 7fbe737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe72ffd640 1 -- 10.20.193.45:0/2555354876 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279294081 0 0) 0x7fbe740ca2c0 con 0x7fbe740c9780 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe72ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe72ffd640 10 monclient(hunting): my global_id is 4263 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe72ffd640 1 -- 10.20.193.45:0/2555354876 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe58003620 con 0x7fbe740c9780 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe73fff640 10 monclient(hunting): handle_auth_done global_id 4282 payload 274 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe73fff640 1 -- 10.20.193.45:0/2555354876 >> v2:10.20.193.92:3300/0 conn(0x7fbe74160040 msgr2=0x7fbe740d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:06:27.839 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe73fff640 1 --2- 10.20.193.45:0/2555354876 >> v2:10.20.193.92:3300/0 conn(0x7fbe74160040 0x7fbe740d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:27.840 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe73fff640 1 -- 10.20.193.45:0/2555354876 >> v1:10.20.193.45:6789/0 conn(0x7fbe740c9780 legacy=0x7fbe740d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:27.840 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe73fff640 10 monclient: _finish_hunting 0 2026-02-17T21:06:27.840 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe73fff640 1 monclient: found mon.noname-b 2026-02-17T21:06:27.840 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:27.840 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe73fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:06:27.840 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.842+0000 7fbe73fff640 1 -- 10.20.193.45:0/2555354876 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe740cff60 con 0x7fbe7415f600 2026-02-17T21:06:27.840 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.844+0000 7fbe73fff640 1 --2- 10.20.193.45:0/2555354876 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe7415f600 0x7fbe7415f9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe7406fa90 tx=0x7fbe6002eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29d4e38487f74002 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:27.848 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 1 -- 10.20.193.45:0/2555354876 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6003c070 con 0x7fbe7415f600 2026-02-17T21:06:27.848 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:27.848 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:06:27.849 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 10 monclient: dump: 2026-02-17T21:06:27.849 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:27.849 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:27.849 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:27.849 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 10 monclient: _finish_auth 0 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:27.850 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 1 -- 10.20.193.45:0/2555354876 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6002fb80 con 0x7fbe7415f600 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 1 -- 10.20.193.45:0/2555354876 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60037440 con 0x7fbe7415f600 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 5 monclient: authenticate success, global_id 4282 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 10 monclient: get_monmap_and_config success 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 4 set_mon_vals no callback set 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe72ffd640 10 monclient: dump: 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:27.851 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:27.852 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:27.852 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:27.852 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:27.852 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:27.852 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:27.852 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:27.852 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 10 monclient: shutdown 2026-02-17T21:06:27.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:27.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 1 -- 10.20.193.45:0/2555354876 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe7415f600 msgr2=0x7fbe7415f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:27.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 1 --2- 10.20.193.45:0/2555354876 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe7415f600 0x7fbe7415f9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe7406fa90 tx=0x7fbe6002eeb0 comp rx=0 tx=0).stop 2026-02-17T21:06:27.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 1 -- 10.20.193.45:0/2555354876 shutdown_connections 2026-02-17T21:06:27.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 1 --2- 10.20.193.45:0/2555354876 >> v2:10.20.193.92:3300/0 conn(0x7fbe74160040 0x7fbe740d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:27.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 1 --2- 10.20.193.45:0/2555354876 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe7415f600 0x7fbe7415f9e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:27.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 1 -- 10.20.193.45:0/2555354876 >> 10.20.193.45:0/2555354876 conn(0x7fbe740d1900 msgr2=0x7fbe740d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:27.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 1 -- 10.20.193.45:0/2555354876 shutdown_connections 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.846+0000 7fbe7a485640 1 -- 10.20.193.45:0/2555354876 wait complete. 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient: build_initial_monmap 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient: monmap: 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:06:27.854 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 librados: starting msgr at 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 librados: starting objecter 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 Processor -- start 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 -- start start 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 librados: setting wanted keys 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 librados: calling monclient init 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient: init 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe740c9780 0x7fbe740c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:27.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient(hunting): picked mon.noname-a con 0x7fbe740c9780 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe7415f600 0x7fbe741f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient(hunting): picked mon.noname-c con 0x7fbe7415f600 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe74160040 0x7fbe74144ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient(hunting): picked mon.noname-b con 0x7fbe74160040 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740d0ff0 con 0x7fbe740c9780 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740d0e70 con 0x7fbe74160040 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbe74143ee0 con 0x7fbe7415f600 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.847+0000 7fbe7a485640 10 monclient(hunting): authenticate will time out at 971.477920s 2026-02-17T21:06:27.856 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe740c9780 0x7fbe740c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe789fb640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe74160040 0x7fbe74144ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe740c9780 0x7fbe740c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36346/0 (socket says 10.20.193.45:36346) 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 1 -- 10.20.193.45:0/4013641036 learned_addr learned my addr 10.20.193.45:0/4013641036 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 10 monclient(hunting): get_auth_request con 0x7fbe740c9780 auth_method 0 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe789fb640 10 monclient(hunting): get_auth_request con 0x7fbe74160040 auth_method 0 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe789fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe789fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe789fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:27.857 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe737fe640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe7415f600 0x7fbe741f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe789fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe789fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe789fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe737fe640 10 monclient(hunting): get_auth_request con 0x7fbe7415f600 auth_method 0 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.848+0000 7fbe73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.849+0000 7fbe737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.849+0000 7fbe737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:27.858 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.849+0000 7fbe737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 10 monclient(hunting): handle_auth_done global_id 4285 payload 824 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 1 -- 10.20.193.45:0/4013641036 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe7415f600 msgr2=0x7fbe741f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe7415f600 0x7fbe741f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 1 -- 10.20.193.45:0/4013641036 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe740c9780 msgr2=0x7fbe740c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe740c9780 0x7fbe740c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 10 monclient: _finish_hunting 0 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 1 monclient: found mon.noname-b 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.850+0000 7fbe789fb640 1 -- 10.20.193.45:0/4013641036 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe741f7ea0 con 0x7fbe74160040 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.851+0000 7fbe789fb640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe74160040 0x7fbe74144ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800cad0 tx=0x7fbe680039b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:27.859 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.851+0000 7fbe70ff9640 10 client.?.objecter ms_handle_connect 0x7fbe74160040 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.851+0000 7fbe70ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe70ff9640 1 -- 10.20.193.45:0/4013641036 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800abe0 con 0x7fbe74160040 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe70ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe70ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe70ff9640 10 monclient: dump: 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:27.860 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe70ff9640 10 monclient: _finish_auth 0 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe70ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe70ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe7a485640 5 monclient: authenticate success, global_id 4285 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe7a485640 10 monclient: _renew_subs 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe7a485640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:27.861 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe740cd8b0 con 0x7fbe74160040 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe7a485640 10 client.4285.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe7a485640 10 monclient: _renew_subs 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe7a485640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe74144410 con 0x7fbe74160040 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.852+0000 7fbe7a485640 1 librados: init done 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe7a485640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe7a485640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe7a485640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe70ff9640 1 -- 10.20.193.45:0/4013641036 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6800ad80 con 0x7fbe74160040 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe7415f9e0 con 0x7fbe74160040 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe70ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe70ff9640 1 -- 10.20.193.45:0/4013641036 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6801b600 con 0x7fbe74160040 2026-02-17T21:06:27.862 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe70ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe727fc640 4 set_mon_vals no callback set 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe70ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.853+0000 7fbe70ff9640 10 monclient: dump: 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:27.863 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:27.864 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:27.954 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.962+0000 7fbe70ff9640 1 -- 10.20.193.45:0/4013641036 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7fbe6801b7a0 con 0x7fbe74160040 2026-02-17T21:06:27.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.963+0000 7fbe70ff9640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbe440791f0 0x7fbe4407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:27.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.963+0000 7fbe73fff640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbe440791f0 0x7fbe4407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:27.955 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.963+0000 7fbe73fff640 10 monclient: get_auth_request con 0x7fbe440791f0 auth_method 0 2026-02-17T21:06:27.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.963+0000 7fbe70ff9640 10 client.4285.objecter ms_handle_connect 0x7fbe440791f0 2026-02-17T21:06:27.956 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.963+0000 7fbe73fff640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbe440791f0 0x7fbe4407b6b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002eef0 tx=0x7fbe60033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:27.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.972+0000 7fbe70ff9640 1 -- 10.20.193.45:0/4013641036 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fbe68098510 con 0x7fbe74160040 2026-02-17T21:06:27.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.972+0000 7fbe70ff9640 10 client.4285.objecter ms_dispatch2 0x7fbe74000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:06:27.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.972+0000 7fbe70ff9640 3 client.4285.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:06:27.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.972+0000 7fbe70ff9640 3 client.4285.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:06:27.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.972+0000 7fbe70ff9640 20 client.4285.objecter dump_active .. 0 homeless 2026-02-17T21:06:27.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.973+0000 7fbe70ff9640 1 -- 10.20.193.45:0/4013641036 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbe68062a70 con 0x7fbe74160040 2026-02-17T21:06:27.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.973+0000 7fbe70ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:27.964 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:27.973+0000 7fbe70ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:06:28.053 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.061+0000 7fbe7a485640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:28.053 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.061+0000 7fbe7a485640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:28.053 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.061+0000 7fbe7a485640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:28.053 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.061+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe7414e790 con 0x7fbe74160040 2026-02-17T21:06:28.066 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.074+0000 7fbe70ff9640 1 -- 10.20.193.45:0/4013641036 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fbe68066d70 con 0x7fbe74160040 2026-02-17T21:06:28.066 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.074+0000 7fbe70ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:28.066 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.074+0000 7fbe70ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:06:28.066 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:06:28.067 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:06:28.069 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 10 librados: watch_flush enter 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 10 librados: watch_flush exit 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 20 client.4285.objecter shutdown clearing up homeless session... 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 10 client.4285.objecter successfully canceled tick 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbe440791f0 msgr2=0x7fbe4407b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbe440791f0 0x7fbe4407b6b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbe6002eef0 tx=0x7fbe60033000 comp rx=0 tx=0).stop 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 10 monclient: shutdown 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe74160040 msgr2=0x7fbe74144ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe74160040 0x7fbe74144ef0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800cad0 tx=0x7fbe680039b0 comp rx=0 tx=0).stop 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 shutdown_connections 2026-02-17T21:06:28.070 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbe440791f0 0x7fbe4407b6b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:28.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe74160040 0x7fbe74144ef0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:28.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe7415f600 0x7fbe741f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:28.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 --2- 10.20.193.45:0/4013641036 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe740c9780 0x7fbe740c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:28.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.076+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 >> 10.20.193.45:0/4013641036 conn(0x7fbe740d1900 msgr2=0x7fbe74150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:28.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.077+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 shutdown_connections 2026-02-17T21:06:28.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.077+0000 7fbe7a485640 1 -- 10.20.193.45:0/4013641036 wait complete. 2026-02-17T21:06:28.071 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:28.077+0000 7fbe7a485640 1 librados: shutdown 2026-02-17T21:06:28.078 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:06:29.683 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:36.896 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:29.712 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:36.925 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:29.714 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:01:36.923 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:29.716 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:01:36.926 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:29.733 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:36.946 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:29.735 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:01:36.944 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:29.739 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:01:36.913 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:29.741 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:01:36.915 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:29.760 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:01:36.933 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:35.693 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:06:35.757 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.764+0000 7f743e51b640 10 monclient: get_monmap_and_config 2026-02-17T21:06:35.757 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.764+0000 7f743e51b640 10 monclient: build_initial_monmap 2026-02-17T21:06:35.757 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.764+0000 7f743e51b640 10 monclient: monmap: 2026-02-17T21:06:35.757 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:35.757 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:35.757 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:06:35.765687+0000 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:06:35.765687+0000 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 1 Processor -- start 2026-02-17T21:06:35.758 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 1 -- start start 2026-02-17T21:06:35.759 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 10 monclient: init 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 10 monclient: _add_conns ranks=[3,0,2,1,5,4] 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f7438153bf0 0x7f7438153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 10 monclient(hunting): picked mon.noname-a con 0x7f7438153bf0 addr v2:10.20.193.45:3300/0 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f74380c7dd0 addr v1:10.20.193.45:6789/0 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f743815b950 addr v1:10.20.193.92:6789/0 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74380c8810 con 0x7f74380c7dd0 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74380c8af0 con 0x7f743815b950 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f74380c9700 con 0x7f7438153bf0 2026-02-17T21:06:35.761 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.765+0000 7f743e51b640 10 monclient(hunting): authenticate will time out at 979.395823s 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.766+0000 7f743ca91640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f743815b950 0x7f74380c52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:54974/0 (socket says 10.20.193.45:54974) 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.766+0000 7f743ca91640 1 -- 10.20.193.45:0/665833225 learned_addr learned my addr 10.20.193.45:0/665833225 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.766+0000 7f7437fff640 1 --2- 10.20.193.45:0/665833225 >> v2:10.20.193.45:3300/0 conn(0x7f7438153bf0 0x7f7438153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.767+0000 7f7437fff640 10 monclient(hunting): get_auth_request con 0x7f7438153bf0 auth_method 0 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.767+0000 7f7437fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.767+0000 7f7437fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.767+0000 7f7437fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.767+0000 7f7437fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.767+0000 7f7437fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.767+0000 7f7437fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:35.762 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.768+0000 7f7436ffd640 1 -- 10.20.193.45:0/665833225 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092054506 0 0) 0x7f74380c8af0 con 0x7f743815b950 2026-02-17T21:06:35.763 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.768+0000 7f7436ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:06:35.763 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.768+0000 7f7436ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:35.763 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.768+0000 7f7436ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:35.763 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.768+0000 7f7436ffd640 10 monclient(hunting): my global_id is 4316 2026-02-17T21:06:35.763 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.768+0000 7f7436ffd640 1 -- 10.20.193.45:0/665833225 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f741c003620 con 0x7f743815b950 2026-02-17T21:06:35.764 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.769+0000 7f7437fff640 10 monclient(hunting): handle_auth_done global_id 4269 payload 274 2026-02-17T21:06:35.764 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.769+0000 7f7437fff640 1 -- 10.20.193.45:0/665833225 >> v1:10.20.193.92:6789/0 conn(0x7f743815b950 legacy=0x7f74380c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:35.764 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.769+0000 7f7437fff640 1 -- 10.20.193.45:0/665833225 >> v1:10.20.193.45:6789/0 conn(0x7f74380c7dd0 legacy=0x7f743815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:35.764 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.769+0000 7f7437fff640 10 monclient: _finish_hunting 0 2026-02-17T21:06:35.764 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.769+0000 7f7437fff640 1 monclient: found mon.noname-a 2026-02-17T21:06:35.764 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.769+0000 7f7437fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:35.764 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.769+0000 7f7437fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:06:35.764 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.769+0000 7f7437fff640 1 -- 10.20.193.45:0/665833225 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74380c8dd0 con 0x7f7438153bf0 2026-02-17T21:06:35.764 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.771+0000 7f7437fff640 1 --2- 10.20.193.45:0/665833225 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7438153bf0 0x7f7438153fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74240098a0 tx=0x7f742402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e5197dce45e825 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:35.769 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 1 -- 10.20.193.45:0/665833225 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742403c070 con 0x7f7438153bf0 2026-02-17T21:06:35.769 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 10 monclient: dump: 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:35.770 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 10 monclient: _finish_auth 0 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 5 monclient: authenticate success, global_id 4269 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 1 -- 10.20.193.45:0/665833225 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742402fb70 con 0x7f7438153bf0 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 10 monclient: get_monmap_and_config success 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 1 -- 10.20.193.45:0/665833225 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424037440 con 0x7f7438153bf0 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 4 set_mon_vals no callback set 2026-02-17T21:06:35.771 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f7436ffd640 10 monclient: dump: 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 10 monclient: shutdown 2026-02-17T21:06:35.772 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 1 -- 10.20.193.45:0/665833225 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7438153bf0 msgr2=0x7f7438153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 1 --2- 10.20.193.45:0/665833225 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7438153bf0 0x7f7438153fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74240098a0 tx=0x7f742402ee60 comp rx=0 tx=0).stop 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 1 -- 10.20.193.45:0/665833225 shutdown_connections 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 1 --2- 10.20.193.45:0/665833225 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7438153bf0 0x7f7438153fd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 1 -- 10.20.193.45:0/665833225 >> 10.20.193.45:0/665833225 conn(0x7f74380c9ed0 msgr2=0x7f74380ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 1 -- 10.20.193.45:0/665833225 shutdown_connections 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 1 -- 10.20.193.45:0/665833225 wait complete. 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 10 monclient: build_initial_monmap 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.773+0000 7f743e51b640 10 monclient: monmap: 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:06:35.773 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 librados: starting msgr at 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 librados: starting objecter 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 Processor -- start 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 -- start start 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 librados: setting wanted keys 2026-02-17T21:06:35.774 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 librados: calling monclient init 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient: init 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74380c7dd0 0x7f74381493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient(hunting): picked mon.noname-c con 0x7f74380c7dd0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7438153bf0 0x7f7438072610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient(hunting): picked mon.noname-b con 0x7f7438153bf0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f743815b950 0x7f7438157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient(hunting): picked mon.noname-a con 0x7f743815b950 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f74380c59e0 con 0x7f743815b950 2026-02-17T21:06:35.775 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f74380c9390 con 0x7f7438153bf0 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74380c5b60 con 0x7f74380c7dd0 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743e51b640 10 monclient(hunting): authenticate will time out at 979.404596s 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743ca91640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f743815b950 0x7f7438157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743ca91640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f743815b950 0x7f7438157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:50192/0 (socket says 10.20.193.45:50192) 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743ca91640 1 -- 10.20.193.45:0/1144207029 learned_addr learned my addr 10.20.193.45:0/1144207029 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743ca91640 10 monclient(hunting): get_auth_request con 0x7f743815b950 auth_method 0 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743ca91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743ca91640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.774+0000 7f743ca91640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:35.776 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f7437fff640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74380c7dd0 0x7f74381493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f74377fe640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7438153bf0 0x7f7438072610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f743ca91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f743ca91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f743ca91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f7437fff640 10 monclient(hunting): get_auth_request con 0x7f74380c7dd0 auth_method 0 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f7437fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f7437fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f7437fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f74377fe640 10 monclient(hunting): get_auth_request con 0x7f7438153bf0 auth_method 0 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f74377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f74377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f74377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:35.777 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f7437fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f7437fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f7437fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f74377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f74377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.775+0000 7f74377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 10 monclient(hunting): handle_auth_done global_id 4275 payload 824 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 1 -- 10.20.193.45:0/1144207029 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74380c7dd0 msgr2=0x7f74381493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74380c7dd0 0x7f74381493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 1 -- 10.20.193.45:0/1144207029 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7438153bf0 msgr2=0x7f7438072610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7438153bf0 0x7f7438072610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 10 monclient: _finish_hunting 0 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 1 monclient: found mon.noname-a 2026-02-17T21:06:35.778 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:35.779 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:06:35.779 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.776+0000 7f743ca91640 1 -- 10.20.193.45:0/1144207029 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7438148060 con 0x7f743815b950 2026-02-17T21:06:35.779 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.777+0000 7f743ca91640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f743815b950 0x7f7438157000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f742c00cb40 tx=0x7f742c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:35.779 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.777+0000 7f7434ff9640 10 client.?.objecter ms_handle_connect 0x7f743815b950 2026-02-17T21:06:35.779 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.777+0000 7f7434ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:06:35.781 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 1 -- 10.20.193.45:0/1144207029 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c00ad50 con 0x7f743815b950 2026-02-17T21:06:35.781 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:35.781 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:06:35.781 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 10 monclient: dump: 2026-02-17T21:06:35.781 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:35.781 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:35.781 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 10 monclient: _finish_auth 0 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f743e51b640 5 monclient: authenticate success, global_id 4275 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 1 -- 10.20.193.45:0/1144207029 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f742c012400 con 0x7f743815b950 2026-02-17T21:06:35.782 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f743e51b640 10 monclient: _renew_subs 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f743e51b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7438148340 con 0x7f743815b950 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 1 -- 10.20.193.45:0/1144207029 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c0127f0 con 0x7f743815b950 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f74367fc640 4 set_mon_vals no callback set 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f7434ff9640 10 monclient: dump: 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:35.783 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f743e51b640 10 client.4275.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f743e51b640 10 monclient: _renew_subs 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f743e51b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7438148900 con 0x7f743815b950 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.779+0000 7f743e51b640 1 librados: init done 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.780+0000 7f743e51b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:35.784 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.780+0000 7f743e51b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:35.785 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.780+0000 7f743e51b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:35.785 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.780+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74380c8240 con 0x7f743815b950 2026-02-17T21:06:35.852 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.860+0000 7f7434ff9640 1 -- 10.20.193.45:0/1144207029 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7f742c012990 con 0x7f743815b950 2026-02-17T21:06:35.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.860+0000 7f7434ff9640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f74080791f0 0x7f740807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:35.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.861+0000 7f7437fff640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f74080791f0 0x7f740807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:35.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.861+0000 7f7437fff640 10 monclient: get_auth_request con 0x7f74080791f0 auth_method 0 2026-02-17T21:06:35.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.861+0000 7f7434ff9640 10 client.4275.objecter ms_handle_connect 0x7f74080791f0 2026-02-17T21:06:35.853 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.861+0000 7f7437fff640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f74080791f0 0x7f740807b6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7424039000 tx=0x7f7424033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:35.893 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.901+0000 7f7434ff9640 1 -- 10.20.193.45:0/1144207029 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7f742c05ec90 con 0x7f743815b950 2026-02-17T21:06:35.893 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.901+0000 7f7434ff9640 10 client.4275.objecter ms_dispatch2 0x7f7438000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:06:35.893 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.901+0000 7f7434ff9640 3 client.4275.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:06:35.893 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.901+0000 7f7434ff9640 3 client.4275.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:06:35.893 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.901+0000 7f7434ff9640 20 client.4275.objecter dump_active .. 0 homeless 2026-02-17T21:06:35.896 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.904+0000 7f7434ff9640 1 -- 10.20.193.45:0/1144207029 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f742c062c50 con 0x7f743815b950 2026-02-17T21:06:35.896 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.904+0000 7f7434ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:35.896 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.904+0000 7f7434ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:06:35.985 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.993+0000 7f743e51b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:35.985 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.993+0000 7f743e51b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:35.986 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.993+0000 7f743e51b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:35.986 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:35.993+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f743815ce10 con 0x7f743815b950 2026-02-17T21:06:35.997 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.004+0000 7f7434ff9640 1 -- 10.20.193.45:0/1144207029 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7f742c066f50 con 0x7f743815b950 2026-02-17T21:06:35.997 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.004+0000 7f7434ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:35.997 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.004+0000 7f7434ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:06:35.997 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:06:35.997 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 10 librados: watch_flush enter 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 10 librados: watch_flush exit 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 20 client.4275.objecter shutdown clearing up homeless session... 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 10 client.4275.objecter successfully canceled tick 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f74080791f0 msgr2=0x7f740807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f74080791f0 0x7f740807b6b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7424039000 tx=0x7f7424033000 comp rx=0 tx=0).stop 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 10 monclient: shutdown 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f743815b950 msgr2=0x7f7438157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:36.000 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f743815b950 0x7f7438157000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f742c00cb40 tx=0x7f742c00a430 comp rx=0 tx=0).stop 2026-02-17T21:06:36.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 shutdown_connections 2026-02-17T21:06:36.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f74080791f0 0x7f740807b6b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:36.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f743815b950 0x7f7438157000 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:36.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7438153bf0 0x7f7438072610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:36.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 --2- 10.20.193.45:0/1144207029 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74380c7dd0 0x7f74381493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:36.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 >> 10.20.193.45:0/1144207029 conn(0x7f74380c9ed0 msgr2=0x7f7438152170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:36.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 shutdown_connections 2026-02-17T21:06:36.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 -- 10.20.193.45:0/1144207029 wait complete. 2026-02-17T21:06:36.001 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:36.007+0000 7f743e51b640 1 librados: shutdown 2026-02-17T21:06:36.008 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:06:43.621 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:06:43.683 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.690+0000 7fccfe155640 10 monclient: get_monmap_and_config 2026-02-17T21:06:43.683 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.690+0000 7fccfe155640 10 monclient: build_initial_monmap 2026-02-17T21:06:43.683 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.690+0000 7fccfe155640 10 monclient: monmap: 2026-02-17T21:06:43.683 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:43.683 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:43.683 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:06:43.691453+0000 2026-02-17T21:06:43.683 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:06:43.691453+0000 2026-02-17T21:06:43.683 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 1 Processor -- start 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 1 -- start start 2026-02-17T21:06:43.684 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 10 monclient: init 2026-02-17T21:06:43.687 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:43.687 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 10 monclient: _add_conns ranks=[4,0,1,3,5,2] 2026-02-17T21:06:43.687 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fccf8155dc0 0x7fccf80c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:43.687 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 10 monclient(hunting): picked mon.noname-b con 0x7fccf8155dc0 addr v2:10.20.193.86:3300/0 2026-02-17T21:06:43.687 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fccf81561a0 addr v1:10.20.193.45:6789/0 2026-02-17T21:06:43.687 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fccf815f590 addr v1:10.20.193.86:6789/0 2026-02-17T21:06:43.687 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccf80c4580 con 0x7fccf81561a0 2026-02-17T21:06:43.687 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccf80c9840 con 0x7fccf815f590 2026-02-17T21:06:43.687 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fccf80c84c0 con 0x7fccf8155dc0 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.691+0000 7fccfe155640 10 monclient(hunting): authenticate will time out at 987.321587s 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.692+0000 7fccf6ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fccf81561a0 0x7fccf815d490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:38594/0 (socket says 10.20.193.45:38594) 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.692+0000 7fccf6ffd640 1 -- 10.20.193.45:0/3245631776 learned_addr learned my addr 10.20.193.45:0/3245631776 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.692+0000 7fccf77fe640 1 --2- 10.20.193.45:0/3245631776 >> v2:10.20.193.86:3300/0 conn(0x7fccf8155dc0 0x7fccf80c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.692+0000 7fccf77fe640 10 monclient(hunting): get_auth_request con 0x7fccf8155dc0 auth_method 0 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.692+0000 7fccf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.692+0000 7fccf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.692+0000 7fccf77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.693+0000 7fccf77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:43.688 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.693+0000 7fccf77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.693+0000 7fccf77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.693+0000 7fccf67fc640 1 -- 10.20.193.45:0/3245631776 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3059602697 0 0) 0x7fccf80c4580 con 0x7fccf81561a0 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.693+0000 7fccf67fc640 10 monclient(hunting): _negotiate 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.693+0000 7fccf67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.693+0000 7fccf67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.693+0000 7fccf67fc640 10 monclient(hunting): my global_id is 4278 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.693+0000 7fccf67fc640 1 -- 10.20.193.45:0/3245631776 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccdc003620 con 0x7fccf81561a0 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.694+0000 7fccf77fe640 10 monclient(hunting): handle_auth_done global_id 4291 payload 274 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.694+0000 7fccf77fe640 1 -- 10.20.193.45:0/3245631776 >> v1:10.20.193.86:6789/0 conn(0x7fccf815f590 legacy=0x7fccf815f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.694+0000 7fccf77fe640 1 -- 10.20.193.45:0/3245631776 >> v1:10.20.193.45:6789/0 conn(0x7fccf81561a0 legacy=0x7fccf815d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.694+0000 7fccf77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:06:43.689 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.694+0000 7fccf77fe640 1 monclient: found mon.noname-b 2026-02-17T21:06:43.690 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.694+0000 7fccf77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:43.690 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.694+0000 7fccf77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:06:43.690 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.694+0000 7fccf77fe640 1 -- 10.20.193.45:0/3245631776 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf80c87a0 con 0x7fccf8155dc0 2026-02-17T21:06:43.690 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.697+0000 7fccf77fe640 1 --2- 10.20.193.45:0/3245631776 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf8155dc0 0x7fccf80c7dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcce40098a0 tx=0x7fcce402ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=371e72c603893b12 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:43.696 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 1 -- 10.20.193.45:0/3245631776 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce403c070 con 0x7fccf8155dc0 2026-02-17T21:06:43.696 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:43.696 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:06:43.696 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 10 monclient: dump: 2026-02-17T21:06:43.696 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:43.696 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:43.696 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:43.696 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 10 monclient: _finish_auth 0 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 10 monclient: _check_auth_tickets 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 1 -- 10.20.193.45:0/3245631776 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce402fb70 con 0x7fccf8155dc0 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:43.697 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 1 -- 10.20.193.45:0/3245631776 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4037440 con 0x7fccf8155dc0 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccf67fc640 10 monclient: dump: 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:43.698 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 5 monclient: authenticate success, global_id 4291 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 10 monclient: get_monmap_and_config success 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 4 set_mon_vals no callback set 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 10 monclient: shutdown 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 1 -- 10.20.193.45:0/3245631776 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf8155dc0 msgr2=0x7fccf80c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 1 --2- 10.20.193.45:0/3245631776 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf8155dc0 0x7fccf80c7dd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcce40098a0 tx=0x7fcce402ee60 comp rx=0 tx=0).stop 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 1 -- 10.20.193.45:0/3245631776 shutdown_connections 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 1 --2- 10.20.193.45:0/3245631776 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf8155dc0 0x7fccf80c7dd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.699+0000 7fccfe155640 1 -- 10.20.193.45:0/3245631776 >> 10.20.193.45:0/3245631776 conn(0x7fccf80c9ed0 msgr2=0x7fccf80ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:43.699 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 1 -- 10.20.193.45:0/3245631776 shutdown_connections 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 1 -- 10.20.193.45:0/3245631776 wait complete. 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 10 monclient: build_initial_monmap 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 10 monclient: monmap: 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:06:43.700 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 1 librados: starting msgr at 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 1 librados: starting objecter 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 1 Processor -- start 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 1 -- start start 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 1 librados: setting wanted keys 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 1 librados: calling monclient init 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.700+0000 7fccfe155640 10 monclient: init 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fccf8155dc0 0x7fccf814d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:43.701 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient(hunting): picked mon.noname-a con 0x7fccf8155dc0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fccf81561a0 0x7fccf814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient(hunting): picked mon.noname-c con 0x7fccf81561a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf815f590 0x7fccf814f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient(hunting): picked mon.noname-b con 0x7fccf815f590 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fccf80c9040 con 0x7fccf8155dc0 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fccf80c8d60 con 0x7fccf815f590 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fccf80c9320 con 0x7fccf81561a0 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccfe155640 10 monclient(hunting): authenticate will time out at 987.331112s 2026-02-17T21:06:43.702 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf77fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fccf8155dc0 0x7fccf814d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf815f590 0x7fccf814f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf815f590 0x7fccf814f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:50712/0 (socket says 10.20.193.45:50712) 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 1 -- 10.20.193.45:0/1639934584 learned_addr learned my addr 10.20.193.45:0/1639934584 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 10 monclient(hunting): get_auth_request con 0x7fccf815f590 auth_method 0 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf77fe640 10 monclient(hunting): get_auth_request con 0x7fccf8155dc0 auth_method 0 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:43.703 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf6ffd640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fccf81561a0 0x7fccf814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.701+0000 7fccf7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf6ffd640 10 monclient(hunting): get_auth_request con 0x7fccf81561a0 auth_method 0 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:43.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.702+0000 7fccf6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 10 monclient(hunting): handle_auth_done global_id 4297 payload 824 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 1 -- 10.20.193.45:0/1639934584 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fccf81561a0 msgr2=0x7fccf814ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fccf81561a0 0x7fccf814ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 1 -- 10.20.193.45:0/1639934584 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fccf8155dc0 msgr2=0x7fccf814d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fccf8155dc0 0x7fccf814d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 10 monclient: _finish_hunting 0 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 1 monclient: found mon.noname-b 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:06:43.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.703+0000 7fccf7fff640 1 -- 10.20.193.45:0/1639934584 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf81f45b0 con 0x7fccf815f590 2026-02-17T21:06:43.707 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.704+0000 7fccf7fff640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf815f590 0x7fccf814f1d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fccec00cc50 tx=0x7fccec00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:43.707 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.704+0000 7fccd3fff640 10 client.?.objecter ms_handle_connect 0x7fccf815f590 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.704+0000 7fccd3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 1 -- 10.20.193.45:0/1639934584 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec003a70 con 0x7fccf815f590 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 10 monclient: dump: 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:43.708 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 10 monclient: _finish_auth 0 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 1 -- 10.20.193.45:0/1639934584 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccec003c10 con 0x7fccf815f590 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 1 -- 10.20.193.45:0/1639934584 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec0050d0 con 0x7fccf815f590 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:43.709 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccf5ffb640 4 set_mon_vals no callback set 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccd3fff640 10 monclient: dump: 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:43.710 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccfe155640 5 monclient: authenticate success, global_id 4297 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccfe155640 10 monclient: _renew_subs 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccfe155640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf81f79f0 con 0x7fccf815f590 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccfe155640 10 client.4297.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccfe155640 10 monclient: _renew_subs 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccfe155640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf81f39a0 con 0x7fccf815f590 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.706+0000 7fccfe155640 1 librados: init done 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.707+0000 7fccfe155640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.707+0000 7fccfe155640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:43.711 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.707+0000 7fccfe155640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:43.712 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.707+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf80c7dd0 con 0x7fccf815f590 2026-02-17T21:06:43.712 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.719+0000 7fccd3fff640 1 -- 10.20.193.45:0/1639934584 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7fccec005270 con 0x7fccf815f590 2026-02-17T21:06:43.713 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.719+0000 7fccd3fff640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fccc80791f0 0x7fccc807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:43.713 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.719+0000 7fccf77fe640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fccc80791f0 0x7fccc807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:43.713 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.719+0000 7fccf77fe640 10 monclient: get_auth_request con 0x7fccc80791f0 auth_method 0 2026-02-17T21:06:43.713 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.720+0000 7fccd3fff640 10 client.4297.objecter ms_handle_connect 0x7fccc80791f0 2026-02-17T21:06:43.713 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.720+0000 7fccf77fe640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fccc80791f0 0x7fccc807b6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcce4039000 tx=0x7fcce4033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:43.714 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.722+0000 7fccd3fff640 1 -- 10.20.193.45:0/1639934584 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7fccec05ead0 con 0x7fccf815f590 2026-02-17T21:06:43.714 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.722+0000 7fccd3fff640 10 client.4297.objecter ms_dispatch2 0x7fccf8000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:06:43.714 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.722+0000 7fccd3fff640 3 client.4297.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:06:43.714 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.722+0000 7fccd3fff640 3 client.4297.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:06:43.715 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.722+0000 7fccd3fff640 20 client.4297.objecter dump_active .. 0 homeless 2026-02-17T21:06:43.824 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.832+0000 7fccd3fff640 1 -- 10.20.193.45:0/1639934584 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fccec062a90 con 0x7fccf815f590 2026-02-17T21:06:43.824 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.832+0000 7fccd3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:43.824 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.832+0000 7fccd3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:06:43.915 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.923+0000 7fccfe155640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:43.916 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.923+0000 7fccfe155640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:43.916 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.923+0000 7fccfe155640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:06:43.916 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.923+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccf806f530 con 0x7fccf815f590 2026-02-17T21:06:43.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.934+0000 7fccd3fff640 1 -- 10.20.193.45:0/1639934584 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7fccec066d90 con 0x7fccf815f590 2026-02-17T21:06:43.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.934+0000 7fccd3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:43.927 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.934+0000 7fccd3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:06:43.927 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:06:43.927 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:06:43.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 10 librados: watch_flush enter 2026-02-17T21:06:43.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 10 librados: watch_flush exit 2026-02-17T21:06:43.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 20 client.4297.objecter shutdown clearing up homeless session... 2026-02-17T21:06:43.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 10 client.4297.objecter successfully canceled tick 2026-02-17T21:06:43.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fccc80791f0 msgr2=0x7fccc807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:43.930 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fccc80791f0 0x7fccc807b6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcce4039000 tx=0x7fcce4033000 comp rx=0 tx=0).stop 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 10 monclient: shutdown 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf815f590 msgr2=0x7fccf814f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf815f590 0x7fccf814f1d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fccec00cc50 tx=0x7fccec00a430 comp rx=0 tx=0).stop 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 shutdown_connections 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fccc80791f0 0x7fccc807b6b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fccf815f590 0x7fccf814f1d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fccf81561a0 0x7fccf814ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 --2- 10.20.193.45:0/1639934584 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fccf8155dc0 0x7fccf814d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:43.931 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 >> 10.20.193.45:0/1639934584 conn(0x7fccf80c9ed0 msgr2=0x7fccf806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:43.932 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 shutdown_connections 2026-02-17T21:06:43.932 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 -- 10.20.193.45:0/1639934584 wait complete. 2026-02-17T21:06:43.932 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:43.937+0000 7fccfe155640 1 librados: shutdown 2026-02-17T21:06:43.939 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:06:49.716 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:56.929 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:49.746 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:01:56.955 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:49.747 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:56.960 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:49.749 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:01:56.958 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:49.754 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:01:56.968 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:49.757 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:01:56.966 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:49.778 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:01:56.951 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:49.779 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:01:56.953 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:49.786 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:01:56.960 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:06:51.551 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:06:51.613 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.621+0000 7ff5e7b85640 10 monclient: get_monmap_and_config 2026-02-17T21:06:51.613 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.621+0000 7ff5e7b85640 10 monclient: build_initial_monmap 2026-02-17T21:06:51.613 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.621+0000 7ff5e7b85640 10 monclient: monmap: 2026-02-17T21:06:51.613 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:51.613 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:06:51.622418+0000 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:06:51.622418+0000 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:06:51.614 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.621+0000 7ff5e7b85640 1 Processor -- start 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 1 -- start start 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient: init 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient: _add_conns ranks=[5,4,3,0,1,2] 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff5e0155dc0 0x7ff5e00c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient(hunting): picked mon.noname-c con 0x7ff5e0155dc0 addr v2:10.20.193.92:3300/0 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff5e01561a0 0x7ff5e015d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient(hunting): picked mon.noname-b con 0x7ff5e01561a0 addr v2:10.20.193.86:3300/0 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff5e015d9d0 0x7ff5e015f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient(hunting): picked mon.noname-a con 0x7ff5e015d9d0 addr v2:10.20.193.45:3300/0 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e00c4580 con 0x7ff5e015d9d0 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e00c9840 con 0x7ff5e01561a0 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e00c84c0 con 0x7ff5e0155dc0 2026-02-17T21:06:51.616 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.622+0000 7ff5e7b85640 10 monclient(hunting): authenticate will time out at 995.252532s 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff5e015d9d0 0x7ff5e015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e50f9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff5e01561a0 0x7ff5e015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e58fa640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff5e0155dc0 0x7ff5e00c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff5e015d9d0 0x7ff5e015f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:52018/0 (socket says 10.20.193.45:52018) 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 1 -- 10.20.193.45:0/1839383719 learned_addr learned my addr 10.20.193.45:0/1839383719 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 10 monclient(hunting): get_auth_request con 0x7ff5e015d9d0 auth_method 0 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e50f9640 10 monclient(hunting): get_auth_request con 0x7ff5e01561a0 auth_method 0 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e50f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e50f9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e50f9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e58fa640 10 monclient(hunting): get_auth_request con 0x7ff5e0155dc0 auth_method 0 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e58fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e58fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e58fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e60fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e50f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e50f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:51.617 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e50f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:51.618 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e58fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:51.618 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e58fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:51.618 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.623+0000 7ff5e58fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:51.618 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 10 monclient(hunting): handle_auth_done global_id 4284 payload 274 2026-02-17T21:06:51.618 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 1 -- 10.20.193.45:0/1839383719 >> v2:10.20.193.92:3300/0 conn(0x7ff5e0155dc0 msgr2=0x7ff5e00c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:06:51.618 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 1 --2- 10.20.193.45:0/1839383719 >> v2:10.20.193.92:3300/0 conn(0x7ff5e0155dc0 0x7ff5e00c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.618 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 1 -- 10.20.193.45:0/1839383719 >> v2:10.20.193.86:3300/0 conn(0x7ff5e01561a0 msgr2=0x7ff5e015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:06:51.618 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 1 --2- 10.20.193.45:0/1839383719 >> v2:10.20.193.86:3300/0 conn(0x7ff5e01561a0 0x7ff5e015d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.619 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 10 monclient: _finish_hunting 0 2026-02-17T21:06:51.619 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 1 monclient: found mon.noname-a 2026-02-17T21:06:51.619 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:51.619 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:06:51.619 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.624+0000 7ff5e60fb640 1 -- 10.20.193.45:0/1839383719 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e00c87a0 con 0x7ff5e015d9d0 2026-02-17T21:06:51.619 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.625+0000 7ff5e60fb640 1 --2- 10.20.193.45:0/1839383719 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e015d9d0 0x7ff5e015f590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00c9e80 tx=0x7ff5dc02f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ee0e0235fb6598 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 1 -- 10.20.193.45:0/1839383719 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc02fd10 con 0x7ff5e015d9d0 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 10 monclient: dump: 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:51.620 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 10 monclient: _finish_auth 0 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 10 monclient: _check_auth_tickets 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 1 -- 10.20.193.45:0/1839383719 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5dc0373f0 con 0x7ff5e015d9d0 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 1 -- 10.20.193.45:0/1839383719 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc0377c0 con 0x7ff5e015d9d0 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e7b85640 5 monclient: authenticate success, global_id 4284 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e7b85640 10 monclient: get_monmap_and_config success 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e7b85640 4 set_mon_vals no callback set 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.627+0000 7ff5e48f8640 10 monclient: dump: 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:51.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 10 monclient: shutdown 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 1 -- 10.20.193.45:0/1839383719 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e015d9d0 msgr2=0x7ff5e015f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/1839383719 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e015d9d0 0x7ff5e015f590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00c9e80 tx=0x7ff5dc02f260 comp rx=0 tx=0).stop 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 1 -- 10.20.193.45:0/1839383719 shutdown_connections 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/1839383719 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e015d9d0 0x7ff5e015f590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/1839383719 >> v2:10.20.193.86:3300/0 conn(0x7ff5e01561a0 0x7ff5e015d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/1839383719 >> v2:10.20.193.92:3300/0 conn(0x7ff5e0155dc0 0x7ff5e00c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 1 -- 10.20.193.45:0/1839383719 >> 10.20.193.45:0/1839383719 conn(0x7ff5e00c9ed0 msgr2=0x7ff5e00ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 1 -- 10.20.193.45:0/1839383719 shutdown_connections 2026-02-17T21:06:51.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 1 -- 10.20.193.45:0/1839383719 wait complete. 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 10 monclient: build_initial_monmap 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.628+0000 7ff5e7b85640 10 monclient: monmap: 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 librados: starting msgr at 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 librados: starting objecter 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 Processor -- start 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 -- start start 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 librados: setting wanted keys 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 librados: calling monclient init 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient: init 2026-02-17T21:06:51.624 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff5e0155dc0 0x7ff5e015f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient(hunting): picked mon.noname-b con 0x7ff5e0155dc0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e01561a0 0x7ff5e00c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient(hunting): picked mon.noname-a con 0x7ff5e01561a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff5e015d9d0 0x7ff5e0158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient(hunting): picked mon.noname-c con 0x7ff5e015d9d0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e00c9040 con 0x7ff5e01561a0 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e00c8d60 con 0x7ff5e0155dc0 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e00c9320 con 0x7ff5e015d9d0 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e7b85640 10 monclient(hunting): authenticate will time out at 995.259534s 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e50f9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e01561a0 0x7ff5e00c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e50f9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e01561a0 0x7ff5e00c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:52022/0 (socket says 10.20.193.45:52022) 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e50f9640 1 -- 10.20.193.45:0/2794334989 learned_addr learned my addr 10.20.193.45:0/2794334989 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e50f9640 10 monclient(hunting): get_auth_request con 0x7ff5e01561a0 auth_method 0 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e50f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e50f9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e50f9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:51.625 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.629+0000 7ff5e58fa640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff5e0155dc0 0x7ff5e015f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e60fb640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff5e015d9d0 0x7ff5e0158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e58fa640 10 monclient(hunting): get_auth_request con 0x7ff5e0155dc0 auth_method 0 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e58fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e58fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e58fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e50f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e50f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e50f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e60fb640 10 monclient(hunting): get_auth_request con 0x7ff5e015d9d0 auth_method 0 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e60fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e60fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e60fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e58fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e58fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e58fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e60fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e60fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.630+0000 7ff5e60fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 10 monclient(hunting): handle_auth_done global_id 4287 payload 824 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 1 -- 10.20.193.45:0/2794334989 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff5e015d9d0 msgr2=0x7ff5e0158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff5e015d9d0 0x7ff5e0158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 1 -- 10.20.193.45:0/2794334989 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff5e0155dc0 msgr2=0x7ff5e015f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:51.626 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff5e0155dc0 0x7ff5e015f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.627 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 10 monclient: _finish_hunting 0 2026-02-17T21:06:51.627 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 1 monclient: found mon.noname-a 2026-02-17T21:06:51.627 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:51.627 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:06:51.627 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.631+0000 7ff5e50f9640 1 -- 10.20.193.45:0/2794334989 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e015f810 con 0x7ff5e01561a0 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.632+0000 7ff5e50f9640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e01561a0 0x7ff5e00c5af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400e860 tx=0x7ff5d400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.632+0000 7ff5ce7fc640 10 client.?.objecter ms_handle_connect 0x7ff5e01561a0 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.632+0000 7ff5ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 1 -- 10.20.193.45:0/2794334989 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4017070 con 0x7ff5e01561a0 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 10 monclient: dump: 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 10 monclient: _finish_auth 0 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:06:51.628 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 1 -- 10.20.193.45:0/2794334989 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d400c940 con 0x7ff5e01561a0 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 1 -- 10.20.193.45:0/2794334989 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d400cd10 con 0x7ff5e01561a0 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5ce7fc640 10 monclient: dump: 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5cffff640 4 set_mon_vals no callback set 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5e7b85640 5 monclient: authenticate success, global_id 4287 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5e7b85640 10 monclient: _renew_subs 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5e7b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e015faf0 con 0x7ff5e01561a0 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5e7b85640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:06:51.629 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5e7b85640 10 monclient: _renew_subs 2026-02-17T21:06:51.630 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5e7b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:51.630 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e01600b0 con 0x7ff5e01561a0 2026-02-17T21:06:51.630 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.634+0000 7ff5e7b85640 1 librados: init done 2026-02-17T21:06:51.630 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.635+0000 7ff5e7b85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:51.630 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.635+0000 7ff5e7b85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:51.630 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.635+0000 7ff5e7b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:51.630 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.635+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e015d490 con 0x7ff5e01561a0 2026-02-17T21:06:51.743 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.751+0000 7ff5ce7fc640 1 -- 10.20.193.45:0/2794334989 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7ff5d4013470 con 0x7ff5e01561a0 2026-02-17T21:06:51.743 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.751+0000 7ff5ce7fc640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff5b00791f0 0x7ff5b007b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:51.743 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.751+0000 7ff5e58fa640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff5b00791f0 0x7ff5b007b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:51.743 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.751+0000 7ff5e58fa640 10 monclient: get_auth_request con 0x7ff5b00791f0 auth_method 0 2026-02-17T21:06:51.744 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.752+0000 7ff5e58fa640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff5b00791f0 0x7ff5b007b6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0159990 tx=0x7ff5d0009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:51.744 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.752+0000 7ff5ce7fc640 10 client.4287.objecter ms_handle_connect 0x7ff5b00791f0 2026-02-17T21:06:51.752 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.760+0000 7ff5ce7fc640 1 -- 10.20.193.45:0/2794334989 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2565+0+0 (secure 0 0 0) 0x7ff5d405e7a0 con 0x7ff5e01561a0 2026-02-17T21:06:51.753 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.760+0000 7ff5ce7fc640 10 client.4287.objecter ms_dispatch2 0x7ff5e0000b90 osd_map(18..18 src has 1..18) 2026-02-17T21:06:51.753 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.760+0000 7ff5ce7fc640 3 client.4287.objecter handle_osd_map got epochs [18,18] > 0 2026-02-17T21:06:51.753 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.760+0000 7ff5ce7fc640 3 client.4287.objecter handle_osd_map decoding full epoch 18 2026-02-17T21:06:51.753 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.760+0000 7ff5ce7fc640 20 client.4287.objecter dump_active .. 0 homeless 2026-02-17T21:06:51.753 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.760+0000 7ff5ce7fc640 1 -- 10.20.193.45:0/2794334989 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff5d4062760 con 0x7ff5e01561a0 2026-02-17T21:06:51.753 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.760+0000 7ff5ce7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:51.753 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.760+0000 7ff5ce7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:06:51.841 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.849+0000 7ff5e7b85640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:51.841 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.849+0000 7ff5e7b85640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:51.841 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.849+0000 7ff5e7b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:51.841 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.849+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5e006f530 con 0x7ff5e01561a0 2026-02-17T21:06:51.852 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.860+0000 7ff5ce7fc640 1 -- 10.20.193.45:0/2794334989 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12879 (secure 0 0 0) 0x7ff5d4066a60 con 0x7ff5e01561a0 2026-02-17T21:06:51.852 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.860+0000 7ff5ce7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:51.852 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.860+0000 7ff5ce7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:06:51.852 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:06:51.852 INFO:teuthology.misc.health.trial045.stdout:{"epoch":18,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:05:22.298564+0000","last_up_change":"0.000000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 10 librados: watch_flush enter 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 10 librados: watch_flush exit 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 20 client.4287.objecter shutdown clearing up homeless session... 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 10 client.4287.objecter successfully canceled tick 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff5b00791f0 msgr2=0x7ff5b007b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff5b00791f0 0x7ff5b007b6b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0159990 tx=0x7ff5d0009290 comp rx=0 tx=0).stop 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 10 monclient: shutdown 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e01561a0 msgr2=0x7ff5e00c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e01561a0 0x7ff5e00c5af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400e860 tx=0x7ff5d400ed30 comp rx=0 tx=0).stop 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 shutdown_connections 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff5b00791f0 0x7ff5b007b6b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff5e015d9d0 0x7ff5e0158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff5e01561a0 0x7ff5e00c5af0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 --2- 10.20.193.45:0/2794334989 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff5e0155dc0 0x7ff5e015f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 >> 10.20.193.45:0/2794334989 conn(0x7ff5e00c9ed0 msgr2=0x7ff5e0072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 shutdown_connections 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 -- 10.20.193.45:0/2794334989 wait complete. 2026-02-17T21:06:51.855 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:51.862+0000 7ff5e7b85640 1 librados: shutdown 2026-02-17T21:06:51.863 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-17T21:06:53.867 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-17T21:06:53.873+0000 77b6940 -1 osd.8 0 log_to_monitors true 2026-02-17T21:06:53.876 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-17T21:06:53.880+0000 77b6940 -1 osd.12 0 log_to_monitors true 2026-02-17T21:06:54.619 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-17T21:06:54.625+0000 77b6940 -1 osd.4 0 log_to_monitors true 2026-02-17T21:06:54.620 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:06:54.616+0000 77b6940 -1 osd.1 0 log_to_monitors true 2026-02-17T21:06:54.635 INFO:tasks.ceph.osd.13.trial086.stderr:2026-02-17T21:06:54.634+0000 77b6940 -1 osd.13 0 log_to_monitors true 2026-02-17T21:06:54.772 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:06:54.778+0000 77b6940 -1 osd.0 0 log_to_monitors true 2026-02-17T21:06:54.885 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:06:54.886+0000 77b6940 -1 osd.7 0 log_to_monitors true 2026-02-17T21:06:54.886 INFO:tasks.ceph.osd.3.trial138.stderr:2026-02-17T21:06:54.886+0000 77b6940 -1 osd.3 0 log_to_monitors true 2026-02-17T21:06:55.139 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:06:55.137+0000 77b6940 -1 osd.5 0 log_to_monitors true 2026-02-17T21:06:55.150 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:06:55.149+0000 77b6940 -1 osd.9 0 log_to_monitors true 2026-02-17T21:06:55.592 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:06:55.593+0000 77b6940 -1 osd.15 0 log_to_monitors true 2026-02-17T21:06:55.775 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:06:55.779+0000 77b6940 -1 osd.2 0 log_to_monitors true 2026-02-17T21:06:55.859 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:06:55.857+0000 77b6940 -1 osd.11 0 log_to_monitors true 2026-02-17T21:06:56.097 INFO:tasks.ceph.osd.6.trial092.stderr:2026-02-17T21:06:56.101+0000 77b6940 -1 osd.6 0 log_to_monitors true 2026-02-17T21:06:56.179 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-17T21:06:56.185+0000 deb0640 -1 osd.8 0 waiting for initial osdmap 2026-02-17T21:06:56.186 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-17T21:06:56.192+0000 deb0640 -1 osd.12 0 waiting for initial osdmap 2026-02-17T21:06:56.317 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:06:56.318+0000 77b6940 -1 osd.14 0 log_to_monitors true 2026-02-17T21:06:56.407 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-17T21:06:56.409+0000 11c74640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:06:56.415 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-17T21:06:56.416+0000 11c74640 -1 osd.12 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:06:57.203 INFO:tasks.ceph.osd.13.trial086.stderr:2026-02-17T21:06:57.202+0000 deb0640 -1 osd.13 0 waiting for initial osdmap 2026-02-17T21:06:57.213 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-17T21:06:57.219+0000 deb0640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T21:06:57.233 INFO:tasks.ceph.osd.10.trial092.stderr:2026-02-17T21:06:57.237+0000 77b6940 -1 osd.10 0 log_to_monitors true 2026-02-17T21:06:57.238 INFO:tasks.ceph.osd.3.trial138.stderr:2026-02-17T21:06:57.238+0000 ce9c640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T21:06:57.408 INFO:tasks.ceph.osd.13.trial086.stderr:2026-02-17T21:06:57.403+0000 11c74640 -1 osd.13 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:06:57.421 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-17T21:06:57.423+0000 11c74640 -1 osd.4 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:06:57.463 INFO:tasks.ceph.osd.3.trial138.stderr:2026-02-17T21:06:57.459+0000 11c74640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:06:58.230 INFO:tasks.ceph.osd.6.trial092.stderr:2026-02-17T21:06:58.234+0000 ce9c640 -1 osd.6 0 waiting for initial osdmap 2026-02-17T21:06:58.479 INFO:tasks.ceph.osd.6.trial092.stderr:2026-02-17T21:06:58.479+0000 11c74640 -1 osd.6 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:06:59.351 INFO:tasks.ceph.osd.10.trial092.stderr:2026-02-17T21:06:59.356+0000 deb0640 -1 osd.10 0 waiting for initial osdmap 2026-02-17T21:06:59.476 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:06:59.536 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.543+0000 7f674bd71640 10 monclient: get_monmap_and_config 2026-02-17T21:06:59.536 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.543+0000 7f674bd71640 10 monclient: build_initial_monmap 2026-02-17T21:06:59.536 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.543+0000 7f674bd71640 10 monclient: monmap: 2026-02-17T21:06:59.536 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:59.536 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:59.536 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:06:59.544725+0000 2026-02-17T21:06:59.536 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:06:59.544725+0000 2026-02-17T21:06:59.536 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:59.536 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:59.537 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:06:59.537 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:06:59.537 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:06:59.537 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:06:59.537 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:06:59.537 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:06:59.537 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:59.539 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 1 Processor -- start 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 1 -- start start 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient: init 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient: _add_conns ranks=[0,5,3,2,1,4] 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6744155dc0 addr v1:10.20.193.45:6789/0 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f67441561a0 0x7f67440c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient(hunting): picked mon.noname-c con 0x7f67441561a0 addr v2:10.20.193.92:3300/0 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f674415f590 0x7f674415f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient(hunting): picked mon.noname-a con 0x7f674415f590 addr v2:10.20.193.45:3300/0 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67440c4580 con 0x7f6744155dc0 2026-02-17T21:06:59.540 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f67440c9840 con 0x7f674415f590 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f67440c84c0 con 0x7f67441561a0 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.544+0000 7f674bd71640 10 monclient(hunting): authenticate will time out at 1003.174972s 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.545+0000 7f67492e5640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f67441561a0 0x7f67440c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.545+0000 7f67492e5640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f67441561a0 0x7f67440c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:46078/0 (socket says 10.20.193.45:46078) 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.545+0000 7f67492e5640 1 -- 10.20.193.45:0/223874973 learned_addr learned my addr 10.20.193.45:0/223874973 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.545+0000 7f67492e5640 10 monclient(hunting): get_auth_request con 0x7f67441561a0 auth_method 0 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.545+0000 7f67492e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.545+0000 7f67492e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:59.541 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.545+0000 7f67492e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.546+0000 7f67492e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.546+0000 7f67492e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.546+0000 7f67492e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.547+0000 7f67492e5640 10 monclient(hunting): handle_auth_done global_id 4379 payload 274 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.547+0000 7f67492e5640 1 -- 10.20.193.45:0/223874973 >> v2:10.20.193.45:3300/0 conn(0x7f674415f590 msgr2=0x7f674415f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.547+0000 7f67492e5640 1 --2- 10.20.193.45:0/223874973 >> v2:10.20.193.45:3300/0 conn(0x7f674415f590 0x7f674415f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.547+0000 7f67492e5640 1 -- 10.20.193.45:0/223874973 >> v1:10.20.193.45:6789/0 conn(0x7f6744155dc0 legacy=0x7f674415d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.547+0000 7f67492e5640 10 monclient: _finish_hunting 0 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.547+0000 7f67492e5640 1 monclient: found mon.noname-c 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.547+0000 7f67492e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.547+0000 7f67492e5640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:06:59.542 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.547+0000 7f67492e5640 1 -- 10.20.193.45:0/223874973 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67440c87a0 con 0x7f67441561a0 2026-02-17T21:06:59.546 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.548+0000 7f67492e5640 1 --2- 10.20.193.45:0/223874973 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f67441561a0 0x7f67440c7dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67440c9e80 tx=0x7f673802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d6b56530e362c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 1 -- 10.20.193.45:0/223874973 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673803c070 con 0x7f67441561a0 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 10 monclient: dump: 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:59.547 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 10 monclient: _finish_auth 0 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 10 monclient: _check_auth_tickets 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f674bd71640 5 monclient: authenticate success, global_id 4379 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f674bd71640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 1 -- 10.20.193.45:0/223874973 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673802fb40 con 0x7f67441561a0 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 1 -- 10.20.193.45:0/223874973 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738037440 con 0x7f67441561a0 2026-02-17T21:06:59.548 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f674bd71640 10 monclient: get_monmap_and_config success 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f674bd71640 4 set_mon_vals no callback set 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.550+0000 7f6748ae4640 10 monclient: dump: 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:59.549 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 10 monclient: shutdown 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 -- 10.20.193.45:0/223874973 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f67441561a0 msgr2=0x7f67440c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 --2- 10.20.193.45:0/223874973 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f67441561a0 0x7f67440c7dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67440c9e80 tx=0x7f673802eed0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 -- 10.20.193.45:0/223874973 shutdown_connections 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 --2- 10.20.193.45:0/223874973 >> v2:10.20.193.45:3300/0 conn(0x7f674415f590 0x7f674415f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 --2- 10.20.193.45:0/223874973 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f67441561a0 0x7f67440c7dd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 -- 10.20.193.45:0/223874973 >> 10.20.193.45:0/223874973 conn(0x7f67440c9ed0 msgr2=0x7f67440ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 -- 10.20.193.45:0/223874973 shutdown_connections 2026-02-17T21:06:59.550 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 -- 10.20.193.45:0/223874973 wait complete. 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 10 monclient: build_initial_monmap 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 10 monclient: monmap: 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:59.551 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 librados: starting msgr at 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 librados: starting objecter 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 Processor -- start 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 -- start start 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 librados: setting wanted keys 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 1 librados: calling monclient init 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.551+0000 7f674bd71640 10 monclient: init 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient: _reopen_session rank -1 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6744155dc0 0x7f6744072e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient(hunting): picked mon.noname-c con 0x7f6744155dc0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67441561a0 0x7f67441f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient(hunting): picked mon.noname-a con 0x7f67441561a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:06:59.552 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f674415f590 0x7f67441f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient(hunting): picked mon.noname-b con 0x7f674415f590 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f67440c9040 con 0x7f67441561a0 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67440c8d60 con 0x7f674415f590 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient(hunting): start opening mon connection 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67440c9320 con 0x7f6744155dc0 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient(hunting): _renew_subs 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674bd71640 10 monclient(hunting): authenticate will time out at 1003.182398s 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f67492e5640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67441561a0 0x7f67441f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f6749ae6640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6744155dc0 0x7f6744072e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:59.553 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f67492e5640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67441561a0 0x7f67441f5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:55808/0 (socket says 10.20.193.45:55808) 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f67492e5640 1 -- 10.20.193.45:0/3326486843 learned_addr learned my addr 10.20.193.45:0/3326486843 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f674a2e7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f674415f590 0x7f67441f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f67492e5640 10 monclient(hunting): get_auth_request con 0x7f67441561a0 auth_method 0 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f67492e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f67492e5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f67492e5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f6749ae6640 10 monclient(hunting): get_auth_request con 0x7f6744155dc0 auth_method 0 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f6749ae6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f6749ae6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.552+0000 7f6749ae6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f674a2e7640 10 monclient(hunting): get_auth_request con 0x7f674415f590 auth_method 0 2026-02-17T21:06:59.554 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f674a2e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f674a2e7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f674a2e7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f67492e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f67492e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f67492e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f6749ae6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f6749ae6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f6749ae6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f674a2e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f674a2e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:06:59.555 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.553+0000 7f674a2e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 10 monclient(hunting): handle_auth_done global_id 4335 payload 824 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 1 -- 10.20.193.45:0/3326486843 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6744155dc0 msgr2=0x7f6744072e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6744155dc0 0x7f6744072e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 1 -- 10.20.193.45:0/3326486843 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f674415f590 msgr2=0x7f67441f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f674415f590 0x7f67441f6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 10 monclient: _finish_hunting 0 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 1 monclient: found mon.noname-a 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:06:59.558 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.555+0000 7f67492e5640 1 -- 10.20.193.45:0/3326486843 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67441f4bd0 con 0x7f67441561a0 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.556+0000 7f67492e5640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67441561a0 0x7f67441f5f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6738002410 tx=0x7f67380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.556+0000 7f67327fc640 10 client.?.objecter ms_handle_connect 0x7f67441561a0 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.556+0000 7f67327fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 1 -- 10.20.193.45:0/3326486843 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738044070 con 0x7f67441561a0 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 10 monclient: dump: 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:59.559 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 10 monclient: _finish_auth 0 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 10 monclient: _check_auth_tickets 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 5 monclient: authenticate success, global_id 4335 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 1 -- 10.20.193.45:0/3326486843 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6738040630 con 0x7f67441561a0 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 10 monclient: _renew_subs 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:59.560 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67441f4e70 con 0x7f67441561a0 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 1 -- 10.20.193.45:0/3326486843 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673803c040 con 0x7f67441561a0 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f6733fff640 4 set_mon_vals no callback set 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f67327fc640 10 monclient: dump: 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:06:59.561 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 10 client.4335.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 10 monclient: _renew_subs 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67441f5430 con 0x7f67441561a0 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 1 librados: init done 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:59.562 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.558+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67440c7dd0 con 0x7f67441561a0 2026-02-17T21:06:59.563 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.571+0000 7f67327fc640 1 -- 10.20.193.45:0/3326486843 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 4) ==== 100189+0+0 (secure 0 0 0) 0x7f673803f050 con 0x7f67441561a0 2026-02-17T21:06:59.564 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.571+0000 7f67327fc640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67140791f0 0x7f671407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:06:59.564 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.571+0000 7f6749ae6640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67140791f0 0x7f671407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:06:59.564 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.571+0000 7f6749ae6640 10 monclient: get_auth_request con 0x7f67140791f0 auth_method 0 2026-02-17T21:06:59.564 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.571+0000 7f6749ae6640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67140791f0 0x7f671407b6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6734004660 tx=0x7f6734009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:06:59.564 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.571+0000 7f67327fc640 10 client.4335.objecter ms_handle_connect 0x7f67140791f0 2026-02-17T21:06:59.566 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.573+0000 7f67327fc640 1 -- 10.20.193.45:0/3326486843 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5752+0+0 (secure 0 0 0) 0x7f67380832a0 con 0x7f67441561a0 2026-02-17T21:06:59.566 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.573+0000 7f67327fc640 10 client.4335.objecter ms_dispatch2 0x7f6744000b90 osd_map(23..23 src has 1..23) 2026-02-17T21:06:59.566 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.573+0000 7f67327fc640 3 client.4335.objecter handle_osd_map got epochs [23,23] > 0 2026-02-17T21:06:59.566 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.573+0000 7f67327fc640 3 client.4335.objecter handle_osd_map decoding full epoch 23 2026-02-17T21:06:59.566 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.573+0000 7f67327fc640 20 client.4335.objecter dump_active .. 0 homeless 2026-02-17T21:06:59.625 INFO:tasks.ceph.osd.10.trial092.stderr:2026-02-17T21:06:59.624+0000 11c74640 -1 osd.10 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:06:59.673 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.681+0000 7f67327fc640 1 -- 10.20.193.45:0/3326486843 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6738087260 con 0x7f67441561a0 2026-02-17T21:06:59.673 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.681+0000 7f67327fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:06:59.673 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.681+0000 7f67327fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:06:59.759 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.767+0000 7f674bd71640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:59.759 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.767+0000 7f674bd71640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:59.759 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.767+0000 7f674bd71640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:06:59.759 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.767+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f674406f530 con 0x7f67441561a0 2026-02-17T21:06:59.802 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.810+0000 7f67327fc640 1 -- 10.20.193.45:0/3326486843 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+17707 (secure 0 0 0) 0x7f673808b560 con 0x7f67441561a0 2026-02-17T21:06:59.802 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.810+0000 7f67327fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:06:59.802 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.810+0000 7f67327fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:06:59.802 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:06:59.802 INFO:teuthology.misc.health.trial045.stdout:{"epoch":23,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:06:59.073039+0000","last_up_change":"2026-02-17T21:06:59.073039+0000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:06:58.807280+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":16.670000076293945,"score_stable":16.670000076293945,"optimal_score":0.059999998658895493,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6800","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6801","nonce":1535515312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6802","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6803","nonce":1535515312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6806","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6807","nonce":1535515312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6804","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6805","nonce":1535515312}]},"public_addr":"10.20.193.138:6801/1535515312","cluster_addr":"10.20.193.138:6803/1535515312","heartbeat_back_addr":"10.20.193.138:6807/1535515312","heartbeat_front_addr":"10.20.193.138:6805/1535515312","state":["exists","up"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6826","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6827","nonce":1457283840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6828","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6829","nonce":1457283840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6832","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6833","nonce":1457283840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6830","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6831","nonce":1457283840}]},"public_addr":"10.20.193.45:6827/1457283840","cluster_addr":"10.20.193.45:6829/1457283840","heartbeat_back_addr":"10.20.193.45:6833/1457283840","heartbeat_front_addr":"10.20.193.45:6831/1457283840","state":["exists","up"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6817","nonce":1142590747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6819","nonce":1142590747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6823","nonce":1142590747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6821","nonce":1142590747}]},"public_addr":"10.20.193.92:6817/1142590747","cluster_addr":"10.20.193.92:6819/1142590747","heartbeat_back_addr":"10.20.193.92:6823/1142590747","heartbeat_front_addr":"10.20.193.92:6821/1142590747","state":["exists","up"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6810","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6811","nonce":442873512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6812","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6813","nonce":442873512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6816","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6817","nonce":442873512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6814","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6815","nonce":442873512}]},"public_addr":"10.20.193.45:6811/442873512","cluster_addr":"10.20.193.45:6813/442873512","heartbeat_back_addr":"10.20.193.45:6817/442873512","heartbeat_front_addr":"10.20.193.45:6815/442873512","state":["exists","up"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6802","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6803","nonce":1807719437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6804","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6805","nonce":1807719437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6808","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6809","nonce":1807719437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6806","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6807","nonce":1807719437}]},"public_addr":"10.20.193.45:6803/1807719437","cluster_addr":"10.20.193.45:6805/1807719437","heartbeat_back_addr":"10.20.193.45:6809/1807719437","heartbeat_front_addr":"10.20.193.45:6807/1807719437","state":["exists","up"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6809","nonce":3260427089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6811","nonce":3260427089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6815","nonce":3260427089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6813","nonce":3260427089}]},"public_addr":"10.20.193.86:6809/3260427089","cluster_addr":"10.20.193.86:6811/3260427089","heartbeat_back_addr":"10.20.193.86:6815/3260427089","heartbeat_front_addr":"10.20.193.86:6813/3260427089","state":["exists","up"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.256012+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.275532+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.236866+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.035025+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:06:59.804 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 10 librados: watch_flush enter 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 10 librados: watch_flush exit 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 20 client.4335.objecter shutdown clearing up homeless session... 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 10 client.4335.objecter successfully canceled tick 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67140791f0 msgr2=0x7f671407b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67140791f0 0x7f671407b6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6734004660 tx=0x7f6734009110 comp rx=0 tx=0).stop 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 10 monclient: shutdown 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67441561a0 msgr2=0x7f67441f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67441561a0 0x7f67441f5f10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6738002410 tx=0x7f67380047c0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 shutdown_connections 2026-02-17T21:06:59.805 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67140791f0 0x7f671407b6b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.806 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f674415f590 0x7f67441f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.806 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67441561a0 0x7f67441f5f10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.806 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.811+0000 7f674bd71640 1 --2- 10.20.193.45:0/3326486843 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6744155dc0 0x7f6744072e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:06:59.806 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.812+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 >> 10.20.193.45:0/3326486843 conn(0x7f67440c9ed0 msgr2=0x7f674406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:06:59.806 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.812+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 shutdown_connections 2026-02-17T21:06:59.806 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.812+0000 7f674bd71640 1 -- 10.20.193.45:0/3326486843 wait complete. 2026-02-17T21:06:59.806 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:06:59.812+0000 7f674bd71640 1 librados: shutdown 2026-02-17T21:06:59.813 DEBUG:teuthology.misc:6 of 16 OSDs are up 2026-02-17T21:07:00.565 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.556+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.569 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.565+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.573 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.562+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.573 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.566+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.579 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.574+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.582 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.572+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.585 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.580+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.586 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.586+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.588 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.586+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.600 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.590+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.605 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.579+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.612 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.589+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.613 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.595+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.618 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.574+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2026-02-17T21:07:00.619 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.619+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.621 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.598+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 2 2026-02-17T21:07:00.622 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.613+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.623 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.625+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.624 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.603+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.629 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.615+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.631 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.601+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.632 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.622+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.633 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.630+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.639 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.631+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.640 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.634+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.645 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.647+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.648 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.626+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.648 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.631+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.648 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.638+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.655 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.650+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.660 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.647+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.664 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.649+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.671 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.665+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.683 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.658+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 2 2026-02-17T21:07:00.683 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.661+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.683 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.683+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.685 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.685+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.688 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.672+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.689 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.683+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.696 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.687+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.698 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.641+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.704 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.670+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.704 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.681+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.705 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.690+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.705 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.706+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.710 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.684+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.712 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.699+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.712 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.714+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.713 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.654+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.715 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.711+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2026-02-17T21:07:00.718 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.665+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.720 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.715+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.726 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.721+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.727 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.727+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.727 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.718+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 3 2026-02-17T21:07:00.727 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.718+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 4 2026-02-17T21:07:00.729 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.725+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 4 2026-02-17T21:07:00.735 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.699+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.735 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.729+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.738 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.728+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.739 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.731+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.740 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.736+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.745 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.741+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.749 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.729+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.751 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.747+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.755 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.741+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.755 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.749+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.761 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.740+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.763 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.756+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.771 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.751+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.772 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.734+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.774 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.772+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.777 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.746+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.779 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.764+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.779 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.768+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.786 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.778+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.798 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.774+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.799 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.791+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.808 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.800+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.814 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.780+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.814 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.787+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 2 2026-02-17T21:07:00.814 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.822+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.820 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.787+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.830 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.838+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.837 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.793+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.838 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.810+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.845 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.816+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.845 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.842+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 2 2026-02-17T21:07:00.845 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.853+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.854 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.773+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.854 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.818+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.857 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.822+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.857 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.839+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.862 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.780+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 6 2026-02-17T21:07:00.866 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.842+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.871 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.861+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.878 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.848+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.888 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.858+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.888 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.866+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.888 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.872+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.897 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.855+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.900 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.864+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.901 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.881+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.902 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.890+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.905 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.896+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.912 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.906+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.919 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.887+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.919 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.903+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.919 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.913+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.926 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.902+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.936 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.915+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.936 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.920+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.937 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.913+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 2 2026-02-17T21:07:00.937 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.919+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.948 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.938+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.953 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.934+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.954 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.962+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 3 2026-02-17T21:07:00.955 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.942+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:00.958 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.940+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.960 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.950+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.963 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.961+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:00.974 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.971+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.984 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.919+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 6 2026-02-17T21:07:00.984 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.943+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:00.987 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.965+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.988 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.988+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:00.992 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.988+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:00.996 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:00.997+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 2 2026-02-17T21:07:01.003 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:00.994+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:01.006 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.957+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:01.007 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:00.964+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:01.007 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:01.007+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:01.010 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:00.967+0000 77b6940 -1 bdev(0x16f3ac50 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2026-02-17T21:07:01.013 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:00.985+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 2 2026-02-17T21:07:01.016 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:01.007+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:01.022 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:01.014+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:01.022 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:01.017+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:01.025 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:01.000+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:01.025 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:01.011+0000 77b6940 -1 bdev(0x16f686e0 /var/lib/ceph/osd/ceph-0/block) aio_submit retries 1 2026-02-17T21:07:01.026 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:01.010+0000 77b6940 -1 bdev(0x16f49ab0 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 1 2026-02-17T21:07:01.032 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:01.027+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:01.037 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:01.023+0000 77b6940 -1 bdev(0x16f4c490 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2026-02-17T21:07:01.062 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:01.035+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:01.073 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:01.063+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:01.079 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:01.075+0000 77b6940 -1 bdev(0x16f59640 /var/lib/ceph/osd/ceph-9/block) aio_submit retries 1 2026-02-17T21:07:01.409 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:01.416+0000 ce9c640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T21:07:01.419 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:01.418+0000 deb0640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T21:07:01.423 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:01.423+0000 deb0640 -1 osd.7 0 waiting for initial osdmap 2026-02-17T21:07:01.458 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:01.456+0000 deb0640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T21:07:01.489 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:01.488+0000 ce9c640 -1 osd.9 0 waiting for initial osdmap 2026-02-17T21:07:01.547 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.550+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.554 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.542+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 2 2026-02-17T21:07:01.560 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.557+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.572 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.572+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.585 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.563+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.586 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.569+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.595 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.578+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.597 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.591+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.597 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.576+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.599 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.601+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.603 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.603+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.606 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.609+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.612 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.588+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.613 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.600+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.616 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.588+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.617 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.599+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.619 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.618+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.621 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.619+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.623 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.612+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.624 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.615+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.626 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.629+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.627 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.620+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.627 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.626+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.631 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.623+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.637 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.642+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.637 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.626+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 2 2026-02-17T21:07:01.641 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:07:01.637+0000 15c7c640 -1 osd.7 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:07:01.641 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:07:01.643+0000 15c7c640 -1 osd.0 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:07:01.645 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.629+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.650 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.630+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.650 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.653+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.657 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.643+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.658 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.663+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.659 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.663+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.669 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.671+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 2 2026-02-17T21:07:01.671 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:07:01.666+0000 15c7c640 -1 osd.5 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:07:01.673 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:07:01.668+0000 15c7c640 -1 osd.1 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:07:01.676 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.678+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 4 2026-02-17T21:07:01.676 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.633+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.676 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.648+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.679 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.674+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.703 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.644+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.704 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.702+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.705 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.690+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 4 2026-02-17T21:07:01.711 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.702+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.714 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.713+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 2 2026-02-17T21:07:01.715 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.710+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.718 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.717+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.721 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.727+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.724 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.708+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.724 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.714+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.730 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:07:01.725+0000 15c7c640 -1 osd.9 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:07:01.736 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.741+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.740 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.719+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.740 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.727+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.745 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.733+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.747 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.743+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.761 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.763+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.767 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.737+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.767 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.745+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.768 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.773+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.776 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.781+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.781 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.762+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 6 2026-02-17T21:07:01.788 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.785+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 3 2026-02-17T21:07:01.791 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.781+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.791 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.797+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.826 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.806+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.839 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.821+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 2 2026-02-17T21:07:01.839 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.833+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 3 2026-02-17T21:07:01.839 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.830+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.841 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.820+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.846 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.817+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.847 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.836+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.849 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.846+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.851 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.852+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.851 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.852+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 2 2026-02-17T21:07:01.851 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.839+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.853 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.845+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.857 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.845+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.858 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.857+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.862 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.856+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.870 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.858+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.872 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.863+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.884 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.865+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.884 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.881+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.889 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.876+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.891 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.889+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 2 2026-02-17T21:07:01.904 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.894+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.904 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.900+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.918 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.907+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.918 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.920+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.918 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.896+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.924 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.913+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.931 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.893+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.933 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.878+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.944 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.945+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.952 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.924+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.953 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.930+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.954 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.958+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 2 2026-02-17T21:07:01.954 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.959+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.956 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.936+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.956 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.947+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 1 2026-02-17T21:07:01.960 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.937+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.960 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.947+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.962 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.954+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.968 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.965+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.971 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.973+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:01.979 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.971+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.980 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.980+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.980 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.985+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:01.986 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.989+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:01.995 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.982+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 4 2026-02-17T21:07:02.001 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:01.985+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:02.012 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:01.995+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 1 2026-02-17T21:07:02.012 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:01.996+0000 77b6940 -1 bdev(0x16f48b50 /var/lib/ceph/osd/ceph-15/block) aio_submit retries 1 2026-02-17T21:07:02.013 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:01.998+0000 77b6940 -1 bdev(0x16f54010 /var/lib/ceph/osd/ceph-11/block) aio_submit retries 2 2026-02-17T21:07:02.041 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:02.023+0000 77b6940 -1 bdev(0x16f27750 /var/lib/ceph/osd/ceph-14/block) aio_submit retries 2 2026-02-17T21:07:02.041 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:02.014+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:02.053 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:02.059+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 4 2026-02-17T21:07:02.073 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:02.075+0000 77b6940 -1 bdev(0x16f40fb0 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2026-02-17T21:07:02.417 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:02.417+0000 deb0640 -1 osd.11 0 waiting for initial osdmap 2026-02-17T21:07:02.419 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:02.419+0000 ce9c640 -1 osd.15 0 waiting for initial osdmap 2026-02-17T21:07:02.440 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:02.443+0000 ce9c640 -1 osd.14 0 waiting for initial osdmap 2026-02-17T21:07:02.451 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:02.456+0000 ce9c640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T21:07:02.680 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:07:02.677+0000 15c7c640 -1 osd.11 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:07:02.692 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:07:02.688+0000 15c7c640 -1 osd.15 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:07:02.695 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:07:02.694+0000 15c7c640 -1 osd.14 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:07:02.703 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:07:02.703+0000 15c7c640 -1 osd.2 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T21:07:07.425 DEBUG:teuthology.orchestra.run.trial045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-17T21:07:07.485 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.492+0000 7f203b0da640 10 monclient: get_monmap_and_config 2026-02-17T21:07:07.486 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.492+0000 7f203b0da640 10 monclient: build_initial_monmap 2026-02-17T21:07:07.486 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.492+0000 7f203b0da640 10 monclient: monmap: 2026-02-17T21:07:07.486 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:07:07.486 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.486 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:07:07.494573+0000 2026-02-17T21:07:07.486 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:07:07.494573+0000 2026-02-17T21:07:07.486 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:07.486 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.486 INFO:teuthology.misc.health.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:07.487 INFO:teuthology.misc.health.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:07.487 INFO:teuthology.misc.health.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:07.487 INFO:teuthology.misc.health.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:07.487 INFO:teuthology.misc.health.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:07.487 INFO:teuthology.misc.health.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:07.487 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:07:07.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 1 Processor -- start 2026-02-17T21:07:07.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 1 -- start start 2026-02-17T21:07:07.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient: init 2026-02-17T21:07:07.490 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient: _add_conns ranks=[4,5,1,0,2,3] 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f2034153bf0 0x7f2034153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient(hunting): picked mon.noname-b con 0x7f2034153bf0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f20340c7dd0 0x7f203415b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient(hunting): picked mon.noname-c con 0x7f20340c7dd0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f20340c8240 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20340c8810 con 0x7f20340c8240 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f20340c9700 con 0x7f2034153bf0 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:07.491 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f20340c8af0 con 0x7f20340c7dd0 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.493+0000 7f203b0da640 10 monclient(hunting): authenticate will time out at 1011.124712s 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f202bfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f20340c7dd0 0x7f203415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f2038e4f640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f2034153bf0 0x7f2034153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f2039650640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f20340c8240 0x7f20340c52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:37892/0 (socket says 10.20.193.45:37892) 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f2039650640 1 -- 10.20.193.45:0/3795933383 learned_addr learned my addr 10.20.193.45:0/3795933383 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f202bfff640 10 monclient(hunting): get_auth_request con 0x7f20340c7dd0 auth_method 0 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f202bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f202bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f202bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f2038e4f640 10 monclient(hunting): get_auth_request con 0x7f2034153bf0 auth_method 0 2026-02-17T21:07:07.492 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f2038e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f2038e4f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f2038e4f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f202bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f202bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.494+0000 7f202bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f2038e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f2038e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f2038e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f202bfff640 10 monclient(hunting): handle_auth_done global_id 4394 payload 274 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f202bfff640 1 -- 10.20.193.45:0/3795933383 >> v2:10.20.193.86:3300/0 conn(0x7f2034153bf0 msgr2=0x7f2034153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f202bfff640 1 --2- 10.20.193.45:0/3795933383 >> v2:10.20.193.86:3300/0 conn(0x7f2034153bf0 0x7f2034153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f202bfff640 1 -- 10.20.193.45:0/3795933383 >> v1:10.20.193.86:6789/0 conn(0x7f20340c8240 legacy=0x7f20340c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.493 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f202bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:07.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f202bfff640 1 monclient: found mon.noname-c 2026-02-17T21:07:07.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f202bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:07.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f202bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:07.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.495+0000 7f202bfff640 1 -- 10.20.193.45:0/3795933383 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20340c8dd0 con 0x7f20340c7dd0 2026-02-17T21:07:07.494 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.496+0000 7f202bfff640 1 --2- 10.20.193.45:0/3795933383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f20340c7dd0 0x7f203415b240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f203415d180 tx=0x7f201c02ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d15d1f612c0343e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:07.500 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 1 -- 10.20.193.45:0/3795933383 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c03c070 con 0x7f20340c7dd0 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 10 monclient: dump: 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:07.501 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 1 -- 10.20.193.45:0/3795933383 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201c02faf0 con 0x7f20340c7dd0 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 1 -- 10.20.193.45:0/3795933383 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c037440 con 0x7f20340c7dd0 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f202b7fe640 10 monclient: dump: 2026-02-17T21:07:07.502 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f203b0da640 5 monclient: authenticate success, global_id 4394 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f203b0da640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:07.503 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.498+0000 7f203b0da640 4 set_mon_vals no callback set 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 10 monclient: shutdown 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 -- 10.20.193.45:0/3795933383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f20340c7dd0 msgr2=0x7f203415b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 --2- 10.20.193.45:0/3795933383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f20340c7dd0 0x7f203415b240 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f203415d180 tx=0x7f201c02ede0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 -- 10.20.193.45:0/3795933383 shutdown_connections 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 --2- 10.20.193.45:0/3795933383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f20340c7dd0 0x7f203415b240 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 --2- 10.20.193.45:0/3795933383 >> v2:10.20.193.86:3300/0 conn(0x7f2034153bf0 0x7f2034153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 -- 10.20.193.45:0/3795933383 >> 10.20.193.45:0/3795933383 conn(0x7f20340c9ed0 msgr2=0x7f20340ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 -- 10.20.193.45:0/3795933383 shutdown_connections 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 -- 10.20.193.45:0/3795933383 wait complete. 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 10 monclient: build_initial_monmap 2026-02-17T21:07:07.504 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 10 monclient: monmap: 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:epoch 0 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:created 0.000000 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 librados: starting msgr at 2026-02-17T21:07:07.505 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 librados: starting objecter 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 Processor -- start 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 -- start start 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 librados: setting wanted keys 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 1 librados: calling monclient init 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.499+0000 7f203b0da640 10 monclient: init 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f20340c7dd0 0x7f203415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient(hunting): picked mon.noname-b con 0x7f20340c7dd0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f20340c8240 0x7f20341f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient(hunting): picked mon.noname-a con 0x7f20340c8240 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2034153bf0 0x7f20341f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.506 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient(hunting): picked mon.noname-c con 0x7f2034153bf0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f20340c59e0 con 0x7f20340c8240 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f20340c9390 con 0x7f20340c7dd0 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20340c5b60 con 0x7f2034153bf0 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f203b0da640 10 monclient(hunting): authenticate will time out at 1011.131259s 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f202bfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f20340c8240 0x7f20341f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2039650640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2034153bf0 0x7f20341f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2038e4f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f20340c7dd0 0x7f203415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.507 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f202bfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f20340c8240 0x7f20341f4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:55854/0 (socket says 10.20.193.45:55854) 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f202bfff640 1 -- 10.20.193.45:0/915423146 learned_addr learned my addr 10.20.193.45:0/915423146 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f202bfff640 10 monclient(hunting): get_auth_request con 0x7f20340c8240 auth_method 0 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f202bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f202bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f202bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2039650640 10 monclient(hunting): get_auth_request con 0x7f2034153bf0 auth_method 0 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2039650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2039650640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2039650640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2038e4f640 10 monclient(hunting): get_auth_request con 0x7f20340c7dd0 auth_method 0 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2038e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2038e4f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:07.508 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.500+0000 7f2038e4f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.501+0000 7f2039650640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.501+0000 7f2039650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.501+0000 7f2039650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.501+0000 7f202bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.501+0000 7f202bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.501+0000 7f202bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.501+0000 7f2038e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.501+0000 7f2038e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.501+0000 7f2038e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:07.509 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 10 monclient(hunting): handle_auth_done global_id 4366 payload 824 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 1 -- 10.20.193.45:0/915423146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2034153bf0 msgr2=0x7f20341f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2034153bf0 0x7f20341f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 1 -- 10.20.193.45:0/915423146 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f20340c8240 msgr2=0x7f20341f4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f20340c8240 0x7f20341f4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 10 monclient: _finish_hunting 0 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 1 monclient: found mon.noname-b 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.502+0000 7f2038e4f640 1 -- 10.20.193.45:0/915423146 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203415b8f0 con 0x7f20340c7dd0 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.503+0000 7f2038e4f640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f20340c7dd0 0x7f203415b020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f202400e9b0 tx=0x7f202400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.503+0000 7f20297fa640 10 client.?.objecter ms_handle_connect 0x7f20340c7dd0 2026-02-17T21:07:07.510 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.503+0000 7f20297fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 1 -- 10.20.193.45:0/915423146 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024017070 con 0x7f20340c7dd0 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 10 monclient: dump: 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:07.511 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f203b0da640 5 monclient: authenticate success, global_id 4366 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 1 -- 10.20.193.45:0/915423146 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202400ca00 con 0x7f20340c7dd0 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 1 -- 10.20.193.45:0/915423146 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202400cdf0 con 0x7f20340c7dd0 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f202affd640 4 set_mon_vals no callback set 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f20297fa640 10 monclient: dump: 2026-02-17T21:07:07.512 INFO:teuthology.misc.health.trial045.stderr:epoch 1 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr: 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f203b0da640 10 monclient: _renew_subs 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f203b0da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:07.513 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203415bbd0 con 0x7f20340c7dd0 2026-02-17T21:07:07.514 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f203b0da640 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:07.514 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f203b0da640 10 monclient: _renew_subs 2026-02-17T21:07:07.514 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f203b0da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:07.514 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203415c190 con 0x7f20340c7dd0 2026-02-17T21:07:07.514 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.505+0000 7f203b0da640 1 librados: init done 2026-02-17T21:07:07.514 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.506+0000 7f203b0da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:07.514 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.506+0000 7f203b0da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:07.514 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.506+0000 7f203b0da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:07.514 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.506+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2034153fd0 con 0x7f20340c7dd0 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.518+0000 7f20297fa640 1 -- 10.20.193.45:0/915423146 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f2024024060 con 0x7f20340c7dd0 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.518+0000 7f20297fa640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f20040792b0 0x7f200407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.518+0000 7f202bfff640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f20040792b0 0x7f200407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.518+0000 7f202bfff640 10 monclient: get_auth_request con 0x7f20040792b0 auth_method 0 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.519+0000 7f202bfff640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f20040792b0 0x7f200407b770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f201c02ee20 tx=0x7f201c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.519+0000 7f20297fa640 10 client.4366.objecter ms_handle_connect 0x7f20040792b0 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.520+0000 7f20297fa640 1 -- 10.20.193.45:0/915423146 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 8563+0+0 (secure 0 0 0) 0x7f202405e470 con 0x7f20340c7dd0 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.520+0000 7f20297fa640 10 client.4366.objecter ms_dispatch2 0x7f2034000b90 osd_map(28..28 src has 1..28) 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.520+0000 7f20297fa640 3 client.4366.objecter handle_osd_map got epochs [28,28] > 0 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.520+0000 7f20297fa640 3 client.4366.objecter handle_osd_map decoding full epoch 28 2026-02-17T21:07:07.516 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.520+0000 7f20297fa640 20 client.4366.objecter dump_active .. 0 homeless 2026-02-17T21:07:07.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.628+0000 7f20297fa640 1 -- 10.20.193.45:0/915423146 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2024062430 con 0x7f20340c7dd0 2026-02-17T21:07:07.621 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.628+0000 7f20297fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:07.622 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.628+0000 7f20297fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:07.704 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.711+0000 7f203b0da640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:07:07.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.711+0000 7f203b0da640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:07:07.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.711+0000 7f203b0da640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:07.705 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.711+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f203414ead0 con 0x7f20340c7dd0 2026-02-17T21:07:07.751 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f20297fa640 1 -- 10.20.193.45:0/915423146 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+22682 (secure 0 0 0) 0x7f2024066730 con 0x7f20340c7dd0 2026-02-17T21:07:07.752 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f20297fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:07:07.752 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f20297fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:07.752 INFO:teuthology.misc.health.trial045.stdout: 2026-02-17T21:07:07.752 INFO:teuthology.misc.health.trial045.stdout:{"epoch":28,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:07:06.065840+0000","last_up_change":"2026-02-17T21:07:03.875560+0000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:06:58.807280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6818","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6819","nonce":529906394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6820","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6821","nonce":529906394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6824","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6825","nonce":529906394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6822","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6823","nonce":529906394}]},"public_addr":"10.20.193.45:6819/529906394","cluster_addr":"10.20.193.45:6821/529906394","heartbeat_back_addr":"10.20.193.45:6825/529906394","heartbeat_front_addr":"10.20.193.45:6823/529906394","state":["exists","up"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6801","nonce":37724401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6803","nonce":37724401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6807","nonce":37724401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6805","nonce":37724401}]},"public_addr":"10.20.193.86:6801/37724401","cluster_addr":"10.20.193.86:6803/37724401","heartbeat_back_addr":"10.20.193.86:6807/37724401","heartbeat_front_addr":"10.20.193.86:6805/37724401","state":["exists","up"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6800","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6801","nonce":281465485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6803","nonce":281465485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6807","nonce":281465485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6805","nonce":281465485}]},"public_addr":"10.20.193.92:6801/281465485","cluster_addr":"10.20.193.92:6803/281465485","heartbeat_back_addr":"10.20.193.92:6807/281465485","heartbeat_front_addr":"10.20.193.92:6805/281465485","state":["exists","up"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6800","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6801","nonce":1535515312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6802","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6803","nonce":1535515312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6806","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6807","nonce":1535515312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6804","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6805","nonce":1535515312}]},"public_addr":"10.20.193.138:6801/1535515312","cluster_addr":"10.20.193.138:6803/1535515312","heartbeat_back_addr":"10.20.193.138:6807/1535515312","heartbeat_front_addr":"10.20.193.138:6805/1535515312","state":["exists","up"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6826","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6827","nonce":1457283840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6828","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6829","nonce":1457283840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6832","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6833","nonce":1457283840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6830","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6831","nonce":1457283840}]},"public_addr":"10.20.193.45:6827/1457283840","cluster_addr":"10.20.193.45:6829/1457283840","heartbeat_back_addr":"10.20.193.45:6833/1457283840","heartbeat_front_addr":"10.20.193.45:6831/1457283840","state":["exists","up"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6824","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6825","nonce":63160539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6826","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6827","nonce":63160539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6830","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6831","nonce":63160539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6828","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6829","nonce":63160539}]},"public_addr":"10.20.193.86:6825/63160539","cluster_addr":"10.20.193.86:6827/63160539","heartbeat_back_addr":"10.20.193.86:6831/63160539","heartbeat_front_addr":"10.20.193.86:6829/63160539","state":["exists","up"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6817","nonce":1142590747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6819","nonce":1142590747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6823","nonce":1142590747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6821","nonce":1142590747}]},"public_addr":"10.20.193.92:6817/1142590747","cluster_addr":"10.20.193.92:6819/1142590747","heartbeat_back_addr":"10.20.193.92:6823/1142590747","heartbeat_front_addr":"10.20.193.92:6821/1142590747","state":["exists","up"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6808","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6809","nonce":1754305677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6810","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6811","nonce":1754305677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6814","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6815","nonce":1754305677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6812","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6813","nonce":1754305677}]},"public_addr":"10.20.193.138:6809/1754305677","cluster_addr":"10.20.193.138:6811/1754305677","heartbeat_back_addr":"10.20.193.138:6815/1754305677","heartbeat_front_addr":"10.20.193.138:6813/1754305677","state":["exists","up"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6810","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6811","nonce":442873512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6812","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6813","nonce":442873512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6816","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6817","nonce":442873512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6814","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6815","nonce":442873512}]},"public_addr":"10.20.193.45:6811/442873512","cluster_addr":"10.20.193.45:6813/442873512","heartbeat_back_addr":"10.20.193.45:6817/442873512","heartbeat_front_addr":"10.20.193.45:6815/442873512","state":["exists","up"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6817","nonce":1248523526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6818","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6819","nonce":1248523526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6822","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6823","nonce":1248523526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6820","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6821","nonce":1248523526}]},"public_addr":"10.20.193.86:6817/1248523526","cluster_addr":"10.20.193.86:6819/1248523526","heartbeat_back_addr":"10.20.193.86:6823/1248523526","heartbeat_front_addr":"10.20.193.86:6821/1248523526","state":["exists","up"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6825","nonce":1170783250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6827","nonce":1170783250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6831","nonce":1170783250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6829","nonce":1170783250}]},"public_addr":"10.20.193.92:6825/1170783250","cluster_addr":"10.20.193.92:6827/1170783250","heartbeat_back_addr":"10.20.193.92:6831/1170783250","heartbeat_front_addr":"10.20.193.92:6829/1170783250","state":["exists","up"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6824","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6825","nonce":4038031379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6826","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6827","nonce":4038031379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6830","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6831","nonce":4038031379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6828","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6829","nonce":4038031379}]},"public_addr":"10.20.193.138:6825/4038031379","cluster_addr":"10.20.193.138:6827/4038031379","heartbeat_back_addr":"10.20.193.138:6831/4038031379","heartbeat_front_addr":"10.20.193.138:6829/4038031379","state":["exists","up"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6802","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6803","nonce":1807719437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6804","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6805","nonce":1807719437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6808","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6809","nonce":1807719437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6806","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6807","nonce":1807719437}]},"public_addr":"10.20.193.45:6803/1807719437","cluster_addr":"10.20.193.45:6805/1807719437","heartbeat_back_addr":"10.20.193.45:6809/1807719437","heartbeat_front_addr":"10.20.193.45:6807/1807719437","state":["exists","up"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6809","nonce":3260427089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6811","nonce":3260427089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6815","nonce":3260427089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6813","nonce":3260427089}]},"public_addr":"10.20.193.86:6809/3260427089","cluster_addr":"10.20.193.86:6811/3260427089","heartbeat_back_addr":"10.20.193.86:6815/3260427089","heartbeat_front_addr":"10.20.193.86:6813/3260427089","state":["exists","up"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6809","nonce":1799526026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6811","nonce":1799526026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6815","nonce":1799526026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6813","nonce":1799526026}]},"public_addr":"10.20.193.92:6809/1799526026","cluster_addr":"10.20.193.92:6811/1799526026","heartbeat_back_addr":"10.20.193.92:6815/1799526026","heartbeat_front_addr":"10.20.193.92:6813/1799526026","state":["exists","up"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6816","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6817","nonce":3769626240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6818","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6819","nonce":3769626240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6822","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6823","nonce":3769626240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6820","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6821","nonce":3769626240}]},"public_addr":"10.20.193.138:6817/3769626240","cluster_addr":"10.20.193.138:6819/3769626240","heartbeat_back_addr":"10.20.193.138:6823/3769626240","heartbeat_front_addr":"10.20.193.138:6821/3769626240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.146672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.052295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.217450+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.256012+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.980302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.553824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.474116+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.319384+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.275532+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.578309+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:58.653384+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.279721+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.236866+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.035025+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.697501+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.942416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:07:07.754 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 10 librados: watch_flush enter 2026-02-17T21:07:07.754 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 10 librados: watch_flush exit 2026-02-17T21:07:07.754 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 20 client.4366.objecter shutdown clearing up homeless session... 2026-02-17T21:07:07.754 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 10 client.4366.objecter successfully canceled tick 2026-02-17T21:07:07.754 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f20040792b0 msgr2=0x7f200407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.754 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f20040792b0 0x7f200407b770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f201c02ee20 tx=0x7f201c033000 comp rx=0 tx=0).stop 2026-02-17T21:07:07.754 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 10 monclient: shutdown 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f20340c7dd0 msgr2=0x7f203415b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f20340c7dd0 0x7f203415b020 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f202400e9b0 tx=0x7f202400ee80 comp rx=0 tx=0).stop 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 shutdown_connections 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f20040792b0 0x7f200407b770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2034153bf0 0x7f20341f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f20340c8240 0x7f20341f4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 --2- 10.20.193.45:0/915423146 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f20340c7dd0 0x7f203415b020 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 >> 10.20.193.45:0/915423146 conn(0x7f20340c9ed0 msgr2=0x7f2034151630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 shutdown_connections 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 -- 10.20.193.45:0/915423146 wait complete. 2026-02-17T21:07:07.755 INFO:teuthology.misc.health.trial045.stderr:2026-02-17T21:07:07.759+0000 7f203b0da640 1 librados: shutdown 2026-02-17T21:07:07.760 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-17T21:07:07.761 INFO:tasks.ceph:Creating RBD pool 2026-02-17T21:07:07.761 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-17T21:07:07.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.835+0000 7f1210cf1640 10 monclient: get_monmap_and_config 2026-02-17T21:07:07.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.835+0000 7f1210cf1640 10 monclient: build_initial_monmap 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.835+0000 7f1210cf1640 10 monclient: monmap: 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:07.837243+0000 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:07.837243+0000 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:07.829 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:07.830 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:07.830 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:07.830 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:07.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.835+0000 7f1210cf1640 1 Processor -- start 2026-02-17T21:07:07.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.835+0000 7f1210cf1640 1 -- start start 2026-02-17T21:07:07.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.835+0000 7f1210cf1640 10 monclient: init 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 10 monclient: _add_conns ranks=[5,1,0,4,3,2] 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f120c15d1e0 0x7f120c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 10 monclient(hunting): picked mon.noname-c con 0x7f120c15d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f120c0748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f120c0c92b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120c0c5860 con 0x7f120c0c92b0 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120c0c5580 con 0x7f120c0748e0 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f120c0c7de0 con 0x7f120c15d1e0 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:07.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f1210cf1640 10 monclient(hunting): authenticate will time out at 1011.467374s 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f120a575640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f120c15d1e0 0x7f120c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f120ad76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f120c0c92b0 0x7f120c153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:36298/0 (socket says 10.20.193.45:36298) 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.836+0000 7f120ad76640 1 -- 10.20.193.45:0/2922932457 learned_addr learned my addr 10.20.193.45:0/2922932457 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.837+0000 7f120a575640 10 monclient(hunting): get_auth_request con 0x7f120c15d1e0 auth_method 0 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.837+0000 7f120a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.837+0000 7f120a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.837+0000 7f120a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.837+0000 7f120a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.837+0000 7f120a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.837+0000 7f120a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f120a575640 10 monclient(hunting): handle_auth_done global_id 4400 payload 274 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f120a575640 1 -- 10.20.193.45:0/2922932457 >> v1:10.20.193.86:6789/0 conn(0x7f120c0748e0 legacy=0x7f120c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f120a575640 1 -- 10.20.193.45:0/2922932457 >> v1:10.20.193.45:6789/0 conn(0x7f120c0c92b0 legacy=0x7f120c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f120a575640 10 monclient: _finish_hunting 0 2026-02-17T21:07:07.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f120a575640 1 monclient: found mon.noname-c 2026-02-17T21:07:07.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f120a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:07.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f120a575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:07.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f120a575640 1 -- 10.20.193.45:0/2922932457 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120c0c80c0 con 0x7f120c15d1e0 2026-02-17T21:07:07.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f1209573640 1 -- 10.20.193.45:0/2922932457 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992086330 0 0) 0x7f120c0c5860 con 0x7f120c0c92b0 2026-02-17T21:07:07.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.838+0000 7f1209573640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:07:07.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.839+0000 7f120a575640 1 --2- 10.20.193.45:0/2922932457 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c15d1e0 0x7f120c15d5c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f12000098d0 tx=0x7f120002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f2573ea6b37fdc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:07.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.840+0000 7f1209573640 1 -- 10.20.193.45:0/2922932457 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120003c070 con 0x7f120c15d1e0 2026-02-17T21:07:07.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.840+0000 7f1209573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:07.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.840+0000 7f1209573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:07.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.840+0000 7f1209573640 10 monclient: dump: 2026-02-17T21:07:07.842 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:07.842 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.842 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.842 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.842 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.840+0000 7f1209573640 10 monclient: _finish_auth 0 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.840+0000 7f1209573640 10 monclient: _check_auth_tickets 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.840+0000 7f1209573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.840+0000 7f1210cf1640 5 monclient: authenticate success, global_id 4400 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.840+0000 7f1210cf1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:07.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1209573640 1 -- 10.20.193.45:0/2922932457 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120002fba0 con 0x7f120c15d1e0 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1209573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1209573640 1 -- 10.20.193.45:0/2922932457 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1200037440 con 0x7f120c15d1e0 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1209573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1209573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1209573640 10 monclient: dump: 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.844 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 4 set_mon_vals no callback set 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 10 monclient: shutdown 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 1 -- 10.20.193.45:0/2922932457 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c15d1e0 msgr2=0x7f120c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 1 --2- 10.20.193.45:0/2922932457 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c15d1e0 0x7f120c15d5c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f12000098d0 tx=0x7f120002eed0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 1 -- 10.20.193.45:0/2922932457 shutdown_connections 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 1 --2- 10.20.193.45:0/2922932457 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c15d1e0 0x7f120c15d5c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 1 -- 10.20.193.45:0/2922932457 >> 10.20.193.45:0/2922932457 conn(0x7f120c0c9d40 msgr2=0x7f120c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 1 -- 10.20.193.45:0/2922932457 shutdown_connections 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.841+0000 7f1210cf1640 1 -- 10.20.193.45:0/2922932457 wait complete. 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 10 monclient: build_initial_monmap 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 10 monclient: monmap: 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:07.846 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 1 librados: starting msgr at 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 1 librados: starting objecter 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 1 Processor -- start 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 1 -- start start 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 1 librados: setting wanted keys 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 1 librados: calling monclient init 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 10 monclient: init 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.842+0000 7f1210cf1640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f120c0748e0 0x7f120c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 10 monclient(hunting): picked mon.noname-a con 0x7f120c0748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:07.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c0c92b0 0x7f120c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 10 monclient(hunting): picked mon.noname-c con 0x7f120c0c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f120c15d1e0 0x7f120c1459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 10 monclient(hunting): picked mon.noname-b con 0x7f120c15d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f120c074d30 con 0x7f120c0748e0 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f120c0c8680 con 0x7f120c15d1e0 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f120c153d20 con 0x7f120c0c92b0 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1210cf1640 10 monclient(hunting): authenticate will time out at 1011.474071s 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f120c0748e0 0x7f120c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1209d74640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c0c92b0 0x7f120c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120ad76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f120c15d1e0 0x7f120c1459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f120c0748e0 0x7f120c06d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:55860/0 (socket says 10.20.193.45:55860) 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 1 -- 10.20.193.45:0/1891852621 learned_addr learned my addr 10.20.193.45:0/1891852621 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 10 monclient(hunting): get_auth_request con 0x7f120c0748e0 auth_method 0 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1209d74640 10 monclient(hunting): get_auth_request con 0x7f120c0c92b0 auth_method 0 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1209d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1209d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1209d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:07.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120ad76640 10 monclient(hunting): get_auth_request con 0x7f120c15d1e0 auth_method 0 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f120a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1209d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1209d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.843+0000 7f1209d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.844+0000 7f120ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.844+0000 7f120ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.844+0000 7f120ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 10 monclient(hunting): handle_auth_done global_id 4403 payload 824 2026-02-17T21:07:07.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 1 -- 10.20.193.45:0/1891852621 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f120c15d1e0 msgr2=0x7f120c1459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f120c15d1e0 0x7f120c1459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 1 -- 10.20.193.45:0/1891852621 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f120c0748e0 msgr2=0x7f120c06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f120c0748e0 0x7f120c06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 10 monclient: _finish_hunting 0 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 1 monclient: found mon.noname-c 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.845+0000 7f1209d74640 1 -- 10.20.193.45:0/1891852621 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120c155bc0 con 0x7f120c0c92b0 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.846+0000 7f1209d74640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c0c92b0 0x7f120c15c160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c4b0 tx=0x7f11f400c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.846+0000 7f11f2ffd640 10 client.?.objecter ms_handle_connect 0x7f120c0c92b0 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.846+0000 7f11f2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:07.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 1 -- 10.20.193.45:0/1891852621 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f40052d0 con 0x7f120c0c92b0 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 10 monclient: dump: 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:07.852 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 5 monclient: authenticate success, global_id 4403 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 10 monclient: _renew_subs 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120c155ea0 con 0x7f120c0c92b0 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 10 client.4403.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 10 monclient: _renew_subs 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f120c156460 con 0x7f120c0c92b0 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 1 librados: init done 2026-02-17T21:07:07.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 1 -- 10.20.193.45:0/1891852621 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f4005470 con 0x7f120c0c92b0 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 1 -- 10.20.193.45:0/1891852621 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f40038f0 con 0x7f120c0c92b0 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f11f2ffd640 10 monclient: dump: 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:07.854 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:07.855 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1208d72640 4 set_mon_vals no callback set 2026-02-17T21:07:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.847+0000 7f1210cf1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.848+0000 7f1210cf1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.848+0000 7f1210cf1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:07.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.848+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120c15d5c0 con 0x7f120c0c92b0 2026-02-17T21:07:07.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.859+0000 7f11f2ffd640 1 -- 10.20.193.45:0/1891852621 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f11f4003a90 con 0x7f120c0c92b0 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.859+0000 7f11f2ffd640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f11d80792b0 0x7f11d807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.859+0000 7f120a575640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f11d80792b0 0x7f11d807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.860+0000 7f120a575640 10 monclient: get_auth_request con 0x7f11d80792b0 auth_method 0 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.860+0000 7f11f2ffd640 10 client.4403.objecter ms_handle_connect 0x7f11d80792b0 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.860+0000 7f120a575640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f11d80792b0 0x7f11d807b770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1200002410 tx=0x7f1200033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.862+0000 7f11f2ffd640 1 -- 10.20.193.45:0/1891852621 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 8563+0+0 (secure 0 0 0) 0x7f11f405e360 con 0x7f120c0c92b0 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.862+0000 7f11f2ffd640 10 client.4403.objecter ms_dispatch2 0x7f120c000b90 osd_map(28..28 src has 1..28) 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.862+0000 7f11f2ffd640 3 client.4403.objecter handle_osd_map got epochs [28,28] > 0 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.862+0000 7f11f2ffd640 3 client.4403.objecter handle_osd_map decoding full epoch 28 2026-02-17T21:07:07.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.862+0000 7f11f2ffd640 20 client.4403.objecter dump_active .. 0 homeless 2026-02-17T21:07:07.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.964+0000 7f11f2ffd640 1 -- 10.20.193.45:0/1891852621 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f11f4062320 con 0x7f120c0c92b0 2026-02-17T21:07:07.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.964+0000 7f11f2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:07.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:07.964+0000 7f11f2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:08.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.045+0000 7f1210cf1640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T21:07:08.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.045+0000 7f1210cf1640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T21:07:08.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.045+0000 7f1210cf1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:08.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.045+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f120c1530a0 con 0x7f120c0c92b0 2026-02-17T21:07:08.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.287+0000 7f11f2ffd640 1 -- 10.20.193.45:0/1891852621 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v29) ==== 109+0+0 (secure 0 0 0) 0x7f11f4066620 con 0x7f120c0c92b0 2026-02-17T21:07:08.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.287+0000 7f11f2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-17T21:07:08.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.287+0000 7f11f2ffd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-17T21:07:08.280 INFO:teuthology.orchestra.run.trial045.stderr:pool 'rbd' created 2026-02-17T21:07:08.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.288+0000 7f1210cf1640 10 librados: watch_flush enter 2026-02-17T21:07:08.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.288+0000 7f1210cf1640 10 librados: watch_flush exit 2026-02-17T21:07:08.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.288+0000 7f1210cf1640 20 client.4403.objecter shutdown clearing up homeless session... 2026-02-17T21:07:08.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.288+0000 7f1210cf1640 10 client.4403.objecter successfully canceled tick 2026-02-17T21:07:08.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f11d80792b0 msgr2=0x7f11d807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:08.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f11d80792b0 0x7f11d807b770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1200002410 tx=0x7f1200033000 comp rx=0 tx=0).stop 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 10 monclient: shutdown 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c0c92b0 msgr2=0x7f120c15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c0c92b0 0x7f120c15c160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11f400c4b0 tx=0x7f11f400c980 comp rx=0 tx=0).stop 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 shutdown_connections 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f11d80792b0 0x7f11d807b770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f120c15d1e0 0x7f120c1459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f120c0c92b0 0x7f120c15c160 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 --2- 10.20.193.45:0/1891852621 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f120c0748e0 0x7f120c06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 >> 10.20.193.45:0/1891852621 conn(0x7f120c0c9d40 msgr2=0x7f120c149400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 shutdown_connections 2026-02-17T21:07:08.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 -- 10.20.193.45:0/1891852621 wait complete. 2026-02-17T21:07:08.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.289+0000 7f1210cf1640 1 librados: shutdown 2026-02-17T21:07:08.290 DEBUG:teuthology.orchestra.run.trial045:> rbd --cluster ceph pool init rbd 2026-02-17T21:07:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.328+0000 7ff0afac00c0 10 monclient: get_monmap_and_config 2026-02-17T21:07:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.328+0000 7ff0afac00c0 10 monclient: build_initial_monmap 2026-02-17T21:07:08.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.328+0000 7ff0afac00c0 10 monclient: monmap: 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:08.330322+0000 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:08.330322+0000 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:08.322 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:08.323 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:08.323 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 1 Processor -- start 2026-02-17T21:07:08.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 1 -- start start 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 10 monclient: init 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 10 monclient: _reopen_session rank -1 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 10 monclient: _add_conns ranks=[2,1,4,5,3,0] 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 10 monclient(hunting): picked mon.noname-c-legacy con 0x55a271d92e00 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 10 monclient(hunting): picked mon.noname-b-legacy con 0x55a271d931e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 1 --2- >> v2:10.20.193.86:3300/0 conn(0x55a271d90a40 0x55a271d90e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 10 monclient(hunting): picked mon.noname-b con 0x55a271d90a40 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55a271b21d20 con 0x55a271d931e0 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55a271d00750 con 0x55a271d92e00 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:08.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x55a271b4e720 con 0x55a271d90a40 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 10 monclient(hunting): _renew_subs 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.329+0000 7ff0afac00c0 10 monclient(hunting): authenticate will time out at 1011.960542s 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0ae588640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x55a271d92e00 0x55a271cffca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:48730/0 (socket says 10.20.193.45:48730) 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0ae588640 1 -- 10.20.193.45:0/3599798728 learned_addr learned my addr 10.20.193.45:0/3599798728 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0af811640 1 --2- 10.20.193.45:0/3599798728 >> v2:10.20.193.86:3300/0 conn(0x55a271d90a40 0x55a271d90e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0af811640 10 monclient(hunting): get_auth_request con 0x55a271d90a40 auth_method 0 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0af811640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0af811640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0af811640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0af811640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0af811640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.330+0000 7ff0af811640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:08.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0ad586640 1 -- 10.20.193.45:0/3599798728 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528517292 0 0) 0x55a271d00750 con 0x55a271d92e00 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0ad586640 10 monclient(hunting): _negotiate 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0ad586640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0ad586640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0ad586640 10 monclient(hunting): my global_id is 4406 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0ad586640 1 -- 10.20.193.45:0/3599798728 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff094001e10 con 0x55a271d92e00 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0af811640 10 monclient(hunting): handle_auth_done global_id 4375 payload 274 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0af811640 1 -- 10.20.193.45:0/3599798728 >> v1:10.20.193.92:6789/0 conn(0x55a271d92e00 legacy=0x55a271cffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0af811640 1 -- 10.20.193.45:0/3599798728 >> v1:10.20.193.86:6789/0 conn(0x55a271d931e0 legacy=0x55a271cfd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0af811640 10 monclient: _finish_hunting 0 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0af811640 1 monclient: found mon.noname-b 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0af811640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0af811640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:08.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.332+0000 7ff0af811640 1 -- 10.20.193.45:0/3599798728 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a271d00a30 con 0x55a271d90a40 2026-02-17T21:07:08.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.334+0000 7ff0af811640 1 --2- 10.20.193.45:0/3599798728 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d90a40 0x55a271d90e40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0005fd0 tx=0x7ff0a0058670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b04560347456759 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 1 -- 10.20.193.45:0/3599798728 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a006d070 con 0x55a271d90a40 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 10 monclient: dump: 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:08.334 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 10 monclient: _finish_auth 0 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 10 monclient: _check_auth_tickets 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 1 -- 10.20.193.45:0/3599798728 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a0060d60 con 0x55a271d90a40 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 1 -- 10.20.193.45:0/3599798728 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0068660 con 0x55a271d90a40 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 5 monclient: authenticate success, global_id 4375 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 10 monclient: get_monmap_and_config success 2026-02-17T21:07:08.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 4 set_mon_vals no callback set 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0ad586640 10 monclient: dump: 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:08.336 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 10 monclient: shutdown 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3599798728 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d90a40 msgr2=0x55a271d90e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 1 --2- 10.20.193.45:0/3599798728 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d90a40 0x55a271d90e40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0005fd0 tx=0x7ff0a0058670 comp rx=0 tx=0).stop 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3599798728 shutdown_connections 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 1 --2- 10.20.193.45:0/3599798728 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d90a40 0x55a271d90e40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3599798728 >> 10.20.193.45:0/3599798728 conn(0x55a271cb7e20 msgr2=0x55a271cb8230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3599798728 shutdown_connections 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3599798728 wait complete. 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 10 monclient: build_initial_monmap 2026-02-17T21:07:08.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.336+0000 7ff0afac00c0 10 monclient: monmap: 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 librados: starting msgr at 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 librados: starting objecter 2026-02-17T21:07:08.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 Processor -- start 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 -- start start 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 librados: setting wanted keys 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 librados: calling monclient init 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient: init 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient: _reopen_session rank -1 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x55a271d90a40 0x55a271d796b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient(hunting): picked mon.noname-c con 0x55a271d90a40 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d92e00 0x55a271d79bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient(hunting): picked mon.noname-b con 0x55a271d92e00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x55a271d931e0 0x55a271cbf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient(hunting): picked mon.noname-a con 0x55a271d931e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:08.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x55a271b9edb0 con 0x55a271d931e0 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x55a271ba2e80 con 0x55a271d92e00 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x55a271b3de50 con 0x55a271d90a40 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient(hunting): _renew_subs 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.337+0000 7ff0afac00c0 10 monclient(hunting): authenticate will time out at 1011.968747s 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d92e00 0x55a271d79bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0af811640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x55a271d931e0 0x55a271cbf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0ae588640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x55a271d90a40 0x55a271d796b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d92e00 0x55a271d79bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:46310/0 (socket says 10.20.193.45:46310) 2026-02-17T21:07:08.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 1 -- 10.20.193.45:0/3046148707 learned_addr learned my addr 10.20.193.45:0/3046148707 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 10 monclient(hunting): get_auth_request con 0x55a271d92e00 auth_method 0 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0af811640 10 monclient(hunting): get_auth_request con 0x55a271d931e0 auth_method 0 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0af811640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0af811640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0af811640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0ae588640 10 monclient(hunting): get_auth_request con 0x55a271d90a40 auth_method 0 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0ae588640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0ae588640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0ae588640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:08.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0add87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0af811640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0af811640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0af811640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0ae588640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0ae588640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.338+0000 7ff0ae588640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 10 monclient(hunting): handle_auth_done global_id 4381 payload 824 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 1 -- 10.20.193.45:0/3046148707 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x55a271d90a40 msgr2=0x55a271d796b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x55a271d90a40 0x55a271d796b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 1 -- 10.20.193.45:0/3046148707 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x55a271d931e0 msgr2=0x55a271cbf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:08.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x55a271d931e0 0x55a271cbf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:08.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 10 monclient: _finish_hunting 0 2026-02-17T21:07:08.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 1 monclient: found mon.noname-b 2026-02-17T21:07:08.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:08.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:08.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a271d9f9e0 con 0x55a271d92e00 2026-02-17T21:07:08.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff0add87640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d92e00 0x55a271d79bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff09800bef0 tx=0x7ff098009530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:08.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff09e7fc640 10 client.?.objecter ms_handle_connect 0x55a271d92e00 2026-02-17T21:07:08.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.340+0000 7ff09e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:08.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098014030 con 0x55a271d92e00 2026-02-17T21:07:08.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff09e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:08.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff09e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:08.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff09e7fc640 10 monclient: dump: 2026-02-17T21:07:08.345 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:08.345 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:08.345 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:08.345 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff09e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff09e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff09e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 5 monclient: authenticate success, global_id 4381 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 10 monclient: _renew_subs 2026-02-17T21:07:08.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a271d7a260 con 0x55a271d92e00 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 10 client.4381.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 10 monclient: _renew_subs 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a271d7a820 con 0x55a271d92e00 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 1 librados: init done 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.341+0000 7ff0afac00c0 10 librados: wait_for_osdmap waiting 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.342+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff098009c50 con 0x55a271d92e00 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.342+0000 7ff09e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.342+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09800f400 con 0x55a271d92e00 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.342+0000 7ff09e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.342+0000 7ff09e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:08.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.342+0000 7ff09e7fc640 10 monclient: dump: 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:08.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.342+0000 7ff0acd85640 4 set_mon_vals no callback set 2026-02-17T21:07:08.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.355+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff09800f5a0 con 0x55a271d92e00 2026-02-17T21:07:08.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.356+0000 7ff09e7fc640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff08c0772b0 0x7ff08c079770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:08.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.356+0000 7ff0ae588640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff08c0772b0 0x7ff08c079770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:08.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.356+0000 7ff0ae588640 10 monclient: get_auth_request con 0x7ff08c0772b0 auth_method 0 2026-02-17T21:07:08.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.356+0000 7ff0ae588640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff08c0772b0 0x7ff08c079770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001a00 tx=0x7ff0a4001990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:08.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.356+0000 7ff09e7fc640 10 client.4381.objecter ms_handle_connect 0x7ff08c0772b0 2026-02-17T21:07:08.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 8905+0+0 (secure 0 0 0) 0x7ff098095ec0 con 0x55a271d92e00 2026-02-17T21:07:08.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff09e7fc640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 osd_map(29..29 src has 1..29) 2026-02-17T21:07:08.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff09e7fc640 3 client.4381.objecter handle_osd_map got epochs [29,29] > 0 2026-02-17T21:07:08.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff09e7fc640 3 client.4381.objecter handle_osd_map decoding full epoch 29 2026-02-17T21:07:08.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff09e7fc640 20 client.4381.objecter dump_active .. 0 homeless 2026-02-17T21:07:08.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff0afac00c0 10 librados: wait_for_osdmap done waiting 2026-02-17T21:07:08.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff0afac00c0 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T21:07:08.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff0afac00c0 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T21:07:08.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff0afac00c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:08.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:08.357+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55a271d7ade0 con 0x55a271d92e00 2026-02-17T21:07:09.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.361+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v30) ==== 141+0+0 (secure 0 0 0) 0x7ff09801e070 con 0x55a271d92e00 2026-02-17T21:07:09.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.361+0000 7ff09e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-17T21:07:09.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.361+0000 7ff09e7fc640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-17T21:07:09.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.361+0000 7ff0afac00c0 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:09.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.361+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0a0060d60 con 0x55a271d92e00 2026-02-17T21:07:09.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.365+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff09805c0c0 con 0x55a271d92e00 2026-02-17T21:07:09.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.365+0000 7ff09e7fc640 10 monclient: handle_get_version_reply finishing 1 version 30 2026-02-17T21:07:09.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.365+0000 7ff0acd85640 10 client.4381.objecter _get_latest_version latest 30, waiting 2026-02-17T21:07:09.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.365+0000 7ff0acd85640 10 client.4381.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:09.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.365+0000 7ff0acd85640 10 monclient: _renew_subs 2026-02-17T21:07:09.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.365+0000 7ff0acd85640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:09.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.365+0000 7ff0acd85640 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=30}) -- 0x7ff090003c90 con 0x55a271d92e00 2026-02-17T21:07:09.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 8 ==== osd_map(30..30 src has 1..30) ==== 674+0+0 (secure 0 0 0) 0x7ff09805fd10 con 0x55a271d92e00 2026-02-17T21:07:09.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff09e7fc640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 osd_map(30..30 src has 1..30) 2026-02-17T21:07:09.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff09e7fc640 3 client.4381.objecter handle_osd_map got epochs [30,30] > 29 2026-02-17T21:07:09.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff09e7fc640 3 client.4381.objecter handle_osd_map decoding incremental epoch 30 2026-02-17T21:07:09.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff09e7fc640 20 client.4381.objecter dump_active .. 0 homeless 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 10 librados: create oid=rbd_trash nspace= 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 10 client.4381.objecter _op_submit op 0x55a271cbfdc0 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 20 client.4381.objecter _calc_target epoch 30 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 20 client.4381.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 10 client.4381.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [14,5] primary 14 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x55a271d81900 0x55a271d9eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 20 client.4381.objecter _get_session s=0x55a271b3e230 osd=14 3 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 10 client.4381.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.14 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 20 client.4381.objecter get_session s=0x55a271b3e230 osd=14 3 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 15 client.4381.objecter _session_op_assign 14 1 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 15 client.4381.objecter _send_op 1 to 2.3 on osd.14 2026-02-17T21:07:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a271d9f000 con 0x55a271d81900 2026-02-17T21:07:09.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 20 client.4381.objecter put_session s=0x55a271b3e230 osd=14 4 2026-02-17T21:07:09.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.366+0000 7ff0afac00c0 5 client.4381.objecter 1 in flight 2026-02-17T21:07:09.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.367+0000 7ff0af811640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x55a271d81900 0x55a271d9eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:09.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.368+0000 7ff0af811640 10 monclient: get_auth_request con 0x55a271d81900 auth_method 0 2026-02-17T21:07:09.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.374+0000 7ff0af811640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x55a271d81900 0x55a271d9eac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:09.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.374+0000 7ff09e7fc640 10 client.4381.objecter ms_handle_connect 0x55a271d81900 2026-02-17T21:07:09.748 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:16.962 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:09.776 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:16.989 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:09.777 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:02:16.987 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:09.779 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:02:16.989 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:09.803 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:17.016 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:09.805 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:02:16.978 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:09.806 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:02:16.979 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:09.807 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:02:17.016 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:09.833 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:02:17.007 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 1 -- 10.20.193.45:0/3046148707 <== osd.14 v2:10.20.193.92:6808/1799526026 1 ==== osd_op_reply(1 rbd_trash [create] v30'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7ff0a0068440 con 0x55a271d81900 2026-02-17T21:07:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 osd_op_reply(1 rbd_trash [create] v30'1 uv1 ondisk = 0) 2026-02-17T21:07:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 10 client.4381.objecter in handle_osd_op_reply 2026-02-17T21:07:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 7 client.4381.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-17T21:07:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 10 client.4381.objecter op 0 rval 0 len 0 2026-02-17T21:07:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 15 client.4381.objecter handle_osd_op_reply completed tid 1 2026-02-17T21:07:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 15 client.4381.objecter _finish_op 1 2026-02-17T21:07:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 20 client.4381.objecter put_session s=0x55a271b3e230 osd=14 4 2026-02-17T21:07:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 15 client.4381.objecter _session_op_remove 14 1 2026-02-17T21:07:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0af811640 5 client.4381.objecter 0 in flight 2026-02-17T21:07:09.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.962+0000 7ff0afac00c0 10 librados: Objecter returned from create r=0 2026-02-17T21:07:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 10 client.4381.objecter _op_submit op 0x55a271dfb820 2026-02-17T21:07:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 20 client.4381.objecter _calc_target epoch 30 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-17T21:07:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 20 client.4381.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T21:07:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 10 client.4381.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [13,12] primary 13 2026-02-17T21:07:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x55a271dfc3d0 0x55a271dfe860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 20 client.4381.objecter _get_session s=0x55a271dfbd50 osd=13 3 2026-02-17T21:07:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 10 client.4381.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.13 2026-02-17T21:07:09.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 20 client.4381.objecter get_session s=0x55a271dfbd50 osd=13 3 2026-02-17T21:07:09.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 15 client.4381.objecter _session_op_assign 13 2 2026-02-17T21:07:09.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.963+0000 7ff0afac00c0 15 client.4381.objecter _send_op 2 to 2.2 on osd.13 2026-02-17T21:07:09.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.964+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a271dfede0 con 0x55a271dfc3d0 2026-02-17T21:07:09.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.964+0000 7ff0afac00c0 20 client.4381.objecter put_session s=0x55a271dfbd50 osd=13 4 2026-02-17T21:07:09.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.964+0000 7ff0afac00c0 5 client.4381.objecter 1 in flight 2026-02-17T21:07:09.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.964+0000 7ff0ae588640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x55a271dfc3d0 0x55a271dfe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:09.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.964+0000 7ff0ae588640 10 monclient: get_auth_request con 0x55a271dfc3d0 auth_method 0 2026-02-17T21:07:09.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.967+0000 7ff09e7fc640 10 client.4381.objecter ms_handle_connect 0x55a271dfc3d0 2026-02-17T21:07:09.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:09.967+0000 7ff0ae588640 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x55a271dfc3d0 0x55a271dfe860 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:10.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 1 -- 10.20.193.45:0/3046148707 <== osd.13 v2:10.20.193.86:6808/3260427089 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff0a4009040 con 0x55a271dfc3d0 2026-02-17T21:07:10.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-17T21:07:10.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 10 client.4381.objecter in handle_osd_op_reply 2026-02-17T21:07:10.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 7 client.4381.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-17T21:07:10.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 10 client.4381.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-17T21:07:10.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 10 client.4381.objecter op 0 rval 0 len 0 2026-02-17T21:07:10.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 15 client.4381.objecter handle_osd_op_reply completed tid 2 2026-02-17T21:07:10.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 15 client.4381.objecter _finish_op 2 2026-02-17T21:07:10.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 20 client.4381.objecter put_session s=0x55a271dfbd50 osd=13 4 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 15 client.4381.objecter _session_op_remove 13 2 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.015+0000 7ff0ae588640 5 client.4381.objecter 0 in flight 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 10 client.4381.objecter _op_submit op 0x55a271dfaa00 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 20 client.4381.objecter _calc_target epoch 30 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 20 client.4381.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 10 client.4381.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [13,12] primary 13 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 20 client.4381.objecter _get_session s=0x55a271dfbd50 osd=13 3 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 10 client.4381.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.13 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 20 client.4381.objecter get_session s=0x55a271dfbd50 osd=13 3 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 15 client.4381.objecter _session_op_assign 13 3 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 15 client.4381.objecter _send_op 3 to 2.2 on osd.13 2026-02-17T21:07:10.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a271dfaeb0 con 0x55a271dfc3d0 2026-02-17T21:07:10.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 20 client.4381.objecter put_session s=0x55a271dfbd50 osd=13 4 2026-02-17T21:07:10.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.016+0000 7ff0afac00c0 5 client.4381.objecter 1 in flight 2026-02-17T21:07:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 1 -- 10.20.193.45:0/3046148707 <== osd.13 v2:10.20.193.86:6808/3260427089 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff0a4009040 con 0x55a271dfc3d0 2026-02-17T21:07:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-17T21:07:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 10 client.4381.objecter in handle_osd_op_reply 2026-02-17T21:07:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 7 client.4381.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-17T21:07:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 10 client.4381.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 10 client.4381.objecter op 0 rval 0 len 0 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 15 client.4381.objecter handle_osd_op_reply completed tid 3 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 15 client.4381.objecter _finish_op 3 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 20 client.4381.objecter put_session s=0x55a271dfbd50 osd=13 4 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 15 client.4381.objecter _session_op_remove 13 3 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.019+0000 7ff0ae588640 5 client.4381.objecter 0 in flight 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.020+0000 7ff09ffff640 10 client.4381.objecter allocate_selfmanaged_snap; pool: 2 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.020+0000 7ff09ffff640 10 client.4381.objecter pool_op_submit 4 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.020+0000 7ff09ffff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.020+0000 7ff09ffff640 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7ff0840030d0 con 0x55a271d92e00 2026-02-17T21:07:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v31) ==== 55+0+0 (secure 0 0 0) 0x7ff098060450 con 0x55a271d92e00 2026-02-17T21:07:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 pool_op_reply(tid 4 (0) Success v31) 2026-02-17T21:07:10.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 10 client.4381.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v31) 2026-02-17T21:07:10.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 10 client.4381.objecter have request 4 at 0x7ff084003060 Op: create unmanaged snap 2026-02-17T21:07:10.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 20 client.4381.objecter waiting for client to reach epoch 31 before calling back 2026-02-17T21:07:10.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 10 client.4381.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:10.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 10 monclient: _renew_subs 2026-02-17T21:07:10.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:10.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=31}) -- 0x7ff08c07fa10 con 0x55a271d92e00 2026-02-17T21:07:10.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.415+0000 7ff09e7fc640 10 client.4381.objecter done 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 10 ==== osd_map(31..31 src has 1..31) ==== 626+0+0 (secure 0 0 0) 0x7ff09805ff10 con 0x55a271d92e00 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff09e7fc640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 osd_map(31..31 src has 1..31) 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff09e7fc640 3 client.4381.objecter handle_osd_map got epochs [31,31] > 30 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff09e7fc640 3 client.4381.objecter handle_osd_map decoding incremental epoch 31 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff09e7fc640 20 client.4381.objecter dump_active .. 0 homeless 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 20 librados: queue_aio_write 0x55a271df6db0 completion 0x55a271d005a0 write_seq 1 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 10 client.4381.objecter _op_submit op 0x7ff090006380 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 20 client.4381.objecter _calc_target epoch 31 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 20 client.4381.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T21:07:10.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 10 client.4381.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [13,12] primary 13 2026-02-17T21:07:10.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 20 client.4381.objecter _get_session s=0x55a271dfbd50 osd=13 3 2026-02-17T21:07:10.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 10 client.4381.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.13 2026-02-17T21:07:10.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 20 client.4381.objecter get_session s=0x55a271dfbd50 osd=13 3 2026-02-17T21:07:10.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 15 client.4381.objecter _session_op_assign 13 5 2026-02-17T21:07:10.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 15 client.4381.objecter _send_op 5 to 2.2 on osd.13 2026-02-17T21:07:10.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x7ff090006a80 con 0x55a271dfc3d0 2026-02-17T21:07:10.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 20 client.4381.objecter put_session s=0x55a271dfbd50 osd=13 4 2026-02-17T21:07:10.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.417+0000 7ff0acd85640 5 client.4381.objecter 1 in flight 2026-02-17T21:07:10.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 1 -- 10.20.193.45:0/3046148707 <== osd.13 v2:10.20.193.86:6808/3260427089 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v31'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ff0a4009040 con 0x55a271dfc3d0 2026-02-17T21:07:10.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 osd_op_reply(5 rbd_info [create,write 0~8] v31'1 uv1 ondisk = 0) 2026-02-17T21:07:10.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 10 client.4381.objecter in handle_osd_op_reply 2026-02-17T21:07:10.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 7 client.4381.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-17T21:07:10.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 10 client.4381.objecter op 0 rval 0 len 0 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 10 client.4381.objecter op 1 rval 0 len 0 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 15 client.4381.objecter handle_osd_op_reply completed tid 5 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 15 client.4381.objecter _finish_op 5 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 20 client.4381.objecter put_session s=0x55a271dfbd50 osd=13 4 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 15 client.4381.objecter _session_op_remove 13 5 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 5 client.4381.objecter 0 in flight 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff0ae588640 20 librados: complete_aio_write 0x55a271d005a0 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff09ffff640 10 client.4381.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff09ffff640 10 client.4381.objecter pool_op_submit 6 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff09ffff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:10.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:10.653+0000 7ff09ffff640 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v31) -- 0x7ff084004520 con 0x55a271d92e00 2026-02-17T21:07:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.338+0000 7ff09d7fa640 10 monclient: tick 2026-02-17T21:07:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.338+0000 7ff09d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.338+0000 7ff09d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:11.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.338+0000 7ff09d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:11.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v32) ==== 43+0+0 (secure 0 0 0) 0x7ff098064750 con 0x55a271d92e00 2026-02-17T21:07:11.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 pool_op_reply(tid 6 (0) Success v32) 2026-02-17T21:07:11.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 10 client.4381.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v32) 2026-02-17T21:07:11.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 10 client.4381.objecter have request 6 at 0x7ff084003060 Op: delete unmanaged snap 2026-02-17T21:07:11.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 20 client.4381.objecter waiting for client to reach epoch 32 before calling back 2026-02-17T21:07:11.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 10 client.4381.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:11.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 10 monclient: _renew_subs 2026-02-17T21:07:11.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:11.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=32}) -- 0x7ff08c07fcf0 con 0x55a271d92e00 2026-02-17T21:07:11.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.505+0000 7ff09e7fc640 10 client.4381.objecter done 2026-02-17T21:07:11.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff09e7fc640 1 -- 10.20.193.45:0/3046148707 <== mon.1 v2:10.20.193.86:3300/0 12 ==== osd_map(32..32 src has 1..32) ==== 654+0+0 (secure 0 0 0) 0x7ff098069170 con 0x55a271d92e00 2026-02-17T21:07:11.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff09e7fc640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 osd_map(32..32 src has 1..32) 2026-02-17T21:07:11.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff09e7fc640 3 client.4381.objecter handle_osd_map got epochs [32,32] > 31 2026-02-17T21:07:11.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff09e7fc640 3 client.4381.objecter handle_osd_map decoding incremental epoch 32 2026-02-17T21:07:11.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff09e7fc640 20 client.4381.objecter dump_active .. 0 homeless 2026-02-17T21:07:11.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 20 librados: queue_aio_write 0x55a271df6db0 completion 0x7ff084001d60 write_seq 2 2026-02-17T21:07:11.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 10 client.4381.objecter _op_submit op 0x7ff090006380 2026-02-17T21:07:11.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 20 client.4381.objecter _calc_target epoch 32 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-17T21:07:11.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 20 client.4381.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-17T21:07:11.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 10 client.4381.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [13,12] primary 13 2026-02-17T21:07:11.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 20 client.4381.objecter _get_session s=0x55a271dfbd50 osd=13 3 2026-02-17T21:07:11.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 10 client.4381.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.13 2026-02-17T21:07:11.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 20 client.4381.objecter get_session s=0x55a271dfbd50 osd=13 3 2026-02-17T21:07:11.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 15 client.4381.objecter _session_op_assign 13 7 2026-02-17T21:07:11.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 15 client.4381.objecter _send_op 7 to 2.2 on osd.13 2026-02-17T21:07:11.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 1 -- 10.20.193.45:0/3046148707 --> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x7ff090006e20 con 0x55a271dfc3d0 2026-02-17T21:07:11.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 20 client.4381.objecter put_session s=0x55a271dfbd50 osd=13 4 2026-02-17T21:07:11.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.507+0000 7ff0acd85640 5 client.4381.objecter 1 in flight 2026-02-17T21:07:11.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 1 -- 10.20.193.45:0/3046148707 <== osd.13 v2:10.20.193.86:6808/3260427089 4 ==== osd_op_reply(7 rbd_info [write 0~19] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0a4009040 con 0x55a271dfc3d0 2026-02-17T21:07:11.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 10 client.4381.objecter ms_dispatch2 0x55a271bb95a0 osd_op_reply(7 rbd_info [write 0~19] v32'2 uv2 ondisk = 0) 2026-02-17T21:07:11.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 10 client.4381.objecter in handle_osd_op_reply 2026-02-17T21:07:11.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 7 client.4381.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-17T21:07:11.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 10 client.4381.objecter op 0 rval 0 len 0 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 15 client.4381.objecter handle_osd_op_reply completed tid 7 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 15 client.4381.objecter _finish_op 7 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 20 client.4381.objecter put_session s=0x55a271dfbd50 osd=13 4 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 15 client.4381.objecter _session_op_remove 13 7 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 5 client.4381.objecter 0 in flight 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0ae588640 20 librados: complete_aio_write 0x7ff084001d60 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 10 librados: watch_flush enter 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 10 librados: watch_flush exit 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 10 client.4381.objecter close_session for osd.13 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x55a271dfc3d0 msgr2=0x55a271dfe860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x55a271dfc3d0 0x55a271dfe860 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 20 client.4381.objecter put_session s=0x55a271dfbd50 osd=13 1 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 10 client.4381.objecter close_session for osd.14 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x55a271d81900 msgr2=0x55a271d9eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x55a271d81900 0x55a271d9eac0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 20 client.4381.objecter put_session s=0x55a271b3e230 osd=14 1 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 20 client.4381.objecter shutdown clearing up homeless session... 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 10 client.4381.objecter successfully canceled tick 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff08c0772b0 msgr2=0x7ff08c079770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff08c0772b0 0x7ff08c079770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001a00 tx=0x7ff0a4001990 comp rx=0 tx=0).stop 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 10 monclient: shutdown 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:11.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d92e00 msgr2=0x55a271d79bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d92e00 0x55a271d79bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff09800bef0 tx=0x7ff098009530 comp rx=0 tx=0).stop 2026-02-17T21:07:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0af811640 1 -- 10.20.193.45:0/3046148707 reap_dead start 2026-02-17T21:07:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 shutdown_connections 2026-02-17T21:07:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 --2- 10.20.193.45:0/3046148707 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x55a271d92e00 0x55a271d79bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 >> 10.20.193.45:0/3046148707 conn(0x55a271cb7e20 msgr2=0x55a271d88650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 shutdown_connections 2026-02-17T21:07:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 -- 10.20.193.45:0/3046148707 wait complete. 2026-02-17T21:07:11.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.579+0000 7ff0afac00c0 1 librados: shutdown 2026-02-17T21:07:11.577 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-17T21:07:11.578 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T21:07:11.578 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-17T21:07:11.579 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-17T21:07:11.579 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-17T21:07:11.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.697+0000 7f002d445640 10 monclient: get_monmap_and_config 2026-02-17T21:07:11.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.697+0000 7f002d445640 10 monclient: build_initial_monmap 2026-02-17T21:07:11.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.697+0000 7f002d445640 10 monclient: monmap: 2026-02-17T21:07:11.690 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:11.698689+0000 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:11.698689+0000 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:11.691 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:11.692 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:11.692 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:11.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 1 Processor -- start 2026-02-17T21:07:11.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 1 -- start start 2026-02-17T21:07:11.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient: init 2026-02-17T21:07:11.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:11.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient: _add_conns ranks=[2,5,4,3,0,1] 2026-02-17T21:07:11.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f002815d1e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:11.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f00280c92b0 0x7f002815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:11.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient(hunting): picked mon.noname-c con 0x7f00280c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:11.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f00280748e0 0x7f0028153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient(hunting): picked mon.noname-b con 0x7f00280748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00280c5860 con 0x7f002815d1e0 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f00280c5580 con 0x7f00280748e0 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f00280c7de0 con 0x7f00280c92b0 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.698+0000 7f002d445640 10 monclient(hunting): authenticate will time out at 1015.328817s 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f00277fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f00280748e0 0x7f0028153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f0026ffd640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f002815d1e0 0x7f00280c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47502/0 (socket says 10.20.193.45:47502) 2026-02-17T21:07:11.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f0026ffd640 1 -- 10.20.193.45:0/4294124044 learned_addr learned my addr 10.20.193.45:0/4294124044 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f00277fe640 10 monclient(hunting): get_auth_request con 0x7f00280748e0 auth_method 0 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f00277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f00277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f00277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f00267fc640 1 --2- 10.20.193.45:0/4294124044 >> v2:10.20.193.92:3300/0 conn(0x7f00280c92b0 0x7f002815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f00277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f00277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.699+0000 7f00277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00267fc640 10 monclient(hunting): get_auth_request con 0x7f00280c92b0 auth_method 0 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00267fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:11.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00267fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00267fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00267fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00267fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00277fe640 10 monclient(hunting): handle_auth_done global_id 4384 payload 274 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00277fe640 1 -- 10.20.193.45:0/4294124044 >> v2:10.20.193.92:3300/0 conn(0x7f00280c92b0 msgr2=0x7f002815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00277fe640 1 --2- 10.20.193.45:0/4294124044 >> v2:10.20.193.92:3300/0 conn(0x7f00280c92b0 0x7f002815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00277fe640 1 -- 10.20.193.45:0/4294124044 >> v1:10.20.193.92:6789/0 conn(0x7f002815d1e0 legacy=0x7f00280c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00277fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00277fe640 1 monclient: found mon.noname-b 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:11.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00277fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:11.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.700+0000 7f00277fe640 1 -- 10.20.193.45:0/4294124044 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00280c80c0 con 0x7f00280748e0 2026-02-17T21:07:11.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.701+0000 7f00277fe640 1 --2- 10.20.193.45:0/4294124044 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280748e0 0x7f0028153610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0018009d90 tx=0x7f001802f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a8011dc322b6943 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:11.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 1 -- 10.20.193.45:0/4294124044 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001803c070 con 0x7f00280748e0 2026-02-17T21:07:11.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:11.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:11.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 10 monclient: dump: 2026-02-17T21:07:11.706 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:11.706 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:11.706 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:11.706 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:11.706 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 1 -- 10.20.193.45:0/4294124044 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0018037440 con 0x7f00280748e0 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:11.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 1 -- 10.20.193.45:0/4294124044 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0018037810 con 0x7f00280748e0 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f0025ffb640 10 monclient: dump: 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:11.708 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f002d445640 5 monclient: authenticate success, global_id 4384 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f002d445640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.703+0000 7f002d445640 4 set_mon_vals no callback set 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 10 monclient: shutdown 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 -- 10.20.193.45:0/4294124044 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280748e0 msgr2=0x7f0028153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 --2- 10.20.193.45:0/4294124044 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280748e0 0x7f0028153610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0018009d90 tx=0x7f001802f1e0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 -- 10.20.193.45:0/4294124044 shutdown_connections 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 --2- 10.20.193.45:0/4294124044 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280748e0 0x7f0028153610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 --2- 10.20.193.45:0/4294124044 >> v2:10.20.193.92:3300/0 conn(0x7f00280c92b0 0x7f002815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 -- 10.20.193.45:0/4294124044 >> 10.20.193.45:0/4294124044 conn(0x7f00280c9d40 msgr2=0x7f00280ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:11.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 -- 10.20.193.45:0/4294124044 shutdown_connections 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 -- 10.20.193.45:0/4294124044 wait complete. 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 10 monclient: build_initial_monmap 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 10 monclient: monmap: 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:11.710 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 librados: starting msgr at 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.704+0000 7f002d445640 1 librados: starting objecter 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 Processor -- start 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 -- start start 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 librados: setting wanted keys 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 librados: calling monclient init 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient: init 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00280748e0 0x7f00281e8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:11.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient(hunting): picked mon.noname-c con 0x7f00280748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280c92b0 0x7f002815c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient(hunting): picked mon.noname-b con 0x7f00280c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f002815d1e0 0x7f00281f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient(hunting): picked mon.noname-a con 0x7f002815d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0028074d30 con 0x7f002815d1e0 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f00280c8680 con 0x7f00280c92b0 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0028153b50 con 0x7f00280748e0 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f002d445640 10 monclient(hunting): authenticate will time out at 1015.335518s 2026-02-17T21:07:11.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f00267fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280c92b0 0x7f002815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f0026ffd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00280748e0 0x7f00281e8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.705+0000 7f00277fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f002815d1e0 0x7f00281f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00267fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280c92b0 0x7f002815c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57182/0 (socket says 10.20.193.45:57182) 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00267fc640 1 -- 10.20.193.45:0/3318384230 learned_addr learned my addr 10.20.193.45:0/3318384230 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00267fc640 10 monclient(hunting): get_auth_request con 0x7f00280c92b0 auth_method 0 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00267fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00267fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f0026ffd640 10 monclient(hunting): get_auth_request con 0x7f00280748e0 auth_method 0 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f0026ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f0026ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:11.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f0026ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00277fe640 10 monclient(hunting): get_auth_request con 0x7f002815d1e0 auth_method 0 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00277fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f0026ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f0026ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f0026ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00267fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00267fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00267fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:11.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.706+0000 7f00277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 10 monclient(hunting): handle_auth_done global_id 4418 payload 824 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 1 -- 10.20.193.45:0/3318384230 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280c92b0 msgr2=0x7f002815c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280c92b0 0x7f002815c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 1 -- 10.20.193.45:0/3318384230 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f002815d1e0 msgr2=0x7f00281f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f002815d1e0 0x7f00281f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 1 monclient: found mon.noname-c 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.707+0000 7f0026ffd640 1 -- 10.20.193.45:0/3318384230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00281f5010 con 0x7f00280748e0 2026-02-17T21:07:11.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.708+0000 7f0026ffd640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00280748e0 0x7f00281e8940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c410 tx=0x7f001c00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.708+0000 7f00077fe640 10 client.?.objecter ms_handle_connect 0x7f00280748e0 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.708+0000 7f00077fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 1 -- 10.20.193.45:0/3318384230 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c017070 con 0x7f00280748e0 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 10 monclient: dump: 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:11.716 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 1 -- 10.20.193.45:0/3318384230 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f001c005de0 con 0x7f00280748e0 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f002d445640 5 monclient: authenticate success, global_id 4418 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f002d445640 10 monclient: _renew_subs 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f002d445640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:11.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00281e8e80 con 0x7f00280748e0 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 1 -- 10.20.193.45:0/3318384230 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c0072d0 con 0x7f00280748e0 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00257fa640 4 set_mon_vals no callback set 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f00077fe640 10 monclient: dump: 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:11.718 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f002d445640 10 client.4418.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f002d445640 10 monclient: _renew_subs 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f002d445640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00281f5590 con 0x7f00280748e0 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.710+0000 7f002d445640 1 librados: init done 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.711+0000 7f002d445640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.711+0000 7f002d445640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:11.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.711+0000 7f002d445640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:11.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.711+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00280c6320 con 0x7f00280748e0 2026-02-17T21:07:11.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.814+0000 7f00077fe640 1 -- 10.20.193.45:0/3318384230 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f001c007470 con 0x7f00280748e0 2026-02-17T21:07:11.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.814+0000 7f00077fe640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efff40792d0 0x7efff407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:11.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.815+0000 7f00267fc640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efff40792d0 0x7efff407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:11.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.815+0000 7f00267fc640 10 monclient: get_auth_request con 0x7efff40792d0 auth_method 0 2026-02-17T21:07:11.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.815+0000 7f00077fe640 10 client.4418.objecter ms_handle_connect 0x7efff40792d0 2026-02-17T21:07:11.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.815+0000 7f00267fc640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efff40792d0 0x7efff407b790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f002814ed90 tx=0x7f0010009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:11.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.815+0000 7f00077fe640 1 -- 10.20.193.45:0/3318384230 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f001c007790 con 0x7f00280748e0 2026-02-17T21:07:11.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.815+0000 7f00077fe640 10 client.4418.objecter ms_dispatch2 0x7f0028000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:11.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.815+0000 7f00077fe640 3 client.4418.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:11.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.815+0000 7f00077fe640 3 client.4418.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:11.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.815+0000 7f00077fe640 20 client.4418.objecter dump_active .. 0 homeless 2026-02-17T21:07:11.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.822+0000 7f00077fe640 1 -- 10.20.193.45:0/3318384230 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f00280c6320 con 0x7f00280748e0 2026-02-17T21:07:11.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.822+0000 7f00077fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:11.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.822+0000 7f00077fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.925+0000 7f002d445640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-17T21:07:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.925+0000 7f002d445640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T21:07:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.925+0000 7f002d445640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:11.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.925+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0028153f30 con 0x7f00280748e0 2026-02-17T21:07:11.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.995+0000 7f00077fe640 1 -- 10.20.193.45:0/3318384230 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+192451 (secure 0 0 0) 0x7f001c021020 con 0x7f00280748e0 2026-02-17T21:07:11.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.995+0000 7f00077fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-17T21:07:11.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.995+0000 7f00077fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:11.990 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:11.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 10 librados: watch_flush enter 2026-02-17T21:07:11.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 10 librados: watch_flush exit 2026-02-17T21:07:11.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 20 client.4418.objecter shutdown clearing up homeless session... 2026-02-17T21:07:11.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 10 client.4418.objecter successfully canceled tick 2026-02-17T21:07:11.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efff40792d0 msgr2=0x7efff407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efff40792d0 0x7efff407b790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f002814ed90 tx=0x7f0010009290 comp rx=0 tx=0).stop 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 10 monclient: shutdown 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00280748e0 msgr2=0x7f00281e8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00280748e0 0x7f00281e8940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f001c00c410 tx=0x7f001c00c8e0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 shutdown_connections 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efff40792d0 0x7efff407b790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f002815d1e0 0x7f00281f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00280c92b0 0x7f002815c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 --2- 10.20.193.45:0/3318384230 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00280748e0 0x7f00281e8940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 >> 10.20.193.45:0/3318384230 conn(0x7f00280c9d40 msgr2=0x7f002806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:11.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.997+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 shutdown_connections 2026-02-17T21:07:11.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.998+0000 7f002d445640 1 -- 10.20.193.45:0/3318384230 wait complete. 2026-02-17T21:07:11.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:11.998+0000 7f002d445640 1 librados: shutdown 2026-02-17T21:07:11.999 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6800","nonce":3582093432},{"type":"v1","addr":"10.20.193.45:6801","nonce":3582093432}]},"active_addr":"10.20.193.45:6801/3582093432","active_change":"2026-02-17T21:05:18.552026+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.45:0","nonce":2708938216}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.45:0","nonce":3690600242}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.45:0","nonce":1175159649}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.45:0","nonce":2452626479}]}]} 2026-02-17T21:07:12.006 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-17T21:07:12.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-17T21:07:12.006 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T21:07:12.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.116+0000 7fdab7a32640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.116+0000 7fdab7a32640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.116+0000 7fdab7a32640 10 monclient: monmap: 2026-02-17T21:07:12.109 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.109 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.109 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.117098+0000 2026-02-17T21:07:12.110 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.117098+0000 2026-02-17T21:07:12.110 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.110 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.110 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.110 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.110 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.110 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.111 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.111 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.111 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.116+0000 7fdab7a32640 1 Processor -- start 2026-02-17T21:07:12.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.116+0000 7fdab7a32640 1 -- start start 2026-02-17T21:07:12.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.116+0000 7fdab7a32640 10 monclient: init 2026-02-17T21:07:12.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 10 monclient: _add_conns ranks=[2,4,1,0,5,3] 2026-02-17T21:07:12.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdab01561c0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:12.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fdab006c890 0x7fdab00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 10 monclient(hunting): picked mon.noname-b con 0x7fdab006c890 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fdab006e110 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab015ce80 con 0x7fdab006e110 2026-02-17T21:07:12.122 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab006f6e0 con 0x7fdab01561c0 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fdab006f490 con 0x7fdab006c890 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab7a32640 10 monclient(hunting): authenticate will time out at 1015.747567s 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab4fa6640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fdab006c890 0x7fdab00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.117+0000 7fdab57a7640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7fdab01561c0 0x7fdab00704a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47516/0 (socket says 10.20.193.45:47516) 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.118+0000 7fdab57a7640 1 -- 10.20.193.45:0/633239821 learned_addr learned my addr 10.20.193.45:0/633239821 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.118+0000 7fdab4fa6640 10 monclient(hunting): get_auth_request con 0x7fdab006c890 auth_method 0 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.118+0000 7fdab4fa6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.118+0000 7fdab4fa6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.123 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.118+0000 7fdab4fa6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.118+0000 7fdab4fa6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.118+0000 7fdab4fa6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.118+0000 7fdab4fa6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.119+0000 7fdab4fa6640 10 monclient(hunting): handle_auth_done global_id 4390 payload 274 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.119+0000 7fdab4fa6640 1 -- 10.20.193.45:0/633239821 >> v1:10.20.193.92:6789/0 conn(0x7fdab01561c0 legacy=0x7fdab00704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.119+0000 7fdab4fa6640 1 -- 10.20.193.45:0/633239821 >> v1:10.20.193.86:6789/0 conn(0x7fdab006e110 legacy=0x7fdab00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.119+0000 7fdab4fa6640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.119+0000 7fdab4fa6640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.119+0000 7fdab4fa6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.119+0000 7fdab4fa6640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.119+0000 7fdab4fa6640 1 -- 10.20.193.45:0/633239821 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab006f9c0 con 0x7fdab006c890 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.121+0000 7fdab4fa6640 1 --2- 10.20.193.45:0/633239821 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006c890 0x7fdab00cca30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40098d0 tx=0x7fdaa402efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=968f083db69281e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.122+0000 7fda9ffff640 1 -- 10.20.193.45:0/633239821 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa403c070 con 0x7fdab006c890 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.122+0000 7fda9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.122+0000 7fda9ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.122+0000 7fda9ffff640 10 monclient: dump: 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.125 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.122+0000 7fda9ffff640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.122+0000 7fda9ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.122+0000 7fda9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.122+0000 7fdab7a32640 5 monclient: authenticate success, global_id 4390 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.122+0000 7fdab7a32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fda9ffff640 1 -- 10.20.193.45:0/633239821 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa402fc80 con 0x7fdab006c890 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fda9ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fda9ffff640 1 -- 10.20.193.45:0/633239821 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4037660 con 0x7fdab006c890 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fda9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fda9ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fda9ffff640 10 monclient: dump: 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 4 set_mon_vals no callback set 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 10 monclient: shutdown 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 -- 10.20.193.45:0/633239821 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006c890 msgr2=0x7fdab00cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 --2- 10.20.193.45:0/633239821 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006c890 0x7fdab00cca30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40098d0 tx=0x7fdaa402efb0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 -- 10.20.193.45:0/633239821 shutdown_connections 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 --2- 10.20.193.45:0/633239821 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006c890 0x7fdab00cca30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 -- 10.20.193.45:0/633239821 >> 10.20.193.45:0/633239821 conn(0x7fdab00cbf10 msgr2=0x7fdab00cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 -- 10.20.193.45:0/633239821 shutdown_connections 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 -- 10.20.193.45:0/633239821 wait complete. 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 10 monclient: monmap: 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 librados: starting msgr at 2026-02-17T21:07:12.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 librados: starting objecter 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.124+0000 7fdab7a32640 1 Processor -- start 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 1 -- start start 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 1 librados: setting wanted keys 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 1 librados: calling monclient init 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient: init 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdab006c890 0x7fdab01f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient(hunting): picked mon.noname-a con 0x7fdab006c890 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006e110 0x7fdab0153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient(hunting): picked mon.noname-b con 0x7fdab006e110 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdab01561c0 0x7fdab01f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient(hunting): picked mon.noname-c con 0x7fdab01561c0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdab006e860 con 0x7fdab006c890 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdab0070010 con 0x7fdab006e110 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdab015cb00 con 0x7fdab01561c0 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab7a32640 10 monclient(hunting): authenticate will time out at 1015.755417s 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab5fa8640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdab01561c0 0x7fdab01f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab57a7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdab006c890 0x7fdab01f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab4fa6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006e110 0x7fdab0153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab4fa6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006e110 0x7fdab0153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57196/0 (socket says 10.20.193.45:57196) 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab4fa6640 1 -- 10.20.193.45:0/371476594 learned_addr learned my addr 10.20.193.45:0/371476594 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab4fa6640 10 monclient(hunting): get_auth_request con 0x7fdab006e110 auth_method 0 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab4fa6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab4fa6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.125+0000 7fdab4fa6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab5fa8640 10 monclient(hunting): get_auth_request con 0x7fdab01561c0 auth_method 0 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab5fa8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab5fa8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab5fa8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab57a7640 10 monclient(hunting): get_auth_request con 0x7fdab006c890 auth_method 0 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab57a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab57a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab57a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab4fa6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab4fa6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab4fa6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab5fa8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab5fa8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab5fa8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab57a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab57a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.126+0000 7fdab57a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 10 monclient(hunting): handle_auth_done global_id 4424 payload 824 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 1 -- 10.20.193.45:0/371476594 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006e110 msgr2=0x7fdab0153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006e110 0x7fdab0153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 1 -- 10.20.193.45:0/371476594 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdab006c890 msgr2=0x7fdab01f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdab006c890 0x7fdab01f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 1 monclient: found mon.noname-c 2026-02-17T21:07:12.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.127+0000 7fdab5fa8640 1 -- 10.20.193.45:0/371476594 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab01f7c00 con 0x7fdab01561c0 2026-02-17T21:07:12.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.128+0000 7fdab5fa8640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdab01561c0 0x7fdab01f1680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00cbf0 tx=0x7fdaac00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.128+0000 7fda9dffb640 10 client.?.objecter ms_handle_connect 0x7fdab01561c0 2026-02-17T21:07:12.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.128+0000 7fda9dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 1 -- 10.20.193.45:0/371476594 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00ce10 con 0x7fdab01561c0 2026-02-17T21:07:12.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 10 monclient: dump: 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.139 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 1 -- 10.20.193.45:0/371476594 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaac003a30 con 0x7fdab01561c0 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 1 -- 10.20.193.45:0/371476594 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac003e00 con 0x7fdab01561c0 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9f7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fda9dffb640 10 monclient: dump: 2026-02-17T21:07:12.140 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fdab7a32640 5 monclient: authenticate success, global_id 4424 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fdab7a32640 10 monclient: _renew_subs 2026-02-17T21:07:12.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fdab7a32640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab01f58c0 con 0x7fdab01561c0 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fdab7a32640 10 client.4424.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fdab7a32640 10 monclient: _renew_subs 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fdab7a32640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab01f5e80 con 0x7fdab01561c0 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.130+0000 7fdab7a32640 1 librados: init done 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.131+0000 7fdab7a32640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.131+0000 7fdab7a32640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.131+0000 7fdab7a32640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.131+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab01565a0 con 0x7fdab01561c0 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.142+0000 7fda9dffb640 1 -- 10.20.193.45:0/371476594 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fdaac0050d0 con 0x7fdab01561c0 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.142+0000 7fda9dffb640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fda800792d0 0x7fda8007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.142+0000 7fdab57a7640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fda800792d0 0x7fda8007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.142+0000 7fdab57a7640 10 monclient: get_auth_request con 0x7fda800792d0 auth_method 0 2026-02-17T21:07:12.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.143+0000 7fda9dffb640 10 client.4424.objecter ms_handle_connect 0x7fda800792d0 2026-02-17T21:07:12.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.143+0000 7fdab57a7640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fda800792d0 0x7fda8007b790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0002770 tx=0x7fdaa0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.143+0000 7fda9dffb640 1 -- 10.20.193.45:0/371476594 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fdaac05e9d0 con 0x7fdab01561c0 2026-02-17T21:07:12.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.143+0000 7fda9dffb640 10 client.4424.objecter ms_dispatch2 0x7fdab0000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:12.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.143+0000 7fda9dffb640 3 client.4424.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:12.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.143+0000 7fda9dffb640 3 client.4424.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:12.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.143+0000 7fda9dffb640 20 client.4424.objecter dump_active .. 0 homeless 2026-02-17T21:07:12.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.244+0000 7fda9dffb640 1 -- 10.20.193.45:0/371476594 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdaac062990 con 0x7fdab01561c0 2026-02-17T21:07:12.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.244+0000 7fda9dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.244+0000 7fda9dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:12.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.329+0000 7fdab7a32640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:07:12.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.329+0000 7fdab7a32640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:07:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.329+0000 7fdab7a32640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.329+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdab0154b00 con 0x7fdab01561c0 2026-02-17T21:07:12.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.381+0000 7fda9dffb640 1 -- 10.20.193.45:0/371476594 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+24580 (secure 0 0 0) 0x7fdaac067e20 con 0x7fdab01561c0 2026-02-17T21:07:12.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.381+0000 7fda9dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:07:12.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.381+0000 7fda9dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:12.374 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:12.375 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":32,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:07:11.381691+0000","last_up_change":"2026-02-17T21:07:03.875560+0000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:06:58.807280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T21:07:08.056677+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6818","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6819","nonce":529906394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6820","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6821","nonce":529906394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6824","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6825","nonce":529906394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6822","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6823","nonce":529906394}]},"public_addr":"10.20.193.45:6819/529906394","cluster_addr":"10.20.193.45:6821/529906394","heartbeat_back_addr":"10.20.193.45:6825/529906394","heartbeat_front_addr":"10.20.193.45:6823/529906394","state":["exists","up"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6801","nonce":37724401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6803","nonce":37724401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6807","nonce":37724401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6805","nonce":37724401}]},"public_addr":"10.20.193.86:6801/37724401","cluster_addr":"10.20.193.86:6803/37724401","heartbeat_back_addr":"10.20.193.86:6807/37724401","heartbeat_front_addr":"10.20.193.86:6805/37724401","state":["exists","up"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6800","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6801","nonce":281465485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6803","nonce":281465485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6807","nonce":281465485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6805","nonce":281465485}]},"public_addr":"10.20.193.92:6801/281465485","cluster_addr":"10.20.193.92:6803/281465485","heartbeat_back_addr":"10.20.193.92:6807/281465485","heartbeat_front_addr":"10.20.193.92:6805/281465485","state":["exists","up"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6800","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6801","nonce":1535515312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6802","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6803","nonce":1535515312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6806","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6807","nonce":1535515312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6804","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6805","nonce":1535515312}]},"public_addr":"10.20.193.138:6801/1535515312","cluster_addr":"10.20.193.138:6803/1535515312","heartbeat_back_addr":"10.20.193.138:6807/1535515312","heartbeat_front_addr":"10.20.193.138:6805/1535515312","state":["exists","up"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6826","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6827","nonce":1457283840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6828","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6829","nonce":1457283840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6832","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6833","nonce":1457283840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6830","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6831","nonce":1457283840}]},"public_addr":"10.20.193.45:6827/1457283840","cluster_addr":"10.20.193.45:6829/1457283840","heartbeat_back_addr":"10.20.193.45:6833/1457283840","heartbeat_front_addr":"10.20.193.45:6831/1457283840","state":["exists","up"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6824","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6825","nonce":63160539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6826","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6827","nonce":63160539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6830","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6831","nonce":63160539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6828","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6829","nonce":63160539}]},"public_addr":"10.20.193.86:6825/63160539","cluster_addr":"10.20.193.86:6827/63160539","heartbeat_back_addr":"10.20.193.86:6831/63160539","heartbeat_front_addr":"10.20.193.86:6829/63160539","state":["exists","up"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6817","nonce":1142590747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6819","nonce":1142590747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6823","nonce":1142590747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6821","nonce":1142590747}]},"public_addr":"10.20.193.92:6817/1142590747","cluster_addr":"10.20.193.92:6819/1142590747","heartbeat_back_addr":"10.20.193.92:6823/1142590747","heartbeat_front_addr":"10.20.193.92:6821/1142590747","state":["exists","up"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6808","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6809","nonce":1754305677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6810","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6811","nonce":1754305677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6814","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6815","nonce":1754305677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6812","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6813","nonce":1754305677}]},"public_addr":"10.20.193.138:6809/1754305677","cluster_addr":"10.20.193.138:6811/1754305677","heartbeat_back_addr":"10.20.193.138:6815/1754305677","heartbeat_front_addr":"10.20.193.138:6813/1754305677","state":["exists","up"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6810","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6811","nonce":442873512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6812","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6813","nonce":442873512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6816","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6817","nonce":442873512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6814","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6815","nonce":442873512}]},"public_addr":"10.20.193.45:6811/442873512","cluster_addr":"10.20.193.45:6813/442873512","heartbeat_back_addr":"10.20.193.45:6817/442873512","heartbeat_front_addr":"10.20.193.45:6815/442873512","state":["exists","up"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6817","nonce":1248523526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6818","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6819","nonce":1248523526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6822","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6823","nonce":1248523526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6820","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6821","nonce":1248523526}]},"public_addr":"10.20.193.86:6817/1248523526","cluster_addr":"10.20.193.86:6819/1248523526","heartbeat_back_addr":"10.20.193.86:6823/1248523526","heartbeat_front_addr":"10.20.193.86:6821/1248523526","state":["exists","up"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6825","nonce":1170783250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6827","nonce":1170783250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6831","nonce":1170783250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6829","nonce":1170783250}]},"public_addr":"10.20.193.92:6825/1170783250","cluster_addr":"10.20.193.92:6827/1170783250","heartbeat_back_addr":"10.20.193.92:6831/1170783250","heartbeat_front_addr":"10.20.193.92:6829/1170783250","state":["exists","up"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6824","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6825","nonce":4038031379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6826","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6827","nonce":4038031379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6830","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6831","nonce":4038031379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6828","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6829","nonce":4038031379}]},"public_addr":"10.20.193.138:6825/4038031379","cluster_addr":"10.20.193.138:6827/4038031379","heartbeat_back_addr":"10.20.193.138:6831/4038031379","heartbeat_front_addr":"10.20.193.138:6829/4038031379","state":["exists","up"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6802","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6803","nonce":1807719437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6804","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6805","nonce":1807719437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6808","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6809","nonce":1807719437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6806","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6807","nonce":1807719437}]},"public_addr":"10.20.193.45:6803/1807719437","cluster_addr":"10.20.193.45:6805/1807719437","heartbeat_back_addr":"10.20.193.45:6809/1807719437","heartbeat_front_addr":"10.20.193.45:6807/1807719437","state":["exists","up"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6809","nonce":3260427089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6811","nonce":3260427089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6815","nonce":3260427089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6813","nonce":3260427089}]},"public_addr":"10.20.193.86:6809/3260427089","cluster_addr":"10.20.193.86:6811/3260427089","heartbeat_back_addr":"10.20.193.86:6815/3260427089","heartbeat_front_addr":"10.20.193.86:6813/3260427089","state":["exists","up"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6809","nonce":1799526026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6811","nonce":1799526026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6815","nonce":1799526026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6813","nonce":1799526026}]},"public_addr":"10.20.193.92:6809/1799526026","cluster_addr":"10.20.193.92:6811/1799526026","heartbeat_back_addr":"10.20.193.92:6815/1799526026","heartbeat_front_addr":"10.20.193.92:6813/1799526026","state":["exists","up"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6816","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6817","nonce":3769626240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6818","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6819","nonce":3769626240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6822","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6823","nonce":3769626240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6820","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6821","nonce":3769626240}]},"public_addr":"10.20.193.138:6817/3769626240","cluster_addr":"10.20.193.138:6819/3769626240","heartbeat_back_addr":"10.20.193.138:6823/3769626240","heartbeat_front_addr":"10.20.193.138:6821/3769626240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.146672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.052295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.217450+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.256012+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.980302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.553824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.474116+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.319384+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.275532+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.578309+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:58.653384+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.279721+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.236866+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.035025+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.697501+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.942416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:07:12.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 10 librados: watch_flush enter 2026-02-17T21:07:12.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 10 librados: watch_flush exit 2026-02-17T21:07:12.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 20 client.4424.objecter shutdown clearing up homeless session... 2026-02-17T21:07:12.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 10 client.4424.objecter successfully canceled tick 2026-02-17T21:07:12.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fda800792d0 msgr2=0x7fda8007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fda800792d0 0x7fda8007b790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0002770 tx=0x7fdaa0009040 comp rx=0 tx=0).stop 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 10 monclient: shutdown 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdab01561c0 msgr2=0x7fdab01f1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdab01561c0 0x7fdab01f1680 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00cbf0 tx=0x7fdaac00a430 comp rx=0 tx=0).stop 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 shutdown_connections 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fda800792d0 0x7fda8007b790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdab01561c0 0x7fdab01f1680 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdab006e110 0x7fdab0153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 --2- 10.20.193.45:0/371476594 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdab006c890 0x7fdab01f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 >> 10.20.193.45:0/371476594 conn(0x7fdab00cbf10 msgr2=0x7fdab0153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 shutdown_connections 2026-02-17T21:07:12.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 -- 10.20.193.45:0/371476594 wait complete. 2026-02-17T21:07:12.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.382+0000 7fdab7a32640 1 librados: shutdown 2026-02-17T21:07:12.385 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-17T21:07:12.385 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T21:07:12.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.462+0000 7fb94a0f5640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.462+0000 7fb94a0f5640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.462+0000 7fb94a0f5640 10 monclient: monmap: 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.462925+0000 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.462925+0000 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.455 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.456 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.456 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.456 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.456 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.456 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.462+0000 7fb94a0f5640 1 Processor -- start 2026-02-17T21:07:12.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.462+0000 7fb94a0f5640 1 -- start start 2026-02-17T21:07:12.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.462+0000 7fb94a0f5640 10 monclient: init 2026-02-17T21:07:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 10 monclient: _add_conns ranks=[4,0,1,5,3,2] 2026-02-17T21:07:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fb944155d30 0x7fb944068e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 10 monclient(hunting): picked mon.noname-b con 0x7fb944155d30 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb94406e290 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb9440c9f50 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb944156110 con 0x7fb94406e290 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb944069360 con 0x7fb9440c9f50 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb94406ec90 con 0x7fb944155d30 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb94a0f5640 10 monclient(hunting): authenticate will time out at 1016.093145s 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb942ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fb94406e290 0x7fb9440c9840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46036/0 (socket says 10.20.193.45:46036) 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.463+0000 7fb942ffd640 1 -- 10.20.193.45:0/21125766 learned_addr learned my addr 10.20.193.45:0/21125766 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.464+0000 7fb9437fe640 1 --2- 10.20.193.45:0/21125766 >> v2:10.20.193.86:3300/0 conn(0x7fb944155d30 0x7fb944068e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9437fe640 10 monclient(hunting): get_auth_request con 0x7fb944155d30 auth_method 0 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9427fc640 1 -- 10.20.193.45:0/21125766 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591999593 0 0) 0x7fb944156110 con 0x7fb94406e290 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9427fc640 10 monclient(hunting): _negotiate 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9427fc640 10 monclient(hunting): my global_id is 4365 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.465+0000 7fb9427fc640 1 -- 10.20.193.45:0/21125766 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb928003620 con 0x7fb94406e290 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.466+0000 7fb9437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.466+0000 7fb9437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.466+0000 7fb9437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.467+0000 7fb9437fe640 10 monclient(hunting): handle_auth_done global_id 4399 payload 274 2026-02-17T21:07:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.467+0000 7fb9437fe640 1 -- 10.20.193.45:0/21125766 >> v1:10.20.193.86:6789/0 conn(0x7fb9440c9f50 legacy=0x7fb94415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.467+0000 7fb9437fe640 1 -- 10.20.193.45:0/21125766 >> v1:10.20.193.45:6789/0 conn(0x7fb94406e290 legacy=0x7fb9440c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.467+0000 7fb9437fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.467+0000 7fb9437fe640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.467+0000 7fb9437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.467+0000 7fb9437fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.467+0000 7fb9437fe640 1 -- 10.20.193.45:0/21125766 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94406ef70 con 0x7fb944155d30 2026-02-17T21:07:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.470+0000 7fb9437fe640 1 --2- 10.20.193.45:0/21125766 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb944155d30 0x7fb944068e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9300098a0 tx=0x7fb93002ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6cae62a6a71b499 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 1 -- 10.20.193.45:0/21125766 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93003c070 con 0x7fb944155d30 2026-02-17T21:07:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 10 monclient: dump: 2026-02-17T21:07:12.466 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 1 -- 10.20.193.45:0/21125766 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93002fca0 con 0x7fb944155d30 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 1 -- 10.20.193.45:0/21125766 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930037660 con 0x7fb944155d30 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb9427fc640 10 monclient: dump: 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.468 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 5 monclient: authenticate success, global_id 4399 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 4 set_mon_vals no callback set 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 10 monclient: shutdown 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 1 -- 10.20.193.45:0/21125766 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb944155d30 msgr2=0x7fb944068e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 1 --2- 10.20.193.45:0/21125766 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb944155d30 0x7fb944068e20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9300098a0 tx=0x7fb93002ef90 comp rx=0 tx=0).stop 2026-02-17T21:07:12.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 1 -- 10.20.193.45:0/21125766 shutdown_connections 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 1 --2- 10.20.193.45:0/21125766 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb944155d30 0x7fb944068e20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 1 -- 10.20.193.45:0/21125766 >> 10.20.193.45:0/21125766 conn(0x7fb944074050 msgr2=0x7fb944074460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 1 -- 10.20.193.45:0/21125766 shutdown_connections 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 1 -- 10.20.193.45:0/21125766 wait complete. 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.472+0000 7fb94a0f5640 10 monclient: monmap: 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.470 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 librados: starting msgr at 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 librados: starting objecter 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 Processor -- start 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 -- start start 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 librados: setting wanted keys 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 librados: calling monclient init 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient: init 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb94406e290 0x7fb9441f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient(hunting): picked mon.noname-a con 0x7fb94406e290 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9440c9f50 0x7fb944158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient(hunting): picked mon.noname-b con 0x7fb9440c9f50 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb944155d30 0x7fb9441f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient(hunting): picked mon.noname-c con 0x7fb944155d30 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb9440c9320 con 0x7fb94406e290 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb9440c9040 con 0x7fb9440c9f50 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb94406f250 con 0x7fb944155d30 2026-02-17T21:07:12.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.473+0000 7fb94a0f5640 10 monclient(hunting): authenticate will time out at 1016.103712s 2026-02-17T21:07:12.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.474+0000 7fb9437fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb94406e290 0x7fb9441f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.475+0000 7fb9437fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb94406e290 0x7fb9441f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41572/0 (socket says 10.20.193.45:41572) 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.475+0000 7fb9437fe640 1 -- 10.20.193.45:0/2847992276 learned_addr learned my addr 10.20.193.45:0/2847992276 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.475+0000 7fb9437fe640 10 monclient(hunting): get_auth_request con 0x7fb94406e290 auth_method 0 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.475+0000 7fb9437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.475+0000 7fb9437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.475+0000 7fb9437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.475+0000 7fb9437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.475+0000 7fb9437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.475+0000 7fb9437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb942ffd640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9440c9f50 0x7fb944158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb942ffd640 10 monclient(hunting): get_auth_request con 0x7fb9440c9f50 auth_method 0 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb942ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb942ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb942ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb943fff640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb944155d30 0x7fb9441f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 10 monclient(hunting): handle_auth_done global_id 4368 payload 824 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 1 -- 10.20.193.45:0/2847992276 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb944155d30 msgr2=0x7fb9441f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb944155d30 0x7fb9441f39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 1 -- 10.20.193.45:0/2847992276 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9440c9f50 msgr2=0x7fb944158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9440c9f50 0x7fb944158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb9437fe640 1 -- 10.20.193.45:0/2847992276 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94414feb0 con 0x7fb94406e290 2026-02-17T21:07:12.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.476+0000 7fb942ffd640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9440c9f50 0x7fb944158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T21:07:12.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.503+0000 7fb9437fe640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb94406e290 0x7fb9441f78c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb930009130 tx=0x7fb9300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.503+0000 7fb91ffff640 10 client.?.objecter ms_handle_connect 0x7fb94406e290 2026-02-17T21:07:12.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.503+0000 7fb91ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 1 -- 10.20.193.45:0/2847992276 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb93003c040 con 0x7fb94406e290 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 10 monclient: dump: 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.501 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 1 -- 10.20.193.45:0/2847992276 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93002fe50 con 0x7fb94406e290 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 1 -- 10.20.193.45:0/2847992276 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb930042870 con 0x7fb94406e290 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb941ffb640 4 set_mon_vals no callback set 2026-02-17T21:07:12.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb91ffff640 10 monclient: dump: 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb94a0f5640 5 monclient: authenticate success, global_id 4368 2026-02-17T21:07:12.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb94a0f5640 10 monclient: _renew_subs 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb94a0f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9441f44a0 con 0x7fb94406e290 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb94a0f5640 10 client.4368.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb94a0f5640 10 monclient: _renew_subs 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb94a0f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb944150150 con 0x7fb94406e290 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.507+0000 7fb94a0f5640 1 librados: init done 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.508+0000 7fb94a0f5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.508+0000 7fb94a0f5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.508+0000 7fb94a0f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.508+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb94415ff70 con 0x7fb94406e290 2026-02-17T21:07:12.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.616+0000 7fb91ffff640 1 -- 10.20.193.45:0/2847992276 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb93004b450 con 0x7fb94406e290 2026-02-17T21:07:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.616+0000 7fb91ffff640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9140792d0 0x7fb91407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.616+0000 7fb942ffd640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9140792d0 0x7fb91407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.616+0000 7fb942ffd640 10 monclient: get_auth_request con 0x7fb9140792d0 auth_method 0 2026-02-17T21:07:12.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.617+0000 7fb942ffd640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9140792d0 0x7fb91407b790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb944151a90 tx=0x7fb934009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.617+0000 7fb91ffff640 10 client.4368.objecter ms_handle_connect 0x7fb9140792d0 2026-02-17T21:07:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.631+0000 7fb91ffff640 1 -- 10.20.193.45:0/2847992276 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fb93002fbe0 con 0x7fb94406e290 2026-02-17T21:07:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.631+0000 7fb91ffff640 10 client.4368.objecter ms_dispatch2 0x7fb944000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.631+0000 7fb91ffff640 3 client.4368.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.631+0000 7fb91ffff640 3 client.4368.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.631+0000 7fb91ffff640 20 client.4368.objecter dump_active .. 0 homeless 2026-02-17T21:07:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.631+0000 7fb91ffff640 1 -- 10.20.193.45:0/2847992276 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb9300871b0 con 0x7fb94406e290 2026-02-17T21:07:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.631+0000 7fb91ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.631+0000 7fb91ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.714+0000 7fb94a0f5640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:07:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.714+0000 7fb94a0f5640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:07:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.714+0000 7fb94a0f5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.714+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb944159660 con 0x7fb94406e290 2026-02-17T21:07:12.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.738+0000 7fb91ffff640 1 -- 10.20.193.45:0/2847992276 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+24580 (secure 0 0 0) 0x7fb930086ab0 con 0x7fb94406e290 2026-02-17T21:07:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.738+0000 7fb91ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:07:12.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.738+0000 7fb91ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:12.731 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:12.731 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":32,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:07:11.381691+0000","last_up_change":"2026-02-17T21:07:03.875560+0000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:06:58.807280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T21:07:08.056677+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6818","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6819","nonce":529906394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6820","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6821","nonce":529906394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6824","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6825","nonce":529906394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6822","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6823","nonce":529906394}]},"public_addr":"10.20.193.45:6819/529906394","cluster_addr":"10.20.193.45:6821/529906394","heartbeat_back_addr":"10.20.193.45:6825/529906394","heartbeat_front_addr":"10.20.193.45:6823/529906394","state":["exists","up"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6801","nonce":37724401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6803","nonce":37724401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6807","nonce":37724401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6805","nonce":37724401}]},"public_addr":"10.20.193.86:6801/37724401","cluster_addr":"10.20.193.86:6803/37724401","heartbeat_back_addr":"10.20.193.86:6807/37724401","heartbeat_front_addr":"10.20.193.86:6805/37724401","state":["exists","up"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6800","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6801","nonce":281465485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6803","nonce":281465485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6807","nonce":281465485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6805","nonce":281465485}]},"public_addr":"10.20.193.92:6801/281465485","cluster_addr":"10.20.193.92:6803/281465485","heartbeat_back_addr":"10.20.193.92:6807/281465485","heartbeat_front_addr":"10.20.193.92:6805/281465485","state":["exists","up"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6800","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6801","nonce":1535515312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6802","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6803","nonce":1535515312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6806","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6807","nonce":1535515312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6804","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6805","nonce":1535515312}]},"public_addr":"10.20.193.138:6801/1535515312","cluster_addr":"10.20.193.138:6803/1535515312","heartbeat_back_addr":"10.20.193.138:6807/1535515312","heartbeat_front_addr":"10.20.193.138:6805/1535515312","state":["exists","up"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6826","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6827","nonce":1457283840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6828","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6829","nonce":1457283840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6832","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6833","nonce":1457283840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6830","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6831","nonce":1457283840}]},"public_addr":"10.20.193.45:6827/1457283840","cluster_addr":"10.20.193.45:6829/1457283840","heartbeat_back_addr":"10.20.193.45:6833/1457283840","heartbeat_front_addr":"10.20.193.45:6831/1457283840","state":["exists","up"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6824","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6825","nonce":63160539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6826","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6827","nonce":63160539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6830","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6831","nonce":63160539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6828","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6829","nonce":63160539}]},"public_addr":"10.20.193.86:6825/63160539","cluster_addr":"10.20.193.86:6827/63160539","heartbeat_back_addr":"10.20.193.86:6831/63160539","heartbeat_front_addr":"10.20.193.86:6829/63160539","state":["exists","up"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6817","nonce":1142590747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6819","nonce":1142590747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6823","nonce":1142590747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6821","nonce":1142590747}]},"public_addr":"10.20.193.92:6817/1142590747","cluster_addr":"10.20.193.92:6819/1142590747","heartbeat_back_addr":"10.20.193.92:6823/1142590747","heartbeat_front_addr":"10.20.193.92:6821/1142590747","state":["exists","up"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6808","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6809","nonce":1754305677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6810","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6811","nonce":1754305677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6814","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6815","nonce":1754305677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6812","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6813","nonce":1754305677}]},"public_addr":"10.20.193.138:6809/1754305677","cluster_addr":"10.20.193.138:6811/1754305677","heartbeat_back_addr":"10.20.193.138:6815/1754305677","heartbeat_front_addr":"10.20.193.138:6813/1754305677","state":["exists","up"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6810","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6811","nonce":442873512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6812","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6813","nonce":442873512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6816","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6817","nonce":442873512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6814","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6815","nonce":442873512}]},"public_addr":"10.20.193.45:6811/442873512","cluster_addr":"10.20.193.45:6813/442873512","heartbeat_back_addr":"10.20.193.45:6817/442873512","heartbeat_front_addr":"10.20.193.45:6815/442873512","state":["exists","up"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6817","nonce":1248523526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6818","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6819","nonce":1248523526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6822","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6823","nonce":1248523526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6820","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6821","nonce":1248523526}]},"public_addr":"10.20.193.86:6817/1248523526","cluster_addr":"10.20.193.86:6819/1248523526","heartbeat_back_addr":"10.20.193.86:6823/1248523526","heartbeat_front_addr":"10.20.193.86:6821/1248523526","state":["exists","up"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6825","nonce":1170783250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6827","nonce":1170783250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6831","nonce":1170783250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6829","nonce":1170783250}]},"public_addr":"10.20.193.92:6825/1170783250","cluster_addr":"10.20.193.92:6827/1170783250","heartbeat_back_addr":"10.20.193.92:6831/1170783250","heartbeat_front_addr":"10.20.193.92:6829/1170783250","state":["exists","up"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6824","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6825","nonce":4038031379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6826","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6827","nonce":4038031379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6830","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6831","nonce":4038031379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6828","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6829","nonce":4038031379}]},"public_addr":"10.20.193.138:6825/4038031379","cluster_addr":"10.20.193.138:6827/4038031379","heartbeat_back_addr":"10.20.193.138:6831/4038031379","heartbeat_front_addr":"10.20.193.138:6829/4038031379","state":["exists","up"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6802","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6803","nonce":1807719437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6804","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6805","nonce":1807719437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6808","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6809","nonce":1807719437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6806","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6807","nonce":1807719437}]},"public_addr":"10.20.193.45:6803/1807719437","cluster_addr":"10.20.193.45:6805/1807719437","heartbeat_back_addr":"10.20.193.45:6809/1807719437","heartbeat_front_addr":"10.20.193.45:6807/1807719437","state":["exists","up"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6809","nonce":3260427089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6811","nonce":3260427089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6815","nonce":3260427089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6813","nonce":3260427089}]},"public_addr":"10.20.193.86:6809/3260427089","cluster_addr":"10.20.193.86:6811/3260427089","heartbeat_back_addr":"10.20.193.86:6815/3260427089","heartbeat_front_addr":"10.20.193.86:6813/3260427089","state":["exists","up"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6809","nonce":1799526026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6811","nonce":1799526026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6815","nonce":1799526026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6813","nonce":1799526026}]},"public_addr":"10.20.193.92:6809/1799526026","cluster_addr":"10.20.193.92:6811/1799526026","heartbeat_back_addr":"10.20.193.92:6815/1799526026","heartbeat_front_addr":"10.20.193.92:6813/1799526026","state":["exists","up"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6816","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6817","nonce":3769626240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6818","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6819","nonce":3769626240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6822","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6823","nonce":3769626240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6820","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6821","nonce":3769626240}]},"public_addr":"10.20.193.138:6817/3769626240","cluster_addr":"10.20.193.138:6819/3769626240","heartbeat_back_addr":"10.20.193.138:6823/3769626240","heartbeat_front_addr":"10.20.193.138:6821/3769626240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.146672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.052295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.217450+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.256012+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.980302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.553824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.474116+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.319384+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.275532+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.578309+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:58.653384+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.279721+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.236866+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.035025+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.697501+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.942416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:07:12.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 10 librados: watch_flush enter 2026-02-17T21:07:12.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 10 librados: watch_flush exit 2026-02-17T21:07:12.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 20 client.4368.objecter shutdown clearing up homeless session... 2026-02-17T21:07:12.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 10 client.4368.objecter successfully canceled tick 2026-02-17T21:07:12.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9140792d0 msgr2=0x7fb91407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9140792d0 0x7fb91407b790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb944151a90 tx=0x7fb934009040 comp rx=0 tx=0).stop 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 10 monclient: shutdown 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb94406e290 msgr2=0x7fb9441f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb94406e290 0x7fb9441f78c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb930009130 tx=0x7fb9300047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 shutdown_connections 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9140792d0 0x7fb91407b790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb944155d30 0x7fb9441f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9440c9f50 0x7fb944158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 --2- 10.20.193.45:0/2847992276 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb94406e290 0x7fb9441f78c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 >> 10.20.193.45:0/2847992276 conn(0x7fb944074050 msgr2=0x7fb9440cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 shutdown_connections 2026-02-17T21:07:12.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 -- 10.20.193.45:0/2847992276 wait complete. 2026-02-17T21:07:12.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.739+0000 7fb94a0f5640 1 librados: shutdown 2026-02-17T21:07:12.742 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-17T21:07:12.743 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-17T21:07:12.743 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-17T21:07:12.744 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-17T21:07:12.744 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-17T21:07:12.744 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-17T21:07:12.745 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-17T21:07:12.745 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-17T21:07:12.746 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-17T21:07:12.746 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-17T21:07:12.747 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-17T21:07:12.747 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-17T21:07:12.747 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-17T21:07:12.748 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-17T21:07:12.748 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-17T21:07:12.749 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-17T21:07:12.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.839+0000 7f963f9d3640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.839+0000 7f963f9d3640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.839+0000 7f963f9d3640 10 monclient: monmap: 2026-02-17T21:07:12.832 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.832 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.832 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.840674+0000 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.840674+0000 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.833 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.840+0000 7f963f9d3640 1 Processor -- start 2026-02-17T21:07:12.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.840+0000 7f963f9d3640 1 -- start start 2026-02-17T21:07:12.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.840+0000 7f963f9d3640 10 monclient: init 2026-02-17T21:07:12.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.840+0000 7f963f9d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.840+0000 7f963f9d3640 10 monclient: _add_conns ranks=[1,0,3,5,4,2] 2026-02-17T21:07:12.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f963815b340 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9638151cd0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:12.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f963815b720 0x7f963806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 10 monclient(hunting): picked mon.noname-a con 0x7f963815b720 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:12.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9638072c70 con 0x7f9638151cd0 2026-02-17T21:07:12.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9638072f50 con 0x7f963815b340 2026-02-17T21:07:12.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f61130db640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f9638073230 con 0x7f963815b720 2026-02-17T21:07:12.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963f9d3640 10 monclient(hunting): authenticate will time out at 1016.471365s 2026-02-17T21:07:12.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963d748640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f963815b340 0x7f96381515c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52708/0 (socket says 10.20.193.45:52708) 2026-02-17T21:07:12.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963d748640 1 -- 10.20.193.45:0/3207590266 learned_addr learned my addr 10.20.193.45:0/3207590266 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f963df49640 1 --2- 10.20.193.45:0/3207590266 >> v2:10.20.193.45:3300/0 conn(0x7f963815b720 0x7f963806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f61130db640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f61130db640 10 monclient: monmap: 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.842109+0000 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.842109+0000 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.839 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.840 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.840 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.840 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.840 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.840 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f61130db640 1 Processor -- start 2026-02-17T21:07:12.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f61130db640 1 -- start start 2026-02-17T21:07:12.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.841+0000 7f61130db640 10 monclient: init 2026-02-17T21:07:12.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f963df49640 10 monclient(hunting): get_auth_request con 0x7f963815b720 auth_method 0 2026-02-17T21:07:12.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f963df49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f963df49640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f963df49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f78d47bc640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f78d47bc640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f78d47bc640 10 monclient: monmap: 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.842930+0000 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.842930+0000 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.842 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.843 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.843 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.843 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.843 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f6b691fe640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f6b691fe640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f6b691fe640 10 monclient: monmap: 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.843019+0000 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.843019+0000 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.844 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.845 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.845 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.845 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 10 monclient: _add_conns ranks=[2,4,1,3,5,0] 2026-02-17T21:07:12.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f610c156ce0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:12.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f610c073fc0 0x7f610c074420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 10 monclient(hunting): picked mon.noname-b con 0x7f610c073fc0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f610c0c3f20 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610c074960 con 0x7f610c0c3f20 2026-02-17T21:07:12.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f78d47bc640 1 Processor -- start 2026-02-17T21:07:12.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f963df49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f963df49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f963df49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610c160c10 con 0x7f610c156ce0 2026-02-17T21:07:12.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f610c1609e0 con 0x7f610c073fc0 2026-02-17T21:07:12.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f78d47bc640 1 -- start start 2026-02-17T21:07:12.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f78d47bc640 10 monclient: init 2026-02-17T21:07:12.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f61130db640 10 monclient(hunting): authenticate will time out at 1016.472548s 2026-02-17T21:07:12.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f6b691fe640 1 Processor -- start 2026-02-17T21:07:12.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f6b691fe640 1 -- start start 2026-02-17T21:07:12.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.842+0000 7f6b691fe640 10 monclient: init 2026-02-17T21:07:12.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6110e50640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f610c156ce0 0x7f610c1602d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47524/0 (socket says 10.20.193.45:47524) 2026-02-17T21:07:12.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6110e50640 1 -- 10.20.193.45:0/3262365574 learned_addr learned my addr 10.20.193.45:0/3262365574 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f9627fff640 1 -- 10.20.193.45:0/3207590266 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199801790 0 0) 0x7f9638072f50 con 0x7f963815b340 2026-02-17T21:07:12.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f9627fff640 10 monclient(hunting): _negotiate 2026-02-17T21:07:12.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f9627fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f9627fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f9627fff640 10 monclient(hunting): my global_id is 4405 2026-02-17T21:07:12.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f9627fff640 1 -- 10.20.193.45:0/3207590266 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9620003620 con 0x7f963815b340 2026-02-17T21:07:12.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 10 monclient: _add_conns ranks=[0,2,3,5,4,1] 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f78cc163930 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f78cc163d10 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f78cc15a200 0x7f78cc16aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 10 monclient(hunting): picked mon.noname-a con 0x7f78cc15a200 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78cc0c7d70 con 0x7f78cc163930 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78cc070e60 con 0x7f78cc163d10 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f78cc15a610 con 0x7f78cc15a200 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f78d47bc640 10 monclient(hunting): authenticate will time out at 1016.473281s 2026-02-17T21:07:12.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6103fff640 1 --2- 10.20.193.45:0/3262365574 >> v2:10.20.193.86:3300/0 conn(0x7f610c073fc0 0x7f610c074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f676ceae640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f676ceae640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f676ceae640 10 monclient: monmap: 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.844301+0000 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.844301+0000 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.855 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.856 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.856 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 10 monclient: _add_conns ranks=[0,2,3,1,4,5] 2026-02-17T21:07:12.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6b64155e40 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:12.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6103fff640 10 monclient(hunting): get_auth_request con 0x7f610c073fc0 auth_method 0 2026-02-17T21:07:12.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6103fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6103fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6103fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6b64074c90 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:12.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f6b64156220 0x7f6b641666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 10 monclient(hunting): picked mon.noname-a con 0x7f6b64156220 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:12.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b640734e0 con 0x7f6b64155e40 2026-02-17T21:07:12.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b640737c0 con 0x7f6b64074c90 2026-02-17T21:07:12.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f6b640cd800 con 0x7f6b64156220 2026-02-17T21:07:12.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f6b691fe640 10 monclient(hunting): authenticate will time out at 1016.473782s 2026-02-17T21:07:12.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f963df49640 10 monclient(hunting): handle_auth_done global_id 4371 payload 274 2026-02-17T21:07:12.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f963df49640 1 -- 10.20.193.45:0/3207590266 >> v1:10.20.193.86:6789/0 conn(0x7f963815b340 legacy=0x7f96381515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f963df49640 1 -- 10.20.193.45:0/3207590266 >> v1:10.20.193.45:6789/0 conn(0x7f9638151cd0 legacy=0x7f9638072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f963df49640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f963df49640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f963df49640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f963df49640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.843+0000 7f963df49640 1 -- 10.20.193.45:0/3207590266 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9638073510 con 0x7f963815b720 2026-02-17T21:07:12.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.844+0000 7f676ceae640 1 Processor -- start 2026-02-17T21:07:12.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.844+0000 7f676ceae640 1 -- start start 2026-02-17T21:07:12.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.844+0000 7f676ceae640 10 monclient: init 2026-02-17T21:07:12.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.844+0000 7f78d2d32640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f78cc15a200 0x7f78cc16aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f6b62575640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f6b64074c90 0x7f6b640ccb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47544/0 (socket says 10.20.193.45:47544) 2026-02-17T21:07:12.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f6b62575640 1 -- 10.20.193.45:0/27303218 learned_addr learned my addr 10.20.193.45:0/27303218 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f61037fe640 1 -- 10.20.193.45:0/3262365574 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089323053 0 0) 0x7f610c160c10 con 0x7f610c156ce0 2026-02-17T21:07:12.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f61037fe640 10 monclient(hunting): _negotiate 2026-02-17T21:07:12.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f61037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f61037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f61037fe640 10 monclient(hunting): my global_id is 4427 2026-02-17T21:07:12.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f61037fe640 1 -- 10.20.193.45:0/3262365574 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60f8003620 con 0x7f610c156ce0 2026-02-17T21:07:12.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f78d1d30640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f78cc163d10 0x7f78cc159af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47534/0 (socket says 10.20.193.45:47534) 2026-02-17T21:07:12.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f78d1d30640 1 -- 10.20.193.45:0/1850192138 learned_addr learned my addr 10.20.193.45:0/1850192138 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 10 monclient: _add_conns ranks=[4,1,5,3,2,0] 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f67681501d0 0x7f67681505b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 10 monclient(hunting): picked mon.noname-b con 0x7f67681501d0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f67680c5920 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f6768076230 0x7f67680c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 10 monclient(hunting): picked mon.noname-c con 0x7f6768076230 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67680c8530 con 0x7f67680c5920 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f67680c7dd0 con 0x7f67681501d0 2026-02-17T21:07:12.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f67680c5da0 con 0x7f6768076230 2026-02-17T21:07:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f676ceae640 10 monclient(hunting): authenticate will time out at 1016.475321s 2026-02-17T21:07:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f78d2d32640 10 monclient(hunting): get_auth_request con 0x7f78cc15a200 auth_method 0 2026-02-17T21:07:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f78d2d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f78d2d32640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f78d2d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f6103fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f6103fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f6103fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f78d2d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f78d2d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.845+0000 7f78d2d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f7030a8f640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f7030a8f640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f7030a8f640 10 monclient: monmap: 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.847425+0000 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.847425+0000 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.869 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f78d2d32640 10 monclient(hunting): handle_auth_done global_id 4374 payload 274 2026-02-17T21:07:12.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f78d2d32640 1 -- 10.20.193.45:0/1850192138 >> v1:10.20.193.92:6789/0 conn(0x7f78cc163d10 legacy=0x7f78cc159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f78d2d32640 1 -- 10.20.193.45:0/1850192138 >> v1:10.20.193.45:6789/0 conn(0x7f78cc163930 legacy=0x7f78cc0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f78d2d32640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f78d2d32640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f78d2d32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f78d2d32640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f78d2d32640 1 -- 10.20.193.45:0/1850192138 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc0c8010 con 0x7f78cc15a200 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f6103fff640 10 monclient(hunting): handle_auth_done global_id 4408 payload 274 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f6103fff640 1 -- 10.20.193.45:0/3262365574 >> v1:10.20.193.92:6789/0 conn(0x7f610c156ce0 legacy=0x7f610c1602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f6103fff640 1 -- 10.20.193.45:0/3262365574 >> v1:10.20.193.86:6789/0 conn(0x7f610c0c3f20 legacy=0x7f610c0c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f6103fff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f6103fff640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f6103fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f6103fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.846+0000 7f6103fff640 1 -- 10.20.193.45:0/3262365574 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c160ef0 con 0x7f610c073fc0 2026-02-17T21:07:12.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 1 Processor -- start 2026-02-17T21:07:12.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 1 -- start start 2026-02-17T21:07:12.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient: init 2026-02-17T21:07:12.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient: _add_conns ranks=[4,2,5,3,0,1] 2026-02-17T21:07:12.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f702c155fe0 0x7f702c0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient(hunting): picked mon.noname-b con 0x7f702c155fe0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f702c0c98b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f702c0c9cf0 0x7f702c0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient(hunting): picked mon.noname-c con 0x7f702c0c9cf0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f702c0c8b60 con 0x7f702c0c98b0 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f702c0c9420 con 0x7f702c155fe0 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f702c15cbb0 con 0x7f702c0c9cf0 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.847+0000 7f7030a8f640 10 monclient(hunting): authenticate will time out at 1016.477963s 2026-02-17T21:07:12.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f6b63577640 1 --2- 10.20.193.45:0/27303218 >> v2:10.20.193.45:3300/0 conn(0x7f6b64156220 0x7f6b641666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f6766575640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f67681501d0 0x7f67681505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f6b63577640 10 monclient(hunting): get_auth_request con 0x7f6b64156220 auth_method 0 2026-02-17T21:07:12.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f6b63577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f6b63577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f6b63577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f6766d76640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f6768076230 0x7f67680c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f321916a640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f321916a640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.848+0000 7f321916a640 10 monclient: monmap: 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.849611+0000 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.849611+0000 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.876 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f321916a640 1 Processor -- start 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f321916a640 1 -- start start 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f321916a640 10 monclient: init 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6765d74640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f67680c5920 0x7f67680c76c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52720/0 (socket says 10.20.193.45:52720) 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6765d74640 1 -- 10.20.193.45:0/3089943578 learned_addr learned my addr 10.20.193.45:0/3089943578 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766d76640 10 monclient(hunting): get_auth_request con 0x7f6768076230 auth_method 0 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766575640 10 monclient(hunting): get_auth_request con 0x7f67681501d0 auth_method 0 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f290ab22640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f290ab22640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f290ab22640 10 monclient: monmap: 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.850524+0000 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.850524+0000 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.878 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.879 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.879 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.879 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.879 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.879 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f321916a640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f321916a640 10 monclient: _add_conns ranks=[1,5,0,3,2,4] 2026-02-17T21:07:12.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f321916a640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3214155e40 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f321916a640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3214074c90 0x7f32140ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f321916a640 10 monclient(hunting): picked mon.noname-c con 0x7f3214074c90 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:12.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6103fff640 1 --2- 10.20.193.45:0/3262365574 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f610c073fc0 0x7f610c074420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60f40098a0 tx=0x7f60f402ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc5b3dd4e3075117 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f6766575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.849+0000 7f321916a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3214156220 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:12.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f321916a640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32140734e0 con 0x7f3214156220 2026-02-17T21:07:12.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f321916a640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32140737c0 con 0x7f3214155e40 2026-02-17T21:07:12.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f321916a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f321916a640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f32140cd800 con 0x7f3214074c90 2026-02-17T21:07:12.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f321916a640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f321916a640 10 monclient(hunting): authenticate will time out at 1016.480130s 2026-02-17T21:07:12.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f963df49640 1 --2- 10.20.193.45:0/3207590266 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f963815b720 0x7f963806d170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f963400aee0 tx=0x7f9634030330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44cf90c81b52fd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f290ab22640 1 Processor -- start 2026-02-17T21:07:12.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f290ab22640 1 -- start start 2026-02-17T21:07:12.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f290ab22640 10 monclient: init 2026-02-17T21:07:12.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f6b63577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f6b63577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f6b63577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f6766575640 10 monclient(hunting): handle_auth_done global_id 4414 payload 274 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f6766575640 1 -- 10.20.193.45:0/3089943578 >> v2:10.20.193.92:3300/0 conn(0x7f6768076230 msgr2=0x7f67680c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f6766575640 1 --2- 10.20.193.45:0/3089943578 >> v2:10.20.193.92:3300/0 conn(0x7f6768076230 0x7f67680c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 10 monclient: _add_conns ranks=[1,4,5,3,2,0] 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2904155e40 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f2904074c90 0x7f29040ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 10 monclient(hunting): picked mon.noname-b con 0x7f2904074c90 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f2904156220 0x7f29040cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 10 monclient(hunting): picked mon.noname-c con 0x7f2904156220 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29040734e0 con 0x7f2904155e40 2026-02-17T21:07:12.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f29040cd800 con 0x7f2904074c90 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f29040737c0 con 0x7f2904156220 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f290ab22640 10 monclient(hunting): authenticate will time out at 1016.481115s 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f6766575640 1 -- 10.20.193.45:0/3089943578 >> v1:10.20.193.86:6789/0 conn(0x7f67680c5920 legacy=0x7f67680c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f6766575640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f6766575640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f6766575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f6766575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.851+0000 7f6766575640 1 -- 10.20.193.45:0/3089943578 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67680c87a0 con 0x7f67681501d0 2026-02-17T21:07:12.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.850+0000 7f78d2d32640 1 --2- 10.20.193.45:0/1850192138 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f78cc15a200 0x7f78cc16aa50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009d90 tx=0x7f78c802f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44d2d157c67559 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7f6b63577640 10 monclient(hunting): handle_auth_done global_id 4380 payload 274 2026-02-17T21:07:12.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7f6b63577640 1 -- 10.20.193.45:0/27303218 >> v1:10.20.193.92:6789/0 conn(0x7f6b64074c90 legacy=0x7f6b640ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7f6b63577640 1 -- 10.20.193.45:0/27303218 >> v1:10.20.193.45:6789/0 conn(0x7f6b64155e40 legacy=0x7f6b64074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7f6b63577640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7f6b63577640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7f6b63577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7f6b63577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7f6b63577640 1 -- 10.20.193.45:0/27303218 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b64073aa0 con 0x7f6b64156220 2026-02-17T21:07:12.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7f702ad76640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f702c0c9cf0 0x7f702c0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7efe8f908640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7efe8f908640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.852+0000 7efe8f908640 10 monclient: monmap: 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.853754+0000 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.853754+0000 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.886 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f702ad76640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f702c0c9cf0 0x7f702c0ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35928/0 (socket says 10.20.193.45:35928) 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f702ad76640 1 -- 10.20.193.45:0/3093640175 learned_addr learned my addr 10.20.193.45:0/3093640175 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f702ad76640 10 monclient(hunting): get_auth_request con 0x7f702c0c9cf0 auth_method 0 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f702ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f702ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f702ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f3212575640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3214074c90 0x7f32140ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7efe8f908640 1 Processor -- start 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7efe8f908640 1 -- start start 2026-02-17T21:07:12.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7efe8f908640 10 monclient: init 2026-02-17T21:07:12.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f3212575640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3214074c90 0x7f32140ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35934/0 (socket says 10.20.193.45:35934) 2026-02-17T21:07:12.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f3212575640 1 -- 10.20.193.45:0/4166436620 learned_addr learned my addr 10.20.193.45:0/4166436620 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f3212575640 10 monclient(hunting): get_auth_request con 0x7f3214074c90 auth_method 0 2026-02-17T21:07:12.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f3212575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f3212575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f3212575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7efe8f908640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7efe8f908640 10 monclient: _add_conns ranks=[2,5,1,4,0,3] 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f702ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.853+0000 7f702ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7f702ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7efe88155fe0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7efe880c98b0 0x7efe880c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 10 monclient(hunting): picked mon.noname-c con 0x7efe880c98b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7efe880d16d0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe880c8b60 con 0x7efe880d16d0 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8815cbb0 con 0x7efe88155fe0 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7efe880c9420 con 0x7efe880c98b0 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7efe8f908640 10 monclient(hunting): authenticate will time out at 1016.484058s 2026-02-17T21:07:12.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7f3212575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7f3212575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7f3212575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7f6766575640 1 --2- 10.20.193.45:0/3089943578 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f67681501d0 0x7f67681505b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f67680c6ee0 tx=0x7f675c02ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=723fd10fae6f1a6a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7feb3755b640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7feb3755b640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.854+0000 7feb3755b640 10 monclient: monmap: 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.855525+0000 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.855525+0000 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f702a575640 1 --2- 10.20.193.45:0/3093640175 >> v2:10.20.193.86:3300/0 conn(0x7f702c155fe0 0x7f702c0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7feb3755b640 1 Processor -- start 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 1 -- 10.20.193.45:0/1850192138 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c803c070 con 0x7f78cc15a200 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f5ea56d6640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f5ea56d6640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f5ea56d6640 10 monclient: monmap: 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.856539+0000 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.856539+0000 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.892 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.893 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.893 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 10 monclient: dump: 2026-02-17T21:07:12.893 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.893 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.893 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d47bc640 5 monclient: authenticate success, global_id 4374 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d47bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 1 -- 10.20.193.45:0/1850192138 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c802fe10 con 0x7f78cc15a200 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 1 -- 10.20.193.45:0/1850192138 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8037660 con 0x7f78cc15a200 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d152f640 10 monclient: dump: 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.894 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d47bc640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.855+0000 7f78d47bc640 4 set_mon_vals no callback set 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7feb3755b640 1 -- start start 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7feb3755b640 10 monclient: init 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f702a575640 10 monclient(hunting): get_auth_request con 0x7f702c155fe0 auth_method 0 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 1 Processor -- start 2026-02-17T21:07:12.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7fee007c3640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f702a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f702a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f702a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 1 -- start start 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 10 monclient: init 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7fee007c3640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7fee007c3640 10 monclient: monmap: 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.857020+0000 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.857020+0000 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.896 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f0e688ea640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f0e688ea640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f0e688ea640 10 monclient: monmap: 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.857132+0000 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.857132+0000 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f9627fff640 1 -- 10.20.193.45:0/3207590266 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634030de0 con 0x7f963815b720 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f9627fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f9627fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f9627fff640 10 monclient: dump: 2026-02-17T21:07:12.897 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f78d47bc640 10 monclient: shutdown 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f9627fff640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f9627fff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f9627fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f963f9d3640 5 monclient: authenticate success, global_id 4371 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f78d47bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f78d47bc640 1 -- 10.20.193.45:0/1850192138 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f78cc15a200 msgr2=0x7f78cc16aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f963f9d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f78d47bc640 1 --2- 10.20.193.45:0/1850192138 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f78cc15a200 0x7f78cc16aa50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009d90 tx=0x7f78c802f150 comp rx=0 tx=0).stop 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7fee007c3640 1 Processor -- start 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7fee007c3640 1 -- start start 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7fee007c3640 10 monclient: init 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f0e688ea640 1 Processor -- start 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f78d47bc640 1 -- 10.20.193.45:0/1850192138 shutdown_connections 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f78d47bc640 1 --2- 10.20.193.45:0/1850192138 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f78cc15a200 0x7f78cc16aa50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f78d47bc640 1 -- 10.20.193.45:0/1850192138 >> 10.20.193.45:0/1850192138 conn(0x7f78cc0c9d40 msgr2=0x7f78cc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f78d47bc640 1 -- 10.20.193.45:0/1850192138 shutdown_connections 2026-02-17T21:07:12.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f78d47bc640 1 -- 10.20.193.45:0/1850192138 wait complete. 2026-02-17T21:07:12.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f0e688ea640 1 -- start start 2026-02-17T21:07:12.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f0e688ea640 10 monclient: init 2026-02-17T21:07:12.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 10 monclient: _add_conns ranks=[1,0,3,5,4,2] 2026-02-17T21:07:12.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7feb3755b640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7feb3755b640 10 monclient: _add_conns ranks=[1,0,5,3,4,2] 2026-02-17T21:07:12.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5ea0155e40 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f54675a9640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f54675a9640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5ea0074c90 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f54675a9640 10 monclient: monmap: 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.857699+0000 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.857699+0000 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7feb3755b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7feb30155e40 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5ea0156220 0x7f5ea01666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7feb3755b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feb30074c90 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:12.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 10 monclient(hunting): picked mon.noname-a con 0x7f5ea0156220 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:12.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea00734e0 con 0x7f5ea0074c90 2026-02-17T21:07:12.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7feb3755b640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7feb30156220 0x7feb301666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ea00737c0 con 0x7f5ea0155e40 2026-02-17T21:07:12.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7f5ea56d6640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea00cd800 con 0x7f5ea0156220 2026-02-17T21:07:12.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.856+0000 7feb3755b640 10 monclient(hunting): picked mon.noname-c con 0x7feb30156220 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f5ea56d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7feb3755b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb300734e0 con 0x7feb30074c90 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f5ea56d6640 10 monclient(hunting): authenticate will time out at 1016.487020s 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7feb3755b640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb300737c0 con 0x7feb30155e40 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7feb3755b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7feb3755b640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7feb300cd800 con 0x7feb30156220 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7feb3755b640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7feb3755b640 10 monclient(hunting): authenticate will time out at 1016.487099s 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fb04ab22640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fb04ab22640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fb04ab22640 10 monclient: monmap: 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.857935+0000 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.857935+0000 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.904 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient: _add_conns ranks=[5,4,3,2,0,1] 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fedf8155e40 0x7fedf8074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient(hunting): picked mon.noname-c con 0x7fedf8155e40 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fedf8156220 0x7fedf8074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient(hunting): picked mon.noname-b con 0x7fedf8156220 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fedf80ccb80 0x7fedf80ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient(hunting): picked mon.noname-a con 0x7fedf80ccb80 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80cd800 con 0x7fedf80ccb80 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80734e0 con 0x7fedf8156220 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80737c0 con 0x7fedf8155e40 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fee007c3640 10 monclient(hunting): authenticate will time out at 1016.487388s 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f78d47bc640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 10 monclient: _add_conns ranks=[4,3,0,5,2,1] 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f0e60155e40 0x7f0e60074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 10 monclient(hunting): picked mon.noname-b con 0x7f0e60155e40 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0e60156220 0x7f0e60074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 10 monclient(hunting): picked mon.noname-a con 0x7f0e60156220 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0e600ccb80 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e600734e0 con 0x7f0e600ccb80 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0e600cd800 con 0x7f0e60156220 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f0e600737c0 con 0x7f0e60155e40 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f0e688ea640 10 monclient(hunting): authenticate will time out at 1016.487366s 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f78d47bc640 10 monclient: monmap: 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f54675a9640 1 Processor -- start 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 1 -- 10.20.193.45:0/3262365574 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f403c070 con 0x7f610c073fc0 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 10 monclient: dump: 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 1 -- 10.20.193.45:0/3262365574 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f402fb70 con 0x7f610c073fc0 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 1 -- 10.20.193.45:0/3262365574 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4037440 con 0x7f610c073fc0 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61037fe640 10 monclient: dump: 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.907 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61130db640 5 monclient: authenticate success, global_id 4408 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61130db640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f61130db640 4 set_mon_vals no callback set 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fb04ab22640 1 Processor -- start 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f3212575640 10 monclient(hunting): handle_auth_done global_id 4442 payload 274 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f3212575640 1 -- 10.20.193.45:0/4166436620 >> v1:10.20.193.86:6789/0 conn(0x7f3214155e40 legacy=0x7f3214074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f3212575640 1 -- 10.20.193.45:0/4166436620 >> v1:10.20.193.45:6789/0 conn(0x7f3214156220 legacy=0x7f321415f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f3212575640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f3212575640 1 monclient: found mon.noname-c 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f3212575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f702a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f702a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f3212575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f3212575640 1 -- 10.20.193.45:0/4166436620 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3214073aa0 con 0x7f3214074c90 2026-02-17T21:07:12.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f702a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fb04ab22640 1 -- start start 2026-02-17T21:07:12.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7fb04ab22640 10 monclient: init 2026-02-17T21:07:12.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f78d47bc640 1 librados: starting msgr at 2026-02-17T21:07:12.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f78d47bc640 1 librados: starting objecter 2026-02-17T21:07:12.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f28fbfff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f2904074c90 0x7f29040ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f78d47bc640 1 Processor -- start 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f78d47bc640 1 -- start start 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f78d47bc640 1 librados: setting wanted keys 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f78d47bc640 1 librados: calling monclient init 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f78d47bc640 10 monclient: init 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f54675a9640 1 -- start start 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.857+0000 7f54675a9640 10 monclient: init 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f61130db640 10 monclient: shutdown 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f61130db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f61130db640 1 -- 10.20.193.45:0/3262365574 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f610c073fc0 msgr2=0x7f610c074420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f61130db640 1 --2- 10.20.193.45:0/3262365574 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f610c073fc0 0x7f610c074420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60f40098a0 tx=0x7f60f402ee60 comp rx=0 tx=0).stop 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 10 monclient: _add_conns ranks=[4,5,2,3,0,1] 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f9627fff640 1 -- 10.20.193.45:0/3207590266 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f963400a2e0 con 0x7f963815b720 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f9627fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 4 set_mon_vals no callback set 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fb044155fe0 0x7fb0440cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 10 monclient(hunting): picked mon.noname-b con 0x7fb044155fe0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fb0440c98b0 0x7fb0440c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 10 monclient(hunting): picked mon.noname-c con 0x7fb0440c98b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 10 monclient: _add_conns ranks=[4,3,0,5,1,2] 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5460155fe0 0x7f54600cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb0440d16d0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0440c8b60 con 0x7fb0440d16d0 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb0440c9420 con 0x7fb044155fe0 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fb04415cbb0 con 0x7fb0440c98b0 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7fb04ab22640 10 monclient(hunting): authenticate will time out at 1016.488315s 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 10 monclient(hunting): picked mon.noname-b con 0x7f5460155fe0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f54600c98b0 0x7f54600c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 10 monclient(hunting): picked mon.noname-a con 0x7f54600c98b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f54600d16d0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:12.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54600c8b60 con 0x7f54600d16d0 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f54600c9420 con 0x7f54600c98b0 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f546015cbb0 con 0x7f5460155fe0 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f54675a9640 10 monclient(hunting): authenticate will time out at 1016.488354s 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f0e65e5e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0e60156220 0x7f0e60074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f61130db640 1 -- 10.20.193.45:0/3262365574 shutdown_connections 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f61130db640 1 --2- 10.20.193.45:0/3262365574 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f610c073fc0 0x7f610c074420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f6b63577640 1 --2- 10.20.193.45:0/27303218 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b64156220 0x7f6b641666d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009d90 tx=0x7f6b5402f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b4b5f84d5c1cb7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f61130db640 1 -- 10.20.193.45:0/3262365574 >> 10.20.193.45:0/3262365574 conn(0x7f610c0ce270 msgr2=0x7f610c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f78cc15a200 0x7f78cc14bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient(hunting): picked mon.noname-a con 0x7f78cc15a200 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f78cc163930 0x7f78cc162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient(hunting): picked mon.noname-b con 0x7f78cc163930 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f78cc163d10 0x7f78cc0c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f61130db640 1 -- 10.20.193.45:0/3262365574 shutdown_connections 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f61130db640 1 -- 10.20.193.45:0/3262365574 wait complete. 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient(hunting): picked mon.noname-c con 0x7f78cc163d10 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc0c88b0 con 0x7f78cc15a200 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f702a575640 10 monclient(hunting): handle_auth_done global_id 4423 payload 274 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f702a575640 1 -- 10.20.193.45:0/3093640175 >> v2:10.20.193.92:3300/0 conn(0x7f702c0c9cf0 msgr2=0x7f702c0ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f702a575640 1 --2- 10.20.193.45:0/3093640175 >> v2:10.20.193.92:3300/0 conn(0x7f702c0c9cf0 0x7f702c0ce170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc0c85d0 con 0x7f78cc163930 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc0c8b90 con 0x7f78cc163d10 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f702a575640 1 -- 10.20.193.45:0/3093640175 >> v1:10.20.193.92:6789/0 conn(0x7f702c0c98b0 legacy=0x7f702c0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f78d47bc640 10 monclient(hunting): authenticate will time out at 1016.488661s 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 10 monclient: shutdown 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 1 -- 10.20.193.45:0/3207590266 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f963815b720 msgr2=0x7f963806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 1 --2- 10.20.193.45:0/3207590266 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f963815b720 0x7f963806d170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f963400aee0 tx=0x7f9634030330 comp rx=0 tx=0).stop 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f2908897640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f2904155e40 0x7f2904074580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52744/0 (socket says 10.20.193.45:52744) 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f2908897640 1 -- 10.20.193.45:0/2801541779 learned_addr learned my addr 10.20.193.45:0/2801541779 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f702a575640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f702a575640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f702a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f702a575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f702a575640 1 -- 10.20.193.45:0/3093640175 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c0d2250 con 0x7f702c155fe0 2026-02-17T21:07:12.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f28fbfff640 10 monclient(hunting): get_auth_request con 0x7f2904074c90 auth_method 0 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f28fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f28fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f28fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 1 -- 10.20.193.45:0/3207590266 shutdown_connections 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 1 --2- 10.20.193.45:0/3207590266 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f963815b720 0x7f963806d170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 1 -- 10.20.193.45:0/3207590266 >> 10.20.193.45:0/3207590266 conn(0x7f96380c9d40 msgr2=0x7f96380ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f0e65e5e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0e60156220 0x7f0e60074ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41620/0 (socket says 10.20.193.45:41620) 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f0e65e5e640 1 -- 10.20.193.45:0/2658410150 learned_addr learned my addr 10.20.193.45:0/2658410150 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f0e65e5e640 10 monclient(hunting): get_auth_request con 0x7f0e60156220 auth_method 0 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 1 -- 10.20.193.45:0/3207590266 shutdown_connections 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f0e65e5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f0e65e5e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f0e65e5e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.858+0000 7f963f9d3640 1 -- 10.20.193.45:0/3207590266 wait complete. 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient: monmap: 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 librados: starting msgr at 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 librados: starting objecter 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 Processor -- start 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f963f9d3640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f963f9d3640 10 monclient: monmap: 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 -- start start 2026-02-17T21:07:12.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 librados: setting wanted keys 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 librados: calling monclient init 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient: init 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f963f9d3640 1 librados: starting msgr at 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f963f9d3640 1 librados: starting objecter 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f963f9d3640 1 Processor -- start 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f963f9d3640 1 -- start start 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f963f9d3640 1 librados: setting wanted keys 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f963f9d3640 1 librados: calling monclient init 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f963f9d3640 10 monclient: init 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f28fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f28fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f28fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f610c073fc0 0x7f610c1f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f5e9f7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5ea0156220 0x7f5ea01666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient(hunting): picked mon.noname-a con 0x7f610c073fc0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f610c0c3f20 0x7f610c1fb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient(hunting): picked mon.noname-c con 0x7f610c0c3f20 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f610c156ce0 0x7f610c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient(hunting): picked mon.noname-b con 0x7f610c156ce0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f610c073b30 con 0x7f610c073fc0 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1611d0 con 0x7f610c156ce0 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0737c0 con 0x7f610c0c3f20 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f61130db640 10 monclient(hunting): authenticate will time out at 1016.489926s 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.859+0000 7f702a575640 1 --2- 10.20.193.45:0/3093640175 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f702c155fe0 0x7f702c0cb550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f702c074ff0 tx=0x7f702002eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=305e3e0434faae11 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9638151cd0 0x7f963814d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient(hunting): picked mon.noname-b con 0x7f9638151cd0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f963815b340 0x7f96381536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient(hunting): picked mon.noname-c con 0x7f963815b340 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f963815b720 0x7f9638147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient(hunting): picked mon.noname-a con 0x7f963815b720 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9638073ff0 con 0x7f963815b720 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9638073ad0 con 0x7f9638151cd0 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9638074170 con 0x7f963815b340 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f963f9d3640 10 monclient(hunting): authenticate will time out at 1016.490132s 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f5e9f7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5ea0156220 0x7f5ea01666d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41610/0 (socket says 10.20.193.45:41610) 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f5e9f7fe640 1 -- 10.20.193.45:0/2579497017 learned_addr learned my addr 10.20.193.45:0/2579497017 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f5e9f7fe640 10 monclient(hunting): get_auth_request con 0x7f5ea0156220 auth_method 0 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f5e9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f5e9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.860+0000 7f5e9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.861+0000 7f3212575640 1 --2- 10.20.193.45:0/4166436620 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3214074c90 0x7f32140ccb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009970 tx=0x7f31fc02eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6a4580704906345 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.861+0000 7f5e9f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.861+0000 7f5e9f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.861+0000 7f5e9f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f0e65e5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f0e65e5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f0e65e5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f28fbfff640 10 monclient(hunting): handle_auth_done global_id 4426 payload 274 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f28fbfff640 1 -- 10.20.193.45:0/2801541779 >> v2:10.20.193.92:3300/0 conn(0x7f2904156220 msgr2=0x7f29040cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f28fbfff640 1 --2- 10.20.193.45:0/2801541779 >> v2:10.20.193.92:3300/0 conn(0x7f2904156220 0x7f29040cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f28fbfff640 1 -- 10.20.193.45:0/2801541779 >> v1:10.20.193.86:6789/0 conn(0x7f2904155e40 legacy=0x7f2904074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f28fbfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f28fbfff640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f28fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f28fbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f28fbfff640 1 -- 10.20.193.45:0/2801541779 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2904073aa0 con 0x7f2904074c90 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7efe8de7e640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7efe880d16d0 0x7efe880ce170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52752/0 (socket says 10.20.193.45:52752) 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7efe8de7e640 1 -- 10.20.193.45:0/305936047 learned_addr learned my addr 10.20.193.45:0/305936047 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f5e9f7fe640 10 monclient(hunting): handle_auth_done global_id 4386 payload 274 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f5e9f7fe640 1 -- 10.20.193.45:0/2579497017 >> v1:10.20.193.86:6789/0 conn(0x7f5ea0155e40 legacy=0x7f5ea0074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f5e9f7fe640 1 -- 10.20.193.45:0/2579497017 >> v1:10.20.193.45:6789/0 conn(0x7f5ea0074c90 legacy=0x7f5ea00ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f5e9f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f5e9f7fe640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f5e9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f5e9f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7f5e9f7fe640 1 -- 10.20.193.45:0/2579497017 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea0073aa0 con 0x7f5ea0156220 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7efe8ce7c640 1 --2- 10.20.193.45:0/305936047 >> v2:10.20.193.92:3300/0 conn(0x7efe880c98b0 0x7efe880c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.862+0000 7fb03bfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fb0440c98b0 0x7fb0440c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.863+0000 7efe8ce7c640 10 monclient(hunting): get_auth_request con 0x7efe880c98b0 auth_method 0 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.863+0000 7efe8ce7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.863+0000 7efe8ce7c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.863+0000 7efe8ce7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7fb03bfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fb0440c98b0 0x7fb0440c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35986/0 (socket says 10.20.193.45:35986) 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7fb03bfff640 1 -- 10.20.193.45:0/3091096992 learned_addr learned my addr 10.20.193.45:0/3091096992 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7fb03bfff640 10 monclient(hunting): get_auth_request con 0x7fb0440c98b0 auth_method 0 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7fb03bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7fb03bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7fb03bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7feb34acf640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7feb30074c90 0x7feb300ccb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46104/0 (socket says 10.20.193.45:46104) 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7feb34acf640 1 -- 10.20.193.45:0/313915026 learned_addr learned my addr 10.20.193.45:0/313915026 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7f3144c56640 10 monclient: get_monmap_and_config 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7f3144c56640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7f3144c56640 10 monclient: monmap: 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:12.865722+0000 2026-02-17T21:07:12.921 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:12.865722+0000 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7efe8ce7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7efe8ce7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.864+0000 7efe8ce7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7fb03bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7fb03bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7fb03bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7f5465b1f640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f54600d16d0 0x7f54600ce170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46124/0 (socket says 10.20.193.45:46124) 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7f5465b1f640 1 -- 10.20.193.45:0/1594471409 learned_addr learned my addr 10.20.193.45:0/1594471409 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7f28fbfff640 1 --2- 10.20.193.45:0/2801541779 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2904074c90 0x7f29040ccb80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f290408f310 tx=0x7f28ec02ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4d02329462c33c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7f3144c56640 1 Processor -- start 2026-02-17T21:07:12.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7f5e9f7fe640 1 --2- 10.20.193.45:0/2579497017 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5ea0156220 0x7f5ea01666d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009e50 tx=0x7f5e9002f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6336a13fa27addd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7f3144c56640 1 -- start start 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7f3144c56640 10 monclient: init 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7efe8ce7c640 10 monclient(hunting): handle_auth_done global_id 4448 payload 274 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7efe8ce7c640 1 -- 10.20.193.45:0/305936047 >> v1:10.20.193.92:6789/0 conn(0x7efe88155fe0 legacy=0x7efe880cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.865+0000 7efe8ce7c640 1 -- 10.20.193.45:0/305936047 >> v1:10.20.193.86:6789/0 conn(0x7efe880d16d0 legacy=0x7efe880ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7efe8ce7c640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7efe8ce7c640 1 monclient: found mon.noname-c 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7efe8ce7c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7efe8ce7c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7efe8ce7c640 1 -- 10.20.193.45:0/305936047 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe880d2250 con 0x7efe880c98b0 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 10 monclient: _add_conns ranks=[4,1,5,3,0,2] 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3140155e40 0x7f3140074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 10 monclient(hunting): picked mon.noname-b con 0x7f3140155e40 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3140156220 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f31400cd290 0x7f3140074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 10 monclient(hunting): picked mon.noname-c con 0x7f31400cd290 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:12.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f5464b1d640 1 --2- 10.20.193.45:0/1594471409 >> v2:10.20.193.45:3300/0 conn(0x7f54600c98b0 0x7f54600c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31400734e0 con 0x7f3140156220 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f31400cd800 con 0x7f3140155e40 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f31400737c0 con 0x7f31400cd290 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f3144c56640 10 monclient(hunting): authenticate will time out at 1016.496144s 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fedfed39640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fedf80ccb80 0x7fedf80ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f5464b1d640 10 monclient(hunting): get_auth_request con 0x7f54600c98b0 auth_method 0 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f5464b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f5464b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f5464b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 1 -- 10.20.193.45:0/3089943578 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c03c070 con 0x7f67681501d0 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 10 monclient: dump: 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.924 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fb03bfff640 10 monclient(hunting): handle_auth_done global_id 4451 payload 274 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 1 -- 10.20.193.45:0/3089943578 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675c02fb80 con 0x7f67681501d0 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 1 -- 10.20.193.45:0/3089943578 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c037440 con 0x7f67681501d0 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f676ceae640 5 monclient: authenticate success, global_id 4414 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fb03bfff640 1 -- 10.20.193.45:0/3091096992 >> v2:10.20.193.86:3300/0 conn(0x7fb044155fe0 msgr2=0x7fb0440cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fb03bfff640 1 --2- 10.20.193.45:0/3091096992 >> v2:10.20.193.86:3300/0 conn(0x7fb044155fe0 0x7fb0440cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fb03bfff640 1 -- 10.20.193.45:0/3091096992 >> v1:10.20.193.92:6789/0 conn(0x7fb0440d16d0 legacy=0x7fb0440ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fb03bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f676ceae640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f676ceae640 4 set_mon_vals no callback set 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fb03bfff640 1 monclient: found mon.noname-c 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fb03bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fb03bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fb03bfff640 1 -- 10.20.193.45:0/3091096992 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0440d2250 con 0x7fb0440c98b0 2026-02-17T21:07:12.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7f6765573640 10 monclient: dump: 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.866+0000 7fedfe538640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fedf8155e40 0x7fedf8074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 10 monclient: shutdown 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 -- 10.20.193.45:0/3089943578 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f67681501d0 msgr2=0x7f67681505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 --2- 10.20.193.45:0/3089943578 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f67681501d0 0x7f67681505b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f67680c6ee0 tx=0x7f675c02ee70 comp rx=0 tx=0).stop 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 -- 10.20.193.45:0/3089943578 shutdown_connections 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 --2- 10.20.193.45:0/3089943578 >> v2:10.20.193.92:3300/0 conn(0x7f6768076230 0x7f67680c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 --2- 10.20.193.45:0/3089943578 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f67681501d0 0x7f67681505b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 -- 10.20.193.45:0/3089943578 >> 10.20.193.45:0/3089943578 conn(0x7f67680ca590 msgr2=0x7f67680ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 -- 10.20.193.45:0/3089943578 shutdown_connections 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 -- 10.20.193.45:0/3089943578 wait complete. 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f5464b1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f5464b1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 1 -- 10.20.193.45:0/27303218 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5403c070 con 0x7f6b64156220 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfed39640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fedf80ccb80 0x7fedf80ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41628/0 (socket says 10.20.193.45:41628) 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfed39640 1 -- 10.20.193.45:0/3199458356 learned_addr learned my addr 10.20.193.45:0/3199458356 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfed39640 10 monclient(hunting): get_auth_request con 0x7fedf80ccb80 auth_method 0 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfed39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfed39640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfed39640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 10 monclient: dump: 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 1 -- 10.20.193.45:0/27303218 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b54037440 con 0x7f6b64156220 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 1 -- 10.20.193.45:0/27303218 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b54037850 con 0x7f6b64156220 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 10 monclient: monmap: 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b691fe640 5 monclient: authenticate success, global_id 4380 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b691fe640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b691fe640 4 set_mon_vals no callback set 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f6b61d74640 10 monclient: dump: 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f5464b1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 librados: starting msgr at 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7f676ceae640 1 librados: starting objecter 2026-02-17T21:07:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 Processor -- start 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfe538640 10 monclient(hunting): get_auth_request con 0x7fedf8155e40 auth_method 0 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfe538640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfe538640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfe538640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfed39640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfed39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.867+0000 7fedfed39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f963cf47640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f963815b340 0x7f96381536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 -- start start 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 librados: setting wanted keys 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 librados: calling monclient init 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient: init 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 10 monclient: shutdown 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 1 -- 10.20.193.45:0/27303218 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b64156220 msgr2=0x7f6b641666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 1 --2- 10.20.193.45:0/27303218 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b64156220 0x7f6b641666d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009d90 tx=0x7f6b5402f260 comp rx=0 tx=0).stop 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 1 -- 10.20.193.45:0/27303218 shutdown_connections 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 1 --2- 10.20.193.45:0/27303218 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b64156220 0x7f6b641666d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 1 -- 10.20.193.45:0/27303218 >> 10.20.193.45:0/27303218 conn(0x7f6b640ce270 msgr2=0x7f6b640ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 1 -- 10.20.193.45:0/27303218 shutdown_connections 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 1 -- 10.20.193.45:0/27303218 wait complete. 2026-02-17T21:07:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7efe8ce7c640 1 --2- 10.20.193.45:0/305936047 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe880c98b0 0x7efe880c9cf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0098a0 tx=0x7efe7c02eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa2e683870c1c596 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7fb03bfff640 1 --2- 10.20.193.45:0/3091096992 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0440c98b0 0x7fb0440c9cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0440c5260 tx=0x7fb02c02ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc8554a138fe46b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6768076230 0x7f67681f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient(hunting): picked mon.noname-b con 0x7f6768076230 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67680c5920 0x7f67681578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f963cf47640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f963815b340 0x7f96381536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36024/0 (socket says 10.20.193.45:36024) 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f963cf47640 1 -- 10.20.193.45:0/164287881 learned_addr learned my addr 10.20.193.45:0/164287881 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f963cf47640 10 monclient(hunting): get_auth_request con 0x7f963815b340 auth_method 0 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f963cf47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f963cf47640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f963cf47640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient(hunting): picked mon.noname-a con 0x7f67680c5920 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f67681501d0 0x7f67681f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient(hunting): picked mon.noname-c con 0x7f67681501d0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6768071600 con 0x7f67680c5920 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f67680c8d60 con 0x7f6768076230 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67681f7ac0 con 0x7f67681501d0 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f676ceae640 10 monclient(hunting): authenticate will time out at 1016.498590s 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f6b691fe640 10 monclient: monmap: 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f7029573640 1 -- 10.20.193.45:0/3093640175 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702003c070 con 0x7f702c155fe0 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f7029573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f7029573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f7029573640 10 monclient: dump: 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.931 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f7029573640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.868+0000 7f7029573640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7029573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7029573640 1 -- 10.20.193.45:0/3093640175 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702002fb80 con 0x7f702c155fe0 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7029573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7029573640 1 -- 10.20.193.45:0/3093640175 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020037440 con 0x7f702c155fe0 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7029573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7029573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7029573640 10 monclient: dump: 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 5 monclient: authenticate success, global_id 4423 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 4 set_mon_vals no callback set 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 librados: starting msgr at 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 librados: starting objecter 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 Processor -- start 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 -- start start 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 librados: setting wanted keys 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 librados: calling monclient init 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient: init 2026-02-17T21:07:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f0e6665f640 1 --2- 10.20.193.45:0/2658410150 >> v2:10.20.193.86:3300/0 conn(0x7f0e60155e40 0x7f0e60074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 10 monclient: shutdown 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 1 -- 10.20.193.45:0/3093640175 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f702c155fe0 msgr2=0x7f702c0cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 1 --2- 10.20.193.45:0/3093640175 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f702c155fe0 0x7f702c0cb550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f702c074ff0 tx=0x7f702002eeb0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 1 -- 10.20.193.45:0/3093640175 shutdown_connections 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 1 --2- 10.20.193.45:0/3093640175 >> v2:10.20.193.92:3300/0 conn(0x7f702c0c9cf0 0x7f702c0ce170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 1 --2- 10.20.193.45:0/3093640175 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f702c155fe0 0x7f702c0cb550 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 1 -- 10.20.193.45:0/3093640175 >> 10.20.193.45:0/3093640175 conn(0x7f702c06d930 msgr2=0x7f702c06dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 1 -- 10.20.193.45:0/3093640175 shutdown_connections 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 10 monclient(hunting): handle_auth_done global_id 4395 payload 274 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 1 -- 10.20.193.45:0/3199458356 >> v2:10.20.193.92:3300/0 conn(0x7fedf8155e40 msgr2=0x7fedf8074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 1 --2- 10.20.193.45:0/3199458356 >> v2:10.20.193.92:3300/0 conn(0x7fedf8155e40 0x7fedf8074580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 1 -- 10.20.193.45:0/3199458356 >> v2:10.20.193.86:3300/0 conn(0x7fedf8156220 msgr2=0x7fedf8074ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 1 --2- 10.20.193.45:0/3199458356 >> v2:10.20.193.86:3300/0 conn(0x7fedf8156220 0x7fedf8074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f7030a8f640 1 -- 10.20.193.45:0/3093640175 wait complete. 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7fedfed39640 1 -- 10.20.193.45:0/3199458356 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf8073aa0 con 0x7fedf80ccb80 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f963cf47640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f963cf47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f963cf47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7feb35ad1640 1 --2- 10.20.193.45:0/313915026 >> v2:10.20.193.92:3300/0 conn(0x7feb30156220 0x7feb301666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f0e6665f640 10 monclient(hunting): get_auth_request con 0x7f0e60155e40 auth_method 0 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f0e6665f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f0e6665f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f0e6665f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b64074c90 0x7f6b64150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient(hunting): picked mon.noname-b con 0x7f6b64074c90 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6b64155e40 0x7f6b641407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient(hunting): picked mon.noname-c con 0x7f6b64155e40 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b64156220 0x7f6b64140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient(hunting): picked mon.noname-a con 0x7f6b64156220 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6b640c4830 con 0x7f6b64156220 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b64074060 con 0x7f6b64074c90 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6b640c49b0 con 0x7f6b64155e40 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.869+0000 7f6b691fe640 10 monclient(hunting): authenticate will time out at 1016.499920s 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 10 monclient: monmap: 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f5464b1d640 10 monclient(hunting): handle_auth_done global_id 4389 payload 274 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f0e6665f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f0e6665f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f5464b1d640 1 -- 10.20.193.45:0/1594471409 >> v2:10.20.193.86:3300/0 conn(0x7f5460155fe0 msgr2=0x7f54600cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f5464b1d640 1 --2- 10.20.193.45:0/1594471409 >> v2:10.20.193.86:3300/0 conn(0x7f5460155fe0 0x7f54600cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f5464b1d640 1 -- 10.20.193.45:0/1594471409 >> v1:10.20.193.45:6789/0 conn(0x7f54600d16d0 legacy=0x7f54600ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f5464b1d640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f5464b1d640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f5464b1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f5464b1d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f5464b1d640 1 -- 10.20.193.45:0/1594471409 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54600d2250 con 0x7f54600c98b0 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f0e6665f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 1 librados: starting msgr at 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 1 librados: starting objecter 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 1 Processor -- start 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 1 -- start start 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 1 librados: setting wanted keys 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 1 librados: calling monclient init 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 10 monclient: init 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f78d2d32640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f78cc163d10 0x7f78cc0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.870+0000 7f7030a8f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f702c0c98b0 0x7f702c15e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 10 monclient(hunting): picked mon.noname-c con 0x7f702c0c98b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f702c0c9cf0 0x7f702c15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 10 monclient(hunting): picked mon.noname-a con 0x7f702c0c9cf0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f702c155fe0 0x7f702c0d0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 10 monclient(hunting): picked mon.noname-b con 0x7f702c155fe0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f702c0c90b0 con 0x7f702c0c9cf0 2026-02-17T21:07:12.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f702c0c8dd0 con 0x7f702c155fe0 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f702c0cc0e0 con 0x7f702c0c98b0 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f7030a8f640 10 monclient(hunting): authenticate will time out at 1016.501182s 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f0e6665f640 10 monclient(hunting): handle_auth_done global_id 4435 payload 274 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f0e6665f640 1 -- 10.20.193.45:0/2658410150 >> v2:10.20.193.45:3300/0 conn(0x7f0e60156220 msgr2=0x7f0e60074ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f0e6665f640 1 --2- 10.20.193.45:0/2658410150 >> v2:10.20.193.45:3300/0 conn(0x7f0e60156220 0x7f0e60074ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f0e6665f640 1 -- 10.20.193.45:0/2658410150 >> v1:10.20.193.45:6789/0 conn(0x7f0e600ccb80 legacy=0x7f0e600ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f0e6665f640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f0e6665f640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f0e6665f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f0e6665f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.871+0000 7f0e6665f640 1 -- 10.20.193.45:0/2658410150 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e60073aa0 con 0x7f0e60155e40 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 10 monclient(hunting): handle_auth_done global_id 4454 payload 824 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 1 -- 10.20.193.45:0/164287881 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9638151cd0 msgr2=0x7f963814d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9638151cd0 0x7f963814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 1 -- 10.20.193.45:0/164287881 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f963815b720 msgr2=0x7f9638147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f963815b720 0x7f9638147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 1 monclient: found mon.noname-c 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7f963cf47640 1 -- 10.20.193.45:0/164287881 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963814da70 con 0x7f963815b340 2026-02-17T21:07:12.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7feb35ad1640 10 monclient(hunting): get_auth_request con 0x7feb30156220 auth_method 0 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7feb35ad1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7feb35ad1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.872+0000 7feb35ad1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d2d32640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f78cc163d10 0x7f78cc0c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36002/0 (socket says 10.20.193.45:36002) 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d2d32640 1 -- 10.20.193.45:0/2624498932 learned_addr learned my addr 10.20.193.45:0/2624498932 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d2d32640 10 monclient(hunting): get_auth_request con 0x7f78cc163d10 auth_method 0 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d2d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d2d32640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d2d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f5464b1d640 1 --2- 10.20.193.45:0/1594471409 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54600c98b0 0x7f54600c9cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f546008eba0 tx=0x7f545402ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78444fd5b8cc546 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7fedfed39640 1 --2- 10.20.193.45:0/3199458356 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 0x7fedf80ccfa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fedf808f5a0 tx=0x7fedf402f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8d3bd75074fff2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d1d30640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f78cc163930 0x7f78cc162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7feb35ad1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7feb35ad1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7feb35ad1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d2d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d2d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d2d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d1d30640 10 monclient(hunting): get_auth_request con 0x7f78cc163930 auth_method 0 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d1d30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d1d30640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.873+0000 7f78d1d30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.874+0000 7f0e6665f640 1 --2- 10.20.193.45:0/2658410150 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0e60155e40 0x7f0e60074580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e6006cf60 tx=0x7f0e5802ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99d4effbee5dbc2e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.874+0000 7f78d1d30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.874+0000 7f78d1d30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.874+0000 7f78d1d30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.875+0000 7feb35ad1640 10 monclient(hunting): handle_auth_done global_id 4457 payload 274 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.875+0000 7feb35ad1640 1 -- 10.20.193.45:0/313915026 >> v1:10.20.193.86:6789/0 conn(0x7feb30155e40 legacy=0x7feb30074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.875+0000 7feb35ad1640 1 -- 10.20.193.45:0/313915026 >> v1:10.20.193.45:6789/0 conn(0x7feb30074c90 legacy=0x7feb300ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.875+0000 7feb35ad1640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.875+0000 7feb35ad1640 1 monclient: found mon.noname-c 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.875+0000 7feb35ad1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.875+0000 7feb35ad1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.875+0000 7feb35ad1640 1 -- 10.20.193.45:0/313915026 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb30073aa0 con 0x7feb30156220 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 10 monclient(hunting): handle_auth_done global_id 4438 payload 824 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 1 -- 10.20.193.45:0/2624498932 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f78cc163d10 msgr2=0x7f78cc0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f78cc163d10 0x7f78cc0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 1 -- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f78cc15a200 msgr2=0x7f78cc14bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f78cc15a200 0x7f78cc14bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.876+0000 7f78d1d30640 1 -- 10.20.193.45:0/2624498932 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc14fa60 con 0x7f78cc163930 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.877+0000 7f963cf47640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f963815b340 0x7f96381536e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f962c00b780 tx=0x7f962c00bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.877+0000 7f9625ffb640 10 client.?.objecter ms_handle_connect 0x7f963815b340 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.877+0000 7f9625ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 1 -- 10.20.193.45:0/2801541779 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec03c070 con 0x7f2904074c90 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 10 monclient: dump: 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 1 -- 10.20.193.45:0/2801541779 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ec02faf0 con 0x7f2904074c90 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 1 -- 10.20.193.45:0/2801541779 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec037440 con 0x7f2904074c90 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f290ab22640 5 monclient: authenticate success, global_id 4426 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f290ab22640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f290ab22640 4 set_mon_vals no callback set 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f28fb7fe640 10 monclient: dump: 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f313e575640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3140155e40 0x7f3140074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f78d1d30640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f78cc163930 0x7f78cc162640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f78c000c500 tx=0x7f78c000c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f78b2ffd640 10 client.?.objecter ms_handle_connect 0x7f78cc163930 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.878+0000 7f78b2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7feb35ad1640 1 --2- 10.20.193.45:0/313915026 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30156220 0x7feb301666d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009d90 tx=0x7feb2c02f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=304849617272cf82 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 10 monclient: shutdown 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 1 -- 10.20.193.45:0/2801541779 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2904074c90 msgr2=0x7f29040ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 1 --2- 10.20.193.45:0/2801541779 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2904074c90 0x7f29040ccb80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f290408f310 tx=0x7f28ec02ede0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 1 -- 10.20.193.45:0/2801541779 shutdown_connections 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 1 --2- 10.20.193.45:0/2801541779 >> v2:10.20.193.92:3300/0 conn(0x7f2904156220 0x7f29040cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 1 --2- 10.20.193.45:0/2801541779 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2904074c90 0x7f29040ccb80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 1 -- 10.20.193.45:0/2801541779 >> 10.20.193.45:0/2801541779 conn(0x7f29040ce270 msgr2=0x7f29040ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 1 -- 10.20.193.45:0/2801541779 shutdown_connections 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f290ab22640 1 -- 10.20.193.45:0/2801541779 wait complete. 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f313e575640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3140155e40 0x7f3140074580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57332/0 (socket says 10.20.193.45:57332) 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f313e575640 1 -- 10.20.193.45:0/2625621250 learned_addr learned my addr 10.20.193.45:0/2625621250 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f313e575640 10 monclient(hunting): get_auth_request con 0x7f3140155e40 auth_method 0 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f313e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f313e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f313e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 1 -- 10.20.193.45:0/1594471409 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545403c070 con 0x7f54600c98b0 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 10 monclient: dump: 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 1 -- 10.20.193.45:0/1594471409 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545402fb80 con 0x7f54600c98b0 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 1 -- 10.20.193.45:0/1594471409 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454037440 con 0x7f54600c98b0 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f544ffff640 10 monclient: dump: 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f54675a9640 5 monclient: authenticate success, global_id 4389 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f54675a9640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.879+0000 7f54675a9640 4 set_mon_vals no callback set 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6111651640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f610c156ce0 0x7f610c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 10 monclient: monmap: 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.943 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 1 librados: starting msgr at 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 1 librados: starting objecter 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f313e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f313e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f313e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 10 monclient: shutdown 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 1 -- 10.20.193.45:0/1594471409 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54600c98b0 msgr2=0x7f54600c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 1 --2- 10.20.193.45:0/1594471409 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54600c98b0 0x7f54600c9cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f546008eba0 tx=0x7f545402ee70 comp rx=0 tx=0).stop 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 1 Processor -- start 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6110e50640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f610c073fc0 0x7f610c1f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 1 -- 10.20.193.45:0/1594471409 shutdown_connections 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 1 --2- 10.20.193.45:0/1594471409 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54600c98b0 0x7f54600c9cf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 1 --2- 10.20.193.45:0/1594471409 >> v2:10.20.193.86:3300/0 conn(0x7f5460155fe0 0x7f54600cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 1 -- 10.20.193.45:0/1594471409 >> 10.20.193.45:0/1594471409 conn(0x7f546006d930 msgr2=0x7f546006dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 1 -- start start 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 1 librados: setting wanted keys 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 1 librados: calling monclient init 2026-02-17T21:07:12.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 10 monclient: init 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6111651640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f610c156ce0 0x7f610c15d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57310/0 (socket says 10.20.193.45:57310) 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6111651640 1 -- 10.20.193.45:0/1225288378 learned_addr learned my addr 10.20.193.45:0/1225288378 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6111651640 10 monclient(hunting): get_auth_request con 0x7f610c156ce0 auth_method 0 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6111651640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6111651640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6111651640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 1 -- 10.20.193.45:0/1594471409 shutdown_connections 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f54675a9640 1 -- 10.20.193.45:0/1594471409 wait complete. 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 1 -- 10.20.193.45:0/4166436620 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc03c070 con 0x7f3214074c90 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 10 monclient: dump: 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.945 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 1 -- 10.20.193.45:0/4166436620 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31fc02fbb0 con 0x7f3214074c90 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f321916a640 5 monclient: authenticate success, global_id 4442 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f321916a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f3211d74640 1 -- 10.20.193.45:0/4166436620 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc037440 con 0x7f3214074c90 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f321916a640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f321916a640 4 set_mon_vals no callback set 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6110e50640 10 monclient(hunting): get_auth_request con 0x7f610c073fc0 auth_method 0 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6110e50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6110e50640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f6110e50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2904074c90 0x7f2904148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 10 monclient(hunting): picked mon.noname-b con 0x7f2904074c90 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.880+0000 7f290ab22640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2904155e40 0x7f29040c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 10 monclient(hunting): picked mon.noname-a con 0x7f2904155e40 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2904156220 0x7f29041e9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f3211d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f3211d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f3211d74640 10 monclient: dump: 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 10 monclient(hunting): picked mon.noname-c con 0x7f2904156220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f29040c4830 con 0x7f2904155e40 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2904074060 con 0x7f2904074c90 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29040c49b0 con 0x7f2904156220 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f290ab22640 10 monclient(hunting): authenticate will time out at 1016.511061s 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f6103fff640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f610c0c3f20 0x7f610c1fb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient: monmap: 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.947 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 librados: starting msgr at 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 librados: starting objecter 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 Processor -- start 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f321916a640 10 monclient: shutdown 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f321916a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f321916a640 1 -- 10.20.193.45:0/4166436620 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3214074c90 msgr2=0x7f32140ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f321916a640 1 --2- 10.20.193.45:0/4166436620 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3214074c90 0x7f32140ccb80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009970 tx=0x7f31fc02eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 -- start start 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 librados: setting wanted keys 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 librados: calling monclient init 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient: init 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f321916a640 1 -- 10.20.193.45:0/4166436620 shutdown_connections 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f321916a640 1 --2- 10.20.193.45:0/4166436620 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3214074c90 0x7f32140ccb80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f321916a640 1 -- 10.20.193.45:0/4166436620 >> 10.20.193.45:0/4166436620 conn(0x7f32140ce270 msgr2=0x7f32140ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f321916a640 1 -- 10.20.193.45:0/4166436620 shutdown_connections 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f321916a640 1 -- 10.20.193.45:0/4166436620 wait complete. 2026-02-17T21:07:12.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f6765d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67680c5920 0x7f67681578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54600c98b0 0x7f5460154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient(hunting): picked mon.noname-a con 0x7f54600c98b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54600d16d0 0x7f546015a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient(hunting): picked mon.noname-b con 0x7f54600d16d0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5460155fe0 0x7f54601fa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient(hunting): picked mon.noname-c con 0x7f5460155fe0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54600c90b0 con 0x7f54600c98b0 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54600c8dd0 con 0x7f54600d16d0 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54600cc0e0 con 0x7f5460155fe0 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.881+0000 7f54675a9640 10 monclient(hunting): authenticate will time out at 1016.511953s 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f313e575640 10 monclient(hunting): handle_auth_done global_id 4441 payload 274 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f313e575640 1 -- 10.20.193.45:0/2625621250 >> v2:10.20.193.92:3300/0 conn(0x7f31400cd290 msgr2=0x7f3140074ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f313e575640 1 --2- 10.20.193.45:0/2625621250 >> v2:10.20.193.92:3300/0 conn(0x7f31400cd290 0x7f3140074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f313e575640 1 -- 10.20.193.45:0/2625621250 >> v1:10.20.193.86:6789/0 conn(0x7f3140156220 legacy=0x7f31400ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f313e575640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f313e575640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f313e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f313e575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f313e575640 1 -- 10.20.193.45:0/2625621250 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3140073aa0 con 0x7f3140155e40 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f321916a640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f321916a640 10 monclient: monmap: 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6103fff640 10 monclient(hunting): get_auth_request con 0x7f610c0c3f20 auth_method 0 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6103fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6103fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6103fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6111651640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6111651640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6111651640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f321916a640 1 librados: starting msgr at 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f321916a640 1 librados: starting objecter 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6110e50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6110e50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f6110e50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f321916a640 1 Processor -- start 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f321916a640 1 -- start start 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f321916a640 1 librados: setting wanted keys 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f321916a640 1 librados: calling monclient init 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7f321916a640 10 monclient: init 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 1 -- 10.20.193.45:0/3091096992 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c03c070 con 0x7fb0440c98b0 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 10 monclient: dump: 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 1 -- 10.20.193.45:0/3091096992 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb02c02fbd0 con 0x7fb0440c98b0 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb04ab22640 5 monclient: authenticate success, global_id 4451 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb04ab22640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb04ab22640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 1 -- 10.20.193.45:0/3091096992 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb02c037440 con 0x7fb0440c98b0 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb04ab22640 4 set_mon_vals no callback set 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.882+0000 7fb03b7fe640 10 monclient: dump: 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 10 monclient: shutdown 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 1 -- 10.20.193.45:0/3091096992 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0440c98b0 msgr2=0x7fb0440c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 1 --2- 10.20.193.45:0/3091096992 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0440c98b0 0x7fb0440c9cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb0440c5260 tx=0x7fb02c02ef60 comp rx=0 tx=0).stop 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 1 -- 10.20.193.45:0/3091096992 shutdown_connections 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 1 --2- 10.20.193.45:0/3091096992 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0440c98b0 0x7fb0440c9cf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 1 --2- 10.20.193.45:0/3091096992 >> v2:10.20.193.86:3300/0 conn(0x7fb044155fe0 0x7fb0440cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 1 -- 10.20.193.45:0/3091096992 >> 10.20.193.45:0/3091096992 conn(0x7fb04406d930 msgr2=0x7fb04406dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3214074c90 0x7f32140cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient(hunting): picked mon.noname-c con 0x7f3214074c90 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3214155e40 0x7f32140c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient(hunting): picked mon.noname-a con 0x7f3214155e40 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3214156220 0x7f32140c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 1 -- 10.20.193.45:0/3091096992 shutdown_connections 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient(hunting): picked mon.noname-b con 0x7f3214156220 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f32140c4830 con 0x7f3214155e40 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7fb04ab22640 1 -- 10.20.193.45:0/3091096992 wait complete. 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3214074060 con 0x7f3214156220 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32140c49b0 con 0x7f3214074c90 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f321916a640 10 monclient(hunting): authenticate will time out at 1016.513527s 2026-02-17T21:07:12.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 10 monclient(hunting): handle_auth_done global_id 4401 payload 824 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 1 -- 10.20.193.45:0/1225288378 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f610c0c3f20 msgr2=0x7f610c1fb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f610c0c3f20 0x7f610c1fb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 1 -- 10.20.193.45:0/1225288378 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f610c156ce0 msgr2=0x7f610c15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f610c156ce0 0x7f610c15d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.883+0000 7f6110e50640 1 -- 10.20.193.45:0/1225288378 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c15e2b0 con 0x7f610c073fc0 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7fb04ab22640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7fb04ab22640 10 monclient: monmap: 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f6765d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67680c5920 0x7f67681578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41672/0 (socket says 10.20.193.45:41672) 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f6765d74640 1 -- 10.20.193.45:0/1138008567 learned_addr learned my addr 10.20.193.45:0/1138008567 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f6765d74640 10 monclient(hunting): get_auth_request con 0x7f67680c5920 auth_method 0 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f6765d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f6765d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7fb04ab22640 1 librados: starting msgr at 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7fb04ab22640 1 librados: starting objecter 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f6765d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7fb04ab22640 1 Processor -- start 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7fb04ab22640 1 -- start start 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7fb04ab22640 1 librados: setting wanted keys 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7fb04ab22640 1 librados: calling monclient init 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7fb04ab22640 10 monclient: init 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 1 -- 10.20.193.45:0/2579497017 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9002fd00 con 0x7f5ea0156220 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 10 monclient: dump: 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.955 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 1 -- 10.20.193.45:0/2579497017 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e900373f0 con 0x7f5ea0156220 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 1 -- 10.20.193.45:0/2579497017 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e900377c0 con 0x7f5ea0156220 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5e9dffb640 10 monclient: dump: 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5ea56d6640 5 monclient: authenticate success, global_id 4386 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5ea56d6640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.884+0000 7f5ea56d6640 4 set_mon_vals no callback set 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 1 -- 10.20.193.45:0/164287881 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c004480 con 0x7f963815b340 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 10 monclient: dump: 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 1 -- 10.20.193.45:0/164287881 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962c010070 con 0x7f963815b340 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f96277fe640 4 set_mon_vals no callback set 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f5ea56d6640 10 monclient: shutdown 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f5ea56d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0440c98b0 0x7fb0441f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient(hunting): picked mon.noname-c con 0x7fb0440c98b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb0440d16d0 0x7fb04413ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient(hunting): picked mon.noname-a con 0x7fb0440d16d0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb044155fe0 0x7fb0441418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient(hunting): picked mon.noname-b con 0x7fb044155fe0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb0440c90b0 con 0x7fb0440d16d0 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb0440c8dd0 con 0x7fb044155fe0 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb0440cc0e0 con 0x7fb0440c98b0 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7fb04ab22640 10 monclient(hunting): authenticate will time out at 1016.515169s 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2579497017 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5ea0156220 msgr2=0x7f5ea01666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f5ea56d6640 1 --2- 10.20.193.45:0/2579497017 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5ea0156220 0x7f5ea01666d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5e90009e50 tx=0x7f5e9002f2a0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 1 -- 10.20.193.45:0/164287881 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c0029a0 con 0x7f963815b340 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f9625ffb640 10 monclient: dump: 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 5 monclient: authenticate success, global_id 4454 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 10 monclient: _renew_subs 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 1 -- 10.20.193.45:0/164287881 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9638150350 con 0x7f963815b340 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 10 client.4454.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 10 monclient: _renew_subs 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 1 -- 10.20.193.45:0/164287881 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9638152c00 con 0x7f963815b340 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f313e575640 1 --2- 10.20.193.45:0/2625621250 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3140155e40 0x7f3140074580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f314008f310 tx=0x7f313402eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0f4d3a66f172aed server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 1 librados: init done 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2579497017 shutdown_connections 2026-02-17T21:07:12.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f5ea56d6640 1 --2- 10.20.193.45:0/2579497017 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5ea0156220 0x7f5ea01666d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2579497017 >> 10.20.193.45:0/2579497017 conn(0x7f5ea00ce270 msgr2=0x7f5ea00ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2579497017 shutdown_connections 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2579497017 wait complete. 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f6765d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f6765d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f6765d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f7029d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f702c0c9cf0 0x7f702c15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f963f9d3640 10 client.4454.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.885+0000 7f702ad76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f702c155fe0 0x7f702c0d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f963f9d3640 15 client.4454.objecter _session_command_op_assign -1 1 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f963f9d3640 20 client.4454.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f963f9d3640 10 client.4454.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f963f9d3640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f963f9d3640 1 -- 10.20.193.45:0/164287881 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9638150630 con 0x7f963815b340 2026-02-17T21:07:12.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f6766575640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6768076230 0x7f67681f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f7029d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f702c0c9cf0 0x7f702c15ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41698/0 (socket says 10.20.193.45:41698) 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f7029d74640 1 -- 10.20.193.45:0/303936379 learned_addr learned my addr 10.20.193.45:0/303936379 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f7029d74640 10 monclient(hunting): get_auth_request con 0x7f702c0c9cf0 auth_method 0 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f7029d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f7029d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f7029d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f5ea56d6640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f5ea56d6640 10 monclient: monmap: 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 1 -- 10.20.193.45:0/3199458356 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf402fd00 con 0x7fedf80ccb80 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 10 monclient: dump: 2026-02-17T21:07:12.960 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 1 -- 10.20.193.45:0/3199458356 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf40373f0 con 0x7fedf80ccb80 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 5 monclient: authenticate success, global_id 4395 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 1 -- 10.20.193.45:0/3199458356 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf40377c0 con 0x7fedf80ccb80 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fedfd536640 10 monclient: dump: 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 4 set_mon_vals no callback set 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f5ea56d6640 1 librados: starting msgr at 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f5ea56d6640 1 librados: starting objecter 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f5ea56d6640 1 Processor -- start 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f5ea56d6640 1 -- start start 2026-02-17T21:07:12.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f5ea56d6640 1 librados: setting wanted keys 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f5ea56d6640 1 librados: calling monclient init 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f5ea56d6640 10 monclient: init 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f6766575640 10 monclient(hunting): get_auth_request con 0x7f6768076230 auth_method 0 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f6766575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f6766575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f6766575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f702ad76640 10 monclient(hunting): get_auth_request con 0x7f702c155fe0 auth_method 0 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f702ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f702ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7f702ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 10 monclient: shutdown 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 1 -- 10.20.193.45:0/3199458356 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 msgr2=0x7fedf80ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 1 --2- 10.20.193.45:0/3199458356 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 0x7fedf80ccfa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fedf808f5a0 tx=0x7fedf402f250 comp rx=0 tx=0).stop 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 1 -- 10.20.193.45:0/3199458356 shutdown_connections 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 1 --2- 10.20.193.45:0/3199458356 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 0x7fedf80ccfa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 1 --2- 10.20.193.45:0/3199458356 >> v2:10.20.193.86:3300/0 conn(0x7fedf8156220 0x7fedf8074ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.886+0000 7fee007c3640 1 --2- 10.20.193.45:0/3199458356 >> v2:10.20.193.92:3300/0 conn(0x7fedf8155e40 0x7fedf8074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7fee007c3640 1 -- 10.20.193.45:0/3199458356 >> 10.20.193.45:0/3199458356 conn(0x7fedf80ce270 msgr2=0x7fedf80ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5ea0074c90 0x7f5ea01f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient(hunting): picked mon.noname-b con 0x7f5ea0074c90 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7fee007c3640 1 -- 10.20.193.45:0/3199458356 shutdown_connections 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5ea0155e40 0x7f5ea01f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient(hunting): picked mon.noname-c con 0x7f5ea0155e40 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5ea0156220 0x7f5ea0151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient(hunting): picked mon.noname-a con 0x7f5ea0156220 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea00c4830 con 0x7f5ea0156220 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea0074060 con 0x7f5ea0074c90 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea00c49b0 con 0x7f5ea0155e40 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7f5ea56d6640 10 monclient(hunting): authenticate will time out at 1016.517413s 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7fee007c3640 1 -- 10.20.193.45:0/3199458356 wait complete. 2026-02-17T21:07:12.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7fee007c3640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.887+0000 7fee007c3640 10 monclient: monmap: 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 10 monclient(hunting): handle_auth_done global_id 4404 payload 824 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 1 -- 10.20.193.45:0/1138008567 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f67681501d0 msgr2=0x7f67681f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f67681501d0 0x7f67681f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 1 -- 10.20.193.45:0/1138008567 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6768076230 msgr2=0x7f67681f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6768076230 0x7f67681f42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6765d74640 1 -- 10.20.193.45:0/1138008567 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67681f7500 con 0x7f67680c5920 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f6766575640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6768076230 0x7f67681f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T21:07:12.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f702ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f702ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7f702ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 librados: starting msgr at 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 librados: starting objecter 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 Processor -- start 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 -- start start 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 librados: setting wanted keys 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 librados: calling monclient init 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient: init 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 0x7fedf8154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient(hunting): picked mon.noname-a con 0x7fedf80ccb80 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fedf8155e40 0x7fedf81f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient(hunting): picked mon.noname-b con 0x7fedf8155e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fedf8156220 0x7fedf81f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient(hunting): picked mon.noname-c con 0x7fedf8156220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80cd4e0 con 0x7fedf80ccb80 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fedf8074060 con 0x7fedf8155e40 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80c4830 con 0x7fedf8156220 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.888+0000 7fee007c3640 10 monclient(hunting): authenticate will time out at 1016.518894s 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.889+0000 7f28fbfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2904155e40 0x7f29040c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.889+0000 7f6110e50640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f610c073fc0 0x7f610c1f9040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c450 tx=0x7f60fc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.889+0000 7f61017fa640 10 client.?.objecter ms_handle_connect 0x7f610c073fc0 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.889+0000 7f61017fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 10 monclient(hunting): handle_auth_done global_id 4450 payload 824 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 1 -- 10.20.193.45:0/303936379 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f702c0c98b0 msgr2=0x7f702c15e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f702c0c98b0 0x7f702c15e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 1 -- 10.20.193.45:0/303936379 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f702c0c9cf0 msgr2=0x7f702c15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f702c0c9cf0 0x7f702c15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f702ad76640 1 -- 10.20.193.45:0/303936379 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c15d120 con 0x7f702c155fe0 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f6b62d76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b64074c90 0x7f6b64150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f28fbfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2904155e40 0x7f29040c7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41714/0 (socket says 10.20.193.45:41714) 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f28fbfff640 1 -- 10.20.193.45:0/113668315 learned_addr learned my addr 10.20.193.45:0/113668315 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f28fbfff640 10 monclient(hunting): get_auth_request con 0x7f2904155e40 auth_method 0 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f28fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f28fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f28fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f6765d74640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67680c5920 0x7f67681578e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f675000c680 tx=0x7f675000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f674effd640 10 client.?.objecter ms_handle_connect 0x7f67680c5920 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.890+0000 7f674effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.891+0000 7f28fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.891+0000 7f28fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.891+0000 7f28fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.891+0000 7f6b62d76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b64074c90 0x7f6b64150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57354/0 (socket says 10.20.193.45:57354) 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.891+0000 7f6b62d76640 1 -- 10.20.193.45:0/496964387 learned_addr learned my addr 10.20.193.45:0/496964387 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.891+0000 7f6b62d76640 10 monclient(hunting): get_auth_request con 0x7f6b64074c90 auth_method 0 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.891+0000 7f6b62d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.891+0000 7f6b62d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.891+0000 7f6b62d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 1 -- 10.20.193.45:0/2658410150 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5803c070 con 0x7f0e60155e40 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 10 monclient: dump: 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.967 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 1 -- 10.20.193.45:0/2658410150 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e5802fa50 con 0x7f0e60155e40 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 1 -- 10.20.193.45:0/2658410150 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5802fe20 con 0x7f0e60155e40 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e6565d640 10 monclient: dump: 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 5 monclient: authenticate success, global_id 4435 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 4 set_mon_vals no callback set 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f702ad76640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f702c155fe0 0x7f702c0d0810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f701c00efc0 tx=0x7f701c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f7012ffd640 10 client.?.objecter ms_handle_connect 0x7f702c155fe0 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f7012ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 10 monclient: shutdown 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 1 -- 10.20.193.45:0/2658410150 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0e60155e40 msgr2=0x7f0e60074580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 1 --2- 10.20.193.45:0/2658410150 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0e60155e40 0x7f0e60074580 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0e6006cf60 tx=0x7f0e5802ede0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 1 -- 10.20.193.45:0/2658410150 shutdown_connections 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 1 --2- 10.20.193.45:0/2658410150 >> v2:10.20.193.45:3300/0 conn(0x7f0e60156220 0x7f0e60074ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 1 --2- 10.20.193.45:0/2658410150 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0e60155e40 0x7f0e60074580 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f6b62d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f6b62d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 1 -- 10.20.193.45:0/2658410150 >> 10.20.193.45:0/2658410150 conn(0x7f0e600ce270 msgr2=0x7f0e600ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 1 -- 10.20.193.45:0/2658410150 shutdown_connections 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f0e688ea640 1 -- 10.20.193.45:0/2658410150 wait complete. 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.892+0000 7f6b62d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 1 -- 10.20.193.45:0/2625621250 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313403c070 con 0x7f3140155e40 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 10 monclient: dump: 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.969 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 1 -- 10.20.193.45:0/2625621250 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313402fb40 con 0x7f3140155e40 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 1 -- 10.20.193.45:0/2625621250 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134037440 con 0x7f3140155e40 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f313d573640 10 monclient: dump: 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 5 monclient: authenticate success, global_id 4441 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 4 set_mon_vals no callback set 2026-02-17T21:07:12.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 10 monclient: monmap: 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 1 librados: starting msgr at 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 1 librados: starting objecter 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 1 Processor -- start 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 1 -- start start 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 1 librados: setting wanted keys 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 1 librados: calling monclient init 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 10 monclient: init 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 10 monclient: shutdown 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 1 -- 10.20.193.45:0/2625621250 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3140155e40 msgr2=0x7f3140074580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 1 --2- 10.20.193.45:0/2625621250 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3140155e40 0x7f3140074580 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f314008f310 tx=0x7f313402eed0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 1 -- 10.20.193.45:0/2625621250 shutdown_connections 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 1 --2- 10.20.193.45:0/2625621250 >> v2:10.20.193.92:3300/0 conn(0x7f31400cd290 0x7f3140074ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 1 --2- 10.20.193.45:0/2625621250 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3140155e40 0x7f3140074580 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 1 -- 10.20.193.45:0/2625621250 >> 10.20.193.45:0/2625621250 conn(0x7f31400ce270 msgr2=0x7f31400ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 1 -- 10.20.193.45:0/2625621250 shutdown_connections 2026-02-17T21:07:12.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f3144c56640 1 -- 10.20.193.45:0/2625621250 wait complete. 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0e600ccb80 0x7f0e600ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 10 monclient(hunting): picked mon.noname-b con 0x7f0e600ccb80 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0e60155e40 0x7f0e60152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 10 monclient(hunting): picked mon.noname-c con 0x7f0e60155e40 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0e60156220 0x7f0e600c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.893+0000 7f0e688ea640 10 monclient(hunting): picked mon.noname-a con 0x7f0e60156220 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f0e688ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f0e688ea640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0e600c4830 con 0x7f0e60156220 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f0e688ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f0e688ea640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0e60074060 con 0x7f0e600ccb80 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f0e688ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f0e688ea640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0e600c49b0 con 0x7f0e60155e40 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f0e688ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f0e688ea640 10 monclient(hunting): authenticate will time out at 1016.524019s 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient: monmap: 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.972 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 10 monclient(hunting): handle_auth_done global_id 4407 payload 824 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 1 -- 10.20.193.45:0/113668315 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2904156220 msgr2=0x7f29041e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2904156220 0x7f29041e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 1 -- 10.20.193.45:0/113668315 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2904074c90 msgr2=0x7f2904148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2904074c90 0x7f2904148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f28fbfff640 1 -- 10.20.193.45:0/113668315 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2904156640 con 0x7f2904155e40 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 librados: starting msgr at 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 librados: starting objecter 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 Processor -- start 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 10 monclient(hunting): handle_auth_done global_id 4453 payload 824 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 1 -- 10.20.193.45:0/496964387 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6b64155e40 msgr2=0x7f6b641407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6b64155e40 0x7f6b641407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 1 -- 10.20.193.45:0/496964387 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b64156220 msgr2=0x7f6b64140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b64156220 0x7f6b64140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 1 monclient: found mon.noname-b 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f6b62d76640 1 -- 10.20.193.45:0/496964387 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b640c9d30 con 0x7f6b64074c90 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 -- start start 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 librados: setting wanted keys 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 librados: calling monclient init 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient: init 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f31400cd290 0x7f31400c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient(hunting): picked mon.noname-b con 0x7f31400cd290 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3140155e40 0x7f3140153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient(hunting): picked mon.noname-a con 0x7f3140155e40 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3140156220 0x7f31400ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient(hunting): picked mon.noname-c con 0x7f3140156220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f31400c4830 con 0x7f3140155e40 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3140074060 con 0x7f31400cd290 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f31400c49b0 con 0x7f3140156220 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.894+0000 7f3144c56640 10 monclient(hunting): authenticate will time out at 1016.524774s 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.895+0000 7f28fbfff640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2904155e40 0x7f29040c7a20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28ec02f310 tx=0x7f28ec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.895+0000 7f28f97fa640 10 client.?.objecter ms_handle_connect 0x7f2904155e40 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.895+0000 7f28f97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.895+0000 7f6b62d76640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b64074c90 0x7f6b64150350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c700 tx=0x7f6b5800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.895+0000 7f6b437fe640 10 client.?.objecter ms_handle_connect 0x7f6b64074c90 2026-02-17T21:07:12.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.895+0000 7f6b437fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 1 -- 10.20.193.45:0/1225288378 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc017070 con 0x7f610c073fc0 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 10 monclient: dump: 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 1 -- 10.20.193.45:0/1225288378 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc005de0 con 0x7f610c073fc0 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 1 -- 10.20.193.45:0/1225288378 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc007270 con 0x7f610c073fc0 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61130db640 5 monclient: authenticate success, global_id 4401 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61130db640 10 monclient: _renew_subs 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61130db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f6102ffd640 4 set_mon_vals no callback set 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c15e590 con 0x7f610c073fc0 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61130db640 10 client.4401.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61017fa640 10 monclient: dump: 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.975 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61130db640 10 monclient: _renew_subs 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61130db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c15eb50 con 0x7f610c073fc0 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.897+0000 7f61130db640 1 librados: init done 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.898+0000 7f61130db640 10 client.4401.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.898+0000 7f61130db640 15 client.4401.objecter _session_command_op_assign -1 1 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.898+0000 7f61130db640 20 client.4401.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.898+0000 7f61130db640 10 client.4401.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.898+0000 7f61130db640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.898+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f610c076de0 con 0x7f610c073fc0 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.899+0000 7f9625ffb640 1 -- 10.20.193.45:0/164287881 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f962c01d030 con 0x7f963815b340 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.899+0000 7f9625ffb640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f96080792d0 0x7f960807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.899+0000 7f963d748640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f96080792d0 0x7f960807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.899+0000 7f963d748640 10 monclient: get_auth_request con 0x7f96080792d0 auth_method 0 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 1 -- 10.20.193.45:0/2624498932 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c0017070 con 0x7f78cc163930 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 10 monclient: dump: 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.976 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 1 -- 10.20.193.45:0/2624498932 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c0005de0 con 0x7f78cc163930 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 1 -- 10.20.193.45:0/2624498932 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c00072b0 con 0x7f78cc163930 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78b2ffd640 10 monclient: dump: 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f9625ffb640 10 client.4454.objecter ms_handle_connect 0x7f96080792d0 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f963d748640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f96080792d0 0x7f960807b790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9628002a30 tx=0x7f96280079f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d0d2e640 4 set_mon_vals no callback set 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 5 monclient: authenticate success, global_id 4438 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 10 monclient: _renew_subs 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78cc162f80 con 0x7f78cc163930 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 10 client.4438.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 10 monclient: _renew_subs 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78cc14fd00 con 0x7f78cc163930 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 1 librados: init done 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 10 client.4438.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 15 client.4438.objecter _session_command_op_assign -1 1 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 20 client.4438.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 10 client.4438.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78cc15da80 con 0x7f78cc163930 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f9625ffb640 1 -- 10.20.193.45:0/164287881 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f962c01de00 con 0x7f963815b340 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f9625ffb640 10 client.4454.objecter ms_dispatch2 0x7f9638000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f9625ffb640 3 client.4454.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.900+0000 7f9625ffb640 3 client.4454.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 10 client.4454.objecter checking command 1 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f9608081870 0x7f9608083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 20 client.4454.objecter _get_session s=0x7f96080811a0 osd=3 3 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 20 client.4454.objecter put_session s=0x7f96080811a0 osd=3 3 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 15 client.4454.objecter _session_command_op_remove -1 1 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 20 client.4454.objecter _get_session s=0x7f96080811a0 osd=3 3 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 20 client.4454.objecter get_session s=0x7f96080811a0 osd=3 3 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 15 client.4454.objecter _session_command_op_assign 3 1 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 20 client.4454.objecter put_session s=0x7f96080811a0 osd=3 4 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 10 client.4454.objecter _send_command 1 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 1 -- 10.20.193.45:0/164287881 --> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f962c022ec0 con 0x7f9608081870 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 20 client.4454.objecter dump_active .. 0 homeless 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 1 -- 10.20.193.45:0/164287881 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f962c05db80 con 0x7f963815b340 2026-02-17T21:07:12.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f9625ffb640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f963df49640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f9608081870 0x7f9608083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.901+0000 7f963df49640 10 monclient: get_auth_request con 0x7f9608081870 auth_method 0 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.904+0000 7f963df49640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f9608081870 0x7f9608083cb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.904+0000 7f9625ffb640 10 client.4454.objecter ms_handle_connect 0x7f9608081870 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.904+0000 7f5465b1f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5460155fe0 0x7f54601fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5465b1f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5460155fe0 0x7f54601fa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36096/0 (socket says 10.20.193.45:36096) 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5465b1f640 1 -- 10.20.193.45:0/3090178177 learned_addr learned my addr 10.20.193.45:0/3090178177 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5465b1f640 10 monclient(hunting): get_auth_request con 0x7f5460155fe0 auth_method 0 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5465b1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5465b1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5465b1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f3212d76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3214074c90 0x7f32140cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5465b1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5465b1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5465b1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.905+0000 7f5464b1d640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54600d16d0 0x7f546015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 1 -- 10.20.193.45:0/305936047 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c03c070 con 0x7efe880c98b0 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 10 monclient: dump: 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 1 -- 10.20.193.45:0/305936047 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7c02fb70 con 0x7efe880c98b0 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 5 monclient: authenticate success, global_id 4448 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 1 -- 10.20.193.45:0/305936047 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c037440 con 0x7efe880c98b0 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe77fff640 10 monclient: dump: 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 4 set_mon_vals no callback set 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 1 -- 10.20.193.45:0/496964387 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b580052d0 con 0x7f6b64074c90 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 10 monclient: dump: 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 1 -- 10.20.193.45:0/496964387 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b58005470 con 0x7f6b64074c90 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 1 -- 10.20.193.45:0/496964387 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b580038d0 con 0x7f6b64074c90 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 5 monclient: authenticate success, global_id 4453 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 10 monclient: _renew_subs 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b61573640 4 set_mon_vals no callback set 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b640ca010 con 0x7f6b64074c90 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b437fe640 10 monclient: dump: 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.981 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 10 client.4453.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 10 monclient: _renew_subs 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b640ca5d0 con 0x7f6b64074c90 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 1 librados: init done 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f5464b1d640 10 monclient(hunting): get_auth_request con 0x7f54600d16d0 auth_method 0 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f5464b1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f5464b1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f5464b1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3213577640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3214156220 0x7f32140c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 10 monclient: shutdown 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 1 -- 10.20.193.45:0/305936047 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe880c98b0 msgr2=0x7efe880c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 1 --2- 10.20.193.45:0/305936047 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe880c98b0 0x7efe880c9cf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efe7c0098a0 tx=0x7efe7c02eeb0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 1 -- 10.20.193.45:0/305936047 shutdown_connections 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 1 --2- 10.20.193.45:0/305936047 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe880c98b0 0x7efe880c9cf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 1 -- 10.20.193.45:0/305936047 >> 10.20.193.45:0/305936047 conn(0x7efe8806d930 msgr2=0x7efe8806dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 1 -- 10.20.193.45:0/305936047 shutdown_connections 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3213577640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3214156220 0x7f32140c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57394/0 (socket says 10.20.193.45:57394) 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3213577640 1 -- 10.20.193.45:0/3517286018 learned_addr learned my addr 10.20.193.45:0/3517286018 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3213577640 10 monclient(hunting): get_auth_request con 0x7f3214156220 auth_method 0 2026-02-17T21:07:12.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3213577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3213577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3213577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7efe8f908640 1 -- 10.20.193.45:0/305936047 wait complete. 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 1 -- 10.20.193.45:0/1138008567 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750017070 con 0x7f67680c5920 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 10 monclient: dump: 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3212d76640 10 monclient(hunting): get_auth_request con 0x7f3214074c90 auth_method 0 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3212d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3212d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f3212d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 1 -- 10.20.193.45:0/1138008567 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6750005b70 con 0x7f67680c5920 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f674effd640 1 -- 10.20.193.45:0/1138008567 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750007070 con 0x7f67680c5920 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f676ceae640 5 monclient: authenticate success, global_id 4404 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f676ceae640 10 monclient: _renew_subs 2026-02-17T21:07:12.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6764d72640 4 set_mon_vals no callback set 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 10 client.4453.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 15 client.4453.objecter _session_command_op_assign -1 1 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f676ceae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67681f77e0 con 0x7f67680c5920 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f674effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.906+0000 7f6b691fe640 20 client.4453.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f674effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f6b691fe640 10 client.4453.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f674effd640 10 monclient: dump: 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f6b691fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b64074580 con 0x7f6b64074c90 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 10 client.4404.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 10 monclient: _renew_subs 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67681f3aa0 con 0x7f67680c5920 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 1 librados: init done 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7efe8f908640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7efe8f908640 10 monclient: monmap: 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 10 client.4404.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 15 client.4404.objecter _session_command_op_assign -1 1 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 20 client.4404.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 10 client.4404.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67680ccd70 con 0x7f67680c5920 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7efe8f908640 1 librados: starting msgr at 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7efe8f908640 1 librados: starting objecter 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7efe8f908640 1 Processor -- start 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7efe8f908640 1 -- start start 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7efe8f908640 1 librados: setting wanted keys 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7efe8f908640 1 librados: calling monclient init 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.907+0000 7efe8f908640 10 monclient: init 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7fb03bfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb0440d16d0 0x7fb04413ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efe880c98b0 0x7efe881f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient(hunting): picked mon.noname-b con 0x7efe880c98b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe880d16d0 0x7efe8814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient(hunting): picked mon.noname-c con 0x7efe880d16d0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efe88155fe0 0x7efe8813ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient(hunting): picked mon.noname-a con 0x7efe88155fe0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7efe880c90b0 con 0x7efe88155fe0 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7efe880c8dd0 con 0x7efe880c98b0 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe880cc0e0 con 0x7efe880d16d0 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7efe8f908640 10 monclient(hunting): authenticate will time out at 1016.538349s 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 10 monclient(hunting): handle_auth_done global_id 4469 payload 824 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 1 -- 10.20.193.45:0/3090178177 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54600d16d0 msgr2=0x7f546015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54600d16d0 0x7f546015a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 1 -- 10.20.193.45:0/3090178177 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54600c98b0 msgr2=0x7f5460154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54600c98b0 0x7f5460154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 1 monclient: found mon.noname-c 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f5465b1f640 1 -- 10.20.193.45:0/3090178177 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54601f8f10 con 0x7f5460155fe0 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 1 -- 10.20.193.45:0/113668315 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec03c040 con 0x7f2904155e40 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 10 monclient: dump: 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 1 -- 10.20.193.45:0/113668315 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ec03f680 con 0x7f2904155e40 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 1 -- 10.20.193.45:0/113668315 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec03fa50 con 0x7f2904155e40 2026-02-17T21:07:12.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28f97fa640 10 monclient: dump: 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f28faffd640 4 set_mon_vals no callback set 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f290ab22640 5 monclient: authenticate success, global_id 4407 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f290ab22640 10 monclient: _renew_subs 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f290ab22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29040c6980 con 0x7f2904155e40 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f290ab22640 10 client.4407.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f0e66e60640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0e60156220 0x7f0e600c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f290ab22640 10 monclient: _renew_subs 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f290ab22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29040c6f40 con 0x7f2904155e40 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.908+0000 7f290ab22640 1 librados: init done 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 1 -- 10.20.193.45:0/313915026 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c03c070 con 0x7feb30156220 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 10 monclient: dump: 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 1 -- 10.20.193.45:0/313915026 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c037440 con 0x7feb30156220 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 1 -- 10.20.193.45:0/313915026 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c037810 con 0x7feb30156220 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb1ffff640 10 monclient: dump: 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 5 monclient: authenticate success, global_id 4457 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 4 set_mon_vals no callback set 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fb03bfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb0440d16d0 0x7fb04413ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41740/0 (socket says 10.20.193.45:41740) 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fb03bfff640 1 -- 10.20.193.45:0/3288689683 learned_addr learned my addr 10.20.193.45:0/3288689683 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fb03bfff640 10 monclient(hunting): get_auth_request con 0x7fb0440d16d0 auth_method 0 2026-02-17T21:07:12.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fb03bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fb03bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fb03bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f0e66e60640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0e60156220 0x7f0e600c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41766/0 (socket says 10.20.193.45:41766) 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f0e66e60640 1 -- 10.20.193.45:0/727614933 learned_addr learned my addr 10.20.193.45:0/727614933 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f0e66e60640 10 monclient(hunting): get_auth_request con 0x7f0e60156220 auth_method 0 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f0e66e60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f0e66e60640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f0e66e60640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f290ab22640 10 client.4407.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f3212d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f3212d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f3212d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f290ab22640 15 client.4407.objecter _session_command_op_assign -1 1 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fb03bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fb03bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fb03bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f290ab22640 20 client.4407.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f290ab22640 10 client.4407.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f290ab22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29040698c0 con 0x7f2904155e40 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 10 monclient: shutdown 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f0e66e60640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f0e66e60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7f0e66e60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 1 -- 10.20.193.45:0/313915026 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30156220 msgr2=0x7feb301666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 1 --2- 10.20.193.45:0/313915026 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30156220 0x7feb301666d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009d90 tx=0x7feb2c02f1e0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7fedfe538640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 0x7fedf8154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 1 -- 10.20.193.45:0/313915026 shutdown_connections 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 1 --2- 10.20.193.45:0/313915026 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30156220 0x7feb301666d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.909+0000 7feb3755b640 1 -- 10.20.193.45:0/313915026 >> 10.20.193.45:0/313915026 conn(0x7feb300ce270 msgr2=0x7feb300ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 1 -- 10.20.193.45:0/313915026 shutdown_connections 2026-02-17T21:07:12.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 1 -- 10.20.193.45:0/313915026 wait complete. 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7fedfe538640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 0x7fedf8154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41750/0 (socket says 10.20.193.45:41750) 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7fedfe538640 1 -- 10.20.193.45:0/3582336345 learned_addr learned my addr 10.20.193.45:0/3582336345 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7fedfe538640 10 monclient(hunting): get_auth_request con 0x7fedf80ccb80 auth_method 0 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7fedfe538640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7fedfe538640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7fedfe538640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7fedfe538640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7fedfe538640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7fedfe538640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 10 monclient: build_initial_monmap 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 10 monclient: monmap: 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:12.992 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 1 librados: starting msgr at 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 1 librados: starting objecter 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 1 Processor -- start 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 1 -- start start 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 1 librados: setting wanted keys 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 1 librados: calling monclient init 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.910+0000 7feb3755b640 10 monclient: init 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30074c90 0x7feb301488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient(hunting): picked mon.noname-c con 0x7feb30074c90 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7feb30155e40 0x7feb30144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient(hunting): picked mon.noname-b con 0x7feb30155e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feb30156220 0x7feb300c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient(hunting): picked mon.noname-a con 0x7feb30156220 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7feb300c4830 con 0x7feb30156220 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7feb30074060 con 0x7feb30155e40 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb300c49b0 con 0x7feb30074c90 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7feb3755b640 10 monclient(hunting): authenticate will time out at 1016.541348s 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 10 monclient(hunting): handle_auth_done global_id 4472 payload 824 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 1 -- 10.20.193.45:0/3517286018 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3214156220 msgr2=0x7f32140c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3214156220 0x7f32140c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 1 -- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3214155e40 msgr2=0x7f32140c7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3214155e40 0x7f32140c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 1 monclient: found mon.noname-c 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:12.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.911+0000 7f3212d76640 1 -- 10.20.193.45:0/3517286018 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32141f39c0 con 0x7f3214074c90 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7f5e9e7fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5ea0155e40 0x7f5ea01f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7f5465b1f640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5460155fe0 0x7f54601fa370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f545c00cbf0 tx=0x7f545c00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7f544dffb640 10 client.?.objecter ms_handle_connect 0x7f5460155fe0 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7f544dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 10 monclient(hunting): handle_auth_done global_id 4419 payload 824 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 1 -- 10.20.193.45:0/3582336345 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fedf8156220 msgr2=0x7fedf81f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fedf8156220 0x7fedf81f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 1 -- 10.20.193.45:0/3582336345 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fedf8155e40 msgr2=0x7fedf81f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fedf8155e40 0x7fedf81f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 10 monclient: _finish_hunting 0 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 1 monclient: found mon.noname-a 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:12.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.912+0000 7fedfe538640 1 -- 10.20.193.45:0/3582336345 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf81f3ca0 con 0x7fedf80ccb80 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.913+0000 7f3212d76640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3214074c90 0x7f32140cf9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f320800c4e0 tx=0x7f320800c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.913+0000 7f31f37fe640 10 client.?.objecter ms_handle_connect 0x7f3214074c90 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.913+0000 7f31f37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.913+0000 7f5e9e7fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5ea0155e40 0x7f5ea01f3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36120/0 (socket says 10.20.193.45:36120) 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.913+0000 7f5e9e7fc640 1 -- 10.20.193.45:0/2882298537 learned_addr learned my addr 10.20.193.45:0/2882298537 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.913+0000 7f5e9e7fc640 10 monclient(hunting): get_auth_request con 0x7f5ea0155e40 auth_method 0 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.913+0000 7f5e9e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.913+0000 7f5e9e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.913+0000 7f5e9e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.914+0000 7f5e9f7fe640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5ea0156220 0x7f5ea0151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.914+0000 7fb048897640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0440c98b0 0x7fb0441f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.914+0000 7f78b2ffd640 1 -- 10.20.193.45:0/2624498932 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f78c0007450 con 0x7f78cc163930 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.914+0000 7f78b2ffd640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f789c079300 0x7f789c07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.914+0000 7f78d2531640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f789c079300 0x7f789c07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.914+0000 7f78d2531640 10 monclient: get_auth_request con 0x7f789c079300 auth_method 0 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7f78d2531640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f789c079300 0x7f789c07b7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78bc006fd0 tx=0x7f78bc006d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:12.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7f78b2ffd640 10 client.4438.objecter ms_handle_connect 0x7f789c079300 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7fb048897640 10 monclient(hunting): get_auth_request con 0x7fb0440c98b0 auth_method 0 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7fb048897640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7fb048897640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7fb048897640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7f78b2ffd640 1 -- 10.20.193.45:0/2624498932 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f78c0007770 con 0x7f78cc163930 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7f78b2ffd640 10 client.4438.objecter ms_dispatch2 0x7f78cc000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7f78b2ffd640 3 client.4438.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7f78b2ffd640 3 client.4438.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7f78b2ffd640 10 client.4438.objecter checking command 1 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7f78b2ffd640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7f789c081840 0x7f789c083c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.915+0000 7f78b2ffd640 20 client.4438.objecter _get_session s=0x7f789c081170 osd=4 3 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78b2ffd640 20 client.4438.objecter put_session s=0x7f789c081170 osd=4 3 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78b2ffd640 15 client.4438.objecter _session_command_op_remove -1 1 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78b2ffd640 20 client.4438.objecter _get_session s=0x7f789c081170 osd=4 3 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78b2ffd640 20 client.4438.objecter get_session s=0x7f789c081170 osd=4 3 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78b2ffd640 15 client.4438.objecter _session_command_op_assign 4 1 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78b2ffd640 20 client.4438.objecter put_session s=0x7f789c081170 osd=4 4 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78b2ffd640 10 client.4438.objecter _send_command 1 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78b2ffd640 1 -- 10.20.193.45:0/2624498932 --> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78c0015e50 con 0x7f789c081840 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78b2ffd640 20 client.4438.objecter dump_active .. 0 homeless 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78d2d32640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7f789c081840 0x7f789c083c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7f78d2d32640 10 monclient: get_auth_request con 0x7f789c081840 auth_method 0 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7fb048897640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7fb048897640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.916+0000 7fb048897640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.917+0000 7f0e65e5e640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0e60155e40 0x7f0e60152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.917+0000 7f5e9effd640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5ea0074c90 0x7f5ea01f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.917+0000 7f313ed76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3140156220 0x7f31400ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f5e9e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f5e9e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f5e9e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 1 -- 10.20.193.45:0/303936379 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c00cd30 con 0x7f702c155fe0 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 10 monclient: dump: 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.997 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f0e65e5e640 10 monclient(hunting): get_auth_request con 0x7f0e60155e40 auth_method 0 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f0e65e5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f0e65e5e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f0e65e5e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 1 -- 10.20.193.45:0/303936379 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f701c003a90 con 0x7f702c155fe0 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 1 -- 10.20.193.45:0/303936379 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c003e60 con 0x7f702c155fe0 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7030a8f640 5 monclient: authenticate success, global_id 4450 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7028d72640 4 set_mon_vals no callback set 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7012ffd640 10 monclient: dump: 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7030a8f640 10 monclient: _renew_subs 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7030a8f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702c15d400 con 0x7f702c155fe0 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f313ed76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3140156220 0x7f31400ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36142/0 (socket says 10.20.193.45:36142) 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f313ed76640 1 -- 10.20.193.45:0/2131907745 learned_addr learned my addr 10.20.193.45:0/2131907745 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f313ed76640 10 monclient(hunting): get_auth_request con 0x7f3140156220 auth_method 0 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f313ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f313ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f313ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7030a8f640 10 client.4450.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7030a8f640 10 monclient: _renew_subs 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7030a8f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702c15d9c0 con 0x7f702c155fe0 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f7030a8f640 1 librados: init done 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f5e9f7fe640 10 monclient(hunting): get_auth_request con 0x7f5ea0156220 auth_method 0 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f5e9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f5e9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.918+0000 7f5e9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7f7030a8f640 10 client.4450.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7f7030a8f640 15 client.4450.objecter _session_command_op_assign -1 1 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7f7030a8f640 20 client.4450.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7f7030a8f640 10 client.4450.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7f7030a8f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f702c15e010 con 0x7f702c155fe0 2026-02-17T21:07:12.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7f78b2ffd640 10 client.4438.objecter ms_handle_connect 0x7f789c081840 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7f78d2d32640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7f789c081840 0x7f789c083c80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7fedfe538640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 0x7fedf8154e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fede800e7f0 tx=0x7fede800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7feddeffd640 10 client.?.objecter ms_handle_connect 0x7fedf80ccb80 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.919+0000 7feddeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 10 monclient(hunting): handle_auth_done global_id 4478 payload 824 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 1 -- 10.20.193.45:0/2882298537 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5ea0074c90 msgr2=0x7f5ea01f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5ea0074c90 0x7f5ea01f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 1 -- 10.20.193.45:0/2882298537 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5ea0156220 msgr2=0x7f5ea0151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5ea0156220 0x7f5ea0151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f5e9e7fc640 1 -- 10.20.193.45:0/2882298537 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea01f4340 con 0x7f5ea0155e40 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f0e65e5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f0e65e5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f0e65e5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f313ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f313ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.920+0000 7f313ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 10 monclient(hunting): handle_auth_done global_id 4416 payload 824 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 1 -- 10.20.193.45:0/727614933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0e60155e40 msgr2=0x7f0e60152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0e60155e40 0x7f0e60152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 1 -- 10.20.193.45:0/727614933 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0e600ccb80 msgr2=0x7f0e600ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0e600ccb80 0x7f0e600ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.921+0000 7f0e66e60640 1 -- 10.20.193.45:0/727614933 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e600c5930 con 0x7f0e60156220 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.922+0000 7f313dd74640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3140155e40 0x7f3140153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 10 monclient(hunting): handle_auth_done global_id 4484 payload 824 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 1 -- 10.20.193.45:0/2131907745 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f31400cd290 msgr2=0x7f31400c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f31400cd290 0x7f31400c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 1 -- 10.20.193.45:0/2131907745 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3140155e40 msgr2=0x7f3140153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3140155e40 0x7f3140153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f313ed76640 1 -- 10.20.193.45:0/2131907745 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31401ee3d0 con 0x7f3140156220 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7fb049098640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb044155fe0 0x7fb0441418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f0e66e60640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0e60156220 0x7f0e600c8af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400b990 tx=0x7f0e5400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f0e4affd640 10 client.?.objecter ms_handle_connect 0x7f0e60156220 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7f0e4affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7fb049098640 10 monclient(hunting): get_auth_request con 0x7fb044155fe0 auth_method 0 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7fb049098640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7fb049098640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.923+0000 7fb049098640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.924+0000 7fb049098640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.924+0000 7fb049098640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.924+0000 7fb049098640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.924+0000 7f5e9e7fc640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5ea0155e40 0x7f5ea01f3c00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800b5a0 tx=0x7f5e8800ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.924+0000 7f5e7f7fe640 10 client.?.objecter ms_handle_connect 0x7f5ea0155e40 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.924+0000 7f5e7f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 10 monclient(hunting): handle_auth_done global_id 4462 payload 824 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 1 -- 10.20.193.45:0/3288689683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0440c98b0 msgr2=0x7fb0441f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0440c98b0 0x7fb0441f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 1 -- 10.20.193.45:0/3288689683 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb0440d16d0 msgr2=0x7fb04413ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb0440d16d0 0x7fb04413ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7fb049098640 1 -- 10.20.193.45:0/3288689683 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb044140570 con 0x7fb044155fe0 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7f78b2ffd640 1 -- 10.20.193.45:0/2624498932 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f78c005ddc0 con 0x7f78cc163930 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.926+0000 7f78b2ffd640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.927+0000 7feb352d0640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30074c90 0x7feb301488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.927+0000 7f313ed76640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3140156220 0x7f31400ca3a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f313000b970 tx=0x7f313000be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.927+0000 7f3126ffd640 10 client.?.objecter ms_handle_connect 0x7f3140156220 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.927+0000 7f3126ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7feb352d0640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30074c90 0x7feb301488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36170/0 (socket says 10.20.193.45:36170) 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7feb352d0640 1 -- 10.20.193.45:0/3927662350 learned_addr learned my addr 10.20.193.45:0/3927662350 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7feb352d0640 10 monclient(hunting): get_auth_request con 0x7feb30074c90 auth_method 0 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7feb352d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7feb352d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7feb352d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7f9625ffb640 1 -- 10.20.193.45:0/164287881 <== osd.3 v2:10.20.193.138:6800/1535515312 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f962c022ec0 con 0x7f9608081870 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7f9625ffb640 10 client.4454.objecter ms_dispatch2 0x7f9638000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7f9625ffb640 10 client.4454.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7f9625ffb640 20 client.4454.objecter put_session s=0x7f96080811a0 osd=3 4 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.928+0000 7f9625ffb640 15 client.4454.objecter _session_command_op_remove 3 1 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7feb352d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7feb352d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7feb352d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 1 -- 10.20.193.45:0/3090178177 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c017070 con 0x7f5460155fe0 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 10 monclient: dump: 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 1 -- 10.20.193.45:0/3090178177 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c00ad70 con 0x7f5460155fe0 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 1 -- 10.20.193.45:0/3090178177 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c012640 con 0x7f5460155fe0 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 5 monclient: authenticate success, global_id 4469 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 10 monclient: _renew_subs 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54601f80d0 con 0x7f5460155fe0 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544dffb640 10 monclient: dump: 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.004 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f544f7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 10 monclient: _renew_subs 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54601f8690 con 0x7f5460155fe0 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 1 librados: init done 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 10 client.4469.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 15 client.4469.objecter _session_command_op_assign -1 1 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 20 client.4469.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.929+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54600c9cf0 con 0x7f5460155fe0 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 1 -- 10.20.193.45:0/2882298537 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e88012070 con 0x7f5ea0155e40 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 10 monclient: dump: 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.005 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 1 -- 10.20.193.45:0/2882298537 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e880044a0 con 0x7f5ea0155e40 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 1 -- 10.20.193.45:0/2882298537 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e880029c0 con 0x7f5ea0155e40 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e7f7fe640 10 monclient: dump: 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5e9d7fa640 4 set_mon_vals no callback set 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5ea56d6640 5 monclient: authenticate success, global_id 4478 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5ea56d6640 10 monclient: _renew_subs 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5ea56d6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea01f4620 con 0x7f5ea0155e40 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5ea56d6640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5ea56d6640 10 monclient: _renew_subs 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5ea56d6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea01e7590 con 0x7f5ea0155e40 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.932+0000 7f5ea56d6640 1 librados: init done 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.933+0000 7f5ea56d6640 10 client.4478.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.933+0000 7f5ea56d6640 15 client.4478.objecter _session_command_op_assign -1 1 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.933+0000 7f5ea56d6640 20 client.4478.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.933+0000 7f5ea56d6640 10 client.4478.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.933+0000 7f5ea56d6640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.933+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ea01f4b40 con 0x7f5ea0155e40 2026-02-17T21:07:13.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.933+0000 7efe8ce7c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe880d16d0 0x7efe8814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.933+0000 7f61017fa640 1 -- 10.20.193.45:0/1225288378 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f60fc007410 con 0x7f610c073fc0 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.934+0000 7f61017fa640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f60dc079300 0x7f60dc07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.934+0000 7f6103fff640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f60dc079300 0x7f60dc07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.934+0000 7f6103fff640 10 monclient: get_auth_request con 0x7f60dc079300 auth_method 0 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.934+0000 7f61017fa640 10 client.4401.objecter ms_handle_connect 0x7f60dc079300 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.934+0000 7f6103fff640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f60dc079300 0x7f60dc07b7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f60f4039000 tx=0x7f60f4033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f6b437fe640 1 -- 10.20.193.45:0/496964387 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f6b58003a70 con 0x7f6b64074c90 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 10 client.4454.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 15 client.4454.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 20 client.4454.objecter _get_session s=0x7f96080811a0 osd=3 3 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 20 client.4454.objecter put_session s=0x7f96080811a0 osd=3 3 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 20 client.4454.objecter _get_session s=0x7f96080811a0 osd=3 3 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 15 client.4454.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 20 client.4454.objecter get_session s=0x7f96080811a0 osd=3 3 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 15 client.4454.objecter _session_command_op_assign 3 2 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 20 client.4454.objecter put_session s=0x7f96080811a0 osd=3 4 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 10 client.4454.objecter _send_command 2 2026-02-17T21:07:13.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f963f9d3640 1 -- 10.20.193.45:0/164287881 --> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f96381525f0 con 0x7f9608081870 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f6b437fe640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b300792d0 0x7f6b3007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f6b62575640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b300792d0 0x7f6b3007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f6b62575640 10 monclient: get_auth_request con 0x7f6b300792d0 auth_method 0 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f6b437fe640 10 client.4453.objecter ms_handle_connect 0x7f6b300792d0 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.935+0000 7f6b62575640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b300792d0 0x7f6b3007b790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c007fd0 tx=0x7f6b4c007b20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.936+0000 7f6b437fe640 1 -- 10.20.193.45:0/496964387 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f6b5805e450 con 0x7f6b64074c90 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.936+0000 7f6b437fe640 10 client.4453.objecter ms_dispatch2 0x7f6b64000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.936+0000 7f6b437fe640 3 client.4453.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.936+0000 7f6b437fe640 3 client.4453.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 10 client.4453.objecter checking command 1 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7f6b30081810 0x7f6b30083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 20 client.4453.objecter _get_session s=0x7f6b30081140 osd=7 3 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 20 client.4453.objecter put_session s=0x7f6b30081140 osd=7 3 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 15 client.4453.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 20 client.4453.objecter _get_session s=0x7f6b30081140 osd=7 3 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 20 client.4453.objecter get_session s=0x7f6b30081140 osd=7 3 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 15 client.4453.objecter _session_command_op_assign 7 1 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 20 client.4453.objecter put_session s=0x7f6b30081140 osd=7 4 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 10 client.4453.objecter _send_command 1 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 1 -- 10.20.193.45:0/496964387 --> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b58013e70 con 0x7f6b30081810 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 20 client.4453.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 1 -- 10.20.193.45:0/496964387 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6b5805e810 con 0x7f6b64074c90 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b437fe640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b63577640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7f6b30081810 0x7f6b30083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7fb049098640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb044155fe0 0x7fb0441418f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb04000be20 tx=0x7fb04000bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7f6b63577640 10 monclient: get_auth_request con 0x7f6b30081810 auth_method 0 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7fb0397fa640 10 client.?.objecter ms_handle_connect 0x7fb044155fe0 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.937+0000 7fb0397fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.939+0000 7f78b2ffd640 1 -- 10.20.193.45:0/2624498932 <== osd.4 v2:10.20.193.45:6826/1457283840 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f78c0015e50 con 0x7f789c081840 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.939+0000 7f78b2ffd640 10 client.4438.objecter ms_dispatch2 0x7f78cc000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.939+0000 7f78b2ffd640 10 client.4438.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.939+0000 7f78b2ffd640 20 client.4438.objecter put_session s=0x7f789c081170 osd=4 4 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.939+0000 7f78b2ffd640 15 client.4438.objecter _session_command_op_remove 4 1 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.940+0000 7f6b63577640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7f6b30081810 0x7f6b30083c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.940+0000 7f6b437fe640 10 client.4453.objecter ms_handle_connect 0x7f6b30081810 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.940+0000 7efe8d67d640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efe880c98b0 0x7efe881f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.940+0000 7efe8d67d640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efe880c98b0 0x7efe881f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57456/0 (socket says 10.20.193.45:57456) 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.940+0000 7efe8d67d640 1 -- 10.20.193.45:0/1211313781 learned_addr learned my addr 10.20.193.45:0/1211313781 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.940+0000 7efe8d67d640 10 monclient(hunting): get_auth_request con 0x7efe880c98b0 auth_method 0 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.940+0000 7efe8d67d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.940+0000 7efe8d67d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.940+0000 7efe8d67d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7efe8d67d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7efe8d67d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7efe8d67d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f9625ffb640 1 -- 10.20.193.45:0/164287881 <== osd.3 v2:10.20.193.138:6800/1535515312 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f96381525f0 con 0x7f9608081870 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f9625ffb640 10 client.4454.objecter ms_dispatch2 0x7f9638000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f9625ffb640 10 client.4454.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f9625ffb640 20 client.4454.objecter put_session s=0x7f96080811a0 osd=3 4 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f9625ffb640 15 client.4454.objecter _session_command_op_remove 3 2 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 10 librados: watch_flush enter 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 10 librados: watch_flush exit 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 10 client.4454.objecter close_session for osd.3 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 -- 10.20.193.45:0/164287881 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f9608081870 msgr2=0x7f9608083cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f9608081870 0x7f9608083cb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 20 client.4454.objecter put_session s=0x7f96080811a0 osd=3 1 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 20 client.4454.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 10 client.4454.objecter successfully canceled tick 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 -- 10.20.193.45:0/164287881 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f96080792d0 msgr2=0x7f960807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f96080792d0 0x7f960807b790 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9628002a30 tx=0x7f96280079f0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 10 monclient: shutdown 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 -- 10.20.193.45:0/164287881 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f963815b340 msgr2=0x7f96381536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 --2- 10.20.193.45:0/164287881 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f963815b340 0x7f96381536e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f962c00b780 tx=0x7f962c00bc50 comp rx=0 tx=0).stop 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f963df49640 1 -- 10.20.193.45:0/164287881 reap_dead start 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 1 -- 10.20.193.45:0/1225288378 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f60fc007730 con 0x7f610c073fc0 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 10 client.4401.objecter ms_dispatch2 0x7f610c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 3 client.4401.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 3 client.4401.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 -- 10.20.193.45:0/164287881 shutdown_connections 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 -- 10.20.193.45:0/164287881 >> 10.20.193.45:0/164287881 conn(0x7f96380c9d40 msgr2=0x7f963806e420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 10 client.4401.objecter checking command 1 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 -- 10.20.193.45:0/164287881 shutdown_connections 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f60dc081840 0x7f60dc083c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 20 client.4401.objecter _get_session s=0x7f60dc081170 osd=1 3 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 20 client.4401.objecter put_session s=0x7f60dc081170 osd=1 3 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 15 client.4401.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 20 client.4401.objecter _get_session s=0x7f60dc081170 osd=1 3 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 20 client.4401.objecter get_session s=0x7f60dc081170 osd=1 3 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 15 client.4401.objecter _session_command_op_assign 1 1 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 20 client.4401.objecter put_session s=0x7f60dc081170 osd=1 4 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 10 client.4401.objecter _send_command 1 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 1 -- 10.20.193.45:0/1225288378 --> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60dc084350 con 0x7f60dc081840 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 20 client.4401.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 1 -- 10.20.193.45:0/1225288378 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f60fc05da80 con 0x7f610c073fc0 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f61017fa640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.941+0000 7f96077fe640 1 -- 10.20.193.45:0/164287881 wait complete. 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.942+0000 7f96077fe640 1 librados: shutdown 2026-02-17T21:07:13.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.942+0000 7f6111651640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f60dc081840 0x7f60dc083c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.942+0000 7f6111651640 10 monclient: get_auth_request con 0x7f60dc081840 auth_method 0 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 10 monclient(hunting): handle_auth_done global_id 4487 payload 824 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 1 -- 10.20.193.45:0/3927662350 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7feb30155e40 msgr2=0x7feb30144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7feb30155e40 0x7feb30144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 1 -- 10.20.193.45:0/3927662350 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feb30156220 msgr2=0x7feb300c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feb30156220 0x7feb300c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7feb352d0640 1 -- 10.20.193.45:0/3927662350 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb300c8140 con 0x7feb30074c90 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7efe8ce7c640 10 monclient(hunting): get_auth_request con 0x7efe880d16d0 auth_method 0 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7efe8ce7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7efe8ce7c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.943+0000 7efe8ce7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 1 -- 10.20.193.45:0/3582336345 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8017070 con 0x7fedf80ccb80 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 10 monclient: dump: 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 1 -- 10.20.193.45:0/3582336345 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede800c8d0 con 0x7fedf80ccb80 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 1 -- 10.20.193.45:0/3582336345 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede800f040 con 0x7fedf80ccb80 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 5 monclient: authenticate success, global_id 4419 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 10 monclient: _renew_subs 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf81f7350 con 0x7fedf80ccb80 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fedfcd35640 4 set_mon_vals no callback set 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7feddeffd640 10 monclient: dump: 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 10 client.4419.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 10 monclient: _renew_subs 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf81f7910 con 0x7fedf80ccb80 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 1 librados: init done 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 10 client.4419.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 15 client.4419.objecter _session_command_op_assign -1 1 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 20 client.4419.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 10 client.4419.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.944+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fedf81f7100 con 0x7fedf80ccb80 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.945+0000 7f61017fa640 10 client.4401.objecter ms_handle_connect 0x7f60dc081840 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.945+0000 7f6111651640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f60dc081840 0x7f60dc083c80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 10 client.4438.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 15 client.4438.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 20 client.4438.objecter _get_session s=0x7f789c081170 osd=4 3 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 20 client.4438.objecter put_session s=0x7f789c081170 osd=4 3 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 20 client.4438.objecter _get_session s=0x7f789c081170 osd=4 3 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 15 client.4438.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 20 client.4438.objecter get_session s=0x7f789c081170 osd=4 3 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 15 client.4438.objecter _session_command_op_assign 4 2 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 20 client.4438.objecter put_session s=0x7f789c081170 osd=4 4 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 10 client.4438.objecter _send_command 2 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 --> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f78cc155fe0 con 0x7f789c081840 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 10 monclient(hunting): handle_auth_done global_id 4465 payload 824 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 1 -- 10.20.193.45:0/1211313781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe880d16d0 msgr2=0x7efe8814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe880d16d0 0x7efe8814dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 1 -- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efe88155fe0 msgr2=0x7efe8813ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efe88155fe0 0x7efe8813ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7efe8d67d640 1 -- 10.20.193.45:0/1211313781 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe881f4b50 con 0x7efe880c98b0 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7fb0397fa640 1 -- 10.20.193.45:0/3288689683 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040006e60 con 0x7fb044155fe0 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7fb0397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7fb0397fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.946+0000 7fb0397fa640 10 monclient: dump: 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb0397fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb0397fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb0397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 5 monclient: authenticate success, global_id 4462 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb0397fa640 1 -- 10.20.193.45:0/3288689683 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb040010070 con 0x7fb044155fe0 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb0397fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 10 monclient: _renew_subs 2026-02-17T21:07:13.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb0397fa640 1 -- 10.20.193.45:0/3288689683 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04000ccf0 con 0x7fb044155fe0 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb03affd640 4 set_mon_vals no callback set 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb044140850 con 0x7fb044155fe0 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb0397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb0397fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb0397fa640 10 monclient: dump: 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 10 monclient: _renew_subs 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb044140e10 con 0x7fb044155fe0 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 1 librados: init done 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 10 client.4462.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 15 client.4462.objecter _session_command_op_assign -1 1 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 20 client.4462.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.947+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb0440cbdb0 con 0x7fb044155fe0 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.950+0000 7f674effd640 1 -- 10.20.193.45:0/1138008567 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f6750007210 con 0x7f67680c5920 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f544dffb640 1 -- 10.20.193.45:0/3090178177 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f545c01b3b0 con 0x7f5460155fe0 2026-02-17T21:07:13.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f674effd640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67340792d0 0x7f673407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f6766575640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67340792d0 0x7f673407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f6766575640 10 monclient: get_auth_request con 0x7f67340792d0 auth_method 0 2026-02-17T21:07:13.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f544dffb640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5430079300 0x7f543007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.017 INFO:teuthology.orchestra.run.trial045.stdout:94489280517 2026-02-17T21:07:13.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f546531e640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5430079300 0x7f543007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f546531e640 10 monclient: get_auth_request con 0x7f5430079300 auth_method 0 2026-02-17T21:07:13.017 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T21:07:13.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f674effd640 10 client.4404.objecter ms_handle_connect 0x7f67340792d0 2026-02-17T21:07:13.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f6766575640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67340792d0 0x7f673407b790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f675c039000 tx=0x7f675c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f546531e640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5430079300 0x7f543007b7c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f54500098a0 tx=0x7f5450006d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.951+0000 7f544dffb640 10 client.4469.objecter ms_handle_connect 0x7f5430079300 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 1 -- 10.20.193.45:0/3090178177 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f545c01bd60 con 0x7f5460155fe0 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 10 client.4469.objecter ms_dispatch2 0x7f5460000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 3 client.4469.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 3 client.4469.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 10 client.4469.objecter checking command 1 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7f5430081840 0x7f5430083c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 20 client.4469.objecter _get_session s=0x7f5430081170 osd=9 3 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 20 client.4469.objecter put_session s=0x7f5430081170 osd=9 3 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 15 client.4469.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 20 client.4469.objecter _get_session s=0x7f5430081170 osd=9 3 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 20 client.4469.objecter get_session s=0x7f5430081170 osd=9 3 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 15 client.4469.objecter _session_command_op_assign 9 1 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 20 client.4469.objecter put_session s=0x7f5430081170 osd=9 4 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 10 client.4469.objecter _send_command 1 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 1 -- 10.20.193.45:0/3090178177 --> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f545c01bbb0 con 0x7f5430081840 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f544dffb640 20 client.4469.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 1 -- 10.20.193.45:0/1138008567 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f675005da20 con 0x7f67680c5920 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 10 client.4404.objecter ms_dispatch2 0x7f6768000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 3 client.4404.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 3 client.4404.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 10 client.4404.objecter checking command 1 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f6734081810 0x7f6734083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 20 client.4404.objecter _get_session s=0x7f6734081140 osd=6 3 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 20 client.4404.objecter put_session s=0x7f6734081140 osd=6 3 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 15 client.4404.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 20 client.4404.objecter _get_session s=0x7f6734081140 osd=6 3 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 20 client.4404.objecter get_session s=0x7f6734081140 osd=6 3 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 15 client.4404.objecter _session_command_op_assign 6 1 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 20 client.4404.objecter put_session s=0x7f6734081140 osd=6 4 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 10 client.4404.objecter _send_command 1 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 1 -- 10.20.193.45:0/1138008567 --> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6750020ec0 con 0x7f6734081810 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 20 client.4404.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 1 -- 10.20.193.45:0/1138008567 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f675005dde0 con 0x7f67680c5920 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.953+0000 7f674effd640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.954+0000 7f5464b1d640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7f5430081840 0x7f5430083c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.954+0000 7f544dffb640 1 -- 10.20.193.45:0/3090178177 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f545c05e6e0 con 0x7f5460155fe0 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.954+0000 7f544dffb640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.954+0000 7f6766d76640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f6734081810 0x7f6734083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.954+0000 7f5464b1d640 10 monclient: get_auth_request con 0x7f5430081840 auth_method 0 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.954+0000 7f6766d76640 10 monclient: get_auth_request con 0x7f6734081810 auth_method 0 2026-02-17T21:07:13.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f7012ffd640 1 -- 10.20.193.45:0/303936379 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f701c004030 con 0x7f702c155fe0 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7feb352d0640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30074c90 0x7feb301488e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feb2000b5a0 tx=0x7feb2000ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7feb1dffb640 10 client.?.objecter ms_handle_connect 0x7feb30074c90 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7feb1dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f7012ffd640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6ff80792d0 0x7f6ff807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78b2ffd640 1 -- 10.20.193.45:0/2624498932 <== osd.4 v2:10.20.193.45:6826/1457283840 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f78cc155fe0 con 0x7f789c081840 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78b2ffd640 10 client.4438.objecter ms_dispatch2 0x7f78cc000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78b2ffd640 10 client.4438.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78b2ffd640 20 client.4438.objecter put_session s=0x7f789c081170 osd=4 4 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78b2ffd640 15 client.4438.objecter _session_command_op_remove 4 2 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f702a575640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6ff80792d0 0x7f6ff807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f702a575640 10 monclient: get_auth_request con 0x7f6ff80792d0 auth_method 0 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 10 librados: watch_flush enter 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 10 librados: watch_flush exit 2026-02-17T21:07:13.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f702a575640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6ff80792d0 0x7f6ff807b790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7020039000 tx=0x7f7020031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f7012ffd640 10 client.4450.objecter ms_handle_connect 0x7f6ff80792d0 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 10 client.4438.objecter close_session for osd.4 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7f789c081840 msgr2=0x7f789c083c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7f789c081840 0x7f789c083c80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 20 client.4438.objecter put_session s=0x7f789c081170 osd=4 1 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 20 client.4438.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 10 client.4438.objecter successfully canceled tick 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f789c079300 msgr2=0x7f789c07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f789c079300 0x7f789c07b7c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78bc006fd0 tx=0x7f78bc006d40 comp rx=0 tx=0).stop 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 10 monclient: shutdown 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f78cc163930 msgr2=0x7f78cc162640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 1 --2- 10.20.193.45:0/2624498932 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f78cc163930 0x7f78cc162640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f78c000c500 tx=0x7f78c000c9d0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d2d32640 1 -- 10.20.193.45:0/2624498932 reap_dead start 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 shutdown_connections 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.955+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 >> 10.20.193.45:0/2624498932 conn(0x7f78cc0c9d40 msgr2=0x7f78cc074210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 shutdown_connections 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f78d47bc640 1 -- 10.20.193.45:0/2624498932 wait complete. 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f78d47bc640 1 librados: shutdown 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f6766d76640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f6734081810 0x7f6734083c50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f674effd640 10 client.4404.objecter ms_handle_connect 0x7f6734081810 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 1 -- 10.20.193.45:0/3517286018 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080052d0 con 0x7f3214074c90 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 10 monclient: dump: 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 1 -- 10.20.193.45:0/3517286018 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3208005470 con 0x7f3214074c90 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 1 -- 10.20.193.45:0/3517286018 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3208003910 con 0x7f3214074c90 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f321916a640 5 monclient: authenticate success, global_id 4472 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f321916a640 10 monclient: _renew_subs 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f3211573640 4 set_mon_vals no callback set 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f321916a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32141f3ca0 con 0x7f3214074c90 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f31f37fe640 10 monclient: dump: 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.022 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f321916a640 10 client.4472.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f321916a640 10 monclient: _renew_subs 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f321916a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32141f4260 con 0x7f3214074c90 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.956+0000 7f321916a640 1 librados: init done 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f321916a640 10 client.4472.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f321916a640 15 client.4472.objecter _session_command_op_assign -1 1 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f321916a640 20 client.4472.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f321916a640 10 client.4472.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f321916a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3214074580 con 0x7f3214074c90 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 1 -- 10.20.193.45:0/303936379 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f701c05f200 con 0x7f702c155fe0 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 10 client.4450.objecter ms_dispatch2 0x7f702c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 3 client.4450.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 3 client.4450.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f544dffb640 10 client.4469.objecter ms_handle_connect 0x7f5430081840 2026-02-17T21:07:13.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f5464b1d640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7f5430081840 0x7f5430083c80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 10 client.4450.objecter checking command 1 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7f6ff8081810 0x7f6ff8083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 20 client.4450.objecter _get_session s=0x7f6ff8081140 osd=14 3 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 20 client.4450.objecter put_session s=0x7f6ff8081140 osd=14 3 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 15 client.4450.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 20 client.4450.objecter _get_session s=0x7f6ff8081140 osd=14 3 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 20 client.4450.objecter get_session s=0x7f6ff8081140 osd=14 3 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 15 client.4450.objecter _session_command_op_assign 14 1 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 20 client.4450.objecter put_session s=0x7f6ff8081140 osd=14 4 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 10 client.4450.objecter _send_command 1 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 1 -- 10.20.193.45:0/303936379 --> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f701c013e50 con 0x7f6ff8081810 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 20 client.4450.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 1 -- 10.20.193.45:0/303936379 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f701c05f5c0 con 0x7f702c155fe0 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7012ffd640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7029d74640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7f6ff8081810 0x7f6ff8083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.957+0000 7f7029d74640 10 monclient: get_auth_request con 0x7f6ff8081810 auth_method 0 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.959+0000 7f7012ffd640 10 client.4450.objecter ms_handle_connect 0x7f6ff8081810 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.959+0000 7f7029d74640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7f6ff8081810 0x7f6ff8083c50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.962+0000 7f28f97fa640 1 -- 10.20.193.45:0/113668315 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f28ec03fbf0 con 0x7f2904155e40 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.962+0000 7efe8d67d640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efe880c98b0 0x7efe881f4610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe7800b570 tx=0x7efe7800ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.962+0000 7efe75ffb640 10 client.?.objecter ms_handle_connect 0x7efe880c98b0 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.962+0000 7efe75ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.963+0000 7f28f97fa640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f28d40792d0 0x7f28d407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-17T21:07:13.025 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.963+0000 7f2908897640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f28d40792d0 0x7f28d407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.963+0000 7f2908897640 10 monclient: get_auth_request con 0x7f28d40792d0 auth_method 0 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.963+0000 7f2908897640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f28d40792d0 0x7f28d407b790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f28f4007fd0 tx=0x7f28f4007b20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.963+0000 7f28f97fa640 10 client.4407.objecter ms_handle_connect 0x7f28d40792d0 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.964+0000 7f5e7f7fe640 1 -- 10.20.193.45:0/2882298537 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f5e8800d460 con 0x7f5ea0155e40 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.964+0000 7f5e7f7fe640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e6c0792d0 0x7f5e6c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f5e9effd640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e6c0792d0 0x7f5e6c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f5e9effd640 10 monclient: get_auth_request con 0x7f5e6c0792d0 auth_method 0 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f5e9effd640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e6c0792d0 0x7f5e6c07b790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400a8d0 tx=0x7f5e94008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f5e7f7fe640 10 client.4478.objecter ms_handle_connect 0x7f5e6c0792d0 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 1 -- 10.20.193.45:0/113668315 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f28ec083d90 con 0x7f2904155e40 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 10 client.4407.objecter ms_dispatch2 0x7f2904000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 3 client.4407.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 3 client.4407.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 10 client.4407.objecter checking command 1 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f28d4081810 0x7f28d4083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 20 client.4407.objecter _get_session s=0x7f28d4081140 osd=13 3 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 20 client.4407.objecter put_session s=0x7f28d4081140 osd=13 3 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 15 client.4407.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 20 client.4407.objecter _get_session s=0x7f28d4081140 osd=13 3 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 20 client.4407.objecter get_session s=0x7f28d4081140 osd=13 3 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 15 client.4407.objecter _session_command_op_assign 13 1 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 20 client.4407.objecter put_session s=0x7f28d4081140 osd=13 4 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 10 client.4407.objecter _send_command 1 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 1 -- 10.20.193.45:0/113668315 --> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28ec038e50 con 0x7f28d4081810 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 20 client.4407.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 1 -- 10.20.193.45:0/113668315 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f28ec084150 con 0x7f2904155e40 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.965+0000 7f28f97fa640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.966+0000 7f2909098640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f28d4081810 0x7f28d4083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.966+0000 7f2909098640 10 monclient: get_auth_request con 0x7f28d4081810 auth_method 0 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 1 -- 10.20.193.45:0/2882298537 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f5e8805deb0 con 0x7f5ea0155e40 2026-02-17T21:07:13.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 10 client.4478.objecter ms_dispatch2 0x7f5ea0000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 3 client.4478.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 3 client.4478.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 10 client.4478.objecter checking command 1 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f5e6c081810 0x7f5e6c083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 20 client.4478.objecter _get_session s=0x7f5e6c081140 osd=5 3 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 20 client.4478.objecter put_session s=0x7f5e6c081140 osd=5 3 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 15 client.4478.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 20 client.4478.objecter _get_session s=0x7f5e6c081140 osd=5 3 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 20 client.4478.objecter get_session s=0x7f5e6c081140 osd=5 3 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 15 client.4478.objecter _session_command_op_assign 5 1 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 20 client.4478.objecter put_session s=0x7f5e6c081140 osd=5 4 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 10 client.4478.objecter _send_command 1 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 1 -- 10.20.193.45:0/2882298537 --> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e88018e50 con 0x7f5e6c081810 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 20 client.4478.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 1 -- 10.20.193.45:0/2882298537 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f5e8805e270 con 0x7f5ea0155e40 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e7f7fe640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 1 -- 10.20.193.45:0/2131907745 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313000c790 con 0x7f3140156220 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 10 monclient: dump: 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.027 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 1 -- 10.20.193.45:0/2131907745 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3130010070 con 0x7f3140156220 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 1 -- 10.20.193.45:0/2131907745 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313000cb90 con 0x7f3140156220 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3144c56640 5 monclient: authenticate success, global_id 4484 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f313cd72640 4 set_mon_vals no callback set 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3126ffd640 10 monclient: dump: 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3144c56640 10 monclient: _renew_subs 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3144c56640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31401ee6b0 con 0x7f3140156220 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3144c56640 10 client.4484.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3144c56640 10 monclient: _renew_subs 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3144c56640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31401e96f0 con 0x7f3140156220 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f3144c56640 1 librados: init done 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e9f7fe640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f5e6c081810 0x7f5e6c083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7f5e9f7fe640 10 monclient: get_auth_request con 0x7f5e6c081810 auth_method 0 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7feb1dffb640 1 -- 10.20.193.45:0/3927662350 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20012070 con 0x7feb30074c90 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7feb1dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.967+0000 7feb1dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 10 monclient: dump: 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 1 -- 10.20.193.45:0/3927662350 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb200044a0 con 0x7feb30074c90 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 5 monclient: authenticate success, global_id 4487 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 10 monclient: _renew_subs 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb300c8420 con 0x7feb30074c90 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 1 -- 10.20.193.45:0/3927662350 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb200029c0 con 0x7feb30074c90 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1f7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb1dffb640 10 monclient: dump: 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.029 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 10 client.4487.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 10 monclient: _renew_subs 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb301f52a0 con 0x7feb30074c90 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 1 librados: init done 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7f3144c56640 10 client.4484.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7f3144c56640 15 client.4484.objecter _session_command_op_assign -1 1 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7f3144c56640 20 client.4484.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7f3144c56640 10 client.4484.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7f3144c56640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31400ccb80 con 0x7f3140156220 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7f28f97fa640 10 client.4407.objecter ms_handle_connect 0x7f28d4081810 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7f2909098640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f28d4081810 0x7f28d4083c50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 10 client.4487.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 15 client.4487.objecter _session_command_op_assign -1 1 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 20 client.4487.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 10 client.4487.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.968+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb30074580 con 0x7feb30074c90 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.970+0000 7f5e7f7fe640 10 client.4478.objecter ms_handle_connect 0x7f5e6c081810 2026-02-17T21:07:13.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.970+0000 7f5e9f7fe640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f5e6c081810 0x7f5e6c083c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.970+0000 7fb0397fa640 1 -- 10.20.193.45:0/3288689683 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb040004070 con 0x7fb044155fe0 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7fb0397fa640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb0140792d0 0x7fb01407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7fb048897640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb0140792d0 0x7fb01407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7fb048897640 10 monclient: get_auth_request con 0x7fb0140792d0 auth_method 0 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7fb0397fa640 10 client.4462.objecter ms_handle_connect 0x7fb0140792d0 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7fb048897640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb0140792d0 0x7fb01407b790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb034004640 tx=0x7fb034009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7f6b437fe640 1 -- 10.20.193.45:0/496964387 <== osd.7 v2:10.20.193.138:6808/1754305677 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6b58013e70 con 0x7f6b30081810 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7f6b437fe640 10 client.4453.objecter ms_dispatch2 0x7f6b64000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7f6b437fe640 10 client.4453.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7f6b437fe640 20 client.4453.objecter put_session s=0x7f6b30081140 osd=7 4 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.971+0000 7f6b437fe640 15 client.4453.objecter _session_command_op_remove 7 1 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 1 -- 10.20.193.45:0/3288689683 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fb04005e120 con 0x7fb044155fe0 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 10 client.4462.objecter ms_dispatch2 0x7fb044000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 3 client.4462.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 3 client.4462.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 10 client.4462.objecter checking command 1 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fb014081870 0x7fb014083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 20 client.4462.objecter _get_session s=0x7fb0140811a0 osd=11 3 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 20 client.4462.objecter put_session s=0x7fb0140811a0 osd=11 3 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 15 client.4462.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 20 client.4462.objecter _get_session s=0x7fb0140811a0 osd=11 3 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 20 client.4462.objecter get_session s=0x7fb0140811a0 osd=11 3 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 15 client.4462.objecter _session_command_op_assign 11 1 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 20 client.4462.objecter put_session s=0x7fb0140811a0 osd=11 4 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 10 client.4462.objecter _send_command 1 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 1 -- 10.20.193.45:0/3288689683 --> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb04001de50 con 0x7fb014081870 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb0397fa640 20 client.4462.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb03bfff640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fb014081870 0x7fb014083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.972+0000 7fb03bfff640 10 monclient: get_auth_request con 0x7fb014081870 auth_method 0 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7fb0397fa640 1 -- 10.20.193.45:0/3288689683 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fb04005e4e0 con 0x7fb044155fe0 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7fb0397fa640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 1 -- 10.20.193.45:0/1211313781 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78013020 con 0x7efe880c98b0 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 10 monclient: dump: 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.032 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 1 -- 10.20.193.45:0/1211313781 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe780044a0 con 0x7efe880c98b0 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 1 -- 10.20.193.45:0/1211313781 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe780029c0 con 0x7efe880c98b0 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe8f908640 5 monclient: authenticate success, global_id 4465 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe8f908640 10 monclient: _renew_subs 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe777fe640 4 set_mon_vals no callback set 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe8f908640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe881f7680 con 0x7efe880c98b0 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe75ffb640 10 monclient: dump: 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe8f908640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe8f908640 10 monclient: _renew_subs 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe8f908640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe881f7c40 con 0x7efe880c98b0 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.973+0000 7efe8f908640 1 librados: init done 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.974+0000 7efe8f908640 10 client.4465.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.974+0000 7efe8f908640 15 client.4465.objecter _session_command_op_assign -1 1 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.974+0000 7efe8f908640 20 client.4465.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.974+0000 7efe8f908640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.974+0000 7efe8f908640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.974+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe880c9cf0 con 0x7efe880c98b0 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.974+0000 7fb0397fa640 10 client.4462.objecter ms_handle_connect 0x7fb014081870 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.974+0000 7fb03bfff640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fb014081870 0x7fb014083cb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.976+0000 7f674effd640 1 -- 10.20.193.45:0/1138008567 <== osd.6 v2:10.20.193.92:6816/1142590747 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6750020ec0 con 0x7f6734081810 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.976+0000 7f674effd640 10 client.4404.objecter ms_dispatch2 0x7f6768000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.976+0000 7f674effd640 10 client.4404.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.976+0000 7f674effd640 20 client.4404.objecter put_session s=0x7f6734081140 osd=6 4 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.976+0000 7f674effd640 15 client.4404.objecter _session_command_op_remove 6 1 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.977+0000 7f61017fa640 1 -- 10.20.193.45:0/1225288378 <== osd.1 v2:10.20.193.86:6800/37724401 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f60dc084350 con 0x7f60dc081840 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.977+0000 7f61017fa640 10 client.4401.objecter ms_dispatch2 0x7f610c000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.977+0000 7f61017fa640 10 client.4401.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.977+0000 7f61017fa640 20 client.4401.objecter put_session s=0x7f60dc081170 osd=1 4 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.977+0000 7f61017fa640 15 client.4401.objecter _session_command_op_remove 1 1 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 10 client.4453.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 15 client.4453.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 20 client.4453.objecter _get_session s=0x7f6b30081140 osd=7 3 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 20 client.4453.objecter put_session s=0x7f6b30081140 osd=7 3 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 20 client.4453.objecter _get_session s=0x7f6b30081140 osd=7 3 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 15 client.4453.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 20 client.4453.objecter get_session s=0x7f6b30081140 osd=7 3 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 15 client.4453.objecter _session_command_op_assign 7 2 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 20 client.4453.objecter put_session s=0x7f6b30081140 osd=7 4 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 10 client.4453.objecter _send_command 2 2026-02-17T21:07:13.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 --> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b641457b0 con 0x7f6b30081810 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7feddeffd640 1 -- 10.20.193.45:0/3582336345 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fede8012050 con 0x7fedf80ccb80 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7feddeffd640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fedc80792b0 0x7fedc807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7fedfdd37640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fedc80792b0 0x7fedc807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.978+0000 7fedfdd37640 10 monclient: get_auth_request con 0x7fedc80792b0 auth_method 0 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.979+0000 7feddeffd640 10 client.4419.objecter ms_handle_connect 0x7fedc80792b0 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.979+0000 7fedfdd37640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fedc80792b0 0x7fedc807b770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fedf8151300 tx=0x7fedec006cf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 1 -- 10.20.193.45:0/3582336345 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fede8097c30 con 0x7fedf80ccb80 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 10 client.4419.objecter ms_dispatch2 0x7fedf8000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 3 client.4419.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 3 client.4419.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 10 client.4419.objecter checking command 1 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7fedc80817f0 0x7fedc8083c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 20 client.4419.objecter _get_session s=0x7fedc8081120 osd=8 3 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 20 client.4419.objecter put_session s=0x7fedc8081120 osd=8 3 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 15 client.4419.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 20 client.4419.objecter _get_session s=0x7fedc8081120 osd=8 3 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 20 client.4419.objecter get_session s=0x7fedc8081120 osd=8 3 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 15 client.4419.objecter _session_command_op_assign 8 1 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 20 client.4419.objecter put_session s=0x7fedc8081120 osd=8 4 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 10 client.4419.objecter _send_command 1 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 1 -- 10.20.193.45:0/3582336345 --> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fedc8084300 con 0x7fedc80817f0 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 20 client.4419.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 1 -- 10.20.193.45:0/3582336345 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7fede805e400 con 0x7fedf80ccb80 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.980+0000 7feddeffd640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7fedfed39640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7fedc80817f0 0x7fedc8083c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7fedfed39640 10 monclient: get_auth_request con 0x7fedc80817f0 auth_method 0 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 1 -- 10.20.193.45:0/727614933 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e54006e60 con 0x7f0e60156220 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 10 monclient: dump: 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 1 -- 10.20.193.45:0/727614933 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e54010070 con 0x7f0e60156220 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e688ea640 5 monclient: authenticate success, global_id 4416 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e688ea640 10 monclient: _renew_subs 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e688ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e600c5bd0 con 0x7f0e60156220 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 1 -- 10.20.193.45:0/727614933 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5400c9d0 con 0x7f0e60156220 2026-02-17T21:07:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e4affd640 10 monclient: dump: 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e64e5c640 4 set_mon_vals no callback set 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e688ea640 10 client.4416.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e688ea640 10 monclient: _renew_subs 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e688ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e600c6190 con 0x7f0e60156220 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.981+0000 7f0e688ea640 1 librados: init done 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.982+0000 7f0e688ea640 10 client.4416.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.982+0000 7f0e688ea640 15 client.4416.objecter _session_command_op_assign -1 1 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.982+0000 7f0e688ea640 20 client.4416.objecter _get_session osd=-1 returning homeless 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.982+0000 7f0e688ea640 10 client.4416.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.982+0000 7f0e688ea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.982+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e600ccfa0 con 0x7f0e60156220 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7feddeffd640 10 client.4419.objecter ms_handle_connect 0x7fedc80817f0 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7fedfed39640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7fedc80817f0 0x7fedc8083c30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 10 client.4404.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 15 client.4404.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 20 client.4404.objecter _get_session s=0x7f6734081140 osd=6 3 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 20 client.4404.objecter put_session s=0x7f6734081140 osd=6 3 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 20 client.4404.objecter _get_session s=0x7f6734081140 osd=6 3 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 15 client.4404.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 20 client.4404.objecter get_session s=0x7f6734081140 osd=6 3 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 15 client.4404.objecter _session_command_op_assign 6 2 2026-02-17T21:07:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 20 client.4404.objecter put_session s=0x7f6734081140 osd=6 4 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 10 client.4404.objecter _send_command 2 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.983+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 --> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6768071780 con 0x7f6734081810 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 10 client.4401.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 15 client.4401.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 20 client.4401.objecter _get_session s=0x7f60dc081170 osd=1 3 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 20 client.4401.objecter put_session s=0x7f60dc081170 osd=1 3 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 20 client.4401.objecter _get_session s=0x7f60dc081170 osd=1 3 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 15 client.4401.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 20 client.4401.objecter get_session s=0x7f60dc081170 osd=1 3 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 15 client.4401.objecter _session_command_op_assign 1 2 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 20 client.4401.objecter put_session s=0x7f60dc081170 osd=1 4 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 10 client.4401.objecter _send_command 2 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 --> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f610c1f9580 con 0x7f60dc081840 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b437fe640 1 -- 10.20.193.45:0/496964387 <== osd.7 v2:10.20.193.138:6808/1754305677 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6b641457b0 con 0x7f6b30081810 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b437fe640 10 client.4453.objecter ms_dispatch2 0x7f6b64000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b437fe640 10 client.4453.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b437fe640 20 client.4453.objecter put_session s=0x7f6b30081140 osd=7 4 2026-02-17T21:07:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b437fe640 15 client.4453.objecter _session_command_op_remove 7 2 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 10 librados: watch_flush enter 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 10 librados: watch_flush exit 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 10 client.4453.objecter close_session for osd.7 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7f6b30081810 msgr2=0x7f6b30083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7f6b30081810 0x7f6b30083c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 20 client.4453.objecter put_session s=0x7f6b30081140 osd=7 1 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 20 client.4453.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 10 client.4453.objecter successfully canceled tick 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b300792d0 msgr2=0x7f6b3007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b300792d0 0x7f6b3007b790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c007fd0 tx=0x7f6b4c007b20 comp rx=0 tx=0).stop 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 10 monclient: shutdown 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b64074c90 msgr2=0x7f6b64150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 --2- 10.20.193.45:0/496964387 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b64074c90 0x7f6b64150350 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6b5800c700 tx=0x7f6b5800cbd0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b63577640 1 -- 10.20.193.45:0/496964387 reap_dead start 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 shutdown_connections 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 >> 10.20.193.45:0/496964387 conn(0x7f6b640ce270 msgr2=0x7f6b64155110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 shutdown_connections 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 -- 10.20.193.45:0/496964387 wait complete. 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7f6b691fe640 1 librados: shutdown 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.984+0000 7efe75ffb640 1 -- 10.20.193.45:0/1211313781 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7efe7800f460 con 0x7efe880c98b0 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.985+0000 7efe75ffb640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efe580792d0 0x7efe5807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.985+0000 7efe8ce7c640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efe580792d0 0x7efe5807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.985+0000 7efe8ce7c640 10 monclient: get_auth_request con 0x7efe580792d0 auth_method 0 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.985+0000 7efe8ce7c640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efe580792d0 0x7efe5807b790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe7c039000 tx=0x7efe7c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.985+0000 7efe75ffb640 10 client.4465.objecter ms_handle_connect 0x7efe580792d0 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 1 -- 10.20.193.45:0/1211313781 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7efe7800c250 con 0x7efe880c98b0 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 10 client.4465.objecter ms_dispatch2 0x7efe88000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 3 client.4465.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 3 client.4465.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 10 client.4465.objecter checking command 1 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7efe58081810 0x7efe58083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 20 client.4465.objecter _get_session s=0x7efe58081140 osd=0 3 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 20 client.4465.objecter put_session s=0x7efe58081140 osd=0 3 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 15 client.4465.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 20 client.4465.objecter _get_session s=0x7efe58081140 osd=0 3 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 20 client.4465.objecter get_session s=0x7efe58081140 osd=0 3 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 15 client.4465.objecter _session_command_op_assign 0 1 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 20 client.4465.objecter put_session s=0x7efe58081140 osd=0 4 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 10 client.4465.objecter _send_command 1 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 1 -- 10.20.193.45:0/1211313781 --> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe58084320 con 0x7efe58081810 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.986+0000 7efe75ffb640 20 client.4465.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7efe75ffb640 1 -- 10.20.193.45:0/1211313781 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7efe7805e7d0 con 0x7efe880c98b0 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7efe75ffb640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f31f37fe640 1 -- 10.20.193.45:0/3517286018 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f3208003ab0 con 0x7f3214074c90 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f674effd640 1 -- 10.20.193.45:0/1138008567 <== osd.6 v2:10.20.193.92:6816/1142590747 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6758012300 con 0x7f6734081810 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f674effd640 10 client.4404.objecter ms_dispatch2 0x7f6768000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f674effd640 10 client.4404.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f674effd640 20 client.4404.objecter put_session s=0x7f6734081140 osd=6 4 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f674effd640 15 client.4404.objecter _session_command_op_remove 6 2 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7efe8de7e640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7efe58081810 0x7efe58083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f31f37fe640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f31e00792d0 0x7f31e007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 10 librados: watch_flush enter 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 10 librados: watch_flush exit 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 10 client.4404.objecter close_session for osd.6 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f6734081810 msgr2=0x7f6734083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f6734081810 0x7f6734083c50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 20 client.4404.objecter put_session s=0x7f6734081140 osd=6 1 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 20 client.4404.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 10 client.4404.objecter successfully canceled tick 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f3212575640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f31e00792d0 0x7f31e007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f3212575640 10 monclient: get_auth_request con 0x7f31e00792d0 auth_method 0 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67340792d0 msgr2=0x7f673407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f67340792d0 0x7f673407b790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f675c039000 tx=0x7f675c033000 comp rx=0 tx=0).stop 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 10 monclient: shutdown 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7efe8de7e640 10 monclient: get_auth_request con 0x7efe58081810 auth_method 0 2026-02-17T21:07:13.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67680c5920 msgr2=0x7f67681578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 --2- 10.20.193.45:0/1138008567 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f67680c5920 0x7f67681578e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f675000c680 tx=0x7f675000cb50 comp rx=0 tx=0).stop 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f6766d76640 1 -- 10.20.193.45:0/1138008567 reap_dead start 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 shutdown_connections 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 >> 10.20.193.45:0/1138008567 conn(0x7f67680ca590 msgr2=0x7f67680ca970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 shutdown_connections 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 -- 10.20.193.45:0/1138008567 wait complete. 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f676ceae640 1 librados: shutdown 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f31f37fe640 10 client.4472.objecter ms_handle_connect 0x7f31e00792d0 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.987+0000 7f3212575640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f31e00792d0 0x7f31e007b790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f321408f310 tx=0x7f31fc031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61017fa640 1 -- 10.20.193.45:0/1225288378 <== osd.1 v2:10.20.193.86:6800/37724401 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f610c1f9580 con 0x7f60dc081840 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61017fa640 10 client.4401.objecter ms_dispatch2 0x7f610c000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61017fa640 10 client.4401.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61017fa640 20 client.4401.objecter put_session s=0x7f60dc081170 osd=1 4 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61017fa640 15 client.4401.objecter _session_command_op_remove 1 2 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 10 librados: watch_flush enter 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 10 librados: watch_flush exit 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f544dffb640 1 -- 10.20.193.45:0/3090178177 <== osd.9 v2:10.20.193.86:6816/1248523526 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f545c01bbb0 con 0x7f5430081840 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f544dffb640 10 client.4469.objecter ms_dispatch2 0x7f5460000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f544dffb640 10 client.4469.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f544dffb640 20 client.4469.objecter put_session s=0x7f5430081170 osd=9 4 2026-02-17T21:07:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f544dffb640 15 client.4469.objecter _session_command_op_remove 9 1 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 10 client.4401.objecter close_session for osd.1 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f60dc081840 msgr2=0x7f60dc083c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f60dc081840 0x7f60dc083c80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 20 client.4401.objecter put_session s=0x7f60dc081170 osd=1 1 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 20 client.4401.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 10 client.4401.objecter successfully canceled tick 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f60dc079300 msgr2=0x7f60dc07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f60dc079300 0x7f60dc07b7c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f60f4039000 tx=0x7f60f4033000 comp rx=0 tx=0).stop 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 10 monclient: shutdown 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f610c073fc0 msgr2=0x7f610c1f9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 --2- 10.20.193.45:0/1225288378 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f610c073fc0 0x7f610c1f9040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c450 tx=0x7f60fc00c920 comp rx=0 tx=0).stop 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f6111651640 1 -- 10.20.193.45:0/1225288378 reap_dead start 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 shutdown_connections 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 >> 10.20.193.45:0/1225288378 conn(0x7f610c0ce270 msgr2=0x7f610c0c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 shutdown_connections 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 -- 10.20.193.45:0/1225288378 wait complete. 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.989+0000 7f61130db640 1 librados: shutdown 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.990+0000 7f7012ffd640 1 -- 10.20.193.45:0/303936379 <== osd.14 v2:10.20.193.92:6808/1799526026 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f701c013e50 con 0x7f6ff8081810 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.990+0000 7f7012ffd640 10 client.4450.objecter ms_dispatch2 0x7f702c000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.990+0000 7f7012ffd640 10 client.4450.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.990+0000 7f7012ffd640 20 client.4450.objecter put_session s=0x7f6ff8081140 osd=14 4 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.990+0000 7f7012ffd640 15 client.4450.objecter _session_command_op_remove 14 1 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.990+0000 7efe8de7e640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7efe58081810 0x7efe58083c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.990+0000 7efe75ffb640 10 client.4465.objecter ms_handle_connect 0x7efe58081810 2026-02-17T21:07:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.992+0000 7f28f97fa640 1 -- 10.20.193.45:0/113668315 <== osd.13 v2:10.20.193.86:6808/3260427089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f28ec038e50 con 0x7f28d4081810 2026-02-17T21:07:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.992+0000 7f28f97fa640 10 client.4407.objecter ms_dispatch2 0x7f2904000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.992+0000 7f28f97fa640 10 client.4407.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.992+0000 7f28f97fa640 20 client.4407.objecter put_session s=0x7f28d4081140 osd=13 4 2026-02-17T21:07:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.992+0000 7f28f97fa640 15 client.4407.objecter _session_command_op_remove 13 1 2026-02-17T21:07:13.044 INFO:teuthology.orchestra.run.trial045.stdout:111669149705 2026-02-17T21:07:13.044 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T21:07:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.994+0000 7f0e4affd640 1 -- 10.20.193.45:0/727614933 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f0e5400cb70 con 0x7f0e60156220 2026-02-17T21:07:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.995+0000 7feb1dffb640 1 -- 10.20.193.45:0/3927662350 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7feb2000d460 con 0x7feb30074c90 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stdout:98784247813 2026-02-17T21:07:13.045 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.995+0000 7feb1dffb640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feb000792d0 0x7feb0007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7feb34acf640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feb000792d0 0x7feb0007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7feb34acf640 10 monclient: get_auth_request con 0x7feb000792d0 auth_method 0 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f0e4affd640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0e300792d0 0x7f0e3007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f0e6665f640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0e300792d0 0x7f0e3007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f0e6665f640 10 monclient: get_auth_request con 0x7f0e300792d0 auth_method 0 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7feb1dffb640 10 client.4487.objecter ms_handle_connect 0x7feb000792d0 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7feb34acf640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feb000792d0 0x7feb0007b790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb24007fd0 tx=0x7feb24007b20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f0e6665f640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0e300792d0 0x7f0e3007b790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0e58039000 tx=0x7f0e58031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f0e4affd640 10 client.4416.objecter ms_handle_connect 0x7f0e300792d0 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 10 client.4469.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 15 client.4469.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 20 client.4469.objecter _get_session s=0x7f5430081170 osd=9 3 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 20 client.4469.objecter put_session s=0x7f5430081170 osd=9 3 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 20 client.4469.objecter _get_session s=0x7f5430081170 osd=9 3 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 15 client.4469.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 20 client.4469.objecter get_session s=0x7f5430081170 osd=9 3 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 15 client.4469.objecter _session_command_op_assign 9 2 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 20 client.4469.objecter put_session s=0x7f5430081170 osd=9 4 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 10 client.4469.objecter _send_command 2 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.996+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 --> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f546014a080 con 0x7f5430081840 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 10 client.4450.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 15 client.4450.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 20 client.4450.objecter _get_session s=0x7f6ff8081140 osd=14 3 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 20 client.4450.objecter put_session s=0x7f6ff8081140 osd=14 3 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 20 client.4450.objecter _get_session s=0x7f6ff8081140 osd=14 3 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 15 client.4450.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 20 client.4450.objecter get_session s=0x7f6ff8081140 osd=14 3 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 15 client.4450.objecter _session_command_op_assign 14 2 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 20 client.4450.objecter put_session s=0x7f6ff8081140 osd=14 4 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 10 client.4450.objecter _send_command 2 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 --> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f702c0cb550 con 0x7f6ff8081810 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stdout:111669149705 2026-02-17T21:07:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f31f37fe640 1 -- 10.20.193.45:0/3517286018 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f3208023dd0 con 0x7f3214074c90 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f31f37fe640 10 client.4472.objecter ms_dispatch2 0x7f3214000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f31f37fe640 3 client.4472.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.997+0000 7f31f37fe640 3 client.4472.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.047 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 10 client.4472.objecter checking command 1 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f31e0081870 0x7f31e0083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 20 client.4472.objecter _get_session s=0x7f31e00811a0 osd=12 3 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 20 client.4472.objecter put_session s=0x7f31e00811a0 osd=12 3 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 15 client.4472.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 20 client.4472.objecter _get_session s=0x7f31e00811a0 osd=12 3 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 20 client.4472.objecter get_session s=0x7f31e00811a0 osd=12 3 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 15 client.4472.objecter _session_command_op_assign 12 1 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 20 client.4472.objecter put_session s=0x7f31e00811a0 osd=12 4 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 10 client.4472.objecter _send_command 1 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 1 -- 10.20.193.45:0/3517286018 --> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3208024ec0 con 0x7f31e0081870 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 20 client.4472.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 1 -- 10.20.193.45:0/3517286018 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f320805e7b0 con 0x7f3214074c90 2026-02-17T21:07:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f31f37fe640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 1 -- 10.20.193.45:0/727614933 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f0e5405dea0 con 0x7f0e60156220 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 10 client.4416.objecter ms_dispatch2 0x7f0e60000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 3 client.4416.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 3 client.4416.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 10 client.4416.objecter checking command 1 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7f0e30081870 0x7f0e30083cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 20 client.4416.objecter _get_session s=0x7f0e300811a0 osd=10 3 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 20 client.4416.objecter put_session s=0x7f0e300811a0 osd=10 3 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 15 client.4416.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 20 client.4416.objecter _get_session s=0x7f0e300811a0 osd=10 3 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 20 client.4416.objecter get_session s=0x7f0e300811a0 osd=10 3 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 15 client.4416.objecter _session_command_op_assign 10 1 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 20 client.4416.objecter put_session s=0x7f0e300811a0 osd=10 4 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 10 client.4416.objecter _send_command 1 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 1 -- 10.20.193.45:0/727614933 --> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e5400ee50 con 0x7f0e30081870 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 20 client.4416.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 1 -- 10.20.193.45:0/727614933 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0e5405e260 con 0x7f0e60156220 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e4affd640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f3213577640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f31e0081870 0x7f31e0083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f3213577640 10 monclient: get_auth_request con 0x7f31e0081870 auth_method 0 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.998+0000 7f0e65e5e640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7f0e30081870 0x7f0e30083cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:12.999+0000 7f0e65e5e640 10 monclient: get_auth_request con 0x7f0e30081870 auth_method 0 2026-02-17T21:07:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 10 client.4407.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 15 client.4407.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 20 client.4407.objecter _get_session s=0x7f28d4081140 osd=13 3 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 20 client.4407.objecter put_session s=0x7f28d4081140 osd=13 3 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 20 client.4407.objecter _get_session s=0x7f28d4081140 osd=13 3 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 15 client.4407.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 20 client.4407.objecter get_session s=0x7f28d4081140 osd=13 3 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 15 client.4407.objecter _session_command_op_assign 13 2 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 20 client.4407.objecter put_session s=0x7f28d4081140 osd=13 4 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 10 client.4407.objecter _send_command 2 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 --> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29040c4d90 con 0x7f28d4081810 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f3213577640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f31e0081870 0x7f31e0083cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.000+0000 7f31f37fe640 10 client.4472.objecter ms_handle_connect 0x7f31e0081870 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7f0e65e5e640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7f0e30081870 0x7f0e30083cb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7f0e4affd640 10 client.4416.objecter ms_handle_connect 0x7f0e30081870 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 1 -- 10.20.193.45:0/3927662350 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7feb2005def0 con 0x7feb30074c90 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 10 client.4487.objecter ms_dispatch2 0x7feb30000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 3 client.4487.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 3 client.4487.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 10 client.4487.objecter checking command 1 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7feb00081810 0x7feb00083c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 20 client.4487.objecter _get_session s=0x7feb00081140 osd=2 3 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 20 client.4487.objecter put_session s=0x7feb00081140 osd=2 3 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 15 client.4487.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 20 client.4487.objecter _get_session s=0x7feb00081140 osd=2 3 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 20 client.4487.objecter get_session s=0x7feb00081140 osd=2 3 2026-02-17T21:07:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 15 client.4487.objecter _session_command_op_assign 2 1 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 20 client.4487.objecter put_session s=0x7feb00081140 osd=2 4 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 10 client.4487.objecter _send_command 1 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 1 -- 10.20.193.45:0/3927662350 --> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb20018e50 con 0x7feb00081810 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7f5e7f7fe640 1 -- 10.20.193.45:0/2882298537 <== osd.5 v2:10.20.193.86:6824/63160539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f5e88018e50 con 0x7f5e6c081810 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7f5e7f7fe640 10 client.4478.objecter ms_dispatch2 0x7f5ea0000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7feb1dffb640 20 client.4487.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7f5e7f7fe640 10 client.4478.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7f5e7f7fe640 20 client.4478.objecter put_session s=0x7f5e6c081140 osd=5 4 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.001+0000 7f5e7f7fe640 15 client.4478.objecter _session_command_op_remove 5 1 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.002+0000 7feb35ad1640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7feb00081810 0x7feb00083c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.002+0000 7feb35ad1640 10 monclient: get_auth_request con 0x7feb00081810 auth_method 0 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.002+0000 7f544dffb640 1 -- 10.20.193.45:0/3090178177 <== osd.9 v2:10.20.193.86:6816/1248523526 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f546014a080 con 0x7f5430081840 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.002+0000 7f544dffb640 10 client.4469.objecter ms_dispatch2 0x7f5460000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.002+0000 7f544dffb640 10 client.4469.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.002+0000 7f544dffb640 20 client.4469.objecter put_session s=0x7f5430081170 osd=9 4 2026-02-17T21:07:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.002+0000 7f544dffb640 15 client.4469.objecter _session_command_op_remove 9 2 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.002+0000 7f54675a9640 10 librados: watch_flush enter 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 10 librados: watch_flush exit 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 10 client.4469.objecter close_session for osd.9 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7f5430081840 msgr2=0x7f5430083c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7f5430081840 0x7f5430083c80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 20 client.4469.objecter put_session s=0x7f5430081170 osd=9 1 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 20 client.4469.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 10 client.4469.objecter successfully canceled tick 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5430079300 msgr2=0x7f543007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5430079300 0x7f543007b7c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f54500098a0 tx=0x7f5450006d90 comp rx=0 tx=0).stop 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 10 monclient: shutdown 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5460155fe0 msgr2=0x7f54601fa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 --2- 10.20.193.45:0/3090178177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5460155fe0 0x7f54601fa370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f545c00cbf0 tx=0x7f545c00a430 comp rx=0 tx=0).stop 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f5465b1f640 1 -- 10.20.193.45:0/3090178177 reap_dead start 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 shutdown_connections 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 >> 10.20.193.45:0/3090178177 conn(0x7f546006d930 msgr2=0x7f54600cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 shutdown_connections 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 -- 10.20.193.45:0/3090178177 wait complete. 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f54675a9640 1 librados: shutdown 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7012ffd640 1 -- 10.20.193.45:0/303936379 <== osd.14 v2:10.20.193.92:6808/1799526026 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f702c0cb550 con 0x7f6ff8081810 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7012ffd640 10 client.4450.objecter ms_dispatch2 0x7f702c000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7012ffd640 10 client.4450.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7012ffd640 20 client.4450.objecter put_session s=0x7f6ff8081140 osd=14 4 2026-02-17T21:07:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7012ffd640 15 client.4450.objecter _session_command_op_remove 14 2 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 10 librados: watch_flush enter 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 10 librados: watch_flush exit 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 10 client.4450.objecter close_session for osd.14 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7f6ff8081810 msgr2=0x7f6ff8083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7f6ff8081810 0x7f6ff8083c50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 20 client.4450.objecter put_session s=0x7f6ff8081140 osd=14 1 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 20 client.4450.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 10 client.4450.objecter successfully canceled tick 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6ff80792d0 msgr2=0x7f6ff807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6ff80792d0 0x7f6ff807b790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7020039000 tx=0x7f7020031000 comp rx=0 tx=0).stop 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 10 monclient: shutdown 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f702c155fe0 msgr2=0x7f702c0d0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f7030a8f640 1 --2- 10.20.193.45:0/303936379 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f702c155fe0 0x7f702c0d0810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f701c00efc0 tx=0x7f701c00c490 comp rx=0 tx=0).stop 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.003+0000 7f702ad76640 1 -- 10.20.193.45:0/303936379 reap_dead start 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.004+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 shutdown_connections 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.004+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 >> 10.20.193.45:0/303936379 conn(0x7f702c06d930 msgr2=0x7f702c06dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.004+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 shutdown_connections 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.004+0000 7f7030a8f640 1 -- 10.20.193.45:0/303936379 wait complete. 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.004+0000 7f7030a8f640 1 librados: shutdown 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.004+0000 7feb1dffb640 10 client.4487.objecter ms_handle_connect 0x7feb00081810 2026-02-17T21:07:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.004+0000 7feb35ad1640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7feb00081810 0x7feb00083c50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.006+0000 7fb0397fa640 1 -- 10.20.193.45:0/3288689683 <== osd.11 v2:10.20.193.138:6824/4038031379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fb04001de50 con 0x7fb014081870 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.006+0000 7fb0397fa640 10 client.4462.objecter ms_dispatch2 0x7fb044000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.006+0000 7fb0397fa640 10 client.4462.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.006+0000 7fb0397fa640 20 client.4462.objecter put_session s=0x7fb0140811a0 osd=11 4 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.006+0000 7fb0397fa640 15 client.4462.objecter _session_command_op_remove 11 1 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.007+0000 7feddeffd640 1 -- 10.20.193.45:0/3582336345 <== osd.8 v2:10.20.193.45:6810/442873512 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fedc8084300 con 0x7fedc80817f0 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.007+0000 7feddeffd640 10 client.4419.objecter ms_dispatch2 0x7fedf8000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.007+0000 7feddeffd640 10 client.4419.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.007+0000 7feddeffd640 20 client.4419.objecter put_session s=0x7fedc8081120 osd=8 4 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.007+0000 7feddeffd640 15 client.4419.objecter _session_command_op_remove 8 1 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7feb1dffb640 1 -- 10.20.193.45:0/3927662350 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7feb2005e2b0 con 0x7feb30074c90 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7feb1dffb640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 10 client.4478.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 15 client.4478.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 20 client.4478.objecter _get_session s=0x7f5e6c081140 osd=5 3 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 20 client.4478.objecter put_session s=0x7f5e6c081140 osd=5 3 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 20 client.4478.objecter _get_session s=0x7f5e6c081140 osd=5 3 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 15 client.4478.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 20 client.4478.objecter get_session s=0x7f5e6c081140 osd=5 3 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 15 client.4478.objecter _session_command_op_assign 5 2 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 20 client.4478.objecter put_session s=0x7f5e6c081140 osd=5 4 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 10 client.4478.objecter _send_command 2 2026-02-17T21:07:13.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.008+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 --> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ea01e7380 con 0x7f5e6c081810 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.009+0000 7f3126ffd640 1 -- 10.20.193.45:0/2131907745 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f313001d030 con 0x7f3140156220 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.009+0000 7f3126ffd640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f310c079300 0x7f310c07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.009+0000 7f313e575640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f310c079300 0x7f310c07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.009+0000 7f313e575640 10 monclient: get_auth_request con 0x7f310c079300 auth_method 0 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.010+0000 7f3126ffd640 10 client.4484.objecter ms_handle_connect 0x7f310c079300 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.010+0000 7f313e575640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f310c079300 0x7f310c07b7c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f314008f5a0 tx=0x7f3134031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f28f97fa640 1 -- 10.20.193.45:0/113668315 <== osd.13 v2:10.20.193.86:6808/3260427089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f29040c4d90 con 0x7f28d4081810 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f28f97fa640 10 client.4407.objecter ms_dispatch2 0x7f2904000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f28f97fa640 10 client.4407.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f28f97fa640 20 client.4407.objecter put_session s=0x7f28d4081140 osd=13 4 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f28f97fa640 15 client.4407.objecter _session_command_op_remove 13 2 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 1 -- 10.20.193.45:0/2131907745 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f313000cd30 con 0x7f3140156220 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 10 client.4484.objecter ms_dispatch2 0x7f3140000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 3 client.4484.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 3 client.4484.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 10 client.4484.objecter checking command 1 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f310c0818a0 0x7f310c083ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 20 client.4484.objecter _get_session s=0x7f310c0811d0 osd=15 3 2026-02-17T21:07:13.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 20 client.4484.objecter put_session s=0x7f310c0811d0 osd=15 3 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 15 client.4484.objecter _session_command_op_remove -1 1 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 20 client.4484.objecter _get_session s=0x7f310c0811d0 osd=15 3 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 20 client.4484.objecter get_session s=0x7f310c0811d0 osd=15 3 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 15 client.4484.objecter _session_command_op_assign 15 1 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 20 client.4484.objecter put_session s=0x7f310c0811d0 osd=15 4 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 10 client.4484.objecter _send_command 1 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 1 -- 10.20.193.45:0/2131907745 --> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f313000ee50 con 0x7f310c0818a0 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 20 client.4484.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 10 librados: watch_flush enter 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 10 librados: watch_flush exit 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 10 client.4407.objecter close_session for osd.13 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f28d4081810 msgr2=0x7f28d4083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f28d4081810 0x7f28d4083c50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 20 client.4407.objecter put_session s=0x7f28d4081140 osd=13 1 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 20 client.4407.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 10 client.4407.objecter successfully canceled tick 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 1 -- 10.20.193.45:0/2131907745 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f313005e100 con 0x7f3140156220 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f3126ffd640 10 monclient: handle_get_version_reply finishing 1 version 32 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f28d40792d0 msgr2=0x7f28d407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f28d40792d0 0x7f28d407b790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f28f4007fd0 tx=0x7f28f4007b20 comp rx=0 tx=0).stop 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 10 monclient: shutdown 2026-02-17T21:07:13.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2904155e40 msgr2=0x7f29040c7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 --2- 10.20.193.45:0/113668315 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2904155e40 0x7f29040c7a20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f28ec02f310 tx=0x7f28ec0047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f2909098640 1 -- 10.20.193.45:0/113668315 reap_dead start 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 shutdown_connections 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 >> 10.20.193.45:0/113668315 conn(0x7f29040ce270 msgr2=0x7f2904151b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 shutdown_connections 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 -- 10.20.193.45:0/113668315 wait complete. 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f290ab22640 1 librados: shutdown 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stdout:111669149704 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.011+0000 7f313dd74640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f310c0818a0 0x7f310c083ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.056 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T21:07:13.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.012+0000 7f313dd74640 10 monclient: get_auth_request con 0x7f310c0818a0 auth_method 0 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stdout:115964117001 2026-02-17T21:07:13.057 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 10 client.4462.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 15 client.4462.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 20 client.4462.objecter _get_session s=0x7fb0140811a0 osd=11 3 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 20 client.4462.objecter put_session s=0x7fb0140811a0 osd=11 3 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 20 client.4462.objecter _get_session s=0x7fb0140811a0 osd=11 3 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 15 client.4462.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 20 client.4462.objecter get_session s=0x7fb0140811a0 osd=11 3 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 15 client.4462.objecter _session_command_op_assign 11 2 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 20 client.4462.objecter put_session s=0x7fb0140811a0 osd=11 4 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 10 client.4462.objecter _send_command 2 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.013+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 --> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb0440c9cf0 con 0x7fb014081870 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 10 client.4419.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 15 client.4419.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 20 client.4419.objecter _get_session s=0x7fedc8081120 osd=8 3 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 20 client.4419.objecter put_session s=0x7fedc8081120 osd=8 3 2026-02-17T21:07:13.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 20 client.4419.objecter _get_session s=0x7fedc8081120 osd=8 3 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 15 client.4419.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 20 client.4419.objecter get_session s=0x7fedc8081120 osd=8 3 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 15 client.4419.objecter _session_command_op_assign 8 2 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 20 client.4419.objecter put_session s=0x7fedc8081120 osd=8 4 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 10 client.4419.objecter _send_command 2 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 --> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fedf80cd2a0 con 0x7fedc80817f0 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7f3126ffd640 10 client.4484.objecter ms_handle_connect 0x7f310c0818a0 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.014+0000 7f313dd74640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f310c0818a0 0x7f310c083ce0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5e7f7fe640 1 -- 10.20.193.45:0/2882298537 <== osd.5 v2:10.20.193.86:6824/63160539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5ea01e7380 con 0x7f5e6c081810 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5e7f7fe640 10 client.4478.objecter ms_dispatch2 0x7f5ea0000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5e7f7fe640 10 client.4478.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5e7f7fe640 20 client.4478.objecter put_session s=0x7f5e6c081140 osd=5 4 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5e7f7fe640 15 client.4478.objecter _session_command_op_remove 5 2 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 10 librados: watch_flush enter 2026-02-17T21:07:13.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 10 librados: watch_flush exit 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 10 client.4478.objecter close_session for osd.5 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f5e6c081810 msgr2=0x7f5e6c083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f5e6c081810 0x7f5e6c083c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 20 client.4478.objecter put_session s=0x7f5e6c081140 osd=5 1 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 20 client.4478.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 10 client.4478.objecter successfully canceled tick 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e6c0792d0 msgr2=0x7f5e6c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e6c0792d0 0x7f5e6c07b790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400a8d0 tx=0x7f5e94008040 comp rx=0 tx=0).stop 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 10 monclient: shutdown 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5ea0155e40 msgr2=0x7f5ea01f3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 --2- 10.20.193.45:0/2882298537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5ea0155e40 0x7f5ea01f3c00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800b5a0 tx=0x7f5e8800ba70 comp rx=0 tx=0).stop 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5e9f7fe640 1 -- 10.20.193.45:0/2882298537 reap_dead start 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 shutdown_connections 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 >> 10.20.193.45:0/2882298537 conn(0x7f5ea00ce270 msgr2=0x7f5ea00d0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 shutdown_connections 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 -- 10.20.193.45:0/2882298537 wait complete. 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.016+0000 7f5ea56d6640 1 librados: shutdown 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.017+0000 7feddeffd640 1 -- 10.20.193.45:0/3582336345 <== osd.8 v2:10.20.193.45:6810/442873512 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fedf80cd2a0 con 0x7fedc80817f0 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.017+0000 7feddeffd640 10 client.4419.objecter ms_dispatch2 0x7fedf8000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.017+0000 7feddeffd640 10 client.4419.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.017+0000 7feddeffd640 20 client.4419.objecter put_session s=0x7fedc8081120 osd=8 4 2026-02-17T21:07:13.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.017+0000 7feddeffd640 15 client.4419.objecter _session_command_op_remove 8 2 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.017+0000 7fee007c3640 10 librados: watch_flush enter 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 10 librados: watch_flush exit 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 10 client.4419.objecter close_session for osd.8 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7fedc80817f0 msgr2=0x7fedc8083c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7fedc80817f0 0x7fedc8083c30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 20 client.4419.objecter put_session s=0x7fedc8081120 osd=8 1 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 20 client.4419.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 10 client.4419.objecter successfully canceled tick 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fedc80792b0 msgr2=0x7fedc807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fedc80792b0 0x7fedc807b770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fedf8151300 tx=0x7fedec006cf0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 10 monclient: shutdown 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 msgr2=0x7fedf8154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 --2- 10.20.193.45:0/3582336345 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fedf80ccb80 0x7fedf8154e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fede800e7f0 tx=0x7fede800ecc0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fedfed39640 1 -- 10.20.193.45:0/3582336345 reap_dead start 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 shutdown_connections 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 >> 10.20.193.45:0/3582336345 conn(0x7fedf80ce270 msgr2=0x7fedf80ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 shutdown_connections 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 -- 10.20.193.45:0/3582336345 wait complete. 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.018+0000 7fee007c3640 1 librados: shutdown 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb0397fa640 1 -- 10.20.193.45:0/3288689683 <== osd.11 v2:10.20.193.138:6824/4038031379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb0440c9cf0 con 0x7fb014081870 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb0397fa640 10 client.4462.objecter ms_dispatch2 0x7fb044000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb0397fa640 10 client.4462.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb0397fa640 20 client.4462.objecter put_session s=0x7fb0140811a0 osd=11 4 2026-02-17T21:07:13.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb0397fa640 15 client.4462.objecter _session_command_op_remove 11 2 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 10 librados: watch_flush enter 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 10 librados: watch_flush exit 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 10 client.4462.objecter close_session for osd.11 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fb014081870 msgr2=0x7fb014083cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fb014081870 0x7fb014083cb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 20 client.4462.objecter put_session s=0x7fb0140811a0 osd=11 1 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 20 client.4462.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 10 client.4462.objecter successfully canceled tick 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb0140792d0 msgr2=0x7fb01407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb0140792d0 0x7fb01407b790 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb034004640 tx=0x7fb034009210 comp rx=0 tx=0).stop 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 10 monclient: shutdown 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb044155fe0 msgr2=0x7fb0441418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 --2- 10.20.193.45:0/3288689683 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb044155fe0 0x7fb0441418f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb04000be20 tx=0x7fb04000bf20 comp rx=0 tx=0).stop 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb049098640 1 -- 10.20.193.45:0/3288689683 reap_dead start 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 shutdown_connections 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 >> 10.20.193.45:0/3288689683 conn(0x7fb04406d930 msgr2=0x7fb044153800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 shutdown_connections 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 -- 10.20.193.45:0/3288689683 wait complete. 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.019+0000 7fb04ab22640 1 librados: shutdown 2026-02-17T21:07:13.061 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-17T21:07:13.062 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7efe75ffb640 1 -- 10.20.193.45:0/1211313781 <== osd.0 v2:10.20.193.45:6818/529906394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7efe58084320 con 0x7efe58081810 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7efe75ffb640 10 client.4465.objecter ms_dispatch2 0x7efe88000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7efe75ffb640 10 client.4465.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7efe75ffb640 20 client.4465.objecter put_session s=0x7efe58081140 osd=0 4 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7efe75ffb640 15 client.4465.objecter _session_command_op_remove 0 1 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stdout:111669149702 2026-02-17T21:07:13.062 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7f0e4affd640 1 -- 10.20.193.45:0/727614933 <== osd.10 v2:10.20.193.92:6824/1170783250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f0e5400ee50 con 0x7f0e30081870 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7f0e4affd640 10 client.4416.objecter ms_dispatch2 0x7f0e60000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7f0e4affd640 10 client.4416.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7f0e4affd640 20 client.4416.objecter put_session s=0x7f0e300811a0 osd=10 4 2026-02-17T21:07:13.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.024+0000 7f0e4affd640 15 client.4416.objecter _session_command_op_remove 10 1 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.025+0000 7f31f37fe640 1 -- 10.20.193.45:0/3517286018 <== osd.12 v2:10.20.193.45:6802/1807719437 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f3208024ec0 con 0x7f31e0081870 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.025+0000 7f31f37fe640 10 client.4472.objecter ms_dispatch2 0x7f3214000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.025+0000 7f31f37fe640 10 client.4472.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.025+0000 7f31f37fe640 20 client.4472.objecter put_session s=0x7f31e00811a0 osd=12 4 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.025+0000 7f31f37fe640 15 client.4472.objecter _session_command_op_remove 12 1 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-17T21:07:13.063 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 10 client.4465.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 15 client.4465.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 20 client.4465.objecter _get_session s=0x7efe58081140 osd=0 3 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 20 client.4465.objecter put_session s=0x7efe58081140 osd=0 3 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 20 client.4465.objecter _get_session s=0x7efe58081140 osd=0 3 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 15 client.4465.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 20 client.4465.objecter get_session s=0x7efe58081140 osd=0 3 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 15 client.4465.objecter _session_command_op_assign 0 2 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 20 client.4465.objecter put_session s=0x7efe58081140 osd=0 4 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 10 client.4465.objecter _send_command 2 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.030+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 --> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe881533b0 con 0x7efe58081810 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stdout:115964117001 2026-02-17T21:07:13.064 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 10 client.4416.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 15 client.4416.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 20 client.4416.objecter _get_session s=0x7f0e300811a0 osd=10 3 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 20 client.4416.objecter put_session s=0x7f0e300811a0 osd=10 3 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 20 client.4416.objecter _get_session s=0x7f0e300811a0 osd=10 3 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 15 client.4416.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 20 client.4416.objecter get_session s=0x7f0e300811a0 osd=10 3 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 15 client.4416.objecter _session_command_op_assign 10 2 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 20 client.4416.objecter put_session s=0x7f0e300811a0 osd=10 4 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 10 client.4416.objecter _send_command 2 2026-02-17T21:07:13.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.031+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 --> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e600c6750 con 0x7f0e30081870 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 10 client.4472.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 15 client.4472.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 20 client.4472.objecter _get_session s=0x7f31e00811a0 osd=12 3 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 20 client.4472.objecter put_session s=0x7f31e00811a0 osd=12 3 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 20 client.4472.objecter _get_session s=0x7f31e00811a0 osd=12 3 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 15 client.4472.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 20 client.4472.objecter get_session s=0x7f31e00811a0 osd=12 3 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 15 client.4472.objecter _session_command_op_assign 12 2 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 20 client.4472.objecter put_session s=0x7f31e00811a0 osd=12 4 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 10 client.4472.objecter _send_command 2 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.032+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 --> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3214159770 con 0x7f31e0081870 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e4affd640 1 -- 10.20.193.45:0/727614933 <== osd.10 v2:10.20.193.92:6824/1170783250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0e600c6750 con 0x7f0e30081870 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e4affd640 10 client.4416.objecter ms_dispatch2 0x7f0e60000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e4affd640 10 client.4416.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e4affd640 20 client.4416.objecter put_session s=0x7f0e300811a0 osd=10 4 2026-02-17T21:07:13.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e4affd640 15 client.4416.objecter _session_command_op_remove 10 2 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 10 librados: watch_flush enter 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 10 librados: watch_flush exit 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 10 client.4416.objecter close_session for osd.10 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7f0e30081870 msgr2=0x7f0e30083cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7f0e30081870 0x7f0e30083cb0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 20 client.4416.objecter put_session s=0x7f0e300811a0 osd=10 1 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 20 client.4416.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 10 client.4416.objecter successfully canceled tick 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0e300792d0 msgr2=0x7f0e3007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0e300792d0 0x7f0e3007b790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0e58039000 tx=0x7f0e58031000 comp rx=0 tx=0).stop 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 10 monclient: shutdown 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0e60156220 msgr2=0x7f0e600c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 --2- 10.20.193.45:0/727614933 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0e60156220 0x7f0e600c8af0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400b990 tx=0x7f0e5400be60 comp rx=0 tx=0).stop 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e66e60640 1 -- 10.20.193.45:0/727614933 reap_dead start 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 shutdown_connections 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 >> 10.20.193.45:0/727614933 conn(0x7f0e600ce270 msgr2=0x7f0e601500b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 shutdown_connections 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 -- 10.20.193.45:0/727614933 wait complete. 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.035+0000 7f0e688ea640 1 librados: shutdown 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.036+0000 7feb1dffb640 1 -- 10.20.193.45:0/3927662350 <== osd.2 v2:10.20.193.92:6800/281465485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7feb20018e50 con 0x7feb00081810 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.036+0000 7feb1dffb640 10 client.4487.objecter ms_dispatch2 0x7feb30000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.036+0000 7feb1dffb640 10 client.4487.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.036+0000 7feb1dffb640 20 client.4487.objecter put_session s=0x7feb00081140 osd=2 4 2026-02-17T21:07:13.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.036+0000 7feb1dffb640 15 client.4487.objecter _session_command_op_remove 2 1 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f31f37fe640 1 -- 10.20.193.45:0/3517286018 <== osd.12 v2:10.20.193.45:6802/1807719437 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3214159770 con 0x7f31e0081870 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f31f37fe640 10 client.4472.objecter ms_dispatch2 0x7f3214000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f31f37fe640 10 client.4472.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f31f37fe640 20 client.4472.objecter put_session s=0x7f31e00811a0 osd=12 4 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f31f37fe640 15 client.4472.objecter _session_command_op_remove 12 2 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 10 librados: watch_flush enter 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 10 librados: watch_flush exit 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 10 client.4472.objecter close_session for osd.12 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f31e0081870 msgr2=0x7f31e0083cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f31e0081870 0x7f31e0083cb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 20 client.4472.objecter put_session s=0x7f31e00811a0 osd=12 1 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 20 client.4472.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 10 client.4472.objecter successfully canceled tick 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe75ffb640 1 -- 10.20.193.45:0/1211313781 <== osd.0 v2:10.20.193.45:6818/529906394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efe881533b0 con 0x7efe58081810 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe75ffb640 10 client.4465.objecter ms_dispatch2 0x7efe88000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe75ffb640 10 client.4465.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe75ffb640 20 client.4465.objecter put_session s=0x7efe58081140 osd=0 4 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe75ffb640 15 client.4465.objecter _session_command_op_remove 0 2 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f31e00792d0 msgr2=0x7f31e007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f31e00792d0 0x7f31e007b790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f321408f310 tx=0x7f31fc031000 comp rx=0 tx=0).stop 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 10 monclient: shutdown 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3214074c90 msgr2=0x7f32140cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 --2- 10.20.193.45:0/3517286018 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3214074c90 0x7f32140cf9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f320800c4e0 tx=0x7f320800c9b0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f3213577640 1 -- 10.20.193.45:0/3517286018 reap_dead start 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 shutdown_connections 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 >> 10.20.193.45:0/3517286018 conn(0x7f32140ce270 msgr2=0x7f32140cc070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 shutdown_connections 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 -- 10.20.193.45:0/3517286018 wait complete. 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7f321916a640 1 librados: shutdown 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 10 librados: watch_flush enter 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 10 librados: watch_flush exit 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 10 client.4465.objecter close_session for osd.0 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7efe58081810 msgr2=0x7efe58083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7efe58081810 0x7efe58083c50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 20 client.4465.objecter put_session s=0x7efe58081140 osd=0 1 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 20 client.4465.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 10 client.4465.objecter successfully canceled tick 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efe580792d0 msgr2=0x7efe5807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efe580792d0 0x7efe5807b790 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe7c039000 tx=0x7efe7c033000 comp rx=0 tx=0).stop 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 10 monclient: shutdown 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efe880c98b0 msgr2=0x7efe881f4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 --2- 10.20.193.45:0/1211313781 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efe880c98b0 0x7efe881f4610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe7800b570 tx=0x7efe7800ba40 comp rx=0 tx=0).stop 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8de7e640 1 -- 10.20.193.45:0/1211313781 reap_dead start 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 shutdown_connections 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 >> 10.20.193.45:0/1211313781 conn(0x7efe8806d930 msgr2=0x7efe8814bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 shutdown_connections 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 -- 10.20.193.45:0/1211313781 wait complete. 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.039+0000 7efe8f908640 1 librados: shutdown 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stdout:103079215109 2026-02-17T21:07:13.069 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 10 client.4487.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 15 client.4487.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 20 client.4487.objecter _get_session s=0x7feb00081140 osd=2 3 2026-02-17T21:07:13.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 20 client.4487.objecter put_session s=0x7feb00081140 osd=2 3 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 20 client.4487.objecter _get_session s=0x7feb00081140 osd=2 3 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 15 client.4487.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 20 client.4487.objecter get_session s=0x7feb00081140 osd=2 3 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 15 client.4487.objecter _session_command_op_assign 2 2 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 20 client.4487.objecter put_session s=0x7feb00081140 osd=2 4 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 10 client.4487.objecter _send_command 2 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.043+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 --> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb30159770 con 0x7feb00081810 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.045+0000 7f3126ffd640 1 -- 10.20.193.45:0/2131907745 <== osd.15 v2:10.20.193.138:6816/3769626240 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f313000ee50 con 0x7f310c0818a0 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.045+0000 7f3126ffd640 10 client.4484.objecter ms_dispatch2 0x7f3140000b90 command_reply(tid 1: 0 ) 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.045+0000 7f3126ffd640 10 client.4484.objecter _finish_command 1 = system:0 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.045+0000 7f3126ffd640 20 client.4484.objecter put_session s=0x7f310c0811d0 osd=15 4 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.045+0000 7f3126ffd640 15 client.4484.objecter _session_command_op_remove 15 1 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stdout:111669149703 2026-02-17T21:07:13.070 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb1dffb640 1 -- 10.20.193.45:0/3927662350 <== osd.2 v2:10.20.193.92:6800/281465485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7feb30159770 con 0x7feb00081810 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb1dffb640 10 client.4487.objecter ms_dispatch2 0x7feb30000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb1dffb640 10 client.4487.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb1dffb640 20 client.4487.objecter put_session s=0x7feb00081140 osd=2 4 2026-02-17T21:07:13.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb1dffb640 15 client.4487.objecter _session_command_op_remove 2 2 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 10 librados: watch_flush enter 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 10 librados: watch_flush exit 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 10 client.4487.objecter close_session for osd.2 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7feb00081810 msgr2=0x7feb00083c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7feb00081810 0x7feb00083c50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 20 client.4487.objecter put_session s=0x7feb00081140 osd=2 1 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 20 client.4487.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 10 client.4487.objecter successfully canceled tick 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feb000792d0 msgr2=0x7feb0007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feb000792d0 0x7feb0007b790 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb24007fd0 tx=0x7feb24007b20 comp rx=0 tx=0).stop 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 10 monclient: shutdown 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30074c90 msgr2=0x7feb301488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 --2- 10.20.193.45:0/3927662350 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb30074c90 0x7feb301488e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feb2000b5a0 tx=0x7feb2000ba70 comp rx=0 tx=0).stop 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb35ad1640 1 -- 10.20.193.45:0/3927662350 reap_dead start 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 shutdown_connections 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 >> 10.20.193.45:0/3927662350 conn(0x7feb300ce270 msgr2=0x7feb30154470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.071 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-17T21:07:13.072 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 shutdown_connections 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 -- 10.20.193.45:0/3927662350 wait complete. 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.049+0000 7feb3755b640 1 librados: shutdown 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 10 client.4484.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 15 client.4484.objecter _session_command_op_assign -1 2 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 20 client.4484.objecter _get_session s=0x7f310c0811d0 osd=15 3 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 20 client.4484.objecter put_session s=0x7f310c0811d0 osd=15 3 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 20 client.4484.objecter _get_session s=0x7f310c0811d0 osd=15 3 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 15 client.4484.objecter _session_command_op_remove -1 2 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 20 client.4484.objecter get_session s=0x7f310c0811d0 osd=15 3 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 15 client.4484.objecter _session_command_op_assign 15 2 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 20 client.4484.objecter put_session s=0x7f310c0811d0 osd=15 4 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 10 client.4484.objecter _send_command 2 2026-02-17T21:07:13.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.052+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 --> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3140159770 con 0x7f310c0818a0 2026-02-17T21:07:13.073 INFO:teuthology.orchestra.run.trial045.stdout:115964117002 2026-02-17T21:07:13.073 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T21:07:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3126ffd640 1 -- 10.20.193.45:0/2131907745 <== osd.15 v2:10.20.193.138:6816/3769626240 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3140159770 con 0x7f310c0818a0 2026-02-17T21:07:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3126ffd640 10 client.4484.objecter ms_dispatch2 0x7f3140000b90 command_reply(tid 2: 0 ) 2026-02-17T21:07:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3126ffd640 10 client.4484.objecter _finish_command 2 = system:0 2026-02-17T21:07:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3126ffd640 20 client.4484.objecter put_session s=0x7f310c0811d0 osd=15 4 2026-02-17T21:07:13.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3126ffd640 15 client.4484.objecter _session_command_op_remove 15 2 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 10 librados: watch_flush enter 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 10 librados: watch_flush exit 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 10 client.4484.objecter close_session for osd.15 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f310c0818a0 msgr2=0x7f310c083ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f310c0818a0 0x7f310c083ce0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 20 client.4484.objecter put_session s=0x7f310c0811d0 osd=15 1 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 20 client.4484.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 10 client.4484.objecter successfully canceled tick 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f310c079300 msgr2=0x7f310c07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f310c079300 0x7f310c07b7c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f314008f5a0 tx=0x7f3134031000 comp rx=0 tx=0).stop 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 10 monclient: shutdown 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3140156220 msgr2=0x7f31400ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 --2- 10.20.193.45:0/2131907745 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3140156220 0x7f31400ca3a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f313000b970 tx=0x7f313000be40 comp rx=0 tx=0).stop 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f313ed76640 1 -- 10.20.193.45:0/2131907745 reap_dead start 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 shutdown_connections 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 >> 10.20.193.45:0/2131907745 conn(0x7f31400ce270 msgr2=0x7f31400cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 shutdown_connections 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 -- 10.20.193.45:0/2131907745 wait complete. 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.058+0000 7f3144c56640 1 librados: shutdown 2026-02-17T21:07:13.074 INFO:teuthology.orchestra.run.trial045.stdout:115964117001 2026-02-17T21:07:13.074 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.162+0000 7fc90dfce640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.162+0000 7fc90dfce640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.162+0000 7fc90dfce640 10 monclient: monmap: 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.162941+0000 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.162941+0000 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.154 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.162+0000 7fc90dfce640 1 Processor -- start 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.162+0000 7fc90dfce640 1 -- start start 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.162+0000 7fc90dfce640 10 monclient: init 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.162+0000 7fd65305e640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.162+0000 7fd65305e640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.162+0000 7fd65305e640 10 monclient: monmap: 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.163712+0000 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.163712+0000 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 10 monclient: _add_conns ranks=[1,3,0,5,2,4] 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc908152620 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc90815b0b0 0x7fc9080c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 10 monclient(hunting): picked mon.noname-a con 0x7fc90815b0b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc908152a00 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9080c7230 con 0x7fc908152a00 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9080c7510 con 0x7fc908152620 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fc908159ec0 con 0x7fc90815b0b0 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc90dfce640 10 monclient(hunting): authenticate will time out at 1016.793365s 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fd65305e640 1 Processor -- start 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fd65305e640 1 -- start start 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fd65305e640 10 monclient: init 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fa83300e640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fa83300e640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fa83300e640 10 monclient: monmap: 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.164629+0000 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.164629+0000 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.156 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc9077fe640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fc908152620 0x7fc90815a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52788/0 (socket says 10.20.193.45:52788) 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc9077fe640 1 -- 10.20.193.45:0/729133750 learned_addr learned my addr 10.20.193.45:0/729133750 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7fc906ffd640 1 --2- 10.20.193.45:0/729133750 >> v2:10.20.193.45:3300/0 conn(0x7fc90815b0b0 0x7fc9080c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7f0f9e361640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.163+0000 7f0f9e361640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7f0f9e361640 10 monclient: monmap: 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.164865+0000 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.164865+0000 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fa83300e640 1 Processor -- start 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fa83300e640 1 -- start start 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fa83300e640 10 monclient: init 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 10 monclient: _add_conns ranks=[2,0,3,4,5,1] 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fc906ffd640 10 monclient(hunting): get_auth_request con 0x7fc90815b0b0 auth_method 0 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fc906ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fc906ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fc906ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fd64c15f580 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd64c0c97b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fd64c15e2b0 0x7fd64c155760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 10 monclient(hunting): picked mon.noname-a con 0x7fd64c15e2b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd64c0c9ce0 con 0x7fd64c0c97b0 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd64c0c9fc0 con 0x7fd64c15f580 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fd64c0ca2a0 con 0x7fd64c15e2b0 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fd65305e640 10 monclient(hunting): authenticate will time out at 1016.794512s 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7f0f9e361640 1 Processor -- start 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7f0f9e361640 1 -- start start 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7f0f9e361640 10 monclient: init 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7f3b25e45640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7f3b25e45640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7f3b25e45640 10 monclient: monmap: 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.158 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.165570+0000 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.165570+0000 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fa83300e640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.164+0000 7fa83300e640 10 monclient: _add_conns ranks=[2,0,4,1,5,3] 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa82c155e40 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fd650dd3640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7fd64c15f580 0x7fd64c15f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47592/0 (socket says 10.20.193.45:47592) 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa82c074c90 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fd650dd3640 1 -- 10.20.193.45:0/1561444335 learned_addr learned my addr 10.20.193.45:0/1561444335 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa82c156220 0x7fa82c1666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 10 monclient(hunting): picked mon.noname-b con 0x7fa82c156220 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:13.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c0734e0 con 0x7fa82c074c90 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fc906ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fc906ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c0737c0 con 0x7fa82c155e40 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fc906ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c0cd800 con 0x7fa82c156220 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa83300e640 10 monclient(hunting): authenticate will time out at 1016.795228s 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fc9067fc640 1 -- 10.20.193.45:0/729133750 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972622640 0 0) 0x7fc9080c7510 con 0x7fc908152620 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fc9067fc640 10 monclient(hunting): _negotiate 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fc9067fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fc9067fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fc9067fc640 10 monclient(hunting): my global_id is 4468 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fc9067fc640 1 -- 10.20.193.45:0/729133750 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8ec003620 con 0x7fc908152620 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f3b25e45640 1 Processor -- start 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f3b25e45640 1 -- start start 2026-02-17T21:07:13.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f3b25e45640 10 monclient: init 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa831584640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa82c156220 0x7fa82c1666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 10 monclient: _add_conns ranks=[1,5,3,4,0,2] 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0f98155df0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0f981561d0 0x7f0f9815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 10 monclient(hunting): picked mon.noname-c con 0x7f0f981561d0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0f9815c330 0x7f0f9815e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 10 monclient(hunting): picked mon.noname-a con 0x7f0f9815c330 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9815d310 con 0x7f0f98155df0 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0f980c8950 con 0x7f0f9815c330 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0f9815c7a0 con 0x7f0f981561d0 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7f0f9e361640 10 monclient(hunting): authenticate will time out at 1016.795773s 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa831584640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa82c156220 0x7fa82c1666d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57474/0 (socket says 10.20.193.45:57474) 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa831584640 1 -- 10.20.193.45:0/1070725628 learned_addr learned my addr 10.20.193.45:0/1070725628 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa831584640 10 monclient(hunting): get_auth_request con 0x7fa82c156220 auth_method 0 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa831584640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa831584640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.165+0000 7fa831584640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 10 monclient: _add_conns ranks=[0,1,5,2,4,3] 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3b2015f530 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3b2015a630 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3b201560d0 0x7f3b2015f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 10 monclient(hunting): picked mon.noname-c con 0x7f3b201560d0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b2015e130 con 0x7f3b2015f530 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b2015e410 con 0x7f3b2015a630 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3b2015e6f0 con 0x7f3b201560d0 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7f3b25e45640 10 monclient(hunting): authenticate will time out at 1016.796131s 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7fd6437fe640 1 -- 10.20.193.45:0/1561444335 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648570094 0 0) 0x7fd64c0c9fc0 con 0x7fd64c15f580 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7fd6437fe640 10 monclient(hunting): _negotiate 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7fd6437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7fd6437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7fd6437fe640 10 monclient(hunting): my global_id is 4493 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.166+0000 7fd6437fe640 1 -- 10.20.193.45:0/1561444335 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd638003620 con 0x7fd64c15f580 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fc906ffd640 10 monclient(hunting): handle_auth_done global_id 4425 payload 274 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fc906ffd640 1 -- 10.20.193.45:0/729133750 >> v1:10.20.193.86:6789/0 conn(0x7fc908152620 legacy=0x7fc90815a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fc906ffd640 1 -- 10.20.193.45:0/729133750 >> v1:10.20.193.45:6789/0 conn(0x7fc908152a00 legacy=0x7fc9080c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fc906ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fc906ffd640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fc906ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fc906ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fc906ffd640 1 -- 10.20.193.45:0/729133750 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90815a1a0 con 0x7fc90815b0b0 2026-02-17T21:07:13.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7f0f977fe640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0f981561d0 0x7f0f9815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fa831584640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fa831584640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7fa831584640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7f1d5820e640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7f1d5820e640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.167+0000 7f1d5820e640 10 monclient: monmap: 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.168796+0000 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.168796+0000 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f04a0074640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f04a0074640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f04a0074640 10 monclient: monmap: 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.169048+0000 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.169048+0000 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.163 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f1d5820e640 1 Processor -- start 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f1d5820e640 1 -- start start 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f1d5820e640 10 monclient: init 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f0f97fff640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f0f98155df0 0x7f0f98068e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52794/0 (socket says 10.20.193.45:52794) 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f0f97fff640 1 -- 10.20.193.45:0/4131687781 learned_addr learned my addr 10.20.193.45:0/4131687781 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f04a0074640 1 Processor -- start 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f04a0074640 1 -- start start 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.168+0000 7f04a0074640 10 monclient: init 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f3b1ffff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3b201560d0 0x7f3b2015f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 10 monclient: _add_conns ranks=[5,1,4,2,3,0] 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f1d50155bd0 0x7f1d500cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 10 monclient(hunting): picked mon.noname-c con 0x7f1d50155bd0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1d500c9590 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f1d50155fb0 0x7f1d5015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 10 monclient(hunting): picked mon.noname-b con 0x7f1d50155fb0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d500c9a10 con 0x7f1d500c9590 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1d500c9cf0 con 0x7f1d50155fb0 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f1d500c9fd0 con 0x7f1d50155bd0 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f1d5820e640 10 monclient(hunting): authenticate will time out at 1016.799248s 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7fc906ffd640 1 --2- 10.20.193.45:0/729133750 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc90815b0b0 0x7fc9080c8d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80098a0 tx=0x7fc8f802ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884ea54da554c843 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f3b1effd640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f3b2015a630 0x7f3b201559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52810/0 (socket says 10.20.193.45:52810) 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f3b1effd640 1 -- 10.20.193.45:0/939001909 learned_addr learned my addr 10.20.193.45:0/939001909 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7fa831584640 10 monclient(hunting): handle_auth_done global_id 4471 payload 274 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7fa831584640 1 -- 10.20.193.45:0/1070725628 >> v1:10.20.193.92:6789/0 conn(0x7fa82c155e40 legacy=0x7fa82c074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7fa831584640 1 -- 10.20.193.45:0/1070725628 >> v1:10.20.193.45:6789/0 conn(0x7fa82c074c90 legacy=0x7fa82c0ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7fa831584640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7fa831584640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7fa831584640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7fa831584640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7fa831584640 1 -- 10.20.193.45:0/1070725628 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c073aa0 con 0x7fa82c156220 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f0f977fe640 10 monclient(hunting): get_auth_request con 0x7f0f981561d0 auth_method 0 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f0f977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f0f977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f0f977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f04a0074640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f04a0074640 10 monclient: _add_conns ranks=[3,2,0,4,5,1] 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f04a0074640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0498155fe0 0x7f04980cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f04a0074640 10 monclient(hunting): picked mon.noname-a con 0x7f0498155fe0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.169+0000 7f04a0074640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f04980c98b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f04a0074640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f04980c9cf0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f04a0074640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04980c8b60 con 0x7f04980c9cf0 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f04a0074640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f049815cbb0 con 0x7f04980c98b0 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f04a0074640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f04a0074640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f04980c9420 con 0x7f0498155fe0 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f04a0074640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f04a0074640 10 monclient(hunting): authenticate will time out at 1016.800089s 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f3b1ffff640 10 monclient(hunting): get_auth_request con 0x7f3b201560d0 auth_method 0 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f3b1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f3b1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f3b1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7fd6515d4640 1 --2- 10.20.193.45:0/1561444335 >> v2:10.20.193.45:3300/0 conn(0x7fd64c15e2b0 0x7fd64c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7fd6515d4640 10 monclient(hunting): get_auth_request con 0x7fd64c15e2b0 auth_method 0 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7fd6515d4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7fd6515d4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7fd6515d4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f0f977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f0f977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.170+0000 7f0f977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7fd6515d4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7fd6515d4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7fd6515d4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7fa831584640 1 --2- 10.20.193.45:0/1070725628 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c156220 0x7fa82c1666d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa828009e50 tx=0x7fa82802f2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea3e64dc23a97e01 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f0f977fe640 10 monclient(hunting): handle_auth_done global_id 4499 payload 274 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f0f977fe640 1 -- 10.20.193.45:0/4131687781 >> v2:10.20.193.45:3300/0 conn(0x7f0f9815c330 msgr2=0x7f0f9815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f0f977fe640 1 --2- 10.20.193.45:0/4131687781 >> v2:10.20.193.45:3300/0 conn(0x7f0f9815c330 0x7f0f9815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f0f977fe640 1 -- 10.20.193.45:0/4131687781 >> v1:10.20.193.86:6789/0 conn(0x7f0f98155df0 legacy=0x7f0f98068e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f0f977fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f0f977fe640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f0f977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f0f977fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f0f977fe640 1 -- 10.20.193.45:0/4131687781 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f98075030 con 0x7f0f981561d0 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f3b1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f3b1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.171+0000 7f3b1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.172+0000 7fd6515d4640 10 monclient(hunting): handle_auth_done global_id 4428 payload 274 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.172+0000 7fd6515d4640 1 -- 10.20.193.45:0/1561444335 >> v1:10.20.193.92:6789/0 conn(0x7fd64c15f580 legacy=0x7fd64c15f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.172+0000 7fd6515d4640 1 -- 10.20.193.45:0/1561444335 >> v1:10.20.193.45:6789/0 conn(0x7fd64c0c97b0 legacy=0x7fd64c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.172+0000 7fd6515d4640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.172+0000 7fd6515d4640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.172+0000 7fd6515d4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.172+0000 7fd6515d4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.172+0000 7fd6515d4640 1 -- 10.20.193.45:0/1561444335 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c15d3c0 con 0x7fd64c15e2b0 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7ff374b01640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7ff374b01640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7ff374b01640 10 monclient: monmap: 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.174039+0000 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.174039+0000 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7f3b1ffff640 10 monclient(hunting): handle_auth_done global_id 4502 payload 274 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7f3b1ffff640 1 -- 10.20.193.45:0/939001909 >> v1:10.20.193.86:6789/0 conn(0x7f3b2015a630 legacy=0x7f3b201559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7f3b1ffff640 1 -- 10.20.193.45:0/939001909 >> v1:10.20.193.45:6789/0 conn(0x7f3b2015f530 legacy=0x7f3b20159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7f3b1ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7f3b1ffff640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7f3b1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7f3b1ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7f3b1ffff640 1 -- 10.20.193.45:0/939001909 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2015e9d0 con 0x7f3b201560d0 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7ff374b01640 1 Processor -- start 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7ff374b01640 1 -- start start 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7ff374b01640 10 monclient: init 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.173+0000 7fd6515d4640 1 --2- 10.20.193.45:0/1561444335 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd64c15e2b0 0x7fd64c155760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd648009d90 tx=0x7fd64802f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b69f2c643dcf41 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f46840bd640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 10 monclient: _add_conns ranks=[3,5,2,0,1,4] 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f46840bd640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff370155e40 0x7ff370074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 10 monclient(hunting): picked mon.noname-a con 0x7ff370155e40 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f46840bd640 10 monclient: monmap: 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.169 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.175053+0000 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.175053+0000 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff370156220 0x7ff370074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 10 monclient(hunting): picked mon.noname-c con 0x7ff370156220 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff3700ccb80 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3700734e0 con 0x7ff3700ccb80 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7ff3700cd800 con 0x7ff370155e40 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff3700737c0 con 0x7ff370156220 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7ff374b01640 10 monclient(hunting): authenticate will time out at 1016.804447s 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f1d56784640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f1d50155fb0 0x7f1d5015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f1d55782640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f1d500c9590 0x7f1d5015d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52818/0 (socket says 10.20.193.45:52818) 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f1d55782640 1 -- 10.20.193.45:0/4115892326 learned_addr learned my addr 10.20.193.45:0/4115892326 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:13.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f049e5ea640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f04980c9cf0 0x7f04980ce170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46166/0 (socket says 10.20.193.45:46166) 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f049e5ea640 1 -- 10.20.193.45:0/3642241025 learned_addr learned my addr 10.20.193.45:0/3642241025 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f1d55f83640 1 --2- 10.20.193.45:0/4115892326 >> v2:10.20.193.92:3300/0 conn(0x7f1d50155bd0 0x7f1d500cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f46840bd640 1 Processor -- start 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f46840bd640 1 -- start start 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f46840bd640 10 monclient: init 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f1d56784640 10 monclient(hunting): get_auth_request con 0x7f1d50155fb0 auth_method 0 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f1d56784640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f1d56784640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.174+0000 7f1d56784640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 1 -- 10.20.193.45:0/1070725628 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82802fd70 con 0x7fa82c156220 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 10 monclient: dump: 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 1 -- 10.20.193.45:0/1070725628 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8280373f0 con 0x7fa82c156220 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 1 -- 10.20.193.45:0/1070725628 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828037800 con 0x7fa82c156220 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa8237fe640 10 monclient: dump: 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 5 monclient: authenticate success, global_id 4471 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 4 set_mon_vals no callback set 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f0f977fe640 1 --2- 10.20.193.45:0/4131687781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f981561d0 0x7f0f9815bdf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f980c1f90 tx=0x7f0f8802edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12441c69a23a8762 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f3b1ffff640 1 --2- 10.20.193.45:0/939001909 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b201560d0 0x7f3b2015f910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009d90 tx=0x7f3b1402f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71cdf41c4974e2b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f1d55f83640 10 monclient(hunting): get_auth_request con 0x7f1d50155bd0 auth_method 0 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f1d55f83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f1d55f83640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f1d55f83640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 10 monclient: _add_conns ranks=[3,0,4,1,2,5] 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f467c155fe0 0x7f467c0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 10 monclient(hunting): picked mon.noname-a con 0x7f467c155fe0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f467c0c98b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f467c0c9cf0 0x7f467c0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 10 monclient(hunting): picked mon.noname-b con 0x7f467c0c9cf0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f467c0c8b60 con 0x7f467c0c98b0 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f467c0c9420 con 0x7f467c155fe0 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f467c15cbb0 con 0x7f467c0c9cf0 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f46840bd640 10 monclient(hunting): authenticate will time out at 1016.805712s 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 10 monclient: shutdown 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 1 -- 10.20.193.45:0/1070725628 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c156220 msgr2=0x7fa82c1666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 1 --2- 10.20.193.45:0/1070725628 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c156220 0x7fa82c1666d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa828009e50 tx=0x7fa82802f2c0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 1 -- 10.20.193.45:0/1070725628 shutdown_connections 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 1 --2- 10.20.193.45:0/1070725628 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c156220 0x7fa82c1666d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 1 -- 10.20.193.45:0/1070725628 >> 10.20.193.45:0/1070725628 conn(0x7fa82c0ce270 msgr2=0x7fa82c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f1d56784640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f1d56784640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7f1d56784640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.175+0000 7fa83300e640 1 -- 10.20.193.45:0/1070725628 shutdown_connections 2026-02-17T21:07:13.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fa83300e640 1 -- 10.20.193.45:0/1070725628 wait complete. 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7f1d55f83640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7f1d55f83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7f1d55f83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fa83300e640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fa83300e640 10 monclient: monmap: 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fa83300e640 1 librados: starting msgr at 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fa83300e640 1 librados: starting objecter 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fe17d415640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fe17d415640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fe17d415640 10 monclient: monmap: 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.177661+0000 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.177661+0000 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.174 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fa83300e640 1 Processor -- start 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fa83300e640 1 -- start start 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fa83300e640 1 librados: setting wanted keys 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.176+0000 7fa83300e640 1 librados: calling monclient init 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient: init 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f1d56784640 10 monclient(hunting): handle_auth_done global_id 4480 payload 274 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f1d56784640 1 -- 10.20.193.45:0/4115892326 >> v2:10.20.193.92:3300/0 conn(0x7f1d50155bd0 msgr2=0x7f1d500cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f1d56784640 1 --2- 10.20.193.45:0/4115892326 >> v2:10.20.193.92:3300/0 conn(0x7f1d50155bd0 0x7f1d500cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f1d56784640 1 -- 10.20.193.45:0/4115892326 >> v1:10.20.193.86:6789/0 conn(0x7f1d500c9590 legacy=0x7f1d5015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f1d56784640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f1d56784640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 1 Processor -- start 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f1d56784640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f1d56784640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f1d56784640 1 -- 10.20.193.45:0/4115892326 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5015d100 con 0x7f1d50155fb0 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 1 -- start start 2026-02-17T21:07:13.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 10 monclient: init 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa82c074c90 0x7fa82c1f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient(hunting): picked mon.noname-c con 0x7fa82c074c90 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c155e40 0x7fa82c1e9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient(hunting): picked mon.noname-b con 0x7fa82c155e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa82c156220 0x7fa82c144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient(hunting): picked mon.noname-a con 0x7fa82c156220 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c0c4830 con 0x7fa82c156220 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c074060 con 0x7fa82c155e40 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f4c6eab0640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f4c6eab0640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f4c6eab0640 10 monclient: monmap: 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.178462+0000 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.178462+0000 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c0c49b0 con 0x7fa82c074c90 2026-02-17T21:07:13.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7f4682633640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f467c0c9cf0 0x7f467c0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fa83300e640 10 monclient(hunting): authenticate will time out at 1016.807756s 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 10 monclient: _add_conns ranks=[0,3,2,5,1,4] 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe178152620 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe17815aff0 0x7fe1780c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 10 monclient(hunting): picked mon.noname-a con 0x7fe17815aff0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe178152a00 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1780c71a0 con 0x7fe178152620 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1780c7480 con 0x7fe178152a00 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe1780c7760 con 0x7fe17815aff0 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.177+0000 7fe17d415640 10 monclient(hunting): authenticate will time out at 1016.807995s 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 1 Processor -- start 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 1 -- start start 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 10 monclient: init 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 10 monclient: _add_conns ranks=[2,0,4,5,1,3] 2026-02-17T21:07:13.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4c68155e40 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4c68074c90 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f4c68156220 0x7f4c681666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f1d56784640 1 --2- 10.20.193.45:0/4115892326 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1d50155fb0 0x7f1d5015f0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1d500cbda0 tx=0x7f1d4c02f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a374128ba50d73ad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 10 monclient(hunting): picked mon.noname-b con 0x7f4c68156220 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c680734e0 con 0x7f4c68074c90 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c680737c0 con 0x7f4c68155e40 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f4c680cd800 con 0x7f4c68156220 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4c6eab0640 10 monclient(hunting): authenticate will time out at 1016.808880s 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4682633640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f467c0c9cf0 0x7f467c0ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57496/0 (socket says 10.20.193.45:57496) 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4682633640 1 -- 10.20.193.45:0/40719897 learned_addr learned my addr 10.20.193.45:0/40719897 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4682633640 10 monclient(hunting): get_auth_request con 0x7f467c0c9cf0 auth_method 0 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4682633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4682633640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.178+0000 7f4682633640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7f4682633640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7f4682633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7f4682633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7ff36e575640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff370155e40 0x7ff370074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7f049dde9640 1 --2- 10.20.193.45:0/3642241025 >> v2:10.20.193.45:3300/0 conn(0x7f0498155fe0 0x7f04980cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7ff36e575640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff370155e40 0x7ff370074580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41836/0 (socket says 10.20.193.45:41836) 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7ff36e575640 1 -- 10.20.193.45:0/4291874125 learned_addr learned my addr 10.20.193.45:0/4291874125 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7ff36e575640 10 monclient(hunting): get_auth_request con 0x7ff370155e40 auth_method 0 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7ff36e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7ff36e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7ff36e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7fddd3688640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7fddd3688640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.179+0000 7fddd3688640 10 monclient: monmap: 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.180373+0000 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.180373+0000 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f049dde9640 10 monclient(hunting): get_auth_request con 0x7f0498155fe0 auth_method 0 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f049dde9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f049dde9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f049dde9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fddd3688640 1 Processor -- start 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f4682633640 10 monclient(hunting): handle_auth_done global_id 4486 payload 274 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f4682633640 1 -- 10.20.193.45:0/40719897 >> v2:10.20.193.45:3300/0 conn(0x7f467c155fe0 msgr2=0x7f467c0cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f4682633640 1 --2- 10.20.193.45:0/40719897 >> v2:10.20.193.45:3300/0 conn(0x7f467c155fe0 0x7f467c0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f4682633640 1 -- 10.20.193.45:0/40719897 >> v1:10.20.193.45:6789/0 conn(0x7f467c0c98b0 legacy=0x7f467c0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f4682633640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f4682633640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f4682633640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f4682633640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f4682633640 1 -- 10.20.193.45:0/40719897 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c0d2250 con 0x7f467c0c9cf0 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fddd3688640 1 -- start start 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fddd3688640 10 monclient: init 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f32f183c640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f32f183c640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f32f183c640 10 monclient: monmap: 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.181327+0000 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.181327+0000 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 1 -- 10.20.193.45:0/939001909 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1403c070 con 0x7f3b201560d0 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 1 -- 10.20.193.45:0/1561444335 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64803c070 con 0x7fd64c15e2b0 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 10 monclient: dump: 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 1 -- 10.20.193.45:0/1561444335 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd648037440 con 0x7fd64c15e2b0 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 10 monclient: dump: 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.181 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 1 -- 10.20.193.45:0/939001909 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b14037440 con 0x7f3b201560d0 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 1 -- 10.20.193.45:0/939001909 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14037810 con 0x7f3b201560d0 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd65305e640 5 monclient: authenticate success, global_id 4428 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd65305e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd65305e640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd65305e640 4 set_mon_vals no callback set 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 1 -- 10.20.193.45:0/1561444335 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648037810 con 0x7fd64c15e2b0 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b25e45640 5 monclient: authenticate success, global_id 4502 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b25e45640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b25e45640 4 set_mon_vals no callback set 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7f3b1e7fc640 10 monclient: dump: 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fd6437fe640 10 monclient: dump: 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.182 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fddd3688640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fddd3688640 10 monclient: _add_conns ranks=[5,3,4,2,1,0] 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.180+0000 7fddd3688640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fddcc155e40 0x7fddcc074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 10 monclient(hunting): picked mon.noname-c con 0x7fddcc155e40 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fddcc156220 0x7fddcc074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 10 monclient(hunting): picked mon.noname-a con 0x7fddcc156220 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fddcc0ccb80 0x7fddcc0ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 10 monclient(hunting): picked mon.noname-b con 0x7fddcc0ccb80 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fddcc0cd800 con 0x7fddcc156220 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fddcc0734e0 con 0x7fddcc0ccb80 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fddcc0737c0 con 0x7fddcc155e40 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fddd3688640 10 monclient(hunting): authenticate will time out at 1016.811058s 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 1 Processor -- start 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fd65305e640 10 monclient: shutdown 2026-02-17T21:07:13.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fd65305e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fd65305e640 1 -- 10.20.193.45:0/1561444335 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd64c15e2b0 msgr2=0x7fd64c155760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fd65305e640 1 --2- 10.20.193.45:0/1561444335 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd64c15e2b0 0x7fd64c155760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd648009d90 tx=0x7fd64802f270 comp rx=0 tx=0).stop 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f9510101640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f9510101640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f9510101640 10 monclient: monmap: 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.182045+0000 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.182045+0000 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f3b25e45640 10 monclient: shutdown 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f3b25e45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f3b25e45640 1 -- 10.20.193.45:0/939001909 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b201560d0 msgr2=0x7f3b2015f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f3b25e45640 1 --2- 10.20.193.45:0/939001909 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b201560d0 0x7f3b2015f910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009d90 tx=0x7f3b1402f1e0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fd65305e640 1 -- 10.20.193.45:0/1561444335 shutdown_connections 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fd65305e640 1 --2- 10.20.193.45:0/1561444335 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd64c15e2b0 0x7fd64c155760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fd65305e640 1 -- 10.20.193.45:0/1561444335 >> 10.20.193.45:0/1561444335 conn(0x7fd64c073030 msgr2=0x7fd64c073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f3b25e45640 1 -- 10.20.193.45:0/939001909 shutdown_connections 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f3b25e45640 1 --2- 10.20.193.45:0/939001909 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b201560d0 0x7f3b2015f910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f3b25e45640 1 -- 10.20.193.45:0/939001909 >> 10.20.193.45:0/939001909 conn(0x7f3b200cf510 msgr2=0x7f3b200cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 1 -- start start 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient: init 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f3b25e45640 1 -- 10.20.193.45:0/939001909 shutdown_connections 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f3b25e45640 1 -- 10.20.193.45:0/939001909 wait complete. 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fd65305e640 1 -- 10.20.193.45:0/1561444335 shutdown_connections 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7fd65305e640 1 -- 10.20.193.45:0/1561444335 wait complete. 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient: _add_conns ranks=[5,4,1,0,3,2] 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f32ec15a4b0 0x7f32ec0d1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient(hunting): picked mon.noname-c con 0x7f32ec15a4b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f32ec0d1e50 0x7f32ec0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient(hunting): picked mon.noname-b con 0x7f32ec0d1e50 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f32ec0c90a0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ec0d22c0 con 0x7f32ec0c90a0 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f32ec0c9510 con 0x7f32ec0d1e50 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f32ec15a890 con 0x7f32ec15a4b0 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.181+0000 7f32f183c640 10 monclient(hunting): authenticate will time out at 1016.811827s 2026-02-17T21:07:13.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f3b25e45640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f3b25e45640 10 monclient: monmap: 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7ff36dd74640 1 --2- 10.20.193.45:0/4291874125 >> v2:10.20.193.92:3300/0 conn(0x7ff370156220 0x7ff370074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa830d83640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa82c074c90 0x7fa82c1f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f2fb72da640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f2fb72da640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 1 Processor -- start 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f2fb72da640 10 monclient: monmap: 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.183017+0000 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.183017+0000 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.186 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fd65305e640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f4682633640 1 --2- 10.20.193.45:0/40719897 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f467c0c9cf0 0x7f467c0ce170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f467c074ff0 tx=0x7f467802f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f213c045151cad64 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 1 -- start start 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient: init 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fd65305e640 10 monclient: monmap: 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f3b25e45640 1 librados: starting msgr at 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f3b25e45640 1 librados: starting objecter 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa564151640 10 monclient: get_monmap_and_config 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa564151640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa564151640 10 monclient: monmap: 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.187 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:13.183232+0000 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:13.183232+0000 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f3b25e45640 1 Processor -- start 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7ff36dd74640 10 monclient(hunting): get_auth_request con 0x7ff370156220 auth_method 0 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7ff36dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7ff36dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7ff36dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f3b25e45640 1 -- start start 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f3b25e45640 1 librados: setting wanted keys 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f3b25e45640 1 librados: calling monclient init 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f3b25e45640 10 monclient: init 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fd65305e640 1 librados: starting msgr at 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fd65305e640 1 librados: starting objecter 2026-02-17T21:07:13.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7ff36e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7ff36e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7ff36e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fd65305e640 1 Processor -- start 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa830d83640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa82c074c90 0x7fa82c1f4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36212/0 (socket says 10.20.193.45:36212) 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 1 -- 10.20.193.45:0/4131687781 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8803c070 con 0x7f0f981561d0 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 10 monclient: dump: 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 1 -- 10.20.193.45:0/4131687781 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8802fb00 con 0x7f0f981561d0 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 1 -- 10.20.193.45:0/4131687781 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f88037440 con 0x7f0f981561d0 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f9e361640 5 monclient: authenticate success, global_id 4499 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f9e361640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f9e361640 4 set_mon_vals no callback set 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa830d83640 1 -- 10.20.193.45:0/3374482939 learned_addr learned my addr 10.20.193.45:0/3374482939 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa830d83640 10 monclient(hunting): get_auth_request con 0x7fa82c074c90 auth_method 0 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa830d83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa830d83640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa830d83640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f1d54f81640 1 -- 10.20.193.45:0/4115892326 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c03c070 con 0x7f1d50155fb0 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f1d54f81640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f1d54f81640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f2fb72da640 1 Processor -- start 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f2fb72da640 1 -- start start 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f2fb72da640 10 monclient: init 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f1d54f81640 10 monclient: dump: 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f1d54f81640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f1d54f81640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f1d54f81640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f1d5820e640 5 monclient: authenticate success, global_id 4480 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f1d5820e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f0f96ffd640 10 monclient: dump: 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient: _add_conns ranks=[5,4,1,2,3,0] 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9508155e40 0x7f9508074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient(hunting): picked mon.noname-c con 0x7f9508155e40 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f9508156220 0x7f9508074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient(hunting): picked mon.noname-b con 0x7f9508156220 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f95080ccb80 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95080734e0 con 0x7f95080ccb80 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f95080cd800 con 0x7f9508156220 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f95080737c0 con 0x7f9508155e40 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7f9510101640 10 monclient(hunting): authenticate will time out at 1016.812932s 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fa564151640 1 Processor -- start 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fd65305e640 1 -- start start 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fd65305e640 1 librados: setting wanted keys 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fd65305e640 1 librados: calling monclient init 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.182+0000 7fd65305e640 10 monclient: init 2026-02-17T21:07:13.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 1 -- start start 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 10 monclient: init 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7ff36dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7ff36dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7ff36dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 10 monclient: _add_conns ranks=[5,3,2,4,0,1] 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f2fb015a4b0 0x7f2fb00d1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 10 monclient(hunting): picked mon.noname-c con 0x7f2fb015a4b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3b201560d0 0x7f3b201fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f2fb00d1e50 0x7f2fb00c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 10 monclient(hunting): picked mon.noname-a con 0x7f2fb00d1e50 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2fb00c90a0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb00d22c0 con 0x7f2fb00c90a0 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb00c9510 con 0x7f2fb00d1e50 2026-02-17T21:07:13.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb015a890 con 0x7f2fb015a4b0 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f2fb72da640 10 monclient(hunting): authenticate will time out at 1016.813245s 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient(hunting): picked mon.noname-a con 0x7f3b201560d0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b2015a630 0x7f3b201565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient(hunting): picked mon.noname-c con 0x7f3b2015a630 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3b2015f530 0x7f3b2006f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient(hunting): picked mon.noname-b con 0x7f3b2015f530 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa830d83640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd64c0c97b0 0x7fd64c0cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient(hunting): picked mon.noname-b con 0x7fd64c0c97b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd64c15e2b0 0x7fd64c14cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient(hunting): picked mon.noname-a con 0x7fd64c15e2b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd64c15f580 0x7fd64c14d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3b200704a0 con 0x7f3b201560d0 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa830d83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient(hunting): picked mon.noname-c con 0x7fd64c15f580 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c160070 con 0x7fd64c15e2b0 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c08f830 con 0x7fd64c0c97b0 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd64c1601f0 con 0x7fd64c15f580 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2015ef90 con 0x7f3b2015f530 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fd65305e640 10 monclient(hunting): authenticate will time out at 1016.813342s 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa830d83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3b20070620 con 0x7f3b2015a630 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f3b25e45640 10 monclient(hunting): authenticate will time out at 1016.813383s 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f049dde9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f049dde9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f049dde9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 10 monclient: shutdown 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 1 -- 10.20.193.45:0/4131687781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f981561d0 msgr2=0x7f0f9815bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 1 --2- 10.20.193.45:0/4131687781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f981561d0 0x7f0f9815bdf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f980c1f90 tx=0x7f0f8802edf0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fe1767fc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe17815aff0 0x7fe1780c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f4c6c825640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f4c68155e40 0x7f4c68074580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47662/0 (socket says 10.20.193.45:47662) 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f4c6c825640 1 -- 10.20.193.45:0/4279843770 learned_addr learned my addr 10.20.193.45:0/4279843770 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 1 -- 10.20.193.45:0/4131687781 shutdown_connections 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 1 --2- 10.20.193.45:0/4131687781 >> v2:10.20.193.45:3300/0 conn(0x7f0f9815c330 0x7f0f9815e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 1 --2- 10.20.193.45:0/4131687781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f981561d0 0x7f0f9815bdf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 1 -- 10.20.193.45:0/4131687781 >> 10.20.193.45:0/4131687781 conn(0x7f0f98074050 msgr2=0x7f0f98074460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 1 -- 10.20.193.45:0/4131687781 shutdown_connections 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f1d54f81640 1 -- 10.20.193.45:0/4115892326 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c02fe40 con 0x7f1d50155fb0 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f1d54f81640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f1d5820e640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f1d5820e640 4 set_mon_vals no callback set 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f1d54f81640 1 -- 10.20.193.45:0/4115892326 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c037660 con 0x7f1d50155fb0 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f1d54f81640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f1d54f81640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f1d54f81640 10 monclient: dump: 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7f0f9e361640 1 -- 10.20.193.45:0/4131687781 wait complete. 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 10 monclient: _add_conns ranks=[1,4,0,5,3,2] 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa55c155e40 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa55c074c90 0x7fa55c0ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 10 monclient(hunting): picked mon.noname-b con 0x7fa55c074c90 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa55c156220 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c0734e0 con 0x7fa55c156220 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c0737c0 con 0x7fa55c155e40 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa55c0cd800 con 0x7fa55c074c90 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.183+0000 7fa564151640 10 monclient(hunting): authenticate will time out at 1016.813801s 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 10 monclient: shutdown 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 -- 10.20.193.45:0/4115892326 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1d50155fb0 msgr2=0x7f1d5015f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 --2- 10.20.193.45:0/4115892326 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1d50155fb0 0x7f1d5015f0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1d500cbda0 tx=0x7f1d4c02f130 comp rx=0 tx=0).stop 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient: monmap: 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.197 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 -- 10.20.193.45:0/4115892326 shutdown_connections 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 --2- 10.20.193.45:0/4115892326 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1d50155fb0 0x7f1d5015f0d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 --2- 10.20.193.45:0/4115892326 >> v2:10.20.193.92:3300/0 conn(0x7f1d50155bd0 0x7f1d500cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 -- 10.20.193.45:0/4115892326 >> 10.20.193.45:0/4115892326 conn(0x7f1d50073030 msgr2=0x7f1d50073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 -- 10.20.193.45:0/4115892326 shutdown_connections 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 -- 10.20.193.45:0/4115892326 wait complete. 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 librados: starting msgr at 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 librados: starting objecter 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 Processor -- start 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 -- start start 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 librados: setting wanted keys 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 librados: calling monclient init 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient: init 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36dd74640 10 monclient(hunting): handle_auth_done global_id 4511 payload 274 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36dd74640 1 -- 10.20.193.45:0/4291874125 >> v2:10.20.193.45:3300/0 conn(0x7ff370155e40 msgr2=0x7ff370074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36dd74640 1 --2- 10.20.193.45:0/4291874125 >> v2:10.20.193.45:3300/0 conn(0x7ff370155e40 0x7ff370074580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36dd74640 1 -- 10.20.193.45:0/4291874125 >> v1:10.20.193.92:6789/0 conn(0x7ff3700ccb80 legacy=0x7ff3700ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36dd74640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36dd74640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36dd74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36dd74640 1 -- 10.20.193.45:0/4291874125 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff370073aa0 con 0x7ff370156220 2026-02-17T21:07:13.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7ff36e575640 1 --2- 10.20.193.45:0/4291874125 >> v2:10.20.193.45:3300/0 conn(0x7ff370155e40 0x7ff370074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0f98155df0 0x7f0f9814c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient(hunting): picked mon.noname-a con 0x7f0f98155df0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0f981561d0 0x7f0f981f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient(hunting): picked mon.noname-b con 0x7f0f981561d0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f9815c330 0x7f0f980cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient(hunting): picked mon.noname-c con 0x7f0f9815c330 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9815d890 con 0x7f0f98155df0 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9815d5b0 con 0x7f0f981561d0 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9815db70 con 0x7f0f9815c330 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f0f9e361640 10 monclient(hunting): authenticate will time out at 1016.814866s 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 10 monclient: monmap: 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 librados: starting msgr at 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 librados: starting objecter 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.184+0000 7f1d5820e640 1 Processor -- start 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fa823fff640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c155e40 0x7fa82c1e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fa823fff640 10 monclient(hunting): get_auth_request con 0x7fa82c155e40 auth_method 0 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fa823fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fa823fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fa823fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fe1767fc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe17815aff0 0x7fe1780c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41874/0 (socket says 10.20.193.45:41874) 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fe1767fc640 1 -- 10.20.193.45:0/3866054856 learned_addr learned my addr 10.20.193.45:0/3866054856 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fe1767fc640 10 monclient(hunting): get_auth_request con 0x7fe17815aff0 auth_method 0 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fe1767fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fe1767fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fe1767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 1 -- start start 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 1 librados: setting wanted keys 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 1 librados: calling monclient init 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient: init 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1d500c9590 0x7f1d501e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient(hunting): picked mon.noname-b con 0x7f1d500c9590 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d50155bd0 0x7f1d501e9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient(hunting): picked mon.noname-c con 0x7f1d50155bd0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1d50155fb0 0x7f1d501f9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient(hunting): picked mon.noname-a con 0x7f1d50155fb0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5015e190 con 0x7f1d50155fb0 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5015e010 con 0x7f1d500c9590 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d501e7bd0 con 0x7f1d50155bd0 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f1d5820e640 10 monclient(hunting): authenticate will time out at 1016.815600s 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7f4c6d026640 1 --2- 10.20.193.45:0/4279843770 >> v2:10.20.193.86:3300/0 conn(0x7f4c68156220 0x7f4c681666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fa823fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fa823fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.185+0000 7fa823fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f049dde9640 10 monclient(hunting): handle_auth_done global_id 4437 payload 274 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f4c6d026640 10 monclient(hunting): get_auth_request con 0x7f4c68156220 auth_method 0 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f049dde9640 1 -- 10.20.193.45:0/3642241025 >> v1:10.20.193.92:6789/0 conn(0x7f04980c98b0 legacy=0x7f04980d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f049dde9640 1 -- 10.20.193.45:0/3642241025 >> v1:10.20.193.45:6789/0 conn(0x7f04980c9cf0 legacy=0x7f04980ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f049dde9640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f049dde9640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f049dde9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f049dde9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f049dde9640 1 -- 10.20.193.45:0/3642241025 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04980d2250 con 0x7f0498155fe0 2026-02-17T21:07:13.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f4c6d026640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f4c6d026640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.186+0000 7f4c6d026640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 10 monclient(hunting): handle_auth_done global_id 4489 payload 824 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7f049dde9640 1 --2- 10.20.193.45:0/3642241025 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 0x7f04980cb550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04880098a0 tx=0x7f048802ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163d79d5631dd0ae server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 1 -- 10.20.193.45:0/3374482939 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa82c074c90 msgr2=0x7fa82c1f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa82c074c90 0x7fa82c1f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 1 -- 10.20.193.45:0/3374482939 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa82c156220 msgr2=0x7fa82c144b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa82c156220 0x7fa82c144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.187+0000 7fa823fff640 1 -- 10.20.193.45:0/3374482939 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c1e97e0 con 0x7fa82c155e40 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.188+0000 7f4c6d026640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.188+0000 7f4c6d026640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.188+0000 7f4c6d026640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.189+0000 7f4c6d026640 10 monclient(hunting): handle_auth_done global_id 4492 payload 274 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.189+0000 7f4c6d026640 1 -- 10.20.193.45:0/4279843770 >> v1:10.20.193.92:6789/0 conn(0x7f4c68155e40 legacy=0x7f4c68074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.189+0000 7f4c6d026640 1 -- 10.20.193.45:0/4279843770 >> v1:10.20.193.45:6789/0 conn(0x7f4c68074c90 legacy=0x7f4c680ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.189+0000 7f4c6d026640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.189+0000 7f4c6d026640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.189+0000 7f4c6d026640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.189+0000 7f4c6d026640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.189+0000 7f4c6d026640 1 -- 10.20.193.45:0/4279843770 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c68073aa0 con 0x7f4c68156220 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.190+0000 7fa823fff640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c155e40 0x7fa82c1e9080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa81400b5b0 tx=0x7fa81400ba80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.190+0000 7fa8217fa640 10 client.?.objecter ms_handle_connect 0x7fa82c155e40 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.190+0000 7fa8217fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.191+0000 7f950de76640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9508155e40 0x7f9508074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.192+0000 7f4c6d026640 1 --2- 10.20.193.45:0/4279843770 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68156220 0x7f4c681666d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009d90 tx=0x7f4c6402f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e81c49e992039a38 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fddd13fd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fddcc155e40 0x7fddcc074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950de76640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9508155e40 0x7f9508074580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36228/0 (socket says 10.20.193.45:36228) 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950de76640 1 -- 10.20.193.45:0/1096557885 learned_addr learned my addr 10.20.193.45:0/1096557885 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950de76640 10 monclient(hunting): get_auth_request con 0x7f9508155e40 auth_method 0 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950de76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950de76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950de76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 1 -- 10.20.193.45:0/40719897 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467802fd70 con 0x7f467c0c9cf0 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 10 monclient: dump: 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.203 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 1 -- 10.20.193.45:0/40719897 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46780373f0 con 0x7f467c0c9cf0 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 5 monclient: authenticate success, global_id 4486 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 1 -- 10.20.193.45:0/40719897 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46780377c0 con 0x7f467c0c9cf0 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f4680e30640 10 monclient: dump: 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 4 set_mon_vals no callback set 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 1 -- 10.20.193.45:0/729133750 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f803c070 con 0x7fc90815b0b0 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 10 monclient: dump: 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.204 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 1 -- 10.20.193.45:0/729133750 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f802fc10 con 0x7fc90815b0b0 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 1 -- 10.20.193.45:0/729133750 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8037440 con 0x7fc90815b0b0 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc9067fc640 10 monclient: dump: 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc90dfce640 5 monclient: authenticate success, global_id 4425 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc90dfce640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fc90dfce640 4 set_mon_vals no callback set 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fddd1bfe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fddcc0ccb80 0x7fddcc0ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950d675640 1 --2- 10.20.193.45:0/1096557885 >> v2:10.20.193.86:3300/0 conn(0x7f9508156220 0x7f9508074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f32ea7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f32ec0d1e50 0x7f32ec0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950de76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950de76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f950de76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 10 monclient: shutdown 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fe1767fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fe1767fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 1 -- 10.20.193.45:0/40719897 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f467c0c9cf0 msgr2=0x7f467c0ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 1 --2- 10.20.193.45:0/40719897 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f467c0c9cf0 0x7f467c0ce170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f467c074ff0 tx=0x7f467802f310 comp rx=0 tx=0).stop 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fe1767fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 1 -- 10.20.193.45:0/40719897 shutdown_connections 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 1 --2- 10.20.193.45:0/40719897 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f467c0c9cf0 0x7f467c0ce170 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 1 --2- 10.20.193.45:0/40719897 >> v2:10.20.193.45:3300/0 conn(0x7f467c155fe0 0x7f467c0cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 1 -- 10.20.193.45:0/40719897 >> 10.20.193.45:0/40719897 conn(0x7f467c06d930 msgr2=0x7f467c06dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fddd13fd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fddcc155e40 0x7fddcc074580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36222/0 (socket says 10.20.193.45:36222) 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fddd13fd640 1 -- 10.20.193.45:0/3204926664 learned_addr learned my addr 10.20.193.45:0/3204926664 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fddd13fd640 10 monclient(hunting): get_auth_request con 0x7fddcc155e40 auth_method 0 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fddd13fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fddd13fd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7fddd13fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 1 -- 10.20.193.45:0/40719897 shutdown_connections 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.193+0000 7f46840bd640 1 -- 10.20.193.45:0/40719897 wait complete. 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 10 monclient: shutdown 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 -- 10.20.193.45:0/729133750 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc90815b0b0 msgr2=0x7fc9080c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 --2- 10.20.193.45:0/729133750 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc90815b0b0 0x7fc9080c8d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80098a0 tx=0x7fc8f802ef00 comp rx=0 tx=0).stop 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 -- 10.20.193.45:0/729133750 shutdown_connections 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7ff36dd74640 1 --2- 10.20.193.45:0/4291874125 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff370156220 0x7ff370074ac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff37008f5a0 tx=0x7ff35802ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc3eb7ab8221aef3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 --2- 10.20.193.45:0/729133750 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc90815b0b0 0x7fc9080c8d90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 -- 10.20.193.45:0/729133750 >> 10.20.193.45:0/729133750 conn(0x7fc9080c9d40 msgr2=0x7fc9080ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 -- 10.20.193.45:0/729133750 shutdown_connections 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 -- 10.20.193.45:0/729133750 wait complete. 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 10 monclient: monmap: 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.207 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fddd1bfe640 10 monclient(hunting): get_auth_request con 0x7fddcc0ccb80 auth_method 0 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fddd1bfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fddd1bfe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fddd1bfe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 1 librados: starting msgr at 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 1 librados: starting objecter 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 1 Processor -- start 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950d675640 10 monclient(hunting): get_auth_request con 0x7f9508156220 auth_method 0 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950d675640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950d675640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 1 -- start start 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 1 librados: setting wanted keys 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 1 librados: calling monclient init 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 10 monclient: init 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950d675640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f32ea7fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f32ec0d1e50 0x7f32ec0c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57516/0 (socket says 10.20.193.45:57516) 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f32ea7fc640 1 -- 10.20.193.45:0/1864272382 learned_addr learned my addr 10.20.193.45:0/1864272382 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f32ea7fc640 10 monclient(hunting): get_auth_request con 0x7f32ec0d1e50 auth_method 0 2026-02-17T21:07:13.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f32ea7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f32ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f32ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 10 monclient: monmap: 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 librados: starting msgr at 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 librados: starting objecter 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f467c0c98b0 0x7f467c0d18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7fc90dfce640 1 Processor -- start 2026-02-17T21:07:13.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 10 monclient(hunting): picked mon.noname-b con 0x7f467c0c98b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c0c9cf0 0x7f467c147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 1 -- start start 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 1 librados: setting wanted keys 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 1 librados: calling monclient init 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient: init 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950de76640 10 monclient(hunting): handle_auth_done global_id 4523 payload 274 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950de76640 1 -- 10.20.193.45:0/1096557885 >> v2:10.20.193.86:3300/0 conn(0x7f9508156220 msgr2=0x7f9508074ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950de76640 1 --2- 10.20.193.45:0/1096557885 >> v2:10.20.193.86:3300/0 conn(0x7f9508156220 0x7f9508074ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950de76640 1 -- 10.20.193.45:0/1096557885 >> v1:10.20.193.86:6789/0 conn(0x7f95080ccb80 legacy=0x7f95080ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950de76640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950de76640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950de76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950de76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f950de76640 1 -- 10.20.193.45:0/1096557885 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9508073aa0 con 0x7f9508155e40 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 10 monclient(hunting): picked mon.noname-c con 0x7f467c0c9cf0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.194+0000 7f46840bd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f467c155fe0 0x7f467c1f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f46840bd640 10 monclient(hunting): picked mon.noname-a con 0x7f467c155fe0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f46840bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f46840bd640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f467c0c90b0 con 0x7f467c155fe0 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f46840bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fddd1bfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fddd1bfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f46840bd640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f467c0c8dd0 con 0x7f467c0c98b0 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f46840bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f46840bd640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f467c0cc0e0 con 0x7f467c0c9cf0 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f46840bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f46840bd640 10 monclient(hunting): authenticate will time out at 1016.825041s 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fddd1bfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fddd13fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fddd13fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fddd13fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fe1767fc640 10 monclient(hunting): handle_auth_done global_id 4443 payload 274 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fe1767fc640 1 -- 10.20.193.45:0/3866054856 >> v1:10.20.193.92:6789/0 conn(0x7fe178152a00 legacy=0x7fe1780c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fe1767fc640 1 -- 10.20.193.45:0/3866054856 >> v1:10.20.193.45:6789/0 conn(0x7fe178152620 legacy=0x7fe17815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fe1767fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fe1767fc640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fe1767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fe1767fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fe1767fc640 1 -- 10.20.193.45:0/3866054856 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe178159e00 con 0x7fe17815aff0 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f32ea7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f32ea7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7f32ea7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc908152620 0x7fc908147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient(hunting): picked mon.noname-a con 0x7fc908152620 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc908152a00 0x7fc908149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient(hunting): picked mon.noname-c con 0x7fc908152a00 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc90815b0b0 0x7fc908149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fddd0bfc640 1 --2- 10.20.193.45:0/3204926664 >> v2:10.20.193.45:3300/0 conn(0x7fddcc156220 0x7fddcc074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient(hunting): picked mon.noname-b con 0x7fc90815b0b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080c9450 con 0x7fc908152620 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080c92d0 con 0x7fc90815b0b0 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080c95d0 con 0x7fc908152a00 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.195+0000 7fc90dfce640 10 monclient(hunting): authenticate will time out at 1016.825556s 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd0bfc640 10 monclient(hunting): get_auth_request con 0x7fddcc156220 auth_method 0 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd0bfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd0bfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd0bfc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 10 monclient(hunting): handle_auth_done global_id 4526 payload 274 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 1 -- 10.20.193.45:0/3204926664 >> v2:10.20.193.86:3300/0 conn(0x7fddcc0ccb80 msgr2=0x7fddcc0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 1 --2- 10.20.193.45:0/3204926664 >> v2:10.20.193.86:3300/0 conn(0x7fddcc0ccb80 0x7fddcc0ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 1 -- 10.20.193.45:0/3204926664 >> v2:10.20.193.45:3300/0 conn(0x7fddcc156220 msgr2=0x7fddcc074ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 1 --2- 10.20.193.45:0/3204926664 >> v2:10.20.193.45:3300/0 conn(0x7fddcc156220 0x7fddcc074ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.196+0000 7fddd13fd640 1 -- 10.20.193.45:0/3204926664 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc073aa0 con 0x7fddcc155e40 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7f32ea7fc640 10 monclient(hunting): handle_auth_done global_id 4501 payload 274 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7f32ea7fc640 1 -- 10.20.193.45:0/1864272382 >> v2:10.20.193.92:3300/0 conn(0x7f32ec15a4b0 msgr2=0x7f32ec0d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7f32ea7fc640 1 --2- 10.20.193.45:0/1864272382 >> v2:10.20.193.92:3300/0 conn(0x7f32ec15a4b0 0x7f32ec0d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7f32ea7fc640 1 -- 10.20.193.45:0/1864272382 >> v1:10.20.193.86:6789/0 conn(0x7f32ec0c90a0 legacy=0x7f32ec1637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7f32ea7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7f32ea7fc640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7f32ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7f32ea7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7f32ea7fc640 1 -- 10.20.193.45:0/1864272382 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec1645e0 con 0x7f32ec0d1e50 2026-02-17T21:07:13.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7fe1767fc640 1 --2- 10.20.193.45:0/3866054856 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe17815aff0 0x7fe1780c8d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe178072110 tx=0x7fe160031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4791f6d4e18166ef server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.197+0000 7fa5616c5640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa55c074c90 0x7fa55c0ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fa5616c5640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa55c074c90 0x7fa55c0ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57554/0 (socket says 10.20.193.45:57554) 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fa5616c5640 1 -- 10.20.193.45:0/699030413 learned_addr learned my addr 10.20.193.45:0/699030413 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fa5616c5640 10 monclient(hunting): get_auth_request con 0x7fa55c074c90 auth_method 0 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fa5616c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fa5616c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fa5616c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fd650dd3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd64c0c97b0 0x7fd64c0cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fddd13fd640 1 --2- 10.20.193.45:0/3204926664 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 0x7fddcc074580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fddcc08f310 tx=0x7fddbc02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84d69b5b378acd1b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fa5616c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fa5616c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7fa5616c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.198+0000 7f950de76640 1 --2- 10.20.193.45:0/1096557885 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9508155e40 0x7f9508074580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f950806cf60 tx=0x7f94f802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dd56538727bde25 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.199+0000 7fd650dd3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd64c0c97b0 0x7fd64c0cfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57544/0 (socket says 10.20.193.45:57544) 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.199+0000 7fd650dd3640 1 -- 10.20.193.45:0/2226589428 learned_addr learned my addr 10.20.193.45:0/2226589428 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.199+0000 7fd650dd3640 10 monclient(hunting): get_auth_request con 0x7fd64c0c97b0 auth_method 0 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.199+0000 7fd650dd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.199+0000 7fd650dd3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.199+0000 7fd650dd3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.199+0000 7f32ea7fc640 1 --2- 10.20.193.45:0/1864272382 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32ec0d1e50 0x7f32ec0c8b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009970 tx=0x7f32d402eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbf5e38d2887fd65 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.199+0000 7f3b1effd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b2015a630 0x7f3b201565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f2fb484e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f2fb00d1e50 0x7f2fb00c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fa5616c5640 10 monclient(hunting): handle_auth_done global_id 4504 payload 274 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fa5616c5640 1 -- 10.20.193.45:0/699030413 >> v1:10.20.193.86:6789/0 conn(0x7fa55c155e40 legacy=0x7fa55c074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fa5616c5640 1 -- 10.20.193.45:0/699030413 >> v1:10.20.193.45:6789/0 conn(0x7fa55c156220 legacy=0x7fa55c15f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fa5616c5640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fa5616c5640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fa5616c5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fa5616c5640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fa5616c5640 1 -- 10.20.193.45:0/699030413 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c073aa0 con 0x7fa55c074c90 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 1 -- 10.20.193.45:0/3642241025 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048803c070 con 0x7f0498155fe0 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 10 monclient: dump: 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.215 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 1 -- 10.20.193.45:0/3642241025 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048802fc10 con 0x7f0498155fe0 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 1 -- 10.20.193.45:0/3642241025 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488037440 con 0x7f0498155fe0 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 5 monclient: authenticate success, global_id 4437 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 4 set_mon_vals no callback set 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f049cde7640 10 monclient: dump: 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f3b1effd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b2015a630 0x7f3b201565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36250/0 (socket says 10.20.193.45:36250) 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f3b1effd640 1 -- 10.20.193.45:0/3179318683 learned_addr learned my addr 10.20.193.45:0/3179318683 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f3b1effd640 10 monclient(hunting): get_auth_request con 0x7f3b2015a630 auth_method 0 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f3b1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f3b1effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f3b1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fd643fff640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd64c15e2b0 0x7fd64c14cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f2fb484e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f2fb00d1e50 0x7f2fb00c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41906/0 (socket says 10.20.193.45:41906) 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f2fb484e640 1 -- 10.20.193.45:0/942373976 learned_addr learned my addr 10.20.193.45:0/942373976 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f2fb484e640 10 monclient(hunting): get_auth_request con 0x7f2fb00d1e50 auth_method 0 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f2fb484e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f2fb484e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f2fb484e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fd650dd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fd650dd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fd650dd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 10 monclient: shutdown 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 1 -- 10.20.193.45:0/3642241025 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 msgr2=0x7f04980cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fd643fff640 10 monclient(hunting): get_auth_request con 0x7fd64c15e2b0 auth_method 0 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fd643fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fd643fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7fd643fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 1 --2- 10.20.193.45:0/3642241025 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 0x7f04980cb550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04880098a0 tx=0x7f048802ef00 comp rx=0 tx=0).stop 2026-02-17T21:07:13.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 1 -- 10.20.193.45:0/3642241025 shutdown_connections 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 1 --2- 10.20.193.45:0/3642241025 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 0x7f04980cb550 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 1 -- 10.20.193.45:0/3642241025 >> 10.20.193.45:0/3642241025 conn(0x7f049806d930 msgr2=0x7f049806dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 1 -- 10.20.193.45:0/3642241025 shutdown_connections 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.200+0000 7f04a0074640 1 -- 10.20.193.45:0/3642241025 wait complete. 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f2fb484e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f2fb484e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f2fb484e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f3b1ffff640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3b2015f530 0x7f3b2006f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f04a0074640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f04a0074640 10 monclient: monmap: 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7fd643fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7fd643fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7fd643fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f04a0074640 1 librados: starting msgr at 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f04a0074640 1 librados: starting objecter 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f04a0074640 1 Processor -- start 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f04a0074640 1 -- start start 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f04a0074640 1 librados: setting wanted keys 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f04a0074640 1 librados: calling monclient init 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f04a0074640 10 monclient: init 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.201+0000 7f2fb504f640 1 --2- 10.20.193.45:0/942373976 >> v2:10.20.193.92:3300/0 conn(0x7f2fb015a4b0 0x7f2fb00d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f3b1effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f3b1effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f2fb484e640 10 monclient(hunting): handle_auth_done global_id 4449 payload 274 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f2fb484e640 1 -- 10.20.193.45:0/942373976 >> v2:10.20.193.92:3300/0 conn(0x7f2fb015a4b0 msgr2=0x7f2fb00d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f2fb484e640 1 --2- 10.20.193.45:0/942373976 >> v2:10.20.193.92:3300/0 conn(0x7f2fb015a4b0 0x7f2fb00d1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f2fb484e640 1 -- 10.20.193.45:0/942373976 >> v1:10.20.193.92:6789/0 conn(0x7f2fb00c90a0 legacy=0x7f2fb01637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f2fb484e640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f2fb484e640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f2fb484e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f2fb484e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f2fb484e640 1 -- 10.20.193.45:0/942373976 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb01645e0 con 0x7f2fb00d1e50 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f04980c98b0 0x7f04981f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient(hunting): picked mon.noname-c con 0x7f04980c98b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f04980c9cf0 0x7f04980732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient(hunting): picked mon.noname-b con 0x7f04980c9cf0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 0x7f049815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient(hunting): picked mon.noname-a con 0x7f0498155fe0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f04980c90b0 con 0x7f0498155fe0 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f04980c8dd0 con 0x7f04980c9cf0 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04980cc0e0 con 0x7f04980c98b0 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f3b1effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7f04a0074640 10 monclient(hunting): authenticate will time out at 1016.832574s 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.202+0000 7fd6515d4640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd64c15f580 0x7fd64c14d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 10 monclient(hunting): handle_auth_done global_id 4507 payload 824 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 1 -- 10.20.193.45:0/2226589428 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd64c15f580 msgr2=0x7fd64c14d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd64c15f580 0x7fd64c14d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 1 -- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd64c15e2b0 msgr2=0x7fd64c14cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd64c15e2b0 0x7fd64c14cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7fd650dd3640 1 -- 10.20.193.45:0/2226589428 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c14b5c0 con 0x7fd64c0c97b0 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7f3b1ffff640 10 monclient(hunting): get_auth_request con 0x7f3b2015f530 auth_method 0 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7f3b1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7f3b1ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.203+0000 7f3b1ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 10 monclient(hunting): handle_auth_done global_id 4529 payload 824 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 1 -- 10.20.193.45:0/3179318683 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3b2015f530 msgr2=0x7f3b2006f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3b2015f530 0x7f3b2006f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7fa5616c5640 1 --2- 10.20.193.45:0/699030413 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa55c074c90 0x7fa55c0ccb80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa550009970 tx=0x7fa55002eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eba673804b5486c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 1 -- 10.20.193.45:0/3179318683 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3b201560d0 msgr2=0x7f3b201fbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3b201560d0 0x7f3b201fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f3b1effd640 1 -- 10.20.193.45:0/3179318683 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b20158150 con 0x7f3b2015a630 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.204+0000 7f1d56784640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1d50155fb0 0x7f1d501f9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.205+0000 7f1d55f83640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1d500c9590 0x7f1d501e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.205+0000 7fd650dd3640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd64c0c97b0 0x7fd64c0cfd90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c520 tx=0x7fd63c00c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.205+0000 7fd6417fa640 10 client.?.objecter ms_handle_connect 0x7fd64c0c97b0 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.205+0000 7fd6417fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.205+0000 7f2fb484e640 1 --2- 10.20.193.45:0/942373976 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb00d1e50 0x7f2fb00c8b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009970 tx=0x7f2fa402eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf26ad77abf5b004 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f0f9c8d7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f9815c330 0x7f0f980cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f1d56784640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1d50155fb0 0x7f1d501f9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41942/0 (socket says 10.20.193.45:41942) 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f1d56784640 1 -- 10.20.193.45:0/3283116438 learned_addr learned my addr 10.20.193.45:0/3283116438 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f1d56784640 10 monclient(hunting): get_auth_request con 0x7f1d50155fb0 auth_method 0 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f1d56784640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f1d56784640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f1d56784640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f3b1effd640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b2015a630 0x7f3b201565c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000c760 tx=0x7f3b1000cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f3afbfff640 10 client.?.objecter ms_handle_connect 0x7f3b2015a630 2026-02-17T21:07:13.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f3afbfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f0f9c8d7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f9815c330 0x7f0f980cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36274/0 (socket says 10.20.193.45:36274) 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f0f9c8d7640 1 -- 10.20.193.45:0/3613247815 learned_addr learned my addr 10.20.193.45:0/3613247815 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f0f9c8d7640 10 monclient(hunting): get_auth_request con 0x7f0f9815c330 auth_method 0 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f0f9c8d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f0f9c8d7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f0f9c8d7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f1d56784640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f1d56784640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.206+0000 7f1d56784640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.207+0000 7f1d55f83640 10 monclient(hunting): get_auth_request con 0x7f1d500c9590 auth_method 0 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.207+0000 7f1d55f83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.207+0000 7f1d55f83640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.207+0000 7f1d55f83640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.207+0000 7f1d55f83640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.207+0000 7f1d55f83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.207+0000 7f1d55f83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7f0f9c8d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7f0f9c8d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7f0f9c8d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7f0f977fe640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0f981561d0 0x7f0f981f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 1 -- 10.20.193.45:0/3374482939 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa814016070 con 0x7fa82c155e40 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 10 monclient: dump: 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 1 -- 10.20.193.45:0/3374482939 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8140044e0 con 0x7fa82c155e40 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 1 -- 10.20.193.45:0/3374482939 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8140029c0 con 0x7fa82c155e40 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 5 monclient: authenticate success, global_id 4489 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 10 monclient: _renew_subs 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c1e9ac0 con 0x7fa82c155e40 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa822ffd640 4 set_mon_vals no callback set 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa8217fa640 10 monclient: dump: 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 10 client.4489.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 10 monclient: _renew_subs 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c1ea080 con 0x7fa82c155e40 2026-02-17T21:07:13.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 1 librados: init done 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.208+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c074580 con 0x7fa82c155e40 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 10 monclient(hunting): handle_auth_done global_id 4455 payload 824 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 1 -- 10.20.193.45:0/3283116438 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d50155bd0 msgr2=0x7f1d501e9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d50155bd0 0x7f1d501e9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 1 -- 10.20.193.45:0/3283116438 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1d500c9590 msgr2=0x7f1d501e7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1d500c9590 0x7f1d501e7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f1d56784640 1 -- 10.20.193.45:0/3283116438 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d501e7eb0 con 0x7f1d50155fb0 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f0f977fe640 10 monclient(hunting): get_auth_request con 0x7f0f981561d0 auth_method 0 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f0f977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f0f977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.209+0000 7f0f977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 10 monclient(hunting): handle_auth_done global_id 4532 payload 824 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 1 -- 10.20.193.45:0/3613247815 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0f981561d0 msgr2=0x7f0f981f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0f981561d0 0x7f0f981f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 1 -- 10.20.193.45:0/3613247815 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0f98155df0 msgr2=0x7f0f9814c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0f98155df0 0x7f0f9814c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.210+0000 7f0f9c8d7640 1 -- 10.20.193.45:0/3613247815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f981f7a40 con 0x7f0f9815c330 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 1 -- 10.20.193.45:0/699030413 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55003c070 con 0x7fa55c074c90 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 10 monclient: dump: 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 1 -- 10.20.193.45:0/699030413 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55002fb60 con 0x7fa55c074c90 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 1 -- 10.20.193.45:0/699030413 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550037440 con 0x7fa55c074c90 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa564151640 5 monclient: authenticate success, global_id 4504 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa564151640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa564151640 4 set_mon_vals no callback set 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f1d56784640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1d50155fb0 0x7f1d501f9bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c03a040 tx=0x7f1d4c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.211+0000 7fa560ec4640 10 monclient: dump: 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.226 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f1d3e7fc640 10 client.?.objecter ms_handle_connect 0x7f1d50155fb0 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f1d3e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7fa564151640 10 monclient: shutdown 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7fa564151640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7fa564151640 1 -- 10.20.193.45:0/699030413 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa55c074c90 msgr2=0x7fa55c0ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7fa564151640 1 --2- 10.20.193.45:0/699030413 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa55c074c90 0x7fa55c0ccb80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa550009970 tx=0x7fa55002eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7fa564151640 1 -- 10.20.193.45:0/699030413 shutdown_connections 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7fa564151640 1 --2- 10.20.193.45:0/699030413 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa55c074c90 0x7fa55c0ccb80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7fa564151640 1 -- 10.20.193.45:0/699030413 >> 10.20.193.45:0/699030413 conn(0x7fa55c0ce270 msgr2=0x7fa55c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7fa564151640 1 -- 10.20.193.45:0/699030413 shutdown_connections 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7fa564151640 1 -- 10.20.193.45:0/699030413 wait complete. 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f0f9c8d7640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f9815c330 0x7f0f980cd3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00b9a0 tx=0x7f0f8c00be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f0f94ff9640 10 client.?.objecter ms_handle_connect 0x7f0f9815c330 2026-02-17T21:07:13.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f0f94ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 1 -- 10.20.193.45:0/1096557885 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f803c070 con 0x7f9508155e40 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 10 monclient: dump: 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 1 -- 10.20.193.45:0/1096557885 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f802fb40 con 0x7f9508155e40 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f9510101640 5 monclient: authenticate success, global_id 4523 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f9510101640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 1 -- 10.20.193.45:0/1096557885 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8037440 con 0x7f9508155e40 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f9510101640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f9510101640 4 set_mon_vals no callback set 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.212+0000 7f950ce74640 10 monclient: dump: 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.228 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 10 monclient: shutdown 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 -- 10.20.193.45:0/1096557885 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9508155e40 msgr2=0x7f9508074580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 --2- 10.20.193.45:0/1096557885 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9508155e40 0x7f9508074580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f950806cf60 tx=0x7f94f802eed0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fa564151640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fa564151640 10 monclient: monmap: 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 -- 10.20.193.45:0/1096557885 shutdown_connections 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 --2- 10.20.193.45:0/1096557885 >> v2:10.20.193.86:3300/0 conn(0x7f9508156220 0x7f9508074ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 --2- 10.20.193.45:0/1096557885 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9508155e40 0x7f9508074580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 -- 10.20.193.45:0/1096557885 >> 10.20.193.45:0/1096557885 conn(0x7f95080ce270 msgr2=0x7f95080ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 -- 10.20.193.45:0/1096557885 shutdown_connections 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 -- 10.20.193.45:0/1096557885 wait complete. 2026-02-17T21:07:13.229 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fc9077fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc908152620 0x7fc908147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 1 -- 10.20.193.45:0/4291874125 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35803c070 con 0x7ff370156220 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 10 monclient: dump: 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 1 -- 10.20.193.45:0/4291874125 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35802faf0 con 0x7ff370156220 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 1 -- 10.20.193.45:0/4291874125 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358037440 con 0x7ff370156220 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 5 monclient: authenticate success, global_id 4511 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 4 set_mon_vals no callback set 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff36d573640 10 monclient: dump: 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.230 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fa564151640 1 librados: starting msgr at 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fa564151640 1 librados: starting objecter 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fa564151640 1 Processor -- start 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fa564151640 1 -- start start 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fa564151640 1 librados: setting wanted keys 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fa564151640 1 librados: calling monclient init 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7fa564151640 10 monclient: init 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 10 monclient: shutdown 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 1 -- 10.20.193.45:0/4291874125 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff370156220 msgr2=0x7ff370074ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 1 --2- 10.20.193.45:0/4291874125 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff370156220 0x7ff370074ac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff37008f5a0 tx=0x7ff35802ede0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 10 monclient: monmap: 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 librados: starting msgr at 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 librados: starting objecter 2026-02-17T21:07:13.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 Processor -- start 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 1 -- 10.20.193.45:0/4291874125 shutdown_connections 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 1 --2- 10.20.193.45:0/4291874125 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff370156220 0x7ff370074ac0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 1 --2- 10.20.193.45:0/4291874125 >> v2:10.20.193.45:3300/0 conn(0x7ff370155e40 0x7ff370074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 1 -- 10.20.193.45:0/4291874125 >> 10.20.193.45:0/4291874125 conn(0x7ff3700ce270 msgr2=0x7ff3700ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7ff374b01640 1 -- 10.20.193.45:0/4291874125 shutdown_connections 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7ff374b01640 1 -- 10.20.193.45:0/4291874125 wait complete. 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa55c074c90 0x7fa55c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient(hunting): picked mon.noname-a con 0x7fa55c074c90 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa55c155e40 0x7fa55c1e9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fc9077fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc908152620 0x7fc908147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41966/0 (socket says 10.20.193.45:41966) 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fc9077fe640 1 -- 10.20.193.45:0/1062729136 learned_addr learned my addr 10.20.193.45:0/1062729136 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fc9077fe640 10 monclient(hunting): get_auth_request con 0x7fc908152620 auth_method 0 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 -- start start 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 librados: setting wanted keys 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 1 librados: calling monclient init 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.213+0000 7f9510101640 10 monclient: init 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient(hunting): picked mon.noname-c con 0x7fa55c155e40 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa55c156220 0x7fa55c0c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient(hunting): picked mon.noname-b con 0x7fa55c156220 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fc9077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fc9077fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fc9077fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0c4830 con 0x7fa55c074c90 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c074060 con 0x7fa55c156220 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c0c49b0 con 0x7fa55c155e40 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7fa564151640 10 monclient(hunting): authenticate will time out at 1016.844230s 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95080ccb80 0x7f950815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient(hunting): picked mon.noname-a con 0x7f95080ccb80 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9508155e40 0x7f95080c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient(hunting): picked mon.noname-b con 0x7f9508155e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9508156220 0x7f95080c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient(hunting): picked mon.noname-c con 0x7f9508156220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f95080c4830 con 0x7f95080ccb80 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9508074060 con 0x7f9508155e40 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95080c49b0 con 0x7f9508156220 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7f9510101640 10 monclient(hunting): authenticate will time out at 1016.844476s 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7ff374b01640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.214+0000 7ff374b01640 10 monclient: monmap: 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 librados: starting msgr at 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 librados: starting objecter 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 Processor -- start 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 -- start start 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 librados: setting wanted keys 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 1 -- 10.20.193.45:0/3866054856 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160036710 con 0x7fe17815aff0 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 librados: calling monclient init 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 10 monclient: dump: 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 1 -- 10.20.193.45:0/3866054856 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1600368b0 con 0x7fe17815aff0 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 1 -- 10.20.193.45:0/3866054856 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe160036c80 con 0x7fe17815aff0 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient: init 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 5 monclient: authenticate success, global_id 4443 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 4 set_mon_vals no callback set 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f4682633640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f467c155fe0 0x7f467c1f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe175ffb640 10 monclient: dump: 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 1 -- 10.20.193.45:0/3179318683 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10017070 con 0x7f3b2015a630 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 10 monclient: dump: 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 1 -- 10.20.193.45:0/3179318683 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b10005b90 con 0x7f3b2015a630 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 1 -- 10.20.193.45:0/3179318683 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10007070 con 0x7f3b2015a630 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3afbfff640 10 monclient: dump: 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.236 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b1dffb640 4 set_mon_vals no callback set 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b25e45640 5 monclient: authenticate success, global_id 4529 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b25e45640 10 monclient: _renew_subs 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b25e45640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b200c9370 con 0x7f3b2015a630 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b25e45640 10 client.4529.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b25e45640 10 monclient: _renew_subs 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fc9077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fc9077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b25e45640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b201f8560 con 0x7f3b2015a630 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fc9077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f3b25e45640 1 librados: init done 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f4682633640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f467c155fe0 0x7f467c1f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41950/0 (socket says 10.20.193.45:41950) 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f4682633640 1 -- 10.20.193.45:0/2869854944 learned_addr learned my addr 10.20.193.45:0/2869854944 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f4682633640 10 monclient(hunting): get_auth_request con 0x7f467c155fe0 auth_method 0 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f4682633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f4682633640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f4682633640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 10 monclient: shutdown 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 1 -- 10.20.193.45:0/3866054856 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe17815aff0 msgr2=0x7fe1780c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 1 --2- 10.20.193.45:0/3866054856 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe17815aff0 0x7fe1780c8d90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe178072110 tx=0x7fe160031720 comp rx=0 tx=0).stop 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 1 -- 10.20.193.45:0/3866054856 shutdown_connections 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 1 --2- 10.20.193.45:0/3866054856 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe17815aff0 0x7fe1780c8d90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 1 -- 10.20.193.45:0/3866054856 >> 10.20.193.45:0/3866054856 conn(0x7fe1780c9d40 msgr2=0x7fe1780ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 1 -- 10.20.193.45:0/3866054856 shutdown_connections 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7f4681631640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c0c9cf0 0x7f467c147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f4682633640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f4682633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f4682633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f3b25e45640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f3b25e45640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f3b25e45640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2015f910 con 0x7f3b2015a630 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3700ccb80 0x7ff3700ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient(hunting): picked mon.noname-a con 0x7ff3700ccb80 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff370155e40 0x7ff3700cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient(hunting): picked mon.noname-b con 0x7ff370155e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff370156220 0x7ff370157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient(hunting): picked mon.noname-c con 0x7ff370156220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff3700c4830 con 0x7ff3700ccb80 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff370074060 con 0x7ff370155e40 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff3700c49b0 con 0x7ff370156220 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7ff374b01640 10 monclient(hunting): authenticate will time out at 1016.845967s 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.215+0000 7fe17d415640 1 -- 10.20.193.45:0/3866054856 wait complete. 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 10 monclient: monmap: 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 1 librados: starting msgr at 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 1 librados: starting objecter 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 1 Processor -- start 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f4681631640 10 monclient(hunting): get_auth_request con 0x7f467c0c9cf0 auth_method 0 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f4681631640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f4681631640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7f4681631640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 1 -- start start 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 1 librados: setting wanted keys 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 1 librados: calling monclient init 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 10 monclient: init 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.216+0000 7fe17d415640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe178152620 0x7fe17806b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 10 monclient(hunting): picked mon.noname-b con 0x7fe178152620 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe178152a00 0x7fe17814a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 1 -- 10.20.193.45:0/942373976 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa403c070 con 0x7f2fb00d1e50 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 10 monclient: dump: 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 1 -- 10.20.193.45:0/942373976 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa402fb20 con 0x7f2fb00d1e50 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 1 -- 10.20.193.45:0/942373976 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4037440 con 0x7f2fb00d1e50 2026-02-17T21:07:13.240 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2f9ffff640 10 monclient: dump: 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 5 monclient: authenticate success, global_id 4449 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 4 set_mon_vals no callback set 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 10 monclient(hunting): picked mon.noname-a con 0x7fe178152a00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe17815aff0 0x7fe17814ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 10 monclient(hunting): picked mon.noname-c con 0x7fe17815aff0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe1780c92d0 con 0x7fe178152a00 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe17815a3c0 con 0x7fe178152620 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1780c9450 con 0x7fe17815aff0 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7fe17d415640 10 monclient(hunting): authenticate will time out at 1016.847127s 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 10 monclient: shutdown 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 1 -- 10.20.193.45:0/942373976 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb00d1e50 msgr2=0x7f2fb00c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 1 --2- 10.20.193.45:0/942373976 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb00d1e50 0x7f2fb00c8b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4009970 tx=0x7f2fa402eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 1 -- 10.20.193.45:0/942373976 shutdown_connections 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 1 --2- 10.20.193.45:0/942373976 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb00d1e50 0x7f2fb00c8b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 1 --2- 10.20.193.45:0/942373976 >> v2:10.20.193.92:3300/0 conn(0x7f2fb015a4b0 0x7f2fb00d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 1 -- 10.20.193.45:0/942373976 >> 10.20.193.45:0/942373976 conn(0x7f2fb006d930 msgr2=0x7f2fb006dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 1 -- 10.20.193.45:0/942373976 shutdown_connections 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.217+0000 7f2fb72da640 1 -- 10.20.193.45:0/942373976 wait complete. 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7f2fb72da640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7f2fb72da640 10 monclient: monmap: 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 10 monclient(hunting): handle_auth_done global_id 4458 payload 824 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 1 -- 10.20.193.45:0/1062729136 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc908152a00 msgr2=0x7fc908149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc908152a00 0x7fc908149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 1 -- 10.20.193.45:0/1062729136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc90815b0b0 msgr2=0x7fc908149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc90815b0b0 0x7fc908149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7fc9077fe640 1 -- 10.20.193.45:0/1062729136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9081513c0 con 0x7fc908152620 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7f2fb72da640 1 librados: starting msgr at 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7f2fb72da640 1 librados: starting objecter 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7f2fb72da640 1 Processor -- start 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7f2fb72da640 1 -- start start 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7f2fb72da640 1 librados: setting wanted keys 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7f2fb72da640 1 librados: calling monclient init 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.218+0000 7f2fb72da640 10 monclient: init 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2fb00c90a0 0x7f2fb00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient(hunting): picked mon.noname-b con 0x7f2fb00c90a0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2fb00d1e50 0x7f2fb01fc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient(hunting): picked mon.noname-c con 0x7f2fb00d1e50 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb015a4b0 0x7f2fb01f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient(hunting): picked mon.noname-a con 0x7f2fb015a4b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb0160800 con 0x7f2fb015a4b0 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 1 -- 10.20.193.45:0/3283116438 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c047020 con 0x7f1d50155fb0 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 10 monclient: dump: 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 1 -- 10.20.193.45:0/3283116438 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c042470 con 0x7f1d50155fb0 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 1 -- 10.20.193.45:0/3283116438 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c03c040 con 0x7f1d50155fb0 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3e7fc640 10 monclient: dump: 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d3ffff640 4 set_mon_vals no callback set 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d5820e640 5 monclient: authenticate success, global_id 4455 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d5820e640 10 monclient: _renew_subs 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d5820e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d501e8190 con 0x7f1d50155fb0 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb0160520 con 0x7f2fb00c90a0 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb0160ae0 con 0x7f2fb00d1e50 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d5820e640 10 client.4455.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d5820e640 10 monclient: _renew_subs 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d5820e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d501f93b0 con 0x7f1d50155fb0 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f2fb72da640 10 monclient(hunting): authenticate will time out at 1016.849710s 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.219+0000 7f1d5820e640 1 librados: init done 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7ff36e575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3700ccb80 0x7ff3700ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7fc9077fe640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc908152620 0x7fc908147f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400c550 tx=0x7fc8f400ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7fc8e3fff640 10 client.?.objecter ms_handle_connect 0x7fc908152620 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7fc8e3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7f1d5820e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7f1d5820e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7f1d5820e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d50073b50 con 0x7f1d50155fb0 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7ff36e575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3700ccb80 0x7ff3700ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42002/0 (socket says 10.20.193.45:42002) 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7ff36e575640 1 -- 10.20.193.45:0/3665908090 learned_addr learned my addr 10.20.193.45:0/3665908090 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7ff36e575640 10 monclient(hunting): get_auth_request con 0x7ff3700ccb80 auth_method 0 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7ff36e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7ff36e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.220+0000 7ff36e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.221+0000 7f4682633640 10 monclient(hunting): handle_auth_done global_id 4461 payload 824 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.222+0000 7f4682633640 1 -- 10.20.193.45:0/2869854944 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c0c9cf0 msgr2=0x7f467c147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.222+0000 7f4682633640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c0c9cf0 0x7f467c147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.222+0000 7f4682633640 1 -- 10.20.193.45:0/2869854944 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f467c0c98b0 msgr2=0x7f467c0d18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.222+0000 7f4682633640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f467c0c98b0 0x7f467c0d18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.222+0000 7f4682633640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.222+0000 7f4682633640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.222+0000 7f4682633640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.222+0000 7f4682633640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.222+0000 7f4682633640 1 -- 10.20.193.45:0/2869854944 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f467c1f6c50 con 0x7f467c155fe0 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.224+0000 7ff36e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.224+0000 7ff36e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.224+0000 7ff36e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.224+0000 7f049e5ea640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 0x7f049815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.224+0000 7f4682633640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f467c155fe0 0x7f467c1f6ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4678039040 tx=0x7f4678004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.224+0000 7f466a7fc640 10 client.?.objecter ms_handle_connect 0x7f467c155fe0 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.224+0000 7f466a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 10 monclient(hunting): handle_auth_done global_id 4464 payload 824 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 1 -- 10.20.193.45:0/3665908090 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff370156220 msgr2=0x7ff370157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff370156220 0x7ff370157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 1 -- 10.20.193.45:0/3665908090 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff370155e40 msgr2=0x7ff3700cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff370155e40 0x7ff3700cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7ff36e575640 1 -- 10.20.193.45:0/3665908090 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3701f49a0 con 0x7ff3700ccb80 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7f049e5ea640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 0x7f049815e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41976/0 (socket says 10.20.193.45:41976) 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7f049e5ea640 1 -- 10.20.193.45:0/4022265308 learned_addr learned my addr 10.20.193.45:0/4022265308 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7f049e5ea640 10 monclient(hunting): get_auth_request con 0x7f0498155fe0 auth_method 0 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7f049e5ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7f049e5ea640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.226+0000 7f049e5ea640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.228+0000 7f049e5ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.228+0000 7f049e5ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.228+0000 7f049e5ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.228+0000 7ff36e575640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3700ccb80 0x7ff3700ca8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff36400ebe0 tx=0x7ff36400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.228+0000 7ff356ffd640 10 client.?.objecter ms_handle_connect 0x7ff3700ccb80 2026-02-17T21:07:13.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.228+0000 7ff356ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 10 monclient(hunting): handle_auth_done global_id 4467 payload 824 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 1 -- 10.20.193.45:0/4022265308 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f04980c98b0 msgr2=0x7f04981f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f04980c98b0 0x7f04981f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 1 -- 10.20.193.45:0/4022265308 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f04980c9cf0 msgr2=0x7f04980732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f04980c9cf0 0x7f04980732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.230+0000 7f049e5ea640 1 -- 10.20.193.45:0/4022265308 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0498152d40 con 0x7f0498155fe0 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.231+0000 7f950de76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95080ccb80 0x7f950815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.232+0000 7f950de76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95080ccb80 0x7f950815d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41988/0 (socket says 10.20.193.45:41988) 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.232+0000 7f950de76640 1 -- 10.20.193.45:0/3150996875 learned_addr learned my addr 10.20.193.45:0/3150996875 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.232+0000 7f950de76640 10 monclient(hunting): get_auth_request con 0x7f95080ccb80 auth_method 0 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.232+0000 7f950de76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.232+0000 7f950de76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.232+0000 7f950de76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.232+0000 7f049e5ea640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 0x7f049815e0b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f049400cb80 tx=0x7f049400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.232+0000 7f04867fc640 10 client.?.objecter ms_handle_connect 0x7f0498155fe0 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.232+0000 7f04867fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.233+0000 7f950de76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.233+0000 7f950de76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.233+0000 7f950de76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 10 monclient(hunting): handle_auth_done global_id 4470 payload 824 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 1 -- 10.20.193.45:0/3150996875 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9508156220 msgr2=0x7f95080c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9508156220 0x7f95080c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 1 -- 10.20.193.45:0/3150996875 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9508155e40 msgr2=0x7f95080c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9508155e40 0x7f95080c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.235+0000 7f950de76640 1 -- 10.20.193.45:0/3150996875 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9508157000 con 0x7f95080ccb80 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.237+0000 7fa561ec6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa55c074c90 0x7fa55c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.238+0000 7fa561ec6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa55c074c90 0x7fa55c0c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:41978/0 (socket says 10.20.193.45:41978) 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.238+0000 7fa561ec6640 1 -- 10.20.193.45:0/583529383 learned_addr learned my addr 10.20.193.45:0/583529383 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.238+0000 7fa561ec6640 10 monclient(hunting): get_auth_request con 0x7fa55c074c90 auth_method 0 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.238+0000 7fa561ec6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.238+0000 7fa561ec6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.238+0000 7fa561ec6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.238+0000 7f2fb5850640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb015a4b0 0x7f2fb01f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f94f67fc640 10 client.?.objecter ms_handle_connect 0x7f95080ccb80 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f950de76640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95080ccb80 0x7f950815d2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009a70 tx=0x7f94f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f94f67fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f2fb5850640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb015a4b0 0x7f2fb01f8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42030/0 (socket says 10.20.193.45:42030) 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f2fb5850640 1 -- 10.20.193.45:0/970739850 learned_addr learned my addr 10.20.193.45:0/970739850 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f2fb5850640 10 monclient(hunting): get_auth_request con 0x7f2fb015a4b0 auth_method 0 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f2fb5850640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f2fb5850640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f2fb5850640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7fa561ec6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7fa561ec6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7fa561ec6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f2fb5850640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f2fb5850640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.239+0000 7f2fb5850640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 10 monclient(hunting): handle_auth_done global_id 4476 payload 824 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 1 -- 10.20.193.45:0/970739850 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2fb00d1e50 msgr2=0x7f2fb01fc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2fb00d1e50 0x7f2fb01fc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 1 -- 10.20.193.45:0/970739850 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2fb00c90a0 msgr2=0x7f2fb00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2fb00c90a0 0x7f2fb00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.241+0000 7f2fb5850640 1 -- 10.20.193.45:0/970739850 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb01615c0 con 0x7f2fb015a4b0 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 10 monclient(hunting): handle_auth_done global_id 4473 payload 824 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 1 -- 10.20.193.45:0/583529383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa55c155e40 msgr2=0x7fa55c1e9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa55c155e40 0x7fa55c1e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 1 -- 10.20.193.45:0/583529383 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa55c156220 msgr2=0x7fa55c0c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa55c156220 0x7fa55c0c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 1 monclient: found mon.noname-a 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.243+0000 7fa561ec6640 1 -- 10.20.193.45:0/583529383 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c0c8060 con 0x7fa55c074c90 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 1 -- 10.20.193.45:0/3204926664 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc03c070 con 0x7fddcc155e40 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 10 monclient: dump: 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 1 -- 10.20.193.45:0/3204926664 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddbc02fb50 con 0x7fddcc155e40 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 1 -- 10.20.193.45:0/3204926664 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc037440 con 0x7fddcc155e40 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddbbfff640 10 monclient: dump: 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.310 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 5 monclient: authenticate success, global_id 4526 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 4 set_mon_vals no callback set 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 10 monclient: shutdown 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 1 -- 10.20.193.45:0/3204926664 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 msgr2=0x7fddcc074580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 1 --2- 10.20.193.45:0/3204926664 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 0x7fddcc074580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fddcc08f310 tx=0x7fddbc02ee90 comp rx=0 tx=0).stop 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 1 -- 10.20.193.45:0/3204926664 shutdown_connections 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 1 --2- 10.20.193.45:0/3204926664 >> v2:10.20.193.86:3300/0 conn(0x7fddcc0ccb80 0x7fddcc0ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 1 --2- 10.20.193.45:0/3204926664 >> v2:10.20.193.45:3300/0 conn(0x7fddcc156220 0x7fddcc074ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 1 --2- 10.20.193.45:0/3204926664 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 0x7fddcc074580 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.318+0000 7fddd3688640 1 -- 10.20.193.45:0/3204926664 >> 10.20.193.45:0/3204926664 conn(0x7fddcc0ce270 msgr2=0x7fddcc0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 1 -- 10.20.193.45:0/3204926664 shutdown_connections 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 1 -- 10.20.193.45:0/3204926664 wait complete. 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 10 monclient: monmap: 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.311 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 1 librados: starting msgr at 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 1 librados: starting objecter 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 1 Processor -- start 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 1 -- start start 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 1 librados: setting wanted keys 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 1 librados: calling monclient init 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.319+0000 7fddd3688640 10 monclient: init 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fddcc0ccb80 0x7fddcc1f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient(hunting): picked mon.noname-a con 0x7fddcc0ccb80 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 0x7fddcc1ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient(hunting): picked mon.noname-c con 0x7fddcc155e40 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fddcc156220 0x7fddcc153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient(hunting): picked mon.noname-b con 0x7fddcc156220 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc0cd4e0 con 0x7fddcc0ccb80 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc074060 con 0x7fddcc156220 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc0c4830 con 0x7fddcc155e40 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.320+0000 7fddd3688640 10 monclient(hunting): authenticate will time out at 1016.950415s 2026-02-17T21:07:13.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.321+0000 7fa8217fa640 1 -- 10.20.193.45:0/3374482939 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fa814002b60 con 0x7fa82c155e40 2026-02-17T21:07:13.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.321+0000 7fa8217fa640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7fc0792d0 0x7fa7fc07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.321+0000 7fa830d83640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7fc0792d0 0x7fa7fc07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.321+0000 7fa830d83640 10 monclient: get_auth_request con 0x7fa7fc0792d0 auth_method 0 2026-02-17T21:07:13.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.321+0000 7fa830d83640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7fc0792d0 0x7fa7fc07b790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0055f0 tx=0x7fa81c002990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.321+0000 7fa8217fa640 10 client.4489.objecter ms_handle_connect 0x7fa7fc0792d0 2026-02-17T21:07:13.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.323+0000 7fa8217fa640 1 -- 10.20.193.45:0/3374482939 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fa814097150 con 0x7fa82c155e40 2026-02-17T21:07:13.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.323+0000 7fa8217fa640 10 client.4489.objecter ms_dispatch2 0x7fa82c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.323+0000 7fa8217fa640 3 client.4489.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.323+0000 7fa8217fa640 3 client.4489.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.323+0000 7fa8217fa640 20 client.4489.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.325+0000 7f0f94ff9640 1 -- 10.20.193.45:0/3613247815 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c00c790 con 0x7f0f9815c330 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.325+0000 7f0f94ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.325+0000 7f0f94ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.325+0000 7f0f94ff9640 10 monclient: dump: 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.325+0000 7f0f94ff9640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.325+0000 7f0f94ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.325+0000 7f0f94ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.325+0000 7f0f94ff9640 1 -- 10.20.193.45:0/3613247815 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c010070 con 0x7f0f9815c330 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.325+0000 7f0f94ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f94ff9640 1 -- 10.20.193.45:0/3613247815 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c00cb90 con 0x7f0f9815c330 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 5 monclient: authenticate success, global_id 4532 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 10 monclient: _renew_subs 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f967fc640 4 set_mon_vals no callback set 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f981e77b0 con 0x7f0f9815c330 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f94ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f94ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f94ff9640 10 monclient: dump: 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 10 client.4532.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 10 monclient: _renew_subs 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f981e7a70 con 0x7f0f9815c330 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 1 librados: init done 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f3afbfff640 1 -- 10.20.193.45:0/3179318683 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f3b10007210 con 0x7f3b2015a630 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f9815cce0 con 0x7f0f9815c330 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.326+0000 7f3afbfff640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3af00792d0 0x7f3af007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.327+0000 7f3b1f7fe640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3af00792d0 0x7f3af007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.327+0000 7f3b1f7fe640 10 monclient: get_auth_request con 0x7f3af00792d0 auth_method 0 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.327+0000 7f3afbfff640 10 client.4529.objecter ms_handle_connect 0x7f3af00792d0 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.327+0000 7f3b1f7fe640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3af00792d0 0x7f3af007b790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c002770 tx=0x7f3b0c007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.328+0000 7f3afbfff640 1 -- 10.20.193.45:0/3179318683 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f3b1005d840 con 0x7f3b2015a630 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.328+0000 7f3afbfff640 10 client.4529.objecter ms_dispatch2 0x7f3b20000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.328+0000 7f3afbfff640 3 client.4529.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.328+0000 7f3afbfff640 3 client.4529.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.328+0000 7f3afbfff640 20 client.4529.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7fa8217fa640 1 -- 10.20.193.45:0/3374482939 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa814020020 con 0x7fa82c155e40 2026-02-17T21:07:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7fa8217fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7fa8217fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 1 -- 10.20.193.45:0/4279843770 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6403c070 con 0x7f4c68156220 2026-02-17T21:07:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 10 monclient: dump: 2026-02-17T21:07:13.321 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 1 -- 10.20.193.45:0/4279843770 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64037440 con 0x7f4c68156220 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 1 -- 10.20.193.45:0/4279843770 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64037810 con 0x7f4c68156220 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c5f7fe640 10 monclient: dump: 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c6eab0640 5 monclient: authenticate success, global_id 4492 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c6eab0640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.329+0000 7f4c6eab0640 4 set_mon_vals no callback set 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 10 monclient: shutdown 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4279843770 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68156220 msgr2=0x7f4c681666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 1 --2- 10.20.193.45:0/4279843770 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68156220 0x7f4c681666d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009d90 tx=0x7f4c6402f230 comp rx=0 tx=0).stop 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4279843770 shutdown_connections 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 1 --2- 10.20.193.45:0/4279843770 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68156220 0x7f4c681666d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4279843770 >> 10.20.193.45:0/4279843770 conn(0x7f4c680ce270 msgr2=0x7f4c680ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4279843770 shutdown_connections 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4279843770 wait complete. 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 10 monclient: monmap: 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.323 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 1 librados: starting msgr at 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.330+0000 7f4c6eab0640 1 librados: starting objecter 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 Processor -- start 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 -- start start 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 librados: setting wanted keys 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 librados: calling monclient init 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient: init 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 1 -- 10.20.193.45:0/2226589428 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c017070 con 0x7fd64c0c97b0 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 10 monclient: dump: 2026-02-17T21:07:13.324 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 1 -- 10.20.193.45:0/2226589428 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd63c005de0 con 0x7fd64c0c97b0 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 1 -- 10.20.193.45:0/2226589428 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63c007270 con 0x7fd64c0c97b0 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 5 monclient: authenticate success, global_id 4507 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd642ffd640 4 set_mon_vals no callback set 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd6417fa640 10 monclient: dump: 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 10 monclient: _renew_subs 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64c1e73c0 con 0x7fd64c0c97b0 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 10 client.4507.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 10 monclient: _renew_subs 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64c1e7980 con 0x7fd64c0c97b0 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 1 librados: init done 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c68074c90 0x7f4c680ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient(hunting): picked mon.noname-c con 0x7f4c68074c90 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68155e40 0x7f4c681513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient(hunting): picked mon.noname-b con 0x7f4c68155e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c68156220 0x7f4c681f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient(hunting): picked mon.noname-a con 0x7f4c68156220 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4c680c4830 con 0x7f4c68156220 2026-02-17T21:07:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c68074060 con 0x7f4c68155e40 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c680c49b0 con 0x7f4c68074c90 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7f4c6eab0640 10 monclient(hunting): authenticate will time out at 1016.961578s 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.331+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd64c0cba40 con 0x7fd64c0c97b0 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.332+0000 7fe176ffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe178152620 0x7fe17806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.332+0000 7fe176ffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe178152620 0x7fe17806b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57642/0 (socket says 10.20.193.45:57642) 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.332+0000 7fe176ffd640 1 -- 10.20.193.45:0/4267800170 learned_addr learned my addr 10.20.193.45:0/4267800170 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.332+0000 7fe176ffd640 10 monclient(hunting): get_auth_request con 0x7fe178152620 auth_method 0 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.332+0000 7fe176ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.332+0000 7fe176ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.332+0000 7fe176ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7fe176ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7fe176ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7fe176ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 1 -- 10.20.193.45:0/1864272382 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d403c070 con 0x7f32ec0d1e50 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 10 monclient: dump: 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.328 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 1 -- 10.20.193.45:0/1864272382 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d402fb20 con 0x7f32ec0d1e50 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 1 -- 10.20.193.45:0/1864272382 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4037440 con 0x7f32ec0d1e50 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32f183c640 5 monclient: authenticate success, global_id 4501 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32f183c640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32f183c640 4 set_mon_vals no callback set 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.333+0000 7f32e9ffb640 10 monclient: dump: 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 10 monclient: shutdown 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 1 -- 10.20.193.45:0/1864272382 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32ec0d1e50 msgr2=0x7f32ec0c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 1 --2- 10.20.193.45:0/1864272382 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32ec0d1e50 0x7f32ec0c8b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009970 tx=0x7f32d402eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 1 -- 10.20.193.45:0/1864272382 shutdown_connections 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 1 --2- 10.20.193.45:0/1864272382 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32ec0d1e50 0x7f32ec0c8b60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 1 --2- 10.20.193.45:0/1864272382 >> v2:10.20.193.92:3300/0 conn(0x7f32ec15a4b0 0x7f32ec0d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 1 -- 10.20.193.45:0/1864272382 >> 10.20.193.45:0/1864272382 conn(0x7f32ec06d930 msgr2=0x7f32ec06dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 1 -- 10.20.193.45:0/1864272382 shutdown_connections 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 1 -- 10.20.193.45:0/1864272382 wait complete. 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f3afbfff640 1 -- 10.20.193.45:0/3179318683 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3b10021020 con 0x7f3b2015a630 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f3afbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f3afbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 10 monclient: build_initial_monmap 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7f32f183c640 10 monclient: monmap: 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:13.330 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7fe176ffd640 10 monclient(hunting): handle_auth_done global_id 4519 payload 824 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7fe176ffd640 1 -- 10.20.193.45:0/4267800170 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe17815aff0 msgr2=0x7fe17814ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.334+0000 7fe176ffd640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe17815aff0 0x7fe17814ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7fe176ffd640 1 -- 10.20.193.45:0/4267800170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe178152a00 msgr2=0x7fe17814a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7fe176ffd640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe178152a00 0x7fe17814a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7fe176ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7fe176ffd640 1 monclient: found mon.noname-b 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7fe176ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7fe176ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7fe176ffd640 1 -- 10.20.193.45:0/4267800170 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe178073490 con 0x7fe178152620 2026-02-17T21:07:13.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 librados: starting msgr at 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 librados: starting objecter 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 Processor -- start 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 -- start start 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 librados: setting wanted keys 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 librados: calling monclient init 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient: init 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32ec0c90a0 0x7f32ec152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient(hunting): picked mon.noname-a con 0x7f32ec0c90a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32ec0d1e50 0x7f32ec153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient(hunting): picked mon.noname-b con 0x7f32ec0d1e50 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32ec15a4b0 0x7f32ec0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient(hunting): picked mon.noname-c con 0x7f32ec15a4b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec160800 con 0x7f32ec0c90a0 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec160520 con 0x7f32ec0d1e50 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec160ae0 con 0x7f32ec15a4b0 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.335+0000 7f32f183c640 10 monclient(hunting): authenticate will time out at 1016.965778s 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.337+0000 7fddd0bfc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 0x7fddcc1ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.337+0000 7f32eb7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32ec15a4b0 0x7f32ec0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.337+0000 7fe176ffd640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe178152620 0x7fe17806b870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00b570 tx=0x7fe16c00ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.337+0000 7fe1577fe640 10 client.?.objecter ms_handle_connect 0x7fe178152620 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.337+0000 7fe1577fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7fddd0bfc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 0x7fddcc1ea8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36368/0 (socket says 10.20.193.45:36368) 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7fddd0bfc640 1 -- 10.20.193.45:0/2259071967 learned_addr learned my addr 10.20.193.45:0/2259071967 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7fddd0bfc640 10 monclient(hunting): get_auth_request con 0x7fddcc155e40 auth_method 0 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7fddd0bfc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7fddd0bfc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7fddd0bfc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7f32eb7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32ec15a4b0 0x7f32ec0d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36390/0 (socket says 10.20.193.45:36390) 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7f32eb7fe640 1 -- 10.20.193.45:0/608173617 learned_addr learned my addr 10.20.193.45:0/608173617 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7f32eb7fe640 10 monclient(hunting): get_auth_request con 0x7f32ec15a4b0 auth_method 0 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7f32eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7f32eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.338+0000 7f32eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.341+0000 7fddd0bfc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.341+0000 7fddd0bfc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.341+0000 7fddd0bfc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.343+0000 7fddd1bfe640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fddcc156220 0x7fddcc153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 1 -- 10.20.193.45:0/2869854944 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678046020 con 0x7f467c155fe0 2026-02-17T21:07:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 10 monclient: dump: 2026-02-17T21:07:13.341 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 1 -- 10.20.193.45:0/2869854944 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4678041450 con 0x7f467c155fe0 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 1 -- 10.20.193.45:0/2869854944 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678037e60 con 0x7f467c155fe0 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466a7fc640 10 monclient: dump: 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f46840bd640 5 monclient: authenticate success, global_id 4461 2026-02-17T21:07:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f466bfff640 4 set_mon_vals no callback set 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f46840bd640 10 monclient: _renew_subs 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f46840bd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467c0d0540 con 0x7f467c155fe0 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f46840bd640 10 client.4461.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f46840bd640 10 monclient: _renew_subs 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f46840bd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467c0d0b00 con 0x7f467c155fe0 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.349+0000 7f46840bd640 1 librados: init done 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.350+0000 7f46840bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.350+0000 7f46840bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.350+0000 7f46840bd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.350+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467c0cb550 con 0x7f467c155fe0 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.351+0000 7f2fb5850640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb015a4b0 0x7f2fb01f8160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00b9c0 tx=0x7f2fac00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.351+0000 7f2f9dffb640 10 client.?.objecter ms_handle_connect 0x7f2fb015a4b0 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.351+0000 7f2f9dffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.351+0000 7fa561ec6640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa55c074c90 0x7fa55c0c5790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00b5a0 tx=0x7fa54c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.351+0000 7fa54a7fc640 10 client.?.objecter ms_handle_connect 0x7fa55c074c90 2026-02-17T21:07:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.351+0000 7fa54a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.414+0000 7fa83300e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:07:13.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.415+0000 7fa83300e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:07:13.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.415+0000 7fa83300e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.415+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa82c159770 con 0x7fa82c155e40 2026-02-17T21:07:13.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.419+0000 7f3b25e45640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:07:13.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.419+0000 7f3b25e45640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:07:13.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.419+0000 7f3b25e45640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.419+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3b2006d0a0 con 0x7f3b2015a630 2026-02-17T21:07:13.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.441+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.441+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.441+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.441+0000 7f0f94ff9640 1 -- 10.20.193.45:0/3613247815 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f0f8c004070 con 0x7f0f9815c330 2026-02-17T21:07:13.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.442+0000 7f0f94ff9640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0f680792d0 0x7f0f6807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.442+0000 7f0f97fff640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0f680792d0 0x7f0f6807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.442+0000 7f0f97fff640 10 monclient: get_auth_request con 0x7f0f680792d0 auth_method 0 2026-02-17T21:07:13.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.442+0000 7f0f97fff640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0f680792d0 0x7f0f6807b790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0f84007fd0 tx=0x7f0f84007b40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.442+0000 7f0f94ff9640 10 client.4532.objecter ms_handle_connect 0x7f0f680792d0 2026-02-17T21:07:13.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.442+0000 7fddd1bfe640 10 monclient(hunting): get_auth_request con 0x7fddcc156220 auth_method 0 2026-02-17T21:07:13.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.442+0000 7fddd1bfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.442+0000 7fddd1bfe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.442+0000 7fddd1bfe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 10 monclient(hunting): handle_auth_done global_id 4538 payload 824 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 1 -- 10.20.193.45:0/2259071967 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fddcc156220 msgr2=0x7fddcc153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fddcc156220 0x7fddcc153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 1 -- 10.20.193.45:0/2259071967 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fddcc0ccb80 msgr2=0x7fddcc1f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fddcc0ccb80 0x7fddcc1f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.443+0000 7fddd0bfc640 1 -- 10.20.193.45:0/2259071967 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc1540a0 con 0x7fddcc155e40 2026-02-17T21:07:13.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.445+0000 7f0f94ff9640 1 -- 10.20.193.45:0/3613247815 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f0f8c00cd30 con 0x7f0f9815c330 2026-02-17T21:07:13.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.446+0000 7f0f94ff9640 10 client.4532.objecter ms_dispatch2 0x7f0f98000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.446+0000 7f0f94ff9640 3 client.4532.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.446+0000 7f0f94ff9640 3 client.4532.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.446+0000 7f0f94ff9640 20 client.4532.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.451+0000 7fd6417fa640 1 -- 10.20.193.45:0/2226589428 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fd63c007410 con 0x7fd64c0c97b0 2026-02-17T21:07:13.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.452+0000 7fd6417fa640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd61c0792d0 0x7fd61c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.452+0000 7fd643fff640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd61c0792d0 0x7fd61c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.452+0000 7f0f94ff9640 1 -- 10.20.193.45:0/3613247815 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0f981f7a40 con 0x7f0f9815c330 2026-02-17T21:07:13.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.452+0000 7f0f94ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.452+0000 7fd643fff640 10 monclient: get_auth_request con 0x7fd61c0792d0 auth_method 0 2026-02-17T21:07:13.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.452+0000 7f0f94ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.452+0000 7fd643fff640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd61c0792d0 0x7fd61c07b790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0c88a0 tx=0x7fd6340091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.452+0000 7fd6417fa640 10 client.4507.objecter ms_handle_connect 0x7fd61c0792d0 2026-02-17T21:07:13.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 10 monclient(hunting): handle_auth_done global_id 4541 payload 824 2026-02-17T21:07:13.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 1 -- 10.20.193.45:0/608173617 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32ec0d1e50 msgr2=0x7f32ec153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32ec0d1e50 0x7f32ec153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 1 -- 10.20.193.45:0/608173617 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32ec0c90a0 msgr2=0x7f32ec152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32ec0c90a0 0x7f32ec152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.453+0000 7f32eb7fe640 1 -- 10.20.193.45:0/608173617 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec153280 con 0x7f32ec15a4b0 2026-02-17T21:07:13.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7fd6417fa640 1 -- 10.20.193.45:0/2226589428 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fd63c007730 con 0x7fd64c0c97b0 2026-02-17T21:07:13.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7fd6417fa640 10 client.4507.objecter ms_dispatch2 0x7fd64c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7fd6417fa640 3 client.4507.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7fd6417fa640 3 client.4507.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7fd6417fa640 20 client.4507.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7f4c5ffff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68155e40 0x7f4c681513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7f4c5ffff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68155e40 0x7f4c681513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57672/0 (socket says 10.20.193.45:57672) 2026-02-17T21:07:13.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7f4c5ffff640 1 -- 10.20.193.45:0/4095411956 learned_addr learned my addr 10.20.193.45:0/4095411956 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:13.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7f4c5ffff640 10 monclient(hunting): get_auth_request con 0x7f4c68155e40 auth_method 0 2026-02-17T21:07:13.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7f4c5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7f4c5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.454+0000 7f4c5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.455+0000 7fddd0bfc640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 0x7fddcc1ea8a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fddc000e840 tx=0x7fddc000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.455+0000 7fddb9ffb640 10 client.?.objecter ms_handle_connect 0x7fddcc155e40 2026-02-17T21:07:13.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.455+0000 7fddb9ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.455+0000 7f32eb7fe640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32ec15a4b0 0x7f32ec0d0a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00b990 tx=0x7f32dc00be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.455+0000 7f32c3fff640 10 client.?.objecter ms_handle_connect 0x7f32ec15a4b0 2026-02-17T21:07:13.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.455+0000 7f32c3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.458+0000 7f4c6c825640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c68074c90 0x7f4c680ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.459+0000 7f4c6c825640 10 monclient(hunting): get_auth_request con 0x7f4c68074c90 auth_method 0 2026-02-17T21:07:13.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.459+0000 7f4c6c825640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:13.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.459+0000 7f4c6c825640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:13.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.459+0000 7f4c6c825640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:13.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 1 -- 10.20.193.45:0/3665908090 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364017070 con 0x7ff3700ccb80 2026-02-17T21:07:13.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f4c6c825640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f4c6c825640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 10 monclient: dump: 2026-02-17T21:07:13.453 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.453 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.453 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 1 -- 10.20.193.45:0/3665908090 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36400cc40 con 0x7ff3700ccb80 2026-02-17T21:07:13.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f4c6c825640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 1 -- 10.20.193.45:0/3665908090 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364013470 con 0x7ff3700ccb80 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff356ffd640 10 monclient: dump: 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.456 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff36cd72640 4 set_mon_vals no callback set 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff374b01640 5 monclient: authenticate success, global_id 4464 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff374b01640 10 monclient: _renew_subs 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff374b01640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3700c8d40 con 0x7ff3700ccb80 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff374b01640 10 client.4464.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff374b01640 10 monclient: _renew_subs 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff374b01640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3700c9300 con 0x7ff3700ccb80 2026-02-17T21:07:13.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7ff374b01640 1 librados: init done 2026-02-17T21:07:13.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7fd6417fa640 1 -- 10.20.193.45:0/2226589428 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd63c022080 con 0x7fd64c0c97b0 2026-02-17T21:07:13.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7fd6417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7fd6417fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 1 -- 10.20.193.45:0/608173617 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00c790 con 0x7f32ec15a4b0 2026-02-17T21:07:13.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 10 monclient: dump: 2026-02-17T21:07:13.459 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.459 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.459 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 1 -- 10.20.193.45:0/608173617 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc010070 con 0x7f32ec15a4b0 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 1 -- 10.20.193.45:0/608173617 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00cbb0 con 0x7f32ec15a4b0 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32c3fff640 10 monclient: dump: 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.461 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32e97fa640 4 set_mon_vals no callback set 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32f183c640 5 monclient: authenticate success, global_id 4541 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32f183c640 10 monclient: _renew_subs 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32f183c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec1540d0 con 0x7f32ec15a4b0 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32f183c640 10 client.4541.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32f183c640 10 monclient: _renew_subs 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32f183c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec154680 con 0x7f32ec15a4b0 2026-02-17T21:07:13.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.460+0000 7f32f183c640 1 librados: init done 2026-02-17T21:07:13.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7ff374b01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7ff374b01640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7ff374b01640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3700ccfa0 con 0x7ff3700ccb80 2026-02-17T21:07:13.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7f32f183c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7f32f183c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7f32f183c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec160dc0 con 0x7f32ec15a4b0 2026-02-17T21:07:13.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7f4c5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:13.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7f4c5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:13.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.461+0000 7f4c5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:13.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 1 -- 10.20.193.45:0/1062729136 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4017070 con 0x7fc908152620 2026-02-17T21:07:13.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 10 monclient: dump: 2026-02-17T21:07:13.466 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.466 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.466 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.466 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.466 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 1 -- 10.20.193.45:0/1062729136 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f4005de0 con 0x7fc908152620 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 1 -- 10.20.193.45:0/1062729136 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4007270 con 0x7fc908152620 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc8e3fff640 10 monclient: dump: 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc905ffb640 4 set_mon_vals no callback set 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc90dfce640 5 monclient: authenticate success, global_id 4458 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc90dfce640 10 monclient: _renew_subs 2026-02-17T21:07:13.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc90dfce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9081516a0 con 0x7fc908152620 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc90dfce640 10 client.4458.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc90dfce640 10 monclient: _renew_subs 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc90dfce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc908151c60 con 0x7fc908152620 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.462+0000 7fc90dfce640 1 librados: init done 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7fc90dfce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7fc90dfce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7fc90dfce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc90815a9a0 con 0x7fc908152620 2026-02-17T21:07:13.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 1 -- 10.20.193.45:0/3150996875 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8047070 con 0x7f95080ccb80 2026-02-17T21:07:13.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 10 monclient: dump: 2026-02-17T21:07:13.470 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.470 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 1 -- 10.20.193.45:0/3150996875 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f8042630 con 0x7f95080ccb80 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 1 -- 10.20.193.45:0/3150996875 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f803c040 con 0x7f95080ccb80 2026-02-17T21:07:13.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f9510101640 5 monclient: authenticate success, global_id 4470 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f7fff640 4 set_mon_vals no callback set 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f9510101640 10 monclient: _renew_subs 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f9510101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95080c6d70 con 0x7f95080ccb80 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f94f67fc640 10 monclient: dump: 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.472 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.473 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f9510101640 10 client.4470.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f9510101640 10 monclient: _renew_subs 2026-02-17T21:07:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f9510101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95080c7330 con 0x7f95080ccb80 2026-02-17T21:07:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f9510101640 1 librados: init done 2026-02-17T21:07:13.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 10 monclient(hunting): handle_auth_done global_id 4544 payload 824 2026-02-17T21:07:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 1 -- 10.20.193.45:0/4095411956 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68155e40 msgr2=0x7f4c681513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68155e40 0x7f4c681513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 1 -- 10.20.193.45:0/4095411956 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c68156220 msgr2=0x7f4c681f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c68156220 0x7f4c681f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 10 monclient: _finish_hunting 0 2026-02-17T21:07:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 1 monclient: found mon.noname-c 2026-02-17T21:07:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.463+0000 7f4c6c825640 1 -- 10.20.193.45:0/4095411956 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c680c8f30 con 0x7f4c68074c90 2026-02-17T21:07:13.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.464+0000 7f9510101640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.464+0000 7f9510101640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.464+0000 7f9510101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.464+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95080ccfa0 con 0x7f95080ccb80 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 1 -- 10.20.193.45:0/4267800170 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c013020 con 0x7fe178152620 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 10 monclient: dump: 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.476 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 1 -- 10.20.193.45:0/4267800170 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16c0044a0 con 0x7fe178152620 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 1 -- 10.20.193.45:0/4267800170 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0029c0 con 0x7fe178152620 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe17d415640 5 monclient: authenticate success, global_id 4519 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1757fa640 4 set_mon_vals no callback set 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe1577fe640 10 monclient: dump: 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.477 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe17d415640 10 monclient: _renew_subs 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe17d415640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe178200a80 con 0x7fe178152620 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe17d415640 10 client.4519.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe17d415640 10 monclient: _renew_subs 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe17d415640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe178200d40 con 0x7fe178152620 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.466+0000 7fe17d415640 1 librados: init done 2026-02-17T21:07:13.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.467+0000 7fe17d415640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.467+0000 7fe17d415640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.467+0000 7fe17d415640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.467+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1780698c0 con 0x7fe178152620 2026-02-17T21:07:13.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.536+0000 7f0f9e361640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:07:13.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.536+0000 7f0f9e361640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:07:13.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.536+0000 7f0f9e361640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.536+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7f0f980cbe40 con 0x7f0f9815c330 2026-02-17T21:07:13.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.544+0000 7fd65305e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:13.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.544+0000 7fd65305e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:13.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.544+0000 7fd65305e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.544+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7fd64c074ed0 con 0x7fd64c0c97b0 2026-02-17T21:07:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.562+0000 7f3afbfff640 1 -- 10.20.193.45:0/3179318683 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b10061f00 con 0x7f3b2015a630 2026-02-17T21:07:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.562+0000 7f3afbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:07:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.562+0000 7f3afbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:13.555 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-17T21:07:13.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 10 librados: watch_flush enter 2026-02-17T21:07:13.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 10 librados: watch_flush exit 2026-02-17T21:07:13.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 20 client.4529.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 10 client.4529.objecter successfully canceled tick 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3af00792d0 msgr2=0x7f3af007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3af00792d0 0x7f3af007b790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c002770 tx=0x7f3b0c007ab0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 10 monclient: shutdown 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b2015a630 msgr2=0x7f3b201565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b2015a630 0x7f3b201565c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000c760 tx=0x7f3b1000cc30 comp rx=0 tx=0).stop 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 shutdown_connections 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3af00792d0 0x7f3af007b790 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3b2015f530 0x7f3b2006f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3b2015a630 0x7f3b201565c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 --2- 10.20.193.45:0/3179318683 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3b201560d0 0x7f3b201fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 >> 10.20.193.45:0/3179318683 conn(0x7f3b200cf510 msgr2=0x7f3b200ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 shutdown_connections 2026-02-17T21:07:13.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 -- 10.20.193.45:0/3179318683 wait complete. 2026-02-17T21:07:13.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.564+0000 7f3b25e45640 1 librados: shutdown 2026-02-17T21:07:13.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.568+0000 7fa8217fa640 1 -- 10.20.193.45:0/3374482939 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa8140616e0 con 0x7fa82c155e40 2026-02-17T21:07:13.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.568+0000 7fa8217fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:07:13.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.568+0000 7fa8217fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:13.561 INFO:teuthology.orchestra.run.trial045.stdout:111669149704 2026-02-17T21:07:13.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7f4c6c825640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c68074c90 0x7f4c680ca590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800c700 tx=0x7f4c5800cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7f4c5d7fa640 10 client.?.objecter ms_handle_connect 0x7f4c68074c90 2026-02-17T21:07:13.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7f4c5d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:13.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7fa83300e640 10 librados: watch_flush enter 2026-02-17T21:07:13.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7fa83300e640 10 librados: watch_flush exit 2026-02-17T21:07:13.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7fa83300e640 20 client.4489.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7fa83300e640 10 client.4489.objecter successfully canceled tick 2026-02-17T21:07:13.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7fc0792d0 msgr2=0x7fa7fc07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7fa83300e640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7fc0792d0 0x7fa7fc07b790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0055f0 tx=0x7fa81c002990 comp rx=0 tx=0).stop 2026-02-17T21:07:13.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.570+0000 7fa83300e640 10 monclient: shutdown 2026-02-17T21:07:13.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c155e40 msgr2=0x7fa82c1e9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c155e40 0x7fa82c1e9080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa81400b5b0 tx=0x7fa81400ba80 comp rx=0 tx=0).stop 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 shutdown_connections 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7fc0792d0 0x7fa7fc07b790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa82c156220 0x7fa82c144b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa82c155e40 0x7fa82c1e9080 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 --2- 10.20.193.45:0/3374482939 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa82c074c90 0x7fa82c1f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 >> 10.20.193.45:0/3374482939 conn(0x7fa82c0ce270 msgr2=0x7fa82c0ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 shutdown_connections 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 -- 10.20.193.45:0/3374482939 wait complete. 2026-02-17T21:07:13.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7fa83300e640 1 librados: shutdown 2026-02-17T21:07:13.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f32c3fff640 1 -- 10.20.193.45:0/608173617 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f32dc01d030 con 0x7f32ec15a4b0 2026-02-17T21:07:13.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 1 -- 10.20.193.45:0/4022265308 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494017070 con 0x7f0498155fe0 2026-02-17T21:07:13.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 10 monclient: dump: 2026-02-17T21:07:13.567 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.567 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.567 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 1 -- 10.20.193.45:0/4022265308 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049400ad50 con 0x7f0498155fe0 2026-02-17T21:07:13.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04a0074640 5 monclient: authenticate success, global_id 4467 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04a0074640 10 monclient: _renew_subs 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04a0074640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049815d010 con 0x7f0498155fe0 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 1 -- 10.20.193.45:0/4022265308 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494012600 con 0x7f0498155fe0 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04867fc640 10 monclient: dump: 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.569 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f0487fff640 4 set_mon_vals no callback set 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04a0074640 10 client.4467.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04a0074640 10 monclient: _renew_subs 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04a0074640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049815d5d0 con 0x7f0498155fe0 2026-02-17T21:07:13.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f04a0074640 1 librados: init done 2026-02-17T21:07:13.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f32c3fff640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32bc0792d0 0x7f32bc07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f32eaffd640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32bc0792d0 0x7f32bc07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.571+0000 7f32eaffd640 10 monclient: get_auth_request con 0x7f32bc0792d0 auth_method 0 2026-02-17T21:07:13.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.572+0000 7f32c3fff640 10 client.4541.objecter ms_handle_connect 0x7f32bc0792d0 2026-02-17T21:07:13.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.572+0000 7f32eaffd640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32bc0792d0 0x7f32bc07b790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009770 tx=0x7f32e0006cf0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.572+0000 7f04a0074640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.572+0000 7f04a0074640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.572+0000 7f04a0074640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.572+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04980cb550 con 0x7f0498155fe0 2026-02-17T21:07:13.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.573+0000 7f32c3fff640 1 -- 10.20.193.45:0/608173617 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f32dc01dde0 con 0x7f32ec15a4b0 2026-02-17T21:07:13.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.573+0000 7f32c3fff640 10 client.4541.objecter ms_dispatch2 0x7f32ec000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.573+0000 7f32c3fff640 3 client.4541.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.573+0000 7f32c3fff640 3 client.4541.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.3 2026-02-17T21:07:13.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.573+0000 7f32c3fff640 20 client.4541.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.577+0000 7fe1577fe640 1 -- 10.20.193.45:0/4267800170 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fe16c002b60 con 0x7fe178152620 2026-02-17T21:07:13.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.578+0000 7fe1577fe640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1440792d0 0x7fe14407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.578+0000 7fe1767fc640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1440792d0 0x7fe14407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.578+0000 7fe1767fc640 10 monclient: get_auth_request con 0x7fe1440792d0 auth_method 0 2026-02-17T21:07:13.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.578+0000 7fe1767fc640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1440792d0 0x7fe14407b790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe178076d30 tx=0x7fe160035000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.578+0000 7fe1577fe640 10 client.4519.objecter ms_handle_connect 0x7fe1440792d0 2026-02-17T21:07:13.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149705 got 111669149704 for osd.7 2026-02-17T21:07:13.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 1 -- 10.20.193.45:0/583529383 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c012070 con 0x7fa55c074c90 2026-02-17T21:07:13.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 10 monclient: dump: 2026-02-17T21:07:13.578 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 1 -- 10.20.193.45:0/583529383 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c0044a0 con 0x7fa55c074c90 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 1 -- 10.20.193.45:0/583529383 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0029c0 con 0x7fa55c074c90 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54a7fc640 10 monclient: dump: 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.580 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa54bfff640 4 set_mon_vals no callback set 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa564151640 5 monclient: authenticate success, global_id 4473 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa564151640 10 monclient: _renew_subs 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa564151640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55c0c8340 con 0x7fa55c074c90 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa564151640 10 client.4473.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa564151640 10 monclient: _renew_subs 2026-02-17T21:07:13.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa564151640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55c1f55d0 con 0x7fa55c074c90 2026-02-17T21:07:13.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fa564151640 1 librados: init done 2026-02-17T21:07:13.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fe1577fe640 1 -- 10.20.193.45:0/4267800170 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fe16c05e390 con 0x7fe178152620 2026-02-17T21:07:13.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fe1577fe640 10 client.4519.objecter ms_dispatch2 0x7fe178000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fe1577fe640 3 client.4519.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fe1577fe640 3 client.4519.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7f0f94ff9640 1 -- 10.20.193.45:0/3613247815 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0f8c062640 con 0x7f0f9815c330 2026-02-17T21:07:13.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7f0f94ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:07:13.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7fe1577fe640 20 client.4519.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.580+0000 7f0f94ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:13.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7f466a7fc640 1 -- 10.20.193.45:0/2869854944 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4678041860 con 0x7f467c155fe0 2026-02-17T21:07:13.584 INFO:teuthology.orchestra.run.trial045.stdout:115964116999 2026-02-17T21:07:13.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7f32c3fff640 1 -- 10.20.193.45:0/608173617 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f32dc062310 con 0x7f32ec15a4b0 2026-02-17T21:07:13.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7f32c3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7f32c3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7fa564151640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7fa564151640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7fa564151640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7f466a7fc640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f464c079280 0x7f464c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55c074580 con 0x7fa55c074c90 2026-02-17T21:07:13.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7f4681e32640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f464c079280 0x7f464c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7f4681e32640 10 monclient: get_auth_request con 0x7f464c079280 auth_method 0 2026-02-17T21:07:13.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7f466a7fc640 10 client.4461.objecter ms_handle_connect 0x7f464c079280 2026-02-17T21:07:13.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.581+0000 7f4681e32640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f464c079280 0x7f464c07b740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f466c0098a0 tx=0x7f466c006d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 1 -- 10.20.193.45:0/2259071967 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc0017070 con 0x7fddcc155e40 2026-02-17T21:07:13.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 10 monclient: dump: 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 10 librados: watch_flush enter 2026-02-17T21:07:13.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 10 librados: watch_flush exit 2026-02-17T21:07:13.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 20 client.4532.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 1 -- 10.20.193.45:0/2259071967 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc000c8d0 con 0x7fddcc155e40 2026-02-17T21:07:13.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 5 monclient: authenticate success, global_id 4538 2026-02-17T21:07:13.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 1 -- 10.20.193.45:0/2259071967 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc000f040 con 0x7fddcc155e40 2026-02-17T21:07:13.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 10 monclient: _renew_subs 2026-02-17T21:07:13.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 10 client.4532.objecter successfully canceled tick 2026-02-17T21:07:13.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddbb7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:13.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddcc154380 con 0x7fddcc155e40 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddb9ffb640 10 monclient: dump: 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.591 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.592 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 10 client.4538.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 10 monclient: _renew_subs 2026-02-17T21:07:13.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0f680792d0 msgr2=0x7f0f6807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0f680792d0 0x7f0f6807b790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0f84007fd0 tx=0x7f0f84007b40 comp rx=0 tx=0).stop 2026-02-17T21:07:13.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddcc1f7e60 con 0x7fddcc155e40 2026-02-17T21:07:13.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 10 monclient: shutdown 2026-02-17T21:07:13.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 1 librados: init done 2026-02-17T21:07:13.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f9815c330 msgr2=0x7f0f980cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f9815c330 0x7f0f980cd3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00b9a0 tx=0x7f0f8c00be70 comp rx=0 tx=0).stop 2026-02-17T21:07:13.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 shutdown_connections 2026-02-17T21:07:13.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0f680792d0 0x7f0f6807b790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0f9815c330 0x7f0f980cd3e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0f981561d0 0x7f0f981f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 --2- 10.20.193.45:0/3613247815 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0f98155df0 0x7f0f9814c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 >> 10.20.193.45:0/3613247815 conn(0x7f0f98074050 msgr2=0x7f0f9815f950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 shutdown_connections 2026-02-17T21:07:13.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7f0f9e361640 1 -- 10.20.193.45:0/3613247815 wait complete. 2026-02-17T21:07:13.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.583+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddcc0cbe40 con 0x7fddcc155e40 2026-02-17T21:07:13.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.584+0000 7f0f9e361640 1 librados: shutdown 2026-02-17T21:07:13.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.587+0000 7fe1577fe640 1 -- 10.20.193.45:0/4267800170 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe1780698c0 con 0x7fe178152620 2026-02-17T21:07:13.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.587+0000 7fe1577fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.587+0000 7fe1577fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.587+0000 7fd6417fa640 1 -- 10.20.193.45:0/2226589428 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fd63c0615c0 con 0x7fd64c0c97b0 2026-02-17T21:07:13.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.587+0000 7fd6417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:13.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.587+0000 7fd6417fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:13.597 INFO:teuthology.orchestra.run.trial045.stdout:94489280515 2026-02-17T21:07:13.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 10 librados: watch_flush enter 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 10 librados: watch_flush exit 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 20 client.4507.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 10 client.4507.objecter successfully canceled tick 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd61c0792d0 msgr2=0x7fd61c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd61c0792d0 0x7fd61c07b790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0c88a0 tx=0x7fd6340091c0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 10 monclient: shutdown 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd64c0c97b0 msgr2=0x7fd64c0cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd64c0c97b0 0x7fd64c0cfd90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c520 tx=0x7fd63c00c9f0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 shutdown_connections 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd61c0792d0 0x7fd61c07b790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd64c15f580 0x7fd64c14d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd64c15e2b0 0x7fd64c14cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 --2- 10.20.193.45:0/2226589428 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd64c0c97b0 0x7fd64c0cfd90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 >> 10.20.193.45:0/2226589428 conn(0x7fd64c073030 msgr2=0x7fd64c15f960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 shutdown_connections 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 -- 10.20.193.45:0/2226589428 wait complete. 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.589+0000 7fd65305e640 1 librados: shutdown 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.591+0000 7f466a7fc640 1 -- 10.20.193.45:0/2869854944 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f4678083fc0 con 0x7f467c155fe0 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.591+0000 7f466a7fc640 10 client.4461.objecter ms_dispatch2 0x7f467c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.591+0000 7f466a7fc640 3 client.4461.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.591+0000 7f466a7fc640 3 client.4461.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.591+0000 7f466a7fc640 20 client.4461.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.591+0000 7f466a7fc640 1 -- 10.20.193.45:0/2869854944 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4678050030 con 0x7f467c155fe0 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.591+0000 7f466a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.591+0000 7f466a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964116999 for osd.14 2026-02-17T21:07:13.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.13 2026-02-17T21:07:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.599+0000 7f1d3e7fc640 1 -- 10.20.193.45:0/3283116438 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f1d4c042860 con 0x7f1d50155fb0 2026-02-17T21:07:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.599+0000 7f1d3e7fc640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1d20079300 0x7f1d2007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.600+0000 7f1d55f83640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1d20079300 0x7f1d2007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.600+0000 7f1d55f83640 10 monclient: get_auth_request con 0x7f1d20079300 auth_method 0 2026-02-17T21:07:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.600+0000 7f1d55f83640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1d20079300 0x7f1d2007b7c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009c40 tx=0x7f1d40009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.600+0000 7f1d3e7fc640 10 client.4455.objecter ms_handle_connect 0x7f1d20079300 2026-02-17T21:07:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.610+0000 7fc8e3fff640 1 -- 10.20.193.45:0/1062729136 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc8f4007410 con 0x7fc908152620 2026-02-17T21:07:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.610+0000 7fc8e3fff640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc8d80792d0 0x7fc8d807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.610+0000 7fc906ffd640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc8d80792d0 0x7fc8d807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.610+0000 7fc906ffd640 10 monclient: get_auth_request con 0x7fc8d80792d0 auth_method 0 2026-02-17T21:07:13.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.610+0000 7fc8e3fff640 10 client.4458.objecter ms_handle_connect 0x7fc8d80792d0 2026-02-17T21:07:13.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.610+0000 7fc906ffd640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc8d80792d0 0x7fc8d807b790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8039000 tx=0x7fc8f8031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.615+0000 7f1d3e7fc640 1 -- 10.20.193.45:0/3283116438 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f1d4c0844c0 con 0x7f1d50155fb0 2026-02-17T21:07:13.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.615+0000 7f1d3e7fc640 10 client.4455.objecter ms_dispatch2 0x7f1d50000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.615+0000 7f1d3e7fc640 3 client.4455.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.615+0000 7f1d3e7fc640 3 client.4455.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.615+0000 7f1d3e7fc640 20 client.4455.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.615+0000 7f1d3e7fc640 1 -- 10.20.193.45:0/3283116438 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1d4c051030 con 0x7f1d50155fb0 2026-02-17T21:07:13.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.615+0000 7f1d3e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.615+0000 7f1d3e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.626+0000 7fc8e3fff640 1 -- 10.20.193.45:0/1062729136 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fc8f4007730 con 0x7fc908152620 2026-02-17T21:07:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.626+0000 7fc8e3fff640 10 client.4458.objecter ms_dispatch2 0x7fc908000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.626+0000 7fc8e3fff640 3 client.4458.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.626+0000 7fc8e3fff640 3 client.4458.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.626+0000 7fc8e3fff640 20 client.4458.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.626+0000 7fc8e3fff640 1 -- 10.20.193.45:0/1062729136 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc8f4022080 con 0x7fc908152620 2026-02-17T21:07:13.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.626+0000 7fc8e3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.626+0000 7fc8e3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 1 -- 10.20.193.45:0/970739850 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00c790 con 0x7f2fb015a4b0 2026-02-17T21:07:13.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 10 monclient: dump: 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 1 -- 10.20.193.45:0/970739850 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fac010070 con 0x7f2fb015a4b0 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 1 -- 10.20.193.45:0/970739850 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00cb70 con 0x7f2fb015a4b0 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2fb72da640 5 monclient: authenticate success, global_id 4476 2026-02-17T21:07:13.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9f7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2f9dffb640 10 monclient: dump: 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2fb72da640 10 monclient: _renew_subs 2026-02-17T21:07:13.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2fb72da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb01f86a0 con 0x7f2fb015a4b0 2026-02-17T21:07:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2fb72da640 10 client.4476.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2fb72da640 10 monclient: _renew_subs 2026-02-17T21:07:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2fb72da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb01f8c50 con 0x7f2fb015a4b0 2026-02-17T21:07:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.629+0000 7f2fb72da640 1 librados: init done 2026-02-17T21:07:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.630+0000 7f2fb72da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.630+0000 7f2fb72da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.630+0000 7f2fb72da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.630+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb0160dc0 con 0x7f2fb015a4b0 2026-02-17T21:07:13.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.669+0000 7f32f183c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:07:13.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.669+0000 7f32f183c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:07:13.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.669+0000 7f32f183c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.669+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f32ec0ccaa0 con 0x7f32ec15a4b0 2026-02-17T21:07:13.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.678+0000 7fe17d415640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:07:13.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.678+0000 7fe17d415640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:07:13.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.678+0000 7fe17d415640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:13.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.678+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fe1780c6c90 con 0x7fe178152620 2026-02-17T21:07:13.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.680+0000 7fe1577fe640 1 -- 10.20.193.45:0/4267800170 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe16c01d020 con 0x7fe178152620 2026-02-17T21:07:13.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.680+0000 7fe1577fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:07:13.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.680+0000 7fe1577fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:13.673 INFO:teuthology.orchestra.run.trial045.stdout:111669149703 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 1 -- 10.20.193.45:0/4095411956 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c58017070 con 0x7f4c68074c90 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 10 monclient: dump: 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.675 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 1 -- 10.20.193.45:0/4095411956 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c58005bd0 con 0x7f4c68074c90 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 1 -- 10.20.193.45:0/4095411956 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c58007070 con 0x7f4c68074c90 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c6eab0640 5 monclient: authenticate success, global_id 4544 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:13.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5effd640 4 set_mon_vals no callback set 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c5d7fa640 10 monclient: dump: 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:13.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c6eab0640 10 monclient: _renew_subs 2026-02-17T21:07:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c6eab0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c680c9210 con 0x7f4c68074c90 2026-02-17T21:07:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c6eab0640 10 client.4544.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c6eab0640 10 monclient: _renew_subs 2026-02-17T21:07:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c6eab0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c680c97d0 con 0x7f4c68074c90 2026-02-17T21:07:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f4c6eab0640 1 librados: init done 2026-02-17T21:07:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f46840bd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:07:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f46840bd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:07:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f46840bd640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f467c0cdb20 con 0x7f467c155fe0 2026-02-17T21:07:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7fe17d415640 10 librados: watch_flush enter 2026-02-17T21:07:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7fe17d415640 10 librados: watch_flush exit 2026-02-17T21:07:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.682+0000 7fe17d415640 20 client.4519.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 10 client.4519.objecter successfully canceled tick 2026-02-17T21:07:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1440792d0 msgr2=0x7fe14407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1440792d0 0x7fe14407b790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe178076d30 tx=0x7fe160035000 comp rx=0 tx=0).stop 2026-02-17T21:07:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 10 monclient: shutdown 2026-02-17T21:07:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe178152620 msgr2=0x7fe17806b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe178152620 0x7fe17806b870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00b570 tx=0x7fe16c00ba40 comp rx=0 tx=0).stop 2026-02-17T21:07:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7f4c6eab0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7f4c6eab0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7f4c6eab0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 shutdown_connections 2026-02-17T21:07:13.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1440792d0 0x7fe14407b790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe17815aff0 0x7fe17814ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe178152a00 0x7fe17814a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 --2- 10.20.193.45:0/4267800170 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe178152620 0x7fe17806b870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 >> 10.20.193.45:0/4267800170 conn(0x7fe1780c9d40 msgr2=0x7fe1780ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c68074580 con 0x7f4c68074c90 2026-02-17T21:07:13.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 shutdown_connections 2026-02-17T21:07:13.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 -- 10.20.193.45:0/4267800170 wait complete. 2026-02-17T21:07:13.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.683+0000 7fe17d415640 1 librados: shutdown 2026-02-17T21:07:13.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.690+0000 7fddb9ffb640 1 -- 10.20.193.45:0/2259071967 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fddc0012050 con 0x7fddcc155e40 2026-02-17T21:07:13.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.691+0000 7fddb9ffb640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdd9c0792d0 0x7fdd9c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.691+0000 7fddd13fd640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdd9c0792d0 0x7fdd9c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.691+0000 7fddd13fd640 10 monclient: get_auth_request con 0x7fdd9c0792d0 auth_method 0 2026-02-17T21:07:13.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.691+0000 7fddd13fd640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdd9c0792d0 0x7fdd9c07b790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fddcc08f5a0 tx=0x7fddbc031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.691+0000 7fddb9ffb640 10 client.4538.objecter ms_handle_connect 0x7fdd9c0792d0 2026-02-17T21:07:13.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149704 got 111669149703 for osd.9 2026-02-17T21:07:13.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.692+0000 7fddb9ffb640 1 -- 10.20.193.45:0/2259071967 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fddc005ddb0 con 0x7fddcc155e40 2026-02-17T21:07:13.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.692+0000 7fddb9ffb640 10 client.4538.objecter ms_dispatch2 0x7fddcc000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.692+0000 7fddb9ffb640 3 client.4538.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.692+0000 7fddb9ffb640 3 client.4538.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.692+0000 7fddb9ffb640 20 client.4538.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.699+0000 7fddb9ffb640 1 -- 10.20.193.45:0/2259071967 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fddcc0cbe40 con 0x7fddcc155e40 2026-02-17T21:07:13.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.699+0000 7fddb9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.699+0000 7fddb9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.700+0000 7f32c3fff640 1 -- 10.20.193.45:0/608173617 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f32dc061c10 con 0x7f32ec15a4b0 2026-02-17T21:07:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.700+0000 7f32c3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:07:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.700+0000 7f32c3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:13.692 INFO:teuthology.orchestra.run.trial045.stdout:111669149702 2026-02-17T21:07:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 10 librados: watch_flush enter 2026-02-17T21:07:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 10 librados: watch_flush exit 2026-02-17T21:07:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 20 client.4541.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 10 client.4541.objecter successfully canceled tick 2026-02-17T21:07:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32bc0792d0 msgr2=0x7f32bc07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32bc0792d0 0x7f32bc07b790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009770 tx=0x7f32e0006cf0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 10 monclient: shutdown 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32ec15a4b0 msgr2=0x7f32ec0d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32ec15a4b0 0x7f32ec0d0a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00b990 tx=0x7f32dc00be60 comp rx=0 tx=0).stop 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 shutdown_connections 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32bc0792d0 0x7f32bc07b790 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32ec15a4b0 0x7f32ec0d0a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32ec0d1e50 0x7f32ec153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 --2- 10.20.193.45:0/608173617 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32ec0c90a0 0x7f32ec152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 >> 10.20.193.45:0/608173617 conn(0x7f32ec06d930 msgr2=0x7f32ec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 shutdown_connections 2026-02-17T21:07:13.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 -- 10.20.193.45:0/608173617 wait complete. 2026-02-17T21:07:13.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.702+0000 7f32f183c640 1 librados: shutdown 2026-02-17T21:07:13.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.704+0000 7f1d5820e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:07:13.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.704+0000 7f1d5820e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:07:13.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.704+0000 7f1d5820e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.704+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f1d5006d6a0 con 0x7f1d50155fb0 2026-02-17T21:07:13.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149703 got 111669149702 for osd.0 2026-02-17T21:07:13.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.716+0000 7fc90dfce640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:07:13.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.716+0000 7fc90dfce640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:07:13.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.716+0000 7fc90dfce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:13.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.716+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc9080c6d40 con 0x7fc908152620 2026-02-17T21:07:13.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.782+0000 7fddd3688640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:07:13.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.782+0000 7fddd3688640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:07:13.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.782+0000 7fddd3688640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.782+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fddcc0698c0 con 0x7fddcc155e40 2026-02-17T21:07:13.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.807+0000 7f4c5d7fa640 1 -- 10.20.193.45:0/4095411956 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4c58007210 con 0x7f4c68074c90 2026-02-17T21:07:13.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.808+0000 7f4c5d7fa640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c380792d0 0x7f4c3807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.808+0000 7f4c5ffff640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c380792d0 0x7f4c3807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.808+0000 7f4c5ffff640 10 monclient: get_auth_request con 0x7f4c380792d0 auth_method 0 2026-02-17T21:07:13.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.808+0000 7f4c5d7fa640 10 client.4544.objecter ms_handle_connect 0x7f4c380792d0 2026-02-17T21:07:13.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.808+0000 7f4c5ffff640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c380792d0 0x7f4c3807b790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4c68146b00 tx=0x7f4c50002a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.809+0000 7f4c5d7fa640 1 -- 10.20.193.45:0/4095411956 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f4c5805d7f0 con 0x7f4c68074c90 2026-02-17T21:07:13.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.809+0000 7f4c5d7fa640 10 client.4544.objecter ms_dispatch2 0x7f4c68000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.809+0000 7f4c5d7fa640 3 client.4544.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.809+0000 7f4c5d7fa640 3 client.4544.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.809+0000 7f4c5d7fa640 20 client.4544.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.815+0000 7f4c5d7fa640 1 -- 10.20.193.45:0/4095411956 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4c58021020 con 0x7f4c68074c90 2026-02-17T21:07:13.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.815+0000 7f4c5d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.815+0000 7f4c5d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.818+0000 7fddb9ffb640 1 -- 10.20.193.45:0/2259071967 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fddcc0698c0 con 0x7fddcc155e40 2026-02-17T21:07:13.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.818+0000 7fddb9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:07:13.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.818+0000 7fddb9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:13.811 INFO:teuthology.orchestra.run.trial045.stdout:115964116999 2026-02-17T21:07:13.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 10 librados: watch_flush enter 2026-02-17T21:07:13.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 10 librados: watch_flush exit 2026-02-17T21:07:13.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 20 client.4538.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 10 client.4538.objecter successfully canceled tick 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdd9c0792d0 msgr2=0x7fdd9c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdd9c0792d0 0x7fdd9c07b790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fddcc08f5a0 tx=0x7fddbc031000 comp rx=0 tx=0).stop 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 10 monclient: shutdown 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 msgr2=0x7fddcc1ea8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 0x7fddcc1ea8a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fddc000e840 tx=0x7fddc000ed10 comp rx=0 tx=0).stop 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 shutdown_connections 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdd9c0792d0 0x7fdd9c07b790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fddcc156220 0x7fddcc153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fddcc155e40 0x7fddcc1ea8a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 --2- 10.20.193.45:0/2259071967 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fddcc0ccb80 0x7fddcc1f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 >> 10.20.193.45:0/2259071967 conn(0x7fddcc0ce270 msgr2=0x7fddcc1529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 shutdown_connections 2026-02-17T21:07:13.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 -- 10.20.193.45:0/2259071967 wait complete. 2026-02-17T21:07:13.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.819+0000 7fddd3688640 1 librados: shutdown 2026-02-17T21:07:13.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964116999 for osd.11 2026-02-17T21:07:13.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.902+0000 7f4c6eab0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:07:13.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.902+0000 7f4c6eab0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:07:13.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.902+0000 7f4c6eab0640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:13.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.902+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4c68159770 con 0x7f4c68074c90 2026-02-17T21:07:13.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.904+0000 7f4c5d7fa640 1 -- 10.20.193.45:0/4095411956 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4c580617b0 con 0x7f4c68074c90 2026-02-17T21:07:13.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.904+0000 7f4c5d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:07:13.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.904+0000 7f4c5d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:13.897 INFO:teuthology.orchestra.run.trial045.stdout:111669149701 2026-02-17T21:07:13.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 10 librados: watch_flush enter 2026-02-17T21:07:13.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 10 librados: watch_flush exit 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 20 client.4544.objecter shutdown clearing up homeless session... 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 10 client.4544.objecter successfully canceled tick 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c380792d0 msgr2=0x7f4c3807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c380792d0 0x7f4c3807b790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4c68146b00 tx=0x7f4c50002a30 comp rx=0 tx=0).stop 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 10 monclient: shutdown 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c68074c90 msgr2=0x7f4c680ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c68074c90 0x7f4c680ca590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c5800c700 tx=0x7f4c5800cbd0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 shutdown_connections 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c380792d0 0x7f4c3807b790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c68156220 0x7f4c681f71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c68155e40 0x7f4c681513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 --2- 10.20.193.45:0/4095411956 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c68074c90 0x7f4c680ca590 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:13.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 >> 10.20.193.45:0/4095411956 conn(0x7f4c680ce270 msgr2=0x7f4c68153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:13.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 shutdown_connections 2026-02-17T21:07:13.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.905+0000 7f4c6eab0640 1 -- 10.20.193.45:0/4095411956 wait complete. 2026-02-17T21:07:13.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.906+0000 7f4c6eab0640 1 librados: shutdown 2026-02-17T21:07:13.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149701 for osd.5 2026-02-17T21:07:13.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.961+0000 7ff356ffd640 1 -- 10.20.193.45:0/3665908090 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff364013610 con 0x7ff3700ccb80 2026-02-17T21:07:13.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.961+0000 7ff356ffd640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff33c079280 0x7ff33c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.962+0000 7ff36dd74640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff33c079280 0x7ff33c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.962+0000 7ff36dd74640 10 monclient: get_auth_request con 0x7ff33c079280 auth_method 0 2026-02-17T21:07:13.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.962+0000 7ff356ffd640 10 client.4464.objecter ms_handle_connect 0x7ff33c079280 2026-02-17T21:07:13.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.962+0000 7ff36dd74640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff33c079280 0x7ff33c07b740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff358039000 tx=0x7ff358031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:13.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.971+0000 7ff356ffd640 1 -- 10.20.193.45:0/3665908090 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7ff36405e890 con 0x7ff3700ccb80 2026-02-17T21:07:13.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.971+0000 7ff356ffd640 10 client.4464.objecter ms_dispatch2 0x7ff370000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:13.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.971+0000 7ff356ffd640 3 client.4464.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:13.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.971+0000 7ff356ffd640 3 client.4464.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:13.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.971+0000 7ff356ffd640 20 client.4464.objecter dump_active .. 0 homeless 2026-02-17T21:07:13.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.971+0000 7ff356ffd640 1 -- 10.20.193.45:0/3665908090 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff364062f50 con 0x7ff3700ccb80 2026-02-17T21:07:13.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.971+0000 7ff356ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:13.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.971+0000 7ff356ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:13.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.981+0000 7f2f9dffb640 1 -- 10.20.193.45:0/970739850 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f2fac004070 con 0x7f2fb015a4b0 2026-02-17T21:07:13.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.981+0000 7f2f9dffb640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2f800792d0 0x7f2f8007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:13.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.981+0000 7f2fb504f640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2f800792d0 0x7f2f8007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:13.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.982+0000 7f2fb504f640 10 monclient: get_auth_request con 0x7f2f800792d0 auth_method 0 2026-02-17T21:07:13.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.982+0000 7f2f9dffb640 10 client.4476.objecter ms_handle_connect 0x7f2f800792d0 2026-02-17T21:07:13.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:13.982+0000 7f2fb504f640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2f800792d0 0x7f2f8007b790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0006fd0 tx=0x7f2fa0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.053+0000 7ff374b01640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:07:14.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.053+0000 7ff374b01640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:07:14.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.053+0000 7ff374b01640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.053+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff370159770 con 0x7ff3700ccb80 2026-02-17T21:07:14.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.193+0000 7f2f9dffb640 1 -- 10.20.193.45:0/970739850 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f2fac012e00 con 0x7f2fb015a4b0 2026-02-17T21:07:14.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.193+0000 7f2f9dffb640 10 client.4476.objecter ms_dispatch2 0x7f2fb0000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.193+0000 7f2f9dffb640 3 client.4476.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.193+0000 7f2f9dffb640 3 client.4476.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.193+0000 7f2f9dffb640 20 client.4476.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.193+0000 7f2f9dffb640 1 -- 10.20.193.45:0/970739850 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2fac062720 con 0x7f2fb015a4b0 2026-02-17T21:07:14.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.193+0000 7f2f9dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.193+0000 7f2f9dffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.200+0000 7f1d3e7fc640 1 -- 10.20.193.45:0/3283116438 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d4c088b80 con 0x7f1d50155fb0 2026-02-17T21:07:14.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.200+0000 7f1d3e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:07:14.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.200+0000 7f1d3e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.193 INFO:teuthology.orchestra.run.trial045.stdout:90194313219 2026-02-17T21:07:14.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.200+0000 7ff356ffd640 1 -- 10.20.193.45:0/3665908090 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff364062850 con 0x7ff3700ccb80 2026-02-17T21:07:14.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.200+0000 7ff356ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:07:14.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.200+0000 7ff356ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.194 INFO:teuthology.orchestra.run.trial045.stdout:98784247812 2026-02-17T21:07:14.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 10 librados: watch_flush enter 2026-02-17T21:07:14.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 10 librados: watch_flush exit 2026-02-17T21:07:14.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 20 client.4455.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 10 client.4455.objecter successfully canceled tick 2026-02-17T21:07:14.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1d20079300 msgr2=0x7f1d2007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1d20079300 0x7f1d2007b7c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1d40009c40 tx=0x7f1d40009290 comp rx=0 tx=0).stop 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 10 monclient: shutdown 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1d50155fb0 msgr2=0x7f1d501f9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1d50155fb0 0x7f1d501f9bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c03a040 tx=0x7f1d4c004b40 comp rx=0 tx=0).stop 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 shutdown_connections 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1d20079300 0x7f1d2007b7c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1d50155fb0 0x7f1d501f9bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d50155bd0 0x7f1d501e9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 --2- 10.20.193.45:0/3283116438 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1d500c9590 0x7f1d501e7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 >> 10.20.193.45:0/3283116438 conn(0x7f1d50073030 msgr2=0x7f1d501533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 10 librados: watch_flush enter 2026-02-17T21:07:14.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 10 librados: watch_flush exit 2026-02-17T21:07:14.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 20 client.4464.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 10 client.4464.objecter successfully canceled tick 2026-02-17T21:07:14.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 shutdown_connections 2026-02-17T21:07:14.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 -- 10.20.193.45:0/3283116438 wait complete. 2026-02-17T21:07:14.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff33c079280 msgr2=0x7ff33c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff33c079280 0x7ff33c07b740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff358039000 tx=0x7ff358031000 comp rx=0 tx=0).stop 2026-02-17T21:07:14.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 10 monclient: shutdown 2026-02-17T21:07:14.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3700ccb80 msgr2=0x7ff3700ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3700ccb80 0x7ff3700ca8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff36400ebe0 tx=0x7ff36400c520 comp rx=0 tx=0).stop 2026-02-17T21:07:14.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7f1d5820e640 1 librados: shutdown 2026-02-17T21:07:14.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 shutdown_connections 2026-02-17T21:07:14.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff33c079280 0x7ff33c07b740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff370156220 0x7ff370157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff370155e40 0x7ff3700cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 --2- 10.20.193.45:0/3665908090 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3700ccb80 0x7ff3700ca8e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.202+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 >> 10.20.193.45:0/3665908090 conn(0x7ff3700ce270 msgr2=0x7ff370151320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.203+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 shutdown_connections 2026-02-17T21:07:14.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.203+0000 7ff374b01640 1 -- 10.20.193.45:0/3665908090 wait complete. 2026-02-17T21:07:14.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.203+0000 7ff374b01640 1 librados: shutdown 2026-02-17T21:07:14.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.208+0000 7f04867fc640 1 -- 10.20.193.45:0/4022265308 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f0494024080 con 0x7f0498155fe0 2026-02-17T21:07:14.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.209+0000 7f04867fc640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0468079280 0x7f046807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.209+0000 7f049dde9640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0468079280 0x7f046807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.209+0000 7f049dde9640 10 monclient: get_auth_request con 0x7f0468079280 auth_method 0 2026-02-17T21:07:14.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.209+0000 7f049dde9640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0468079280 0x7f046807b740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0488039000 tx=0x7f0488031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.209+0000 7f04867fc640 10 client.4467.objecter ms_handle_connect 0x7f0468079280 2026-02-17T21:07:14.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313219 for osd.8 2026-02-17T21:07:14.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247812 for osd.6 2026-02-17T21:07:14.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.215+0000 7f94f67fc640 1 -- 10.20.193.45:0/3150996875 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f94f803f3c0 con 0x7f95080ccb80 2026-02-17T21:07:14.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.216+0000 7f94f67fc640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f94d80792d0 0x7f94d807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.216+0000 7f950d675640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f94d80792d0 0x7f94d807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.216+0000 7f950d675640 10 monclient: get_auth_request con 0x7f94d80792d0 auth_method 0 2026-02-17T21:07:14.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.216+0000 7f950d675640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f94d80792d0 0x7f94d807b790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f94fc006fd0 tx=0x7f94fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.216+0000 7f94f67fc640 10 client.4470.objecter ms_handle_connect 0x7f94d80792d0 2026-02-17T21:07:14.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.229+0000 7f94f67fc640 1 -- 10.20.193.45:0/3150996875 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f94f802fa40 con 0x7f95080ccb80 2026-02-17T21:07:14.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.229+0000 7f94f67fc640 10 client.4470.objecter ms_dispatch2 0x7f9508000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.229+0000 7f94f67fc640 3 client.4470.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.229+0000 7f94f67fc640 3 client.4470.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.229+0000 7f94f67fc640 20 client.4470.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.229+0000 7f94f67fc640 1 -- 10.20.193.45:0/3150996875 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f94f8051080 con 0x7f95080ccb80 2026-02-17T21:07:14.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.229+0000 7f94f67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.229+0000 7f94f67fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.235+0000 7f04867fc640 1 -- 10.20.193.45:0/4022265308 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f049405e190 con 0x7f0498155fe0 2026-02-17T21:07:14.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.235+0000 7f04867fc640 10 client.4467.objecter ms_dispatch2 0x7f0498000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.235+0000 7f04867fc640 3 client.4467.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.235+0000 7f04867fc640 3 client.4467.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.235+0000 7f04867fc640 20 client.4467.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.235+0000 7f04867fc640 1 -- 10.20.193.45:0/4022265308 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0494062150 con 0x7f0498155fe0 2026-02-17T21:07:14.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.235+0000 7f04867fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.235+0000 7f04867fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.242+0000 7fa54a7fc640 1 -- 10.20.193.45:0/583529383 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fa54c021480 con 0x7fa55c074c90 2026-02-17T21:07:14.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.243+0000 7fa54a7fc640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa52c0792d0 0x7fa52c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.243+0000 7fa5616c5640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa52c0792d0 0x7fa52c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.243+0000 7fa5616c5640 10 monclient: get_auth_request con 0x7fa52c0792d0 auth_method 0 2026-02-17T21:07:14.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.243+0000 7fa5616c5640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa52c0792d0 0x7fa52c07b790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa55c08f310 tx=0x7fa550031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.243+0000 7fa54a7fc640 10 client.4473.objecter ms_handle_connect 0x7fa52c0792d0 2026-02-17T21:07:14.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.251+0000 7fa54a7fc640 1 -- 10.20.193.45:0/583529383 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fa54c05dda0 con 0x7fa55c074c90 2026-02-17T21:07:14.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.251+0000 7fa54a7fc640 10 client.4473.objecter ms_dispatch2 0x7fa55c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.251+0000 7fa54a7fc640 3 client.4473.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.251+0000 7fa54a7fc640 3 client.4473.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.251+0000 7fa54a7fc640 20 client.4473.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.251+0000 7fa54a7fc640 1 -- 10.20.193.45:0/583529383 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa54c062460 con 0x7fa55c074c90 2026-02-17T21:07:14.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.251+0000 7fa54a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.251+0000 7fa54a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.255+0000 7f466a7fc640 1 -- 10.20.193.45:0/2869854944 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4678088680 con 0x7f467c155fe0 2026-02-17T21:07:14.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.255+0000 7f466a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:07:14.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.255+0000 7f466a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.247 INFO:teuthology.orchestra.run.trial045.stdout:115964116999 2026-02-17T21:07:14.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 10 librados: watch_flush enter 2026-02-17T21:07:14.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 10 librados: watch_flush exit 2026-02-17T21:07:14.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 20 client.4461.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 10 client.4461.objecter successfully canceled tick 2026-02-17T21:07:14.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f464c079280 msgr2=0x7f464c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f464c079280 0x7f464c07b740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f466c0098a0 tx=0x7f466c006d90 comp rx=0 tx=0).stop 2026-02-17T21:07:14.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 10 monclient: shutdown 2026-02-17T21:07:14.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f467c155fe0 msgr2=0x7f467c1f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f467c155fe0 0x7f467c1f6ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4678039040 tx=0x7f4678004b40 comp rx=0 tx=0).stop 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 shutdown_connections 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f464c079280 0x7f464c07b740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f467c155fe0 0x7f467c1f6ed0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c0c9cf0 0x7f467c147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 --2- 10.20.193.45:0/2869854944 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f467c0c98b0 0x7f467c0d18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 >> 10.20.193.45:0/2869854944 conn(0x7f467c06d930 msgr2=0x7f467c0cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 shutdown_connections 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 -- 10.20.193.45:0/2869854944 wait complete. 2026-02-17T21:07:14.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.257+0000 7f46840bd640 1 librados: shutdown 2026-02-17T21:07:14.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.260+0000 7fc8e3fff640 1 -- 10.20.193.45:0/1062729136 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8f4061d50 con 0x7fc908152620 2026-02-17T21:07:14.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.260+0000 7fc8e3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:07:14.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.260+0000 7fc8e3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.253 INFO:teuthology.orchestra.run.trial045.stdout:94489280515 2026-02-17T21:07:14.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 10 librados: watch_flush enter 2026-02-17T21:07:14.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 10 librados: watch_flush exit 2026-02-17T21:07:14.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 20 client.4458.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 10 client.4458.objecter successfully canceled tick 2026-02-17T21:07:14.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc8d80792d0 msgr2=0x7fc8d807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc8d80792d0 0x7fc8d807b790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8039000 tx=0x7fc8f8031000 comp rx=0 tx=0).stop 2026-02-17T21:07:14.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 10 monclient: shutdown 2026-02-17T21:07:14.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc908152620 msgr2=0x7fc908147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc908152620 0x7fc908147f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400c550 tx=0x7fc8f400ca20 comp rx=0 tx=0).stop 2026-02-17T21:07:14.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 shutdown_connections 2026-02-17T21:07:14.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc8d80792d0 0x7fc8d807b790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc90815b0b0 0x7fc908149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc908152a00 0x7fc908149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 --2- 10.20.193.45:0/1062729136 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc908152620 0x7fc908147f10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 >> 10.20.193.45:0/1062729136 conn(0x7fc9080c9d40 msgr2=0x7fc90815bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 shutdown_connections 2026-02-17T21:07:14.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 -- 10.20.193.45:0/1062729136 wait complete. 2026-02-17T21:07:14.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.262+0000 7fc90dfce640 1 librados: shutdown 2026-02-17T21:07:14.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964116999 for osd.15 2026-02-17T21:07:14.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.4 2026-02-17T21:07:14.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.283+0000 7f2fb72da640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:07:14.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.283+0000 7f2fb72da640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:07:14.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.283+0000 7f2fb72da640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.283+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2fb00c4b30 con 0x7f2fb015a4b0 2026-02-17T21:07:14.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.305+0000 7f2f9dffb640 1 -- 10.20.193.45:0/970739850 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2fac062020 con 0x7f2fb015a4b0 2026-02-17T21:07:14.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.305+0000 7f2f9dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:07:14.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.305+0000 7f2f9dffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.298 INFO:teuthology.orchestra.run.trial045.stdout:115964117000 2026-02-17T21:07:14.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 10 librados: watch_flush enter 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 10 librados: watch_flush exit 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 20 client.4476.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 10 client.4476.objecter successfully canceled tick 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2f800792d0 msgr2=0x7f2f8007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2f800792d0 0x7f2f8007b790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0006fd0 tx=0x7f2fa0008040 comp rx=0 tx=0).stop 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 10 monclient: shutdown 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb015a4b0 msgr2=0x7f2fb01f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb015a4b0 0x7f2fb01f8160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00b9c0 tx=0x7f2fac00be90 comp rx=0 tx=0).stop 2026-02-17T21:07:14.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 shutdown_connections 2026-02-17T21:07:14.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2f800792d0 0x7f2f8007b790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2fb015a4b0 0x7f2fb01f8160 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2fb00d1e50 0x7f2fb01fc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 --2- 10.20.193.45:0/970739850 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2fb00c90a0 0x7f2fb00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 >> 10.20.193.45:0/970739850 conn(0x7f2fb006d930 msgr2=0x7f2fb015e280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 shutdown_connections 2026-02-17T21:07:14.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 -- 10.20.193.45:0/970739850 wait complete. 2026-02-17T21:07:14.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.308+0000 7f2fb72da640 1 librados: shutdown 2026-02-17T21:07:14.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117002 got 115964117000 for osd.2 2026-02-17T21:07:14.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.316+0000 7f9510101640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:07:14.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.316+0000 7f9510101640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:07:14.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.316+0000 7f9510101640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.316+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f95080cbde0 con 0x7f95080ccb80 2026-02-17T21:07:14.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.326+0000 7f04a0074640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:07:14.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.326+0000 7f04a0074640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:07:14.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.326+0000 7f04a0074640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.326+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f04980cda80 con 0x7f0498155fe0 2026-02-17T21:07:14.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.339+0000 7fa564151640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:07:14.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.339+0000 7fa564151640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:07:14.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.339+0000 7fa564151640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.339+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7fa55c159770 con 0x7fa55c074c90 2026-02-17T21:07:14.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.347+0000 7f04867fc640 1 -- 10.20.193.45:0/4022265308 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0494066450 con 0x7f0498155fe0 2026-02-17T21:07:14.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.347+0000 7f04867fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:07:14.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.347+0000 7f04867fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.340 INFO:teuthology.orchestra.run.trial045.stdout:111669149704 2026-02-17T21:07:14.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 10 librados: watch_flush enter 2026-02-17T21:07:14.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 10 librados: watch_flush exit 2026-02-17T21:07:14.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 20 client.4467.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 10 client.4467.objecter successfully canceled tick 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0468079280 msgr2=0x7f046807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0468079280 0x7f046807b740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0488039000 tx=0x7f0488031000 comp rx=0 tx=0).stop 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 10 monclient: shutdown 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 msgr2=0x7f049815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 0x7f049815e0b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f049400cb80 tx=0x7f049400a430 comp rx=0 tx=0).stop 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 shutdown_connections 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0468079280 0x7f046807b740 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0498155fe0 0x7f049815e0b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f04980c9cf0 0x7f04980732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 --2- 10.20.193.45:0/4022265308 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f04980c98b0 0x7f04981f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 >> 10.20.193.45:0/4022265308 conn(0x7f049806d930 msgr2=0x7f04980cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 shutdown_connections 2026-02-17T21:07:14.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 -- 10.20.193.45:0/4022265308 wait complete. 2026-02-17T21:07:14.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.349+0000 7f04a0074640 1 librados: shutdown 2026-02-17T21:07:14.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.352+0000 7f94f67fc640 1 -- 10.20.193.45:0/3150996875 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f94f8087540 con 0x7f95080ccb80 2026-02-17T21:07:14.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.352+0000 7f94f67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:07:14.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.352+0000 7f94f67fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.345 INFO:teuthology.orchestra.run.trial045.stdout:103079215108 2026-02-17T21:07:14.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.353+0000 7fa54a7fc640 1 -- 10.20.193.45:0/583529383 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fa54c061d60 con 0x7fa55c074c90 2026-02-17T21:07:14.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.353+0000 7fa54a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:07:14.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.353+0000 7fa54a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.346 INFO:teuthology.orchestra.run.trial045.stdout:90194313220 2026-02-17T21:07:14.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 10 librados: watch_flush enter 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 10 librados: watch_flush exit 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 20 client.4470.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 10 client.4470.objecter successfully canceled tick 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f94d80792d0 msgr2=0x7f94d807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f94d80792d0 0x7f94d807b790 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f94fc006fd0 tx=0x7f94fc008040 comp rx=0 tx=0).stop 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 10 monclient: shutdown 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95080ccb80 msgr2=0x7f950815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.354+0000 7f9510101640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95080ccb80 0x7f950815d2d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009a70 tx=0x7f94f80047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 shutdown_connections 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7f9510101640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f94d80792d0 0x7f94d807b790 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7f9510101640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9508156220 0x7f95080c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7f9510101640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9508155e40 0x7f95080c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7f9510101640 1 --2- 10.20.193.45:0/3150996875 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95080ccb80 0x7f950815d2d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 >> 10.20.193.45:0/3150996875 conn(0x7f95080ce270 msgr2=0x7f95080cff70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 shutdown_connections 2026-02-17T21:07:14.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7f9510101640 1 -- 10.20.193.45:0/3150996875 wait complete. 2026-02-17T21:07:14.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7f9510101640 1 librados: shutdown 2026-02-17T21:07:14.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 10 librados: watch_flush enter 2026-02-17T21:07:14.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 10 librados: watch_flush exit 2026-02-17T21:07:14.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 20 client.4473.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 10 client.4473.objecter successfully canceled tick 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa52c0792d0 msgr2=0x7fa52c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa52c0792d0 0x7fa52c07b790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa55c08f310 tx=0x7fa550031000 comp rx=0 tx=0).stop 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 10 monclient: shutdown 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa55c074c90 msgr2=0x7fa55c0c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa55c074c90 0x7fa55c0c5790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00b5a0 tx=0x7fa54c00ba70 comp rx=0 tx=0).stop 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 shutdown_connections 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa52c0792d0 0x7fa52c07b790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa55c156220 0x7fa55c0c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa55c155e40 0x7fa55c1e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 --2- 10.20.193.45:0/583529383 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa55c074c90 0x7fa55c0c5790 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 >> 10.20.193.45:0/583529383 conn(0x7fa55c0ce270 msgr2=0x7fa55c150a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 shutdown_connections 2026-02-17T21:07:14.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 -- 10.20.193.45:0/583529383 wait complete. 2026-02-17T21:07:14.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.355+0000 7fa564151640 1 librados: shutdown 2026-02-17T21:07:14.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149705 got 111669149704 for osd.1 2026-02-17T21:07:14.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215108 for osd.10 2026-02-17T21:07:14.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.12 2026-02-17T21:07:14.575 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T21:07:14.577 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T21:07:14.601 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-17T21:07:14.601 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T21:07:14.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fc6502f3640 10 monclient: get_monmap_and_config 2026-02-17T21:07:14.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fc6502f3640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fc6502f3640 10 monclient: monmap: 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:14.655136+0000 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:14.655136+0000 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:14.647 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:14.648 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fb6c8da9640 10 monclient: get_monmap_and_config 2026-02-17T21:07:14.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fb6c8da9640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fb6c8da9640 10 monclient: monmap: 2026-02-17T21:07:14.648 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.648 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.648 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:14.655402+0000 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:14.655402+0000 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:14.649 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fc6502f3640 1 Processor -- start 2026-02-17T21:07:14.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fc6502f3640 1 -- start start 2026-02-17T21:07:14.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fc6502f3640 10 monclient: init 2026-02-17T21:07:14.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fb6c8da9640 1 Processor -- start 2026-02-17T21:07:14.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fb6c8da9640 1 -- start start 2026-02-17T21:07:14.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.654+0000 7fb6c8da9640 10 monclient: init 2026-02-17T21:07:14.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 10 monclient: _add_conns ranks=[4,2,0,5,1,3] 2026-02-17T21:07:14.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc648155e40 0x7fc648074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 10 monclient(hunting): picked mon.noname-b con 0x7fc648155e40 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:14.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc648156220 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:14.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc6480cd290 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:14.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6480734e0 con 0x7fc6480cd290 2026-02-17T21:07:14.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6480737c0 con 0x7fc648156220 2026-02-17T21:07:14.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc6480cd800 con 0x7fc648155e40 2026-02-17T21:07:14.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc6502f3640 10 monclient(hunting): authenticate will time out at 1018.285429s 2026-02-17T21:07:14.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 10 monclient: _add_conns ranks=[1,2,3,4,0,5] 2026-02-17T21:07:14.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb6c4155cf0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:14.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb6c41560d0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:14.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fb6c40c9530 0x7fb6c40cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 10 monclient(hunting): picked mon.noname-a con 0x7fb6c40c9530 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:14.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c406e730 con 0x7fb6c4155cf0 2026-02-17T21:07:14.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c406ea10 con 0x7fb6c41560d0 2026-02-17T21:07:14.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c406ecf0 con 0x7fb6c40c9530 2026-02-17T21:07:14.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c8da9640 10 monclient(hunting): authenticate will time out at 1018.285495s 2026-02-17T21:07:14.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c2d76640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fb6c40c9530 0x7fb6c40cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc64d867640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7fc648156220 0x7fc6480ccb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47674/0 (socket says 10.20.193.45:47674) 2026-02-17T21:07:14.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc64e068640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc648155e40 0x7fc648074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fc64d867640 1 -- 10.20.193.45:0/4111311860 learned_addr learned my addr 10.20.193.45:0/4111311860 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:14.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c2575640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fb6c4155cf0 0x7fb6c4076230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52848/0 (socket says 10.20.193.45:52848) 2026-02-17T21:07:14.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.655+0000 7fb6c2575640 1 -- 10.20.193.45:0/4022401763 learned_addr learned my addr 10.20.193.45:0/4022401763 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:14.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fc64e068640 10 monclient(hunting): get_auth_request con 0x7fc648155e40 auth_method 0 2026-02-17T21:07:14.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fc64e068640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fc64e068640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fc64e068640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fb6c2d76640 10 monclient(hunting): get_auth_request con 0x7fb6c40c9530 auth_method 0 2026-02-17T21:07:14.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fb6c2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fb6c2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fb6c2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fc64e068640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fc64e068640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fc64e068640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fb6c2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fb6c2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.656+0000 7fb6c2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.657+0000 7fc64e068640 10 monclient(hunting): handle_auth_done global_id 4528 payload 274 2026-02-17T21:07:14.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.657+0000 7fc64e068640 1 -- 10.20.193.45:0/4111311860 >> v1:10.20.193.92:6789/0 conn(0x7fc648156220 legacy=0x7fc6480ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.657+0000 7fc64e068640 1 -- 10.20.193.45:0/4111311860 >> v1:10.20.193.45:6789/0 conn(0x7fc6480cd290 legacy=0x7fc64815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.657+0000 7fc64e068640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.657+0000 7fc64e068640 1 monclient: found mon.noname-b 2026-02-17T21:07:14.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.657+0000 7fc64e068640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.657+0000 7fc64e068640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.657+0000 7fc64e068640 1 -- 10.20.193.45:0/4111311860 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc648073aa0 con 0x7fc648155e40 2026-02-17T21:07:14.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.658+0000 7fb6c2d76640 10 monclient(hunting): handle_auth_done global_id 4479 payload 274 2026-02-17T21:07:14.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.658+0000 7fb6c2d76640 1 -- 10.20.193.45:0/4022401763 >> v1:10.20.193.92:6789/0 conn(0x7fb6c41560d0 legacy=0x7fb6c40c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.658+0000 7fb6c2d76640 1 -- 10.20.193.45:0/4022401763 >> v1:10.20.193.86:6789/0 conn(0x7fb6c4155cf0 legacy=0x7fb6c4076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.658+0000 7fb6c2d76640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.658+0000 7fb6c2d76640 1 monclient: found mon.noname-a 2026-02-17T21:07:14.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.658+0000 7fb6c2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.658+0000 7fb6c2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.658+0000 7fb6c2d76640 1 -- 10.20.193.45:0/4022401763 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c40c8620 con 0x7fb6c40c9530 2026-02-17T21:07:14.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.659+0000 7fc64e068640 1 --2- 10.20.193.45:0/4111311860 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648155e40 0x7fc648074580 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc6380098a0 tx=0x7fc63802ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f596b6599ce4506b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.659+0000 7fb6c2d76640 1 --2- 10.20.193.45:0/4022401763 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c40c9530 0x7fb6c40cb0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009d90 tx=0x7fb6b402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e357305d55014d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 1 -- 10.20.193.45:0/4111311860 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63803c070 con 0x7fc648155e40 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 10 monclient: dump: 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.664 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 1 -- 10.20.193.45:0/4111311860 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63802fb70 con 0x7fc648155e40 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 1 -- 10.20.193.45:0/4111311860 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638037440 con 0x7fc648155e40 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 5 monclient: authenticate success, global_id 4528 2026-02-17T21:07:14.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 4 set_mon_vals no callback set 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc64d066640 10 monclient: dump: 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.666 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 10 monclient: shutdown 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 1 -- 10.20.193.45:0/4111311860 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648155e40 msgr2=0x7fc648074580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 1 --2- 10.20.193.45:0/4111311860 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648155e40 0x7fc648074580 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc6380098a0 tx=0x7fc63802ee60 comp rx=0 tx=0).stop 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 1 -- 10.20.193.45:0/4111311860 shutdown_connections 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 1 --2- 10.20.193.45:0/4111311860 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648155e40 0x7fc648074580 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 1 -- 10.20.193.45:0/4111311860 >> 10.20.193.45:0/4111311860 conn(0x7fc6480ce270 msgr2=0x7fc6480ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 1 -- 10.20.193.45:0/4111311860 shutdown_connections 2026-02-17T21:07:14.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 1 -- 10.20.193.45:0/4111311860 wait complete. 2026-02-17T21:07:14.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 1 -- 10.20.193.45:0/4022401763 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b403c070 con 0x7fb6c40c9530 2026-02-17T21:07:14.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 10 monclient: dump: 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.669 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 1 -- 10.20.193.45:0/4022401763 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b4037440 con 0x7fb6c40c9530 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c8da9640 5 monclient: authenticate success, global_id 4479 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c8da9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c8da9640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 1 -- 10.20.193.45:0/4022401763 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4037810 con 0x7fb6c40c9530 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c8da9640 4 set_mon_vals no callback set 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c1573640 10 monclient: dump: 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.671 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fc6502f3640 10 monclient: monmap: 2026-02-17T21:07:14.672 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.672 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:14.672 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:14.672 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:14.673 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.673 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.673 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:14.673 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:14.673 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:14.673 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c8da9640 10 monclient: shutdown 2026-02-17T21:07:14.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c8da9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c8da9640 1 -- 10.20.193.45:0/4022401763 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c40c9530 msgr2=0x7fb6c40cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.662+0000 7fb6c8da9640 1 --2- 10.20.193.45:0/4022401763 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c40c9530 0x7fb6c40cb0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009d90 tx=0x7fb6b402f230 comp rx=0 tx=0).stop 2026-02-17T21:07:14.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 -- 10.20.193.45:0/4022401763 shutdown_connections 2026-02-17T21:07:14.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 --2- 10.20.193.45:0/4022401763 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c40c9530 0x7fb6c40cb0c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 -- 10.20.193.45:0/4022401763 >> 10.20.193.45:0/4022401763 conn(0x7fb6c40ca5a0 msgr2=0x7fb6c40ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 -- 10.20.193.45:0/4022401763 shutdown_connections 2026-02-17T21:07:14.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 -- 10.20.193.45:0/4022401763 wait complete. 2026-02-17T21:07:14.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 librados: starting msgr at 2026-02-17T21:07:14.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 librados: starting objecter 2026-02-17T21:07:14.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 Processor -- start 2026-02-17T21:07:14.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 -- start start 2026-02-17T21:07:14.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 librados: setting wanted keys 2026-02-17T21:07:14.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 librados: calling monclient init 2026-02-17T21:07:14.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient: init 2026-02-17T21:07:14.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc6480cd290 0x7fc6481f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient(hunting): picked mon.noname-c con 0x7fc6480cd290 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc648155e40 0x7fc64813f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient(hunting): picked mon.noname-a con 0x7fc648155e40 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648156220 0x7fc6480c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient(hunting): picked mon.noname-b con 0x7fc648156220 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480c4830 con 0x7fc648155e40 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc648074060 con 0x7fc648156220 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6480c49b0 con 0x7fc6480cd290 2026-02-17T21:07:14.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc6502f3640 10 monclient(hunting): authenticate will time out at 1018.293584s 2026-02-17T21:07:14.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 10 monclient: monmap: 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 librados: starting msgr at 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 librados: starting objecter 2026-02-17T21:07:14.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 Processor -- start 2026-02-17T21:07:14.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 -- start start 2026-02-17T21:07:14.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 librados: setting wanted keys 2026-02-17T21:07:14.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 1 librados: calling monclient init 2026-02-17T21:07:14.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fb6c8da9640 10 monclient: init 2026-02-17T21:07:14.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.663+0000 7fc64e869640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648156220 0x7fc6480c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e068640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc6480cd290 0x7fc6481f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e869640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648156220 0x7fc6480c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57706/0 (socket says 10.20.193.45:57706) 2026-02-17T21:07:14.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e869640 1 -- 10.20.193.45:0/709365572 learned_addr learned my addr 10.20.193.45:0/709365572 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e869640 10 monclient(hunting): get_auth_request con 0x7fc648156220 auth_method 0 2026-02-17T21:07:14.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e869640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e869640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e869640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e068640 10 monclient(hunting): get_auth_request con 0x7fc6480cd290 auth_method 0 2026-02-17T21:07:14.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e068640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e068640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e068640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64d867640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc648155e40 0x7fc64813f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e869640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e869640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e869640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb6c40c9530 0x7fb6c41565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient(hunting): picked mon.noname-b con 0x7fb6c40c9530 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c4155cf0 0x7fb6c41f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient(hunting): picked mon.noname-a con 0x7fb6c4155cf0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb6c41560d0 0x7fb6c4144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient(hunting): picked mon.noname-c con 0x7fb6c41560d0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c41667d0 con 0x7fb6c4155cf0 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4166650 con 0x7fb6c40c9530 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c4166950 con 0x7fb6c41560d0 2026-02-17T21:07:14.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fb6c8da9640 10 monclient(hunting): authenticate will time out at 1018.294506s 2026-02-17T21:07:14.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64d867640 10 monclient(hunting): get_auth_request con 0x7fc648155e40 auth_method 0 2026-02-17T21:07:14.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64d867640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64d867640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64d867640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e068640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e068640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64e068640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64d867640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64d867640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.664+0000 7fc64d867640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fb6c1d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c4155cf0 0x7fb6c41f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 10 monclient(hunting): handle_auth_done global_id 4534 payload 824 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 1 -- 10.20.193.45:0/709365572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc6480cd290 msgr2=0x7fc6481f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc6480cd290 0x7fc6481f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 1 -- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc648155e40 msgr2=0x7fc64813f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc648155e40 0x7fc64813f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 1 monclient: found mon.noname-b 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.665+0000 7fc64e869640 1 -- 10.20.193.45:0/709365572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64813f680 con 0x7fc648156220 2026-02-17T21:07:14.688 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T21:07:14.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.666+0000 7fb6c2575640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb6c40c9530 0x7fb6c41565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fc64e869640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648156220 0x7fc6480c9b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc64400cc50 tx=0x7fc64400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fc62effd640 10 client.?.objecter ms_handle_connect 0x7fc648156220 2026-02-17T21:07:14.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fc62effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:14.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2d76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb6c41560d0 0x7fb6c4144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2575640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb6c40c9530 0x7fb6c41565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57716/0 (socket says 10.20.193.45:57716) 2026-02-17T21:07:14.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2575640 1 -- 10.20.193.45:0/1708118909 learned_addr learned my addr 10.20.193.45:0/1708118909 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2575640 10 monclient(hunting): get_auth_request con 0x7fb6c40c9530 auth_method 0 2026-02-17T21:07:14.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c1d74640 10 monclient(hunting): get_auth_request con 0x7fb6c4155cf0 auth_method 0 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.667+0000 7fb6c2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.668+0000 7fb6c1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.668+0000 7fb6c1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.668+0000 7fb6c1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.668+0000 7fb6c2d76640 10 monclient(hunting): get_auth_request con 0x7fb6c41560d0 auth_method 0 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.668+0000 7fb6c2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.668+0000 7fb6c2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.668+0000 7fb6c2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 10 monclient(hunting): handle_auth_done global_id 4485 payload 824 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 1 -- 10.20.193.45:0/1708118909 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb6c41560d0 msgr2=0x7fb6c4144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb6c41560d0 0x7fb6c4144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 1 -- 10.20.193.45:0/1708118909 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb6c40c9530 msgr2=0x7fb6c41565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb6c40c9530 0x7fb6c41565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 1 monclient: found mon.noname-a 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.669+0000 7fb6c1d74640 1 -- 10.20.193.45:0/1708118909 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c41f5810 con 0x7fb6c4155cf0 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 1 -- 10.20.193.45:0/709365572 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644003a70 con 0x7fc648156220 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 10 monclient: dump: 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.693 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 1 -- 10.20.193.45:0/709365572 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc644003c10 con 0x7fc648156220 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 1 -- 10.20.193.45:0/709365572 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6440050d0 con 0x7fc648156220 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc64c865640 4 set_mon_vals no callback set 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc62effd640 10 monclient: dump: 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.694 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc6502f3640 5 monclient: authenticate success, global_id 4534 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc6502f3640 10 monclient: _renew_subs 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc6502f3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6480ca400 con 0x7fc648156220 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc6502f3640 10 client.4534.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc6502f3640 10 monclient: _renew_subs 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc6502f3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6480ca9c0 con 0x7fc648156220 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.670+0000 7fc6502f3640 1 librados: init done 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.671+0000 7fb6c1d74640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c4155cf0 0x7fb6c41f52d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00c460 tx=0x7fb6ac00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.671+0000 7fb6aaffd640 10 client.?.objecter ms_handle_connect 0x7fb6c4155cf0 2026-02-17T21:07:14.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.671+0000 7fb6aaffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:14.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.671+0000 7fc6502f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.671+0000 7fc6502f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.671+0000 7fc6502f3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.671+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6480ccb80 con 0x7fc648156220 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 1 -- 10.20.193.45:0/1708118909 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0052d0 con 0x7fb6c4155cf0 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 10 monclient: dump: 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 1 -- 10.20.193.45:0/1708118909 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ac005470 con 0x7fb6c4155cf0 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 1 -- 10.20.193.45:0/1708118909 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0038c0 con 0x7fb6c4155cf0 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6aaffd640 10 monclient: dump: 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6c0d72640 4 set_mon_vals no callback set 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6c8da9640 5 monclient: authenticate success, global_id 4485 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6c8da9640 10 monclient: _renew_subs 2026-02-17T21:07:14.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6c8da9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.682+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c4156cb0 con 0x7fb6c4155cf0 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fb6c8da9640 10 client.4485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fb6c8da9640 10 monclient: _renew_subs 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fb6c8da9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c4157270 con 0x7fb6c4155cf0 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fb6c8da9640 1 librados: init done 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fb6c8da9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fb6c8da9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fb6c8da9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c41596f0 con 0x7fb6c4155cf0 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.683+0000 7fc62effd640 1 -- 10.20.193.45:0/709365572 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc644005270 con 0x7fc648156220 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.684+0000 7fc62effd640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc618079280 0x7fc61807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.684+0000 7fc64e068640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc618079280 0x7fc61807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.684+0000 7fc64e068640 10 monclient: get_auth_request con 0x7fc618079280 auth_method 0 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.684+0000 7fc62effd640 10 client.4534.objecter ms_handle_connect 0x7fc618079280 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.684+0000 7fc64e068640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc618079280 0x7fc61807b740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc638039000 tx=0x7fc638033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.685+0000 7fc62effd640 1 -- 10.20.193.45:0/709365572 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fc64405eb10 con 0x7fc648156220 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.685+0000 7fc62effd640 10 client.4534.objecter ms_dispatch2 0x7fc648000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.685+0000 7fc62effd640 3 client.4534.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.685+0000 7fc62effd640 3 client.4534.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.685+0000 7fc62effd640 20 client.4534.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.694+0000 7fb6aaffd640 1 -- 10.20.193.45:0/1708118909 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb6ac003a60 con 0x7fb6c4155cf0 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.695+0000 7fb6aaffd640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6900792d0 0x7fb69007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.695+0000 7fb6c2575640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6900792d0 0x7fb69007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.695+0000 7fb6c2575640 10 monclient: get_auth_request con 0x7fb6900792d0 auth_method 0 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.695+0000 7fb6c2575640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6900792d0 0x7fb69007b790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8002770 tx=0x7fb6b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.695+0000 7fb6aaffd640 10 client.4485.objecter ms_handle_connect 0x7fb6900792d0 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.697+0000 7fb6aaffd640 1 -- 10.20.193.45:0/1708118909 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fb6ac05e2d0 con 0x7fb6c4155cf0 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.697+0000 7fb6aaffd640 10 client.4485.objecter ms_dispatch2 0x7fb6c4000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.697+0000 7fb6aaffd640 3 client.4485.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.697+0000 7fb6aaffd640 3 client.4485.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.697+0000 7fb6aaffd640 20 client.4485.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7fa449c15640 10 monclient: get_monmap_and_config 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7fa449c15640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7fa449c15640 10 monclient: monmap: 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:14.699031+0000 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:14.699031+0000 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:14.702 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7f9ab7096640 10 monclient: get_monmap_and_config 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7f9ab7096640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7f9ab7096640 10 monclient: monmap: 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:14.699034+0000 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:14.699034+0000 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7fa449c15640 1 Processor -- start 2026-02-17T21:07:14.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7fa449c15640 1 -- start start 2026-02-17T21:07:14.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7fa449c15640 10 monclient: init 2026-02-17T21:07:14.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7f9ab7096640 1 Processor -- start 2026-02-17T21:07:14.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7f9ab7096640 1 -- start start 2026-02-17T21:07:14.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.698+0000 7f9ab7096640 10 monclient: init 2026-02-17T21:07:14.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 10 monclient: _add_conns ranks=[0,5,2,4,1,3] 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa4440c3e40 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fa44415f8e0 0x7fa44406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 10 monclient(hunting): picked mon.noname-c con 0x7fa44415f8e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa4440c92a0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4440c96d0 con 0x7fa4440c3e40 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4440c7c40 con 0x7fa4440c92a0 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa4440c8e10 con 0x7fa44415f8e0 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa449c15640 10 monclient(hunting): authenticate will time out at 1018.329179s 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient: _add_conns ranks=[5,4,3,1,0,2] 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9ab015d1e0 0x7f9ab015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient(hunting): picked mon.noname-c con 0x7f9ab015d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f9ab00748e0 0x7f9ab00c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient(hunting): picked mon.noname-b con 0x7f9ab00748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f9ab00c90e0 0x7f9ab0153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient(hunting): picked mon.noname-a con 0x7f9ab00c90e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab00c9570 con 0x7f9ab00c90e0 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab00c5860 con 0x7f9ab00748e0 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab00c5580 con 0x7f9ab015d1e0 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab7096640 10 monclient(hunting): authenticate will time out at 1018.329299s 2026-02-17T21:07:14.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7fa442ffd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fa44415f8e0 0x7fa44406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.699+0000 7f9ab4e0b640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9ab015d1e0 0x7f9ab015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7f9ab4e0b640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9ab015d1e0 0x7f9ab015d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36442/0 (socket says 10.20.193.45:36442) 2026-02-17T21:07:14.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7f9ab4e0b640 1 -- 10.20.193.45:0/806503207 learned_addr learned my addr 10.20.193.45:0/806503207 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7f9ab4e0b640 10 monclient(hunting): get_auth_request con 0x7f9ab015d1e0 auth_method 0 2026-02-17T21:07:14.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7f9ab4e0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7f9ab4e0b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7f9ab4e0b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.707 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7fa442ffd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fa44415f8e0 0x7fa44406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36426/0 (socket says 10.20.193.45:36426) 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7fa442ffd640 1 -- 10.20.193.45:0/2812218101 learned_addr learned my addr 10.20.193.45:0/2812218101 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7fa442ffd640 10 monclient(hunting): get_auth_request con 0x7fa44415f8e0 auth_method 0 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7fa442ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7fa442ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7fa442ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7f9ab4e0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7f9ab4e0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7f9ab4e0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7fa442ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7fa442ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.700+0000 7fa442ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 10 monclient(hunting): handle_auth_done global_id 4559 payload 274 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 1 -- 10.20.193.45:0/806503207 >> v2:10.20.193.86:3300/0 conn(0x7f9ab00748e0 msgr2=0x7f9ab00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 1 --2- 10.20.193.45:0/806503207 >> v2:10.20.193.86:3300/0 conn(0x7f9ab00748e0 0x7f9ab00c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 1 -- 10.20.193.45:0/806503207 >> v2:10.20.193.45:3300/0 conn(0x7f9ab00c90e0 msgr2=0x7f9ab0153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 1 --2- 10.20.193.45:0/806503207 >> v2:10.20.193.45:3300/0 conn(0x7f9ab00c90e0 0x7f9ab0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 1 monclient: found mon.noname-c 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.701+0000 7f9ab4e0b640 1 -- 10.20.193.45:0/806503207 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab00c7de0 con 0x7f9ab015d1e0 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.702+0000 7fa442ffd640 10 monclient(hunting): handle_auth_done global_id 4562 payload 274 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.702+0000 7fa442ffd640 1 -- 10.20.193.45:0/2812218101 >> v1:10.20.193.92:6789/0 conn(0x7fa4440c92a0 legacy=0x7fa444073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.702+0000 7fa442ffd640 1 -- 10.20.193.45:0/2812218101 >> v1:10.20.193.45:6789/0 conn(0x7fa4440c3e40 legacy=0x7fa44415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.702+0000 7fa442ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.702+0000 7fa442ffd640 1 monclient: found mon.noname-c 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.702+0000 7fa442ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.702+0000 7fa442ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.702+0000 7fa442ffd640 1 -- 10.20.193.45:0/2812218101 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4440c7f20 con 0x7fa44415f8e0 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.704+0000 7fa442ffd640 1 --2- 10.20.193.45:0/2812218101 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa44415f8e0 0x7fa44406d170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa434009970 tx=0x7fa43402eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe63a89f881c7554 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.704+0000 7f9ab4e0b640 1 --2- 10.20.193.45:0/806503207 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab015d1e0 0x7f9ab015d5c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0076cd0 tx=0x7f9aa002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8e0d964804e2b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 1 -- 10.20.193.45:0/2812218101 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43403c070 con 0x7fa44415f8e0 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 10 monclient: dump: 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 1 -- 10.20.193.45:0/2812218101 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43402fbb0 con 0x7fa44415f8e0 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 1 -- 10.20.193.45:0/2812218101 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434037440 con 0x7fa44415f8e0 2026-02-17T21:07:14.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa449c15640 5 monclient: authenticate success, global_id 4562 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa449c15640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa449c15640 4 set_mon_vals no callback set 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.707+0000 7fa4427fc640 10 monclient: dump: 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 10 monclient: shutdown 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 1 -- 10.20.193.45:0/2812218101 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa44415f8e0 msgr2=0x7fa44406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 1 --2- 10.20.193.45:0/2812218101 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa44415f8e0 0x7fa44406d170 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa434009970 tx=0x7fa43402eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 1 -- 10.20.193.45:0/806503207 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa003c070 con 0x7f9ab015d1e0 2026-02-17T21:07:14.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 10 monclient: dump: 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 1 -- 10.20.193.45:0/806503207 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa002fb50 con 0x7f9ab015d1e0 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 5 monclient: authenticate success, global_id 4559 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 1 -- 10.20.193.45:0/2812218101 shutdown_connections 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 1 -- 10.20.193.45:0/806503207 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0037440 con 0x7f9ab015d1e0 2026-02-17T21:07:14.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 1 --2- 10.20.193.45:0/2812218101 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa44415f8e0 0x7fa44406d170 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9aa77fe640 10 monclient: dump: 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 4 set_mon_vals no callback set 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 1 -- 10.20.193.45:0/2812218101 >> 10.20.193.45:0/2812218101 conn(0x7fa4440c9d40 msgr2=0x7fa4440ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 1 -- 10.20.193.45:0/2812218101 shutdown_connections 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 1 -- 10.20.193.45:0/2812218101 wait complete. 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 10 monclient: shutdown 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 1 -- 10.20.193.45:0/806503207 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab015d1e0 msgr2=0x7f9ab015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 1 --2- 10.20.193.45:0/806503207 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab015d1e0 0x7f9ab015d5c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0076cd0 tx=0x7f9aa002eed0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 1 -- 10.20.193.45:0/806503207 shutdown_connections 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 1 --2- 10.20.193.45:0/806503207 >> v2:10.20.193.45:3300/0 conn(0x7f9ab00c90e0 0x7f9ab0153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 1 --2- 10.20.193.45:0/806503207 >> v2:10.20.193.86:3300/0 conn(0x7f9ab00748e0 0x7f9ab00c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 1 --2- 10.20.193.45:0/806503207 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab015d1e0 0x7f9ab015d5c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 1 -- 10.20.193.45:0/806503207 >> 10.20.193.45:0/806503207 conn(0x7f9ab00c9d40 msgr2=0x7f9ab00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 1 -- 10.20.193.45:0/806503207 shutdown_connections 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 1 -- 10.20.193.45:0/806503207 wait complete. 2026-02-17T21:07:14.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 10 monclient: monmap: 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 1 librados: starting msgr at 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7fa449c15640 1 librados: starting objecter 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.708+0000 7f9ab7096640 10 monclient: monmap: 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:14.716 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 Processor -- start 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 -- start start 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 librados: setting wanted keys 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 librados: calling monclient init 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient: init 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 librados: starting msgr at 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 librados: starting objecter 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 Processor -- start 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 -- start start 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 librados: setting wanted keys 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 librados: calling monclient init 2026-02-17T21:07:14.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient: init 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa4440c3e40 0x7fa444150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient(hunting): picked mon.noname-c con 0x7fa4440c3e40 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa4440c92a0 0x7fa44414b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient(hunting): picked mon.noname-a con 0x7fa4440c92a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa44415f8e0 0x7fa4441e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient(hunting): picked mon.noname-b con 0x7fa44415f8e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440c87c0 con 0x7fa4440c92a0 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440c84e0 con 0x7fa44415f8e0 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa4440c8aa0 con 0x7fa4440c3e40 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa449c15640 10 monclient(hunting): authenticate will time out at 1018.339517s 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7fa4437fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa4440c3e40 0x7fa444150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7fa4437fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa4440c3e40 0x7fa444150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36452/0 (socket says 10.20.193.45:36452) 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7fa4437fe640 1 -- 10.20.193.45:0/47230742 learned_addr learned my addr 10.20.193.45:0/47230742 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7fa4437fe640 10 monclient(hunting): get_auth_request con 0x7fa4440c3e40 auth_method 0 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7fa4437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7fa4437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7fa4437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9ab00748e0 0x7f9ab0074130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient(hunting): picked mon.noname-a con 0x7f9ab00748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab00c90e0 0x7f9ab0145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient(hunting): picked mon.noname-c con 0x7f9ab00c90e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9ab015d1e0 0x7f9ab01f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient(hunting): picked mon.noname-b con 0x7f9ab015d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab00c8680 con 0x7f9ab00748e0 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab00c83a0 con 0x7f9ab015d1e0 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab0074d30 con 0x7f9ab00c90e0 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.709+0000 7f9ab7096640 10 monclient(hunting): authenticate will time out at 1018.339779s 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7f9aa7fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab00c90e0 0x7f9ab0145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7fa4437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7fa4437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7fa4437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7f9aa7fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab00c90e0 0x7f9ab0145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36454/0 (socket says 10.20.193.45:36454) 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7f9aa7fff640 1 -- 10.20.193.45:0/1666693592 learned_addr learned my addr 10.20.193.45:0/1666693592 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7f9aa7fff640 10 monclient(hunting): get_auth_request con 0x7f9ab00c90e0 auth_method 0 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7f9aa7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7f9aa7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.710+0000 7f9aa7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 10 monclient(hunting): handle_auth_done global_id 4565 payload 824 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 1 -- 10.20.193.45:0/47230742 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa44415f8e0 msgr2=0x7fa4441e7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa44415f8e0 0x7fa4441e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 1 -- 10.20.193.45:0/47230742 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa4440c92a0 msgr2=0x7fa44414b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa4440c92a0 0x7fa44414b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 1 monclient: found mon.noname-c 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.711+0000 7fa4437fe640 1 -- 10.20.193.45:0/47230742 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4441e7d00 con 0x7fa4440c3e40 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.712+0000 7f9aa7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.712+0000 7f9aa7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.712+0000 7f9aa7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 10 monclient(hunting): handle_auth_done global_id 4568 payload 824 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 1 -- 10.20.193.45:0/1666693592 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9ab015d1e0 msgr2=0x7f9ab01f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9ab015d1e0 0x7f9ab01f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 1 -- 10.20.193.45:0/1666693592 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9ab00748e0 msgr2=0x7f9ab0074130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9ab00748e0 0x7f9ab0074130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 1 monclient: found mon.noname-c 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7f9aa7fff640 1 -- 10.20.193.45:0/1666693592 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab0072db0 con 0x7f9ab00c90e0 2026-02-17T21:07:14.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7fa4437fe640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa4440c3e40 0x7fa444150830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa43000b500 tx=0x7fa43000b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7fa41ffff640 10 client.?.objecter ms_handle_connect 0x7fa4440c3e40 2026-02-17T21:07:14.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.714+0000 7fa41ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:14.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.715+0000 7f9aa7fff640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab00c90e0 0x7f9ab0145690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800b500 tx=0x7f9a9800b9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.715+0000 7f9aa57fa640 10 client.?.objecter ms_handle_connect 0x7f9ab00c90e0 2026-02-17T21:07:14.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.715+0000 7f9aa57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:14.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 1 -- 10.20.193.45:0/47230742 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430004480 con 0x7fa4440c3e40 2026-02-17T21:07:14.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 10 monclient: dump: 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 1 -- 10.20.193.45:0/47230742 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa430014070 con 0x7fa4440c3e40 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa449c15640 5 monclient: authenticate success, global_id 4565 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa449c15640 10 monclient: _renew_subs 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa449c15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4441e7fe0 con 0x7fa4440c3e40 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 1 -- 10.20.193.45:0/47230742 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430002920 con 0x7fa4440c3e40 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa41ffff640 10 monclient: dump: 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.723 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa441ffb640 4 set_mon_vals no callback set 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa449c15640 10 client.4565.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa449c15640 10 monclient: _renew_subs 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa449c15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4441e9c80 con 0x7fa4440c3e40 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.717+0000 7fa449c15640 1 librados: init done 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.718+0000 7fa449c15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.718+0000 7fa449c15640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.718+0000 7fa449c15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.718+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa444070d50 con 0x7fa4440c3e40 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 1 -- 10.20.193.45:0/1666693592 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98004480 con 0x7f9ab00c90e0 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 10 monclient: dump: 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.724 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 1 -- 10.20.193.45:0/1666693592 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a98014070 con 0x7f9ab00c90e0 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 5 monclient: authenticate success, global_id 4568 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 10 monclient: _renew_subs 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab0073090 con 0x7f9ab00c90e0 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 1 -- 10.20.193.45:0/1666693592 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98002920 con 0x7f9ab00c90e0 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa57fa640 10 monclient: dump: 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9aa6ffd640 4 set_mon_vals no callback set 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 10 client.4568.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 10 monclient: _renew_subs 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab0073650 con 0x7f9ab00c90e0 2026-02-17T21:07:14.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 1 librados: init done 2026-02-17T21:07:14.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.719+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab0070740 con 0x7f9ab00c90e0 2026-02-17T21:07:14.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.776+0000 7f49a3ae3640 10 monclient: get_monmap_and_config 2026-02-17T21:07:14.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.776+0000 7f49a3ae3640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.776+0000 7f49a3ae3640 10 monclient: monmap: 2026-02-17T21:07:14.768 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.768 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.768 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:14.777616+0000 2026-02-17T21:07:14.768 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:14.777616+0000 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 1 Processor -- start 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 1 -- start start 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 10 monclient: init 2026-02-17T21:07:14.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 10 monclient: _add_conns ranks=[4,0,2,5,1,3] 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f499c155fe0 0x7f499c0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 10 monclient(hunting): picked mon.noname-b con 0x7f499c155fe0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f499c0c98b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f499c0c9cf0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.777+0000 7f49a3ae3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c0c8b60 con 0x7f499c0c98b0 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.778+0000 7f49a3ae3640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f499c15cbb0 con 0x7f499c0c9cf0 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.778+0000 7f49a3ae3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.778+0000 7f49a3ae3640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f499c0c9420 con 0x7f499c155fe0 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.778+0000 7f49a3ae3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.778+0000 7f49a3ae3640 10 monclient(hunting): authenticate will time out at 1018.408016s 2026-02-17T21:07:14.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.788+0000 7fc62effd640 1 -- 10.20.193.45:0/709365572 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc644062ad0 con 0x7fc648156220 2026-02-17T21:07:14.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.788+0000 7fc62effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.788+0000 7fc62effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.790+0000 7f49a1858640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f499c155fe0 0x7f499c0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.791+0000 7f49a1858640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f499c155fe0 0x7f499c0cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57748/0 (socket says 10.20.193.45:57748) 2026-02-17T21:07:14.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.791+0000 7f49a1858640 1 -- 10.20.193.45:0/3170847429 learned_addr learned my addr 10.20.193.45:0/3170847429 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.791+0000 7f49a1858640 10 monclient(hunting): get_auth_request con 0x7f499c155fe0 auth_method 0 2026-02-17T21:07:14.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.791+0000 7f49a1858640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.791+0000 7f49a1858640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.791+0000 7f49a1858640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.791+0000 7f49a1858640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.791+0000 7f49a1858640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.791+0000 7f49a1858640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.792+0000 7f49a1858640 10 monclient(hunting): handle_auth_done global_id 4540 payload 274 2026-02-17T21:07:14.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.792+0000 7f49a1858640 1 -- 10.20.193.45:0/3170847429 >> v1:10.20.193.92:6789/0 conn(0x7f499c0c9cf0 legacy=0x7f499c0ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.792+0000 7f49a1858640 1 -- 10.20.193.45:0/3170847429 >> v1:10.20.193.45:6789/0 conn(0x7f499c0c98b0 legacy=0x7f499c0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.792+0000 7f49a1858640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.792+0000 7f49a1858640 1 monclient: found mon.noname-b 2026-02-17T21:07:14.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.792+0000 7f49a1858640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.792+0000 7f49a1858640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.792+0000 7f49a1858640 1 -- 10.20.193.45:0/3170847429 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c0d2250 con 0x7f499c155fe0 2026-02-17T21:07:14.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.793+0000 7f49a1858640 1 --2- 10.20.193.45:0/3170847429 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c155fe0 0x7f499c0cb550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f498c009970 tx=0x7f498c02efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a091903d66e59a86 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 1 -- 10.20.193.45:0/3170847429 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c03c070 con 0x7f499c155fe0 2026-02-17T21:07:14.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 10 monclient: dump: 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.791 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 1 -- 10.20.193.45:0/3170847429 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f498c02fbe0 con 0x7f499c155fe0 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 1 -- 10.20.193.45:0/3170847429 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c037440 con 0x7f499c155fe0 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a0856640 10 monclient: dump: 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.792 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a3ae3640 5 monclient: authenticate success, global_id 4540 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a3ae3640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.795+0000 7f49a3ae3640 4 set_mon_vals no callback set 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 10 monclient: shutdown 2026-02-17T21:07:14.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 1 -- 10.20.193.45:0/3170847429 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c155fe0 msgr2=0x7f499c0cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 1 --2- 10.20.193.45:0/3170847429 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c155fe0 0x7f499c0cb550 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f498c009970 tx=0x7f498c02efb0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 1 -- 10.20.193.45:0/3170847429 shutdown_connections 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 1 --2- 10.20.193.45:0/3170847429 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c155fe0 0x7f499c0cb550 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 1 -- 10.20.193.45:0/3170847429 >> 10.20.193.45:0/3170847429 conn(0x7f499c06d930 msgr2=0x7f499c06dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 1 -- 10.20.193.45:0/3170847429 shutdown_connections 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 1 -- 10.20.193.45:0/3170847429 wait complete. 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.796+0000 7f49a3ae3640 10 monclient: monmap: 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:14.794 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 librados: starting msgr at 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 librados: starting objecter 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 Processor -- start 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 -- start start 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 librados: setting wanted keys 2026-02-17T21:07:14.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 librados: calling monclient init 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient: init 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f499c0c98b0 0x7f499c15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient(hunting): picked mon.noname-a con 0x7f499c0c98b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c0c9cf0 0x7f499c1f5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient(hunting): picked mon.noname-b con 0x7f499c0c9cf0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f499c155fe0 0x7f499c1f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient(hunting): picked mon.noname-c con 0x7f499c155fe0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f499c0c90b0 con 0x7f499c0c98b0 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f499c0c8dd0 con 0x7f499c0c9cf0 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f499c0cc0e0 con 0x7f499c155fe0 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a3ae3640 10 monclient(hunting): authenticate will time out at 1018.427517s 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a1057640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c0c9cf0 0x7f499c1f5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a1057640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c0c9cf0 0x7f499c1f5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57756/0 (socket says 10.20.193.45:57756) 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a1057640 1 -- 10.20.193.45:0/2000596819 learned_addr learned my addr 10.20.193.45:0/2000596819 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a1057640 10 monclient(hunting): get_auth_request con 0x7f499c0c9cf0 auth_method 0 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a1057640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a1057640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.797+0000 7f49a1057640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.798+0000 7f49a1057640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.798+0000 7f49a1057640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.798+0000 7f49a1057640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 10 monclient(hunting): handle_auth_done global_id 4543 payload 824 2026-02-17T21:07:14.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 1 -- 10.20.193.45:0/2000596819 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f499c155fe0 msgr2=0x7f499c1f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f499c155fe0 0x7f499c1f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 1 -- 10.20.193.45:0/2000596819 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f499c0c98b0 msgr2=0x7f499c15a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f499c0c98b0 0x7f499c15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 1 monclient: found mon.noname-b 2026-02-17T21:07:14.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.799+0000 7f49a1057640 1 -- 10.20.193.45:0/2000596819 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c1e91d0 con 0x7f499c0c9cf0 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.800+0000 7f49a1057640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c0c9cf0 0x7f499c1f5260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f499000b500 tx=0x7f499000b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.800+0000 7f498a7fc640 10 client.?.objecter ms_handle_connect 0x7f499c0c9cf0 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.800+0000 7f498a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 1 -- 10.20.193.45:0/2000596819 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990004480 con 0x7f499c0c9cf0 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 10 monclient: dump: 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.801 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 1 -- 10.20.193.45:0/2000596819 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4990014070 con 0x7f499c0c9cf0 2026-02-17T21:07:14.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 5 monclient: authenticate success, global_id 4543 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 10 monclient: _renew_subs 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c1e94b0 con 0x7f499c0c9cf0 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 1 -- 10.20.193.45:0/2000596819 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990002920 con 0x7f499c0c9cf0 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498bfff640 4 set_mon_vals no callback set 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f498a7fc640 10 monclient: dump: 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.803 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 10 client.4543.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 10 monclient: _renew_subs 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c1e9a70 con 0x7f499c0c9cf0 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 1 librados: init done 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.802+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499c0cb550 con 0x7f499c0c9cf0 2026-02-17T21:07:14.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.811+0000 7fb6aaffd640 1 -- 10.20.193.45:0/1708118909 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb6ac062290 con 0x7fb6c4155cf0 2026-02-17T21:07:14.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.811+0000 7fb6aaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.811+0000 7fb6aaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.821 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T21:07:14.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.830+0000 7fa41ffff640 1 -- 10.20.193.45:0/47230742 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fa430019460 con 0x7fa4440c3e40 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.831+0000 7fa41ffff640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa4140792d0 0x7fa41407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.831+0000 7fa442ffd640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa4140792d0 0x7fa41407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.831+0000 7fa442ffd640 10 monclient: get_auth_request con 0x7fa4140792d0 auth_method 0 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.831+0000 7fa41ffff640 10 client.4565.objecter ms_handle_connect 0x7fa4140792d0 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.831+0000 7fa442ffd640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa4140792d0 0x7fa41407b790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa44406a450 tx=0x7fa434031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.832+0000 7fa41ffff640 1 -- 10.20.193.45:0/47230742 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fa43005e200 con 0x7fa4440c3e40 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.832+0000 7fa41ffff640 10 client.4565.objecter ms_dispatch2 0x7fa444000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.832+0000 7fa41ffff640 3 client.4565.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.832+0000 7fa41ffff640 3 client.4565.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.832+0000 7fa41ffff640 20 client.4565.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.836+0000 7fcbc1f87640 10 monclient: get_monmap_and_config 2026-02-17T21:07:14.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.836+0000 7fcbc1f87640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.836+0000 7fcbc1f87640 10 monclient: monmap: 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:14.837443+0000 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:14.837443+0000 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:14.829 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:14.830 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 1 Processor -- start 2026-02-17T21:07:14.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 1 -- start start 2026-02-17T21:07:14.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient: init 2026-02-17T21:07:14.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient: _add_conns ranks=[4,3,2,0,1,5] 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fcbbc155e40 0x7fcbbc074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient(hunting): picked mon.noname-b con 0x7fcbbc155e40 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fcbbc156220 0x7fcbbc074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient(hunting): picked mon.noname-a con 0x7fcbbc156220 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcbbc0ccb80 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc0734e0 con 0x7fcbbc0ccb80 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fcbbc0cd800 con 0x7fcbbc156220 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fcbbc0737c0 con 0x7fcbbc155e40 2026-02-17T21:07:14.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.837+0000 7fcbc1f87640 10 monclient(hunting): authenticate will time out at 1018.467838s 2026-02-17T21:07:14.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fcbbc156220 0x7fcbbc074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fa41ffff640 1 -- 10.20.193.45:0/47230742 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa4300628c0 con 0x7fa4440c3e40 2026-02-17T21:07:14.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fa41ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fa41ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fcbbc156220 0x7fcbbc074ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42132/0 (socket says 10.20.193.45:42132) 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 1 -- 10.20.193.45:0/725822421 learned_addr learned my addr 10.20.193.45:0/725822421 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 10 monclient(hunting): get_auth_request con 0x7fcbbc156220 auth_method 0 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.838+0000 7fcbbaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.840+0000 7fcbbaffd640 10 monclient(hunting): handle_auth_done global_id 4488 payload 274 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.840+0000 7fcbbaffd640 1 -- 10.20.193.45:0/725822421 >> v2:10.20.193.86:3300/0 conn(0x7fcbbc155e40 msgr2=0x7fcbbc074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.840+0000 7fcbbaffd640 1 --2- 10.20.193.45:0/725822421 >> v2:10.20.193.86:3300/0 conn(0x7fcbbc155e40 0x7fcbbc074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.840+0000 7fcbbaffd640 1 -- 10.20.193.45:0/725822421 >> v1:10.20.193.92:6789/0 conn(0x7fcbbc0ccb80 legacy=0x7fcbbc0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.840+0000 7fcbbaffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.840+0000 7fcbbaffd640 1 monclient: found mon.noname-a 2026-02-17T21:07:14.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.840+0000 7fcbbaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.840+0000 7fcbbaffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.840+0000 7fcbbaffd640 1 -- 10.20.193.45:0/725822421 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc073aa0 con 0x7fcbbc156220 2026-02-17T21:07:14.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.841+0000 7fcbbaffd640 1 --2- 10.20.193.45:0/725822421 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 0x7fcbbc074ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc06cf60 tx=0x7fcbac02eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385cc3d143058c2c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 1 -- 10.20.193.45:0/725822421 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac03c070 con 0x7fcbbc156220 2026-02-17T21:07:14.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 10 monclient: dump: 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 1 -- 10.20.193.45:0/725822421 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac02fb40 con 0x7fcbbc156220 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 1 -- 10.20.193.45:0/725822421 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbac037440 con 0x7fcbbc156220 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 5 monclient: authenticate success, global_id 4488 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 4 set_mon_vals no callback set 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbba7fc640 10 monclient: dump: 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.841 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 10 monclient: shutdown 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 1 -- 10.20.193.45:0/725822421 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 msgr2=0x7fcbbc074ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 1 --2- 10.20.193.45:0/725822421 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 0x7fcbbc074ac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc06cf60 tx=0x7fcbac02eed0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 1 -- 10.20.193.45:0/725822421 shutdown_connections 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 1 --2- 10.20.193.45:0/725822421 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 0x7fcbbc074ac0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 1 --2- 10.20.193.45:0/725822421 >> v2:10.20.193.86:3300/0 conn(0x7fcbbc155e40 0x7fcbbc074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 1 -- 10.20.193.45:0/725822421 >> 10.20.193.45:0/725822421 conn(0x7fcbbc0ce270 msgr2=0x7fcbbc0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 1 -- 10.20.193.45:0/725822421 shutdown_connections 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.843+0000 7fcbc1f87640 1 -- 10.20.193.45:0/725822421 wait complete. 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient: monmap: 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.843 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 librados: starting msgr at 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 librados: starting objecter 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 Processor -- start 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 -- start start 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 librados: setting wanted keys 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 librados: calling monclient init 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient: init 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcbbc0ccb80 0x7fcbbc156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient(hunting): picked mon.noname-c con 0x7fcbbc0ccb80 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:14.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcbbc155e40 0x7fcbbc147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient(hunting): picked mon.noname-b con 0x7fcbbc155e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 0x7fcbbc1585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient(hunting): picked mon.noname-a con 0x7fcbbc156220 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc0c4830 con 0x7fcbbc156220 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc074060 con 0x7fcbbc155e40 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcbbc0c49b0 con 0x7fcbbc0ccb80 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.844+0000 7fcbc1f87640 10 monclient(hunting): authenticate will time out at 1018.474925s 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 0x7fcbbc1585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 0x7fcbbc1585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42142/0 (socket says 10.20.193.45:42142) 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 1 -- 10.20.193.45:0/1642553144 learned_addr learned my addr 10.20.193.45:0/1642553144 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 10 monclient(hunting): get_auth_request con 0x7fcbbc156220 auth_method 0 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.845+0000 7fcbbbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 10 monclient(hunting): handle_auth_done global_id 4491 payload 824 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 1 -- 10.20.193.45:0/1642553144 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcbbc0ccb80 msgr2=0x7fcbbc156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcbbc0ccb80 0x7fcbbc156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 1 -- 10.20.193.45:0/1642553144 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcbbc155e40 msgr2=0x7fcbbc147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcbbc155e40 0x7fcbbc147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 1 monclient: found mon.noname-a 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.846+0000 7fcbbbfff640 1 -- 10.20.193.45:0/1642553144 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc1f3e30 con 0x7fcbbc156220 2026-02-17T21:07:14.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.847+0000 7fcbbbfff640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 0x7fcbbc1585e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000b9c0 tx=0x7fcbb000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.847+0000 7fcb97fff640 10 client.?.objecter ms_handle_connect 0x7fcbbc156220 2026-02-17T21:07:14.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.847+0000 7fcb97fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:14.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 1 -- 10.20.193.45:0/1642553144 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0006e60 con 0x7fcbbc156220 2026-02-17T21:07:14.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 10 monclient: dump: 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 1 -- 10.20.193.45:0/1642553144 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb0010070 con 0x7fcbbc156220 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbc1f87640 5 monclient: authenticate success, global_id 4491 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbc1f87640 10 monclient: _renew_subs 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbc1f87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbbc1f4110 con 0x7fcbbc156220 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 1 -- 10.20.193.45:0/1642553144 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000c9d0 con 0x7fcbbc156220 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcb97fff640 10 monclient: dump: 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.850 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbb9ffb640 4 set_mon_vals no callback set 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbc1f87640 10 client.4491.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbc1f87640 10 monclient: _renew_subs 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbc1f87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbbc1f46d0 con 0x7fcbbc156220 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.849+0000 7fcbc1f87640 1 librados: init done 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.850+0000 7fcbc1f87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.850+0000 7fcbc1f87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.850+0000 7fcbc1f87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.850+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbbc0ccfa0 con 0x7fcbbc156220 2026-02-17T21:07:14.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.862+0000 7fcb97fff640 1 -- 10.20.193.45:0/1642553144 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fcbb000cb70 con 0x7fcbbc156220 2026-02-17T21:07:14.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.863+0000 7fcb97fff640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcb8c079280 0x7fcb8c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.863+0000 7fcbbb7fe640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcb8c079280 0x7fcb8c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.863+0000 7fcbbb7fe640 10 monclient: get_auth_request con 0x7fcb8c079280 auth_method 0 2026-02-17T21:07:14.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.863+0000 7fcbbb7fe640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcb8c079280 0x7fcb8c07b740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcba80098a0 tx=0x7fcba8006d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.863+0000 7fcb97fff640 10 client.4491.objecter ms_handle_connect 0x7fcb8c079280 2026-02-17T21:07:14.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.877+0000 7fc6502f3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:07:14.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.877+0000 7fc6502f3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:07:14.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.877+0000 7fc6502f3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.877+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc648159770 con 0x7fc648156220 2026-02-17T21:07:14.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.897+0000 7fb6c8da9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:07:14.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.897+0000 7fb6c8da9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:07:14.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.897+0000 7fb6c8da9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:14.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.897+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb6c4074400 con 0x7fb6c4155cf0 2026-02-17T21:07:14.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.898+0000 7f9d0537e640 10 monclient: get_monmap_and_config 2026-02-17T21:07:14.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.898+0000 7f9d0537e640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.898+0000 7f9d0537e640 10 monclient: monmap: 2026-02-17T21:07:14.890 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.890 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.890 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:14.898975+0000 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:14.898975+0000 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:14.891 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.898+0000 7f9d0537e640 1 Processor -- start 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.898+0000 7f9d0537e640 1 -- start start 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.898+0000 7f9d0537e640 10 monclient: init 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 10 monclient: _add_conns ranks=[3,2,5,4,0,1] 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f9d00155e40 0x7f9d00074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 10 monclient(hunting): picked mon.noname-a con 0x7f9d00155e40 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9d00156220 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9d000cd290 0x7f9d00074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 10 monclient(hunting): picked mon.noname-c con 0x7f9d000cd290 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:14.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d000734e0 con 0x7f9d00156220 2026-02-17T21:07:14.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f9d000cd800 con 0x7f9d00155e40 2026-02-17T21:07:14.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f9d000737c0 con 0x7f9d000cd290 2026-02-17T21:07:14.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.899+0000 7f9d0537e640 10 monclient(hunting): authenticate will time out at 1018.529421s 2026-02-17T21:07:14.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.909+0000 7f498a7fc640 1 -- 10.20.193.45:0/2000596819 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4990019460 con 0x7f499c0c9cf0 2026-02-17T21:07:14.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.909+0000 7f498a7fc640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f496c079300 0x7f496c07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.909+0000 7f49a1858640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f496c079300 0x7f496c07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.909+0000 7f49a1858640 10 monclient: get_auth_request con 0x7f496c079300 auth_method 0 2026-02-17T21:07:14.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.910+0000 7f498a7fc640 10 client.4543.objecter ms_handle_connect 0x7f496c079300 2026-02-17T21:07:14.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.910+0000 7f49a1858640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f496c079300 0x7f496c07b7c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f499c0c5260 tx=0x7f498c031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.911+0000 7f498a7fc640 1 -- 10.20.193.45:0/2000596819 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f499005e1a0 con 0x7f499c0c9cf0 2026-02-17T21:07:14.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.911+0000 7f498a7fc640 10 client.4543.objecter ms_dispatch2 0x7f499c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.911+0000 7f498a7fc640 3 client.4543.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.911+0000 7f498a7fc640 3 client.4543.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.911+0000 7f498a7fc640 20 client.4543.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.907 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T21:07:14.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.918+0000 7f498a7fc640 1 -- 10.20.193.45:0/2000596819 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f499000e360 con 0x7f499c0c9cf0 2026-02-17T21:07:14.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.918+0000 7f498a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.918+0000 7f498a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.921+0000 7fc62effd640 1 -- 10.20.193.45:0/709365572 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc644066dd0 con 0x7fc648156220 2026-02-17T21:07:14.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.921+0000 7fc62effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:07:14.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.921+0000 7fc62effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.914 INFO:teuthology.orchestra.run.trial045.stdout:111669149704 2026-02-17T21:07:14.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 10 librados: watch_flush enter 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 10 librados: watch_flush exit 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 20 client.4534.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 10 client.4534.objecter successfully canceled tick 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc618079280 msgr2=0x7fc61807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc618079280 0x7fc61807b740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc638039000 tx=0x7fc638033000 comp rx=0 tx=0).stop 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 10 monclient: shutdown 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648156220 msgr2=0x7fc6480c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648156220 0x7fc6480c9b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc64400cc50 tx=0x7fc64400a430 comp rx=0 tx=0).stop 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 shutdown_connections 2026-02-17T21:07:14.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc618079280 0x7fc61807b740 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc648156220 0x7fc6480c9b60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc648155e40 0x7fc64813f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 --2- 10.20.193.45:0/709365572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc6480cd290 0x7fc6481f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 >> 10.20.193.45:0/709365572 conn(0x7fc6480ce270 msgr2=0x7fc648152180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 shutdown_connections 2026-02-17T21:07:14.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 -- 10.20.193.45:0/709365572 wait complete. 2026-02-17T21:07:14.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.923+0000 7fc6502f3640 1 librados: shutdown 2026-02-17T21:07:14.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.925+0000 7fa449c15640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:07:14.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.925+0000 7fa449c15640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:07:14.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.925+0000 7fa449c15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.925+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7fa44406d520 con 0x7fa4440c3e40 2026-02-17T21:07:14.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.928+0000 7fcb97fff640 1 -- 10.20.193.45:0/1642553144 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fcbb0012de0 con 0x7fcbbc156220 2026-02-17T21:07:14.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.928+0000 7fcb97fff640 10 client.4491.objecter ms_dispatch2 0x7fcbbc000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.928+0000 7fcb97fff640 3 client.4491.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.928+0000 7fcb97fff640 3 client.4491.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.928+0000 7fcb97fff640 20 client.4491.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149705 got 111669149704 for osd.7 2026-02-17T21:07:14.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.942+0000 7f9aa57fa640 1 -- 10.20.193.45:0/1666693592 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f9a98019460 con 0x7f9ab00c90e0 2026-02-17T21:07:14.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.943+0000 7f9aa57fa640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a800792d0 0x7f9a8007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.943+0000 7f9ab4e0b640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a800792d0 0x7f9a8007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.943+0000 7f9ab4e0b640 10 monclient: get_auth_request con 0x7f9a800792d0 auth_method 0 2026-02-17T21:07:14.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.943+0000 7f9ab4e0b640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a800792d0 0x7f9a8007b790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00c6af0 tx=0x7f9aa0031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.943+0000 7f9aa57fa640 10 client.4568.objecter ms_handle_connect 0x7f9a800792d0 2026-02-17T21:07:14.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.944+0000 7f9aa57fa640 1 -- 10.20.193.45:0/1666693592 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f9a9805e1b0 con 0x7f9ab00c90e0 2026-02-17T21:07:14.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.944+0000 7f9aa57fa640 10 client.4568.objecter ms_dispatch2 0x7f9ab0000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.944+0000 7f9aa57fa640 3 client.4568.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.944+0000 7f9aa57fa640 3 client.4568.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.944+0000 7f9aa57fa640 20 client.4568.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.950+0000 7f9aa57fa640 1 -- 10.20.193.45:0/1666693592 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9ab0070740 con 0x7f9ab00c90e0 2026-02-17T21:07:14.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.950+0000 7f9aa57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.950+0000 7f9aa57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.952+0000 7f9cfe7fc640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f9d00156220 0x7f9d000ccb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47708/0 (socket says 10.20.193.45:47708) 2026-02-17T21:07:14.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.952+0000 7f9cfe7fc640 1 -- 10.20.193.45:0/1685340068 learned_addr learned my addr 10.20.193.45:0/1685340068 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:14.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.956+0000 7fa41ffff640 1 -- 10.20.193.45:0/47230742 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa4300621c0 con 0x7fa4440c3e40 2026-02-17T21:07:14.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.956+0000 7fa41ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:07:14.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.956+0000 7fa41ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.949 INFO:teuthology.orchestra.run.trial045.stdout:115964117000 2026-02-17T21:07:14.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.957+0000 7f9cff7fe640 1 --2- 10.20.193.45:0/1685340068 >> v2:10.20.193.92:3300/0 conn(0x7f9d000cd290 0x7f9d00074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cff7fe640 10 monclient(hunting): get_auth_request con 0x7f9d000cd290 auth_method 0 2026-02-17T21:07:14.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716863048 0 0) 0x7f9d000734e0 con 0x7f9d00156220 2026-02-17T21:07:14.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cfdffb640 10 monclient(hunting): _negotiate 2026-02-17T21:07:14.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cfdffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cfdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cfdffb640 10 monclient(hunting): my global_id is 4571 2026-02-17T21:07:14.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.958+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cec003620 con 0x7f9d00156220 2026-02-17T21:07:14.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 10 librados: watch_flush enter 2026-02-17T21:07:14.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 10 librados: watch_flush exit 2026-02-17T21:07:14.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 20 client.4565.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 10 client.4565.objecter successfully canceled tick 2026-02-17T21:07:14.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa4140792d0 msgr2=0x7fa41407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa4140792d0 0x7fa41407b790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa44406a450 tx=0x7fa434031000 comp rx=0 tx=0).stop 2026-02-17T21:07:14.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 10 monclient: shutdown 2026-02-17T21:07:14.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa4440c3e40 msgr2=0x7fa444150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa4440c3e40 0x7fa444150830 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa43000b500 tx=0x7fa43000b9d0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 shutdown_connections 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa4140792d0 0x7fa41407b790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa44415f8e0 0x7fa4441e7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa4440c92a0 0x7fa44414b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 --2- 10.20.193.45:0/47230742 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa4440c3e40 0x7fa444150830 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 >> 10.20.193.45:0/47230742 conn(0x7fa4440c9d40 msgr2=0x7fa44406dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 shutdown_connections 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 -- 10.20.193.45:0/47230742 wait complete. 2026-02-17T21:07:14.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.959+0000 7fa449c15640 1 librados: shutdown 2026-02-17T21:07:14.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.960+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.960+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.960+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.960+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 <== mon.2 v1:10.20.193.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2523181845 0 0) 0x7f9cec003620 con 0x7f9d00156220 2026-02-17T21:07:14.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 >> v2:10.20.193.92:3300/0 conn(0x7f9d000cd290 msgr2=0x7f9d00074ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 1 --2- 10.20.193.45:0/1685340068 >> v2:10.20.193.92:3300/0 conn(0x7f9d000cd290 0x7f9d00074ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 >> v2:10.20.193.45:3300/0 conn(0x7f9d00155e40 msgr2=0x7f9d00074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 1 --2- 10.20.193.45:0/1685340068 >> v2:10.20.193.45:3300/0 conn(0x7f9d00155e40 0x7f9d00074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.92:6789/0 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 --> v1:10.20.193.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d00073aa0 con 0x7f9d00156220 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9d0537e640 5 monclient: authenticate success, global_id 4571 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9d0537e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:14.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 <== mon.2 v1:10.20.193.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f9ce8002f00 con 0x7f9d00156220 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 10 monclient: dump: 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.960 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] but i'm connected to v1:10.20.193.92:6789/0, reconnecting 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.961+0000 7f9cfdffb640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 >> v1:10.20.193.92:6789/0 conn(0x7f9d00156220 legacy=0x7f9d000ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 1 --2- 10.20.193.45:0/1685340068 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9cec003ba0 0x7f9cec003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 10 monclient(hunting): picked mon.c con 0x7f9cec003ba0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:14.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 1 --2- 10.20.193.45:0/1685340068 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9cec004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 10 monclient(hunting): picked mon.b con 0x7f9cec004900 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 1 --2- 10.20.193.45:0/1685340068 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9cec0053e0 0x7f9cec00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 10 monclient(hunting): picked mon.a con 0x7f9cec0053e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000cd800 con 0x7f9cec0053e0 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000737c0 con 0x7f9cec004900 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9cec00c360 con 0x7f9cec003ba0 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfdffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:07:14.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9d0537e640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfe7fc640 1 --2- 10.20.193.45:0/1685340068 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9cec004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfe7fc640 10 monclient(hunting): get_auth_request con 0x7f9cec004900 auth_method 0 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.962+0000 7f9cfe7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.963+0000 7f9cfe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.963+0000 7f9cfe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.963+0000 7f9cfe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 10 monclient(hunting): handle_auth_done global_id 4571 payload 293 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 1 -- 10.20.193.45:0/1685340068 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9cec003ba0 msgr2=0x7f9cec003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 1 --2- 10.20.193.45:0/1685340068 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9cec003ba0 0x7f9cec003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 1 -- 10.20.193.45:0/1685340068 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9cec0053e0 msgr2=0x7f9cec00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 1 --2- 10.20.193.45:0/1685340068 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9cec0053e0 0x7f9cec00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 1 monclient: found mon.b 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cff7fe640 1 -- 10.20.193.45:0/1685340068 reap_dead start 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 1 -- 10.20.193.45:0/1685340068 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cec003620 con 0x7f9cec004900 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.964+0000 7f9cfe7fc640 1 --2- 10.20.193.45:0/1685340068 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9cec004d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c2f0 tx=0x7f9ce802f640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c1d386e345450f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8007e30 con 0x7f9cec004900 2026-02-17T21:07:14.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:14.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 10 monclient: dump: 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce8005bf0 con 0x7f9cec004900 2026-02-17T21:07:14.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9d0537e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 1 -- 10.20.193.45:0/1685340068 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8007070 con 0x7f9cec004900 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9cfdffb640 10 monclient: dump: 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.968 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9d0537e640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.966+0000 7f9d0537e640 4 set_mon_vals no callback set 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 10 monclient: shutdown 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 1 -- 10.20.193.45:0/1685340068 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 msgr2=0x7f9cec004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 1 --2- 10.20.193.45:0/1685340068 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9cec004d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c2f0 tx=0x7f9ce802f640 comp rx=0 tx=0).stop 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 1 -- 10.20.193.45:0/1685340068 shutdown_connections 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 1 --2- 10.20.193.45:0/1685340068 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9cec004d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 1 -- 10.20.193.45:0/1685340068 >> 10.20.193.45:0/1685340068 conn(0x7f9d000ce270 msgr2=0x7f9d000ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 1 -- 10.20.193.45:0/1685340068 shutdown_connections 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 1 -- 10.20.193.45:0/1685340068 wait complete. 2026-02-17T21:07:14.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 10 monclient: monmap: 2026-02-17T21:07:14.970 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.970 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:14.970 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:14.970 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:14.971 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.971 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.971 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:14.971 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:14.971 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:14.971 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117000 for osd.14 2026-02-17T21:07:14.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 1 librados: starting msgr at 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.967+0000 7f9d0537e640 1 librados: starting objecter 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 Processor -- start 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 -- start start 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 librados: setting wanted keys 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 librados: calling monclient init 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient: init 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9d001e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient(hunting): picked mon.noname-b con 0x7f9cec004900 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9d000ca1b0 0x7f9d001e72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient(hunting): picked mon.noname-a con 0x7f9d000ca1b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d000ca630 0x7f9d001e7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient(hunting): picked mon.noname-c con 0x7f9d000ca630 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:14.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000c4830 con 0x7f9d000ca1b0 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9d00074060 con 0x7f9cec004900 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d000c49b0 con 0x7f9d000ca630 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9d0537e640 10 monclient(hunting): authenticate will time out at 1018.598504s 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9cfeffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9d001e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9cff7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d000ca630 0x7f9d001e7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9cfeffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9d001e9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57796/0 (socket says 10.20.193.45:57796) 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9cfeffd640 1 -- 10.20.193.45:0/668538713 learned_addr learned my addr 10.20.193.45:0/668538713 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9cfeffd640 10 monclient(hunting): get_auth_request con 0x7f9cec004900 auth_method 0 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9cfeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9cfeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.968+0000 7f9cfeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cff7fe640 10 monclient(hunting): get_auth_request con 0x7f9d000ca630 auth_method 0 2026-02-17T21:07:14.976 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cfeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cfeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cfeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.969+0000 7f9cff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 10 monclient(hunting): handle_auth_done global_id 4546 payload 824 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 1 -- 10.20.193.45:0/668538713 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d000ca630 msgr2=0x7f9d001e7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d000ca630 0x7f9d001e7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 1 -- 10.20.193.45:0/668538713 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9d000ca1b0 msgr2=0x7f9d001e72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9d000ca1b0 0x7f9d001e72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 1 monclient: found mon.noname-b 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.970+0000 7f9cfeffd640 1 -- 10.20.193.45:0/668538713 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d001f47e0 con 0x7f9cec004900 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.971+0000 7f9cfeffd640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9d001e9ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400b9a0 tx=0x7f9cf400be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.971+0000 7f9cdf7fe640 10 client.?.objecter ms_handle_connect 0x7f9cec004900 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.971+0000 7f9cdf7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 1 -- 10.20.193.45:0/668538713 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4004480 con 0x7f9cec004900 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 10 monclient: dump: 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.978 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 1 -- 10.20.193.45:0/668538713 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf4010070 con 0x7f9cec004900 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 5 monclient: authenticate success, global_id 4546 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 1 -- 10.20.193.45:0/668538713 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400c9d0 con 0x7f9cec004900 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cdf7fe640 10 monclient: dump: 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.979 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9cfd7fa640 4 set_mon_vals no callback set 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 10 monclient: _renew_subs 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d000c8b90 con 0x7f9cec004900 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 10 client.4546.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 10 monclient: _renew_subs 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d000c9150 con 0x7f9cec004900 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 1 librados: init done 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:14.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.973+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d000ccb80 con 0x7f9cec004900 2026-02-17T21:07:14.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.975+0000 7fcb97fff640 1 -- 10.20.193.45:0/1642553144 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcbb0062500 con 0x7fcbbc156220 2026-02-17T21:07:14.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.975+0000 7fcb97fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.975+0000 7fcb97fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:14.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.984+0000 7f9cdf7fe640 1 -- 10.20.193.45:0/668538713 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f9cf400cb70 con 0x7f9cec004900 2026-02-17T21:07:14.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.985+0000 7f9cdf7fe640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9ccc0792b0 0x7f9ccc07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.985+0000 7f9cfe7fc640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9ccc0792b0 0x7f9ccc07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.985+0000 7f9cfe7fc640 10 monclient: get_auth_request con 0x7f9ccc0792b0 auth_method 0 2026-02-17T21:07:14.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.985+0000 7f9cdf7fe640 10 client.4546.objecter ms_handle_connect 0x7f9ccc0792b0 2026-02-17T21:07:14.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.985+0000 7f9cfe7fc640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9ccc0792b0 0x7f9ccc07b770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8036000 tx=0x7f9ce8009070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7fb6aaffd640 1 -- 10.20.193.45:0/1708118909 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb6ac066590 con 0x7fb6c4155cf0 2026-02-17T21:07:14.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7fb6aaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:07:14.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7fb6aaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:14.982 INFO:teuthology.orchestra.run.trial045.stdout:94489280516 2026-02-17T21:07:14.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7f9cdf7fe640 1 -- 10.20.193.45:0/668538713 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f9cf405dda0 con 0x7f9cec004900 2026-02-17T21:07:14.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7f9cdf7fe640 10 client.4546.objecter ms_dispatch2 0x7f9d00000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:14.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7f9cdf7fe640 3 client.4546.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:14.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7f9cdf7fe640 3 client.4546.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:14.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7f9cdf7fe640 20 client.4546.objecter dump_active .. 0 homeless 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7fbe2f093640 10 monclient: get_monmap_and_config 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7fbe2f093640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.986+0000 7fbe2f093640 10 monclient: monmap: 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:14.987733+0000 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:14.987733+0000 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 1 Processor -- start 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 1 -- start start 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 10 monclient: init 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 10 monclient: _add_conns ranks=[2,5,0,4,1,3] 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbe28072ce0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fbe2815c7c0 0x7fbe280730c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 10 monclient(hunting): picked mon.noname-c con 0x7fbe2815c7c0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbe280c82a0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe280c8b40 con 0x7fbe280c82a0 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe280c8e20 con 0x7fbe28072ce0 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fbe280c9a30 con 0x7fbe2815c7c0 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.987+0000 7fbe2f093640 10 monclient(hunting): authenticate will time out at 1018.617970s 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fbe2e892640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fbe280c82a0 0x7fbe2815d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46274/0 (socket says 10.20.193.45:46274) 2026-02-17T21:07:14.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fbe2e892640 1 -- 10.20.193.45:0/2315528106 learned_addr learned my addr 10.20.193.45:0/2315528106 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 10 librados: watch_flush enter 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 10 librados: watch_flush exit 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 20 client.4485.objecter shutdown clearing up homeless session... 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 10 client.4485.objecter successfully canceled tick 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6900792d0 msgr2=0x7fb69007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6900792d0 0x7fb69007b790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8002770 tx=0x7fb6b8009040 comp rx=0 tx=0).stop 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 10 monclient: shutdown 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c4155cf0 msgr2=0x7fb6c41f52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c4155cf0 0x7fb6c41f52d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac00c460 tx=0x7fb6ac00c930 comp rx=0 tx=0).stop 2026-02-17T21:07:14.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fbe2d890640 1 --2- 10.20.193.45:0/2315528106 >> v2:10.20.193.92:3300/0 conn(0x7fbe2815c7c0 0x7fbe280730c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 shutdown_connections 2026-02-17T21:07:14.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6900792d0 0x7fb69007b790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb6c41560d0 0x7fb6c4144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb6c4155cf0 0x7fb6c41f52d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 --2- 10.20.193.45:0/1708118909 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb6c40c9530 0x7fb6c41565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 >> 10.20.193.45:0/1708118909 conn(0x7fb6c40ca5a0 msgr2=0x7fb6c406b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 shutdown_connections 2026-02-17T21:07:14.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 -- 10.20.193.45:0/1708118909 wait complete. 2026-02-17T21:07:14.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fb6c8da9640 1 librados: shutdown 2026-02-17T21:07:14.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fbe2d890640 10 monclient(hunting): get_auth_request con 0x7fbe2815c7c0 auth_method 0 2026-02-17T21:07:14.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fbe2d890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fbe2d890640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.988+0000 7fbe2d890640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.989+0000 7fbe2d08f640 1 -- 10.20.193.45:0/2315528106 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764002115 0 0) 0x7fbe280c8b40 con 0x7fbe280c82a0 2026-02-17T21:07:14.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.989+0000 7fbe2d08f640 10 monclient(hunting): _negotiate 2026-02-17T21:07:14.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.989+0000 7fbe2d08f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.989+0000 7fbe2d08f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.989+0000 7fbe2d08f640 10 monclient(hunting): my global_id is 4494 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.989+0000 7fbe2d08f640 1 -- 10.20.193.45:0/2315528106 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe10003620 con 0x7fbe280c82a0 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.989+0000 7fbe2d890640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.989+0000 7fbe2d890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.989+0000 7fbe2d890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.990+0000 7fbe2d08f640 1 -- 10.20.193.45:0/2315528106 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223983501 0 0) 0x7fbe280c8e20 con 0x7fbe28072ce0 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.990+0000 7fbe2d08f640 10 monclient(hunting): _negotiate 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.990+0000 7fbe2d08f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.990+0000 7fbe2d08f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.990+0000 7fbe2d08f640 10 monclient(hunting): my global_id is 4583 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.990+0000 7fbe2d08f640 1 -- 10.20.193.45:0/2315528106 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe280c8b40 con 0x7fbe28072ce0 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.991+0000 7fbe2d890640 10 monclient(hunting): handle_auth_done global_id 4580 payload 274 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.991+0000 7fbe2d890640 1 -- 10.20.193.45:0/2315528106 >> v1:10.20.193.92:6789/0 conn(0x7fbe28072ce0 legacy=0x7fbe28076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.991+0000 7fbe2d890640 1 -- 10.20.193.45:0/2315528106 >> v1:10.20.193.45:6789/0 conn(0x7fbe280c82a0 legacy=0x7fbe2815d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.991+0000 7fbe2d890640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.991+0000 7fbe2d890640 1 monclient: found mon.noname-c 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.991+0000 7fbe2d890640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.991+0000 7fbe2d890640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.991+0000 7fbe2d890640 1 -- 10.20.193.45:0/2315528106 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe280c9100 con 0x7fbe2815c7c0 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.992+0000 7fbe2d890640 1 --2- 10.20.193.45:0/2315528106 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe2815c7c0 0x7fbe280730c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0098a0 tx=0x7fbe1c02ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4d1dc0e08477c4d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 1 -- 10.20.193.45:0/2315528106 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c03c070 con 0x7fbe2815c7c0 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 10 monclient: dump: 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 1 -- 10.20.193.45:0/2315528106 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c02fb70 con 0x7fbe2815c7c0 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 5 monclient: authenticate success, global_id 4580 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 1 -- 10.20.193.45:0/2315528106 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c037440 con 0x7fbe2815c7c0 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 4 set_mon_vals no callback set 2026-02-17T21:07:14.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2d08f640 10 monclient: dump: 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 10 monclient: shutdown 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 1 -- 10.20.193.45:0/2315528106 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe2815c7c0 msgr2=0x7fbe280730c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 1 --2- 10.20.193.45:0/2315528106 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe2815c7c0 0x7fbe280730c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0098a0 tx=0x7fbe1c02ee60 comp rx=0 tx=0).stop 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 1 -- 10.20.193.45:0/2315528106 shutdown_connections 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 1 --2- 10.20.193.45:0/2315528106 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe2815c7c0 0x7fbe280730c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 1 -- 10.20.193.45:0/2315528106 >> 10.20.193.45:0/2315528106 conn(0x7fbe280ca3a0 msgr2=0x7fbe280ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 1 -- 10.20.193.45:0/2315528106 shutdown_connections 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.994+0000 7fbe2f093640 1 -- 10.20.193.45:0/2315528106 wait complete. 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient: build_initial_monmap 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient: monmap: 2026-02-17T21:07:14.993 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 librados: starting msgr at 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 librados: starting objecter 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 Processor -- start 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 -- start start 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 librados: setting wanted keys 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 librados: calling monclient init 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient: init 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe28072ce0 0x7fbe2814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient(hunting): picked mon.noname-c con 0x7fbe28072ce0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe280c82a0 0x7fbe2815e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient(hunting): picked mon.noname-a con 0x7fbe280c82a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe2815c7c0 0x7fbe2815e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient(hunting): picked mon.noname-b con 0x7fbe2815c7c0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbe280c8750 con 0x7fbe280c82a0 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbe280c96c0 con 0x7fbe2815c7c0 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbe280c88d0 con 0x7fbe28072ce0 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.995+0000 7fbe2f093640 10 monclient(hunting): authenticate will time out at 1018.625888s 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2e091640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe28072ce0 0x7fbe2814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe280c82a0 0x7fbe2815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe280c82a0 0x7fbe2815e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42182/0 (socket says 10.20.193.45:42182) 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 1 -- 10.20.193.45:0/588682202 learned_addr learned my addr 10.20.193.45:0/588682202 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 10 monclient(hunting): get_auth_request con 0x7fbe280c82a0 auth_method 0 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2e091640 10 monclient(hunting): get_auth_request con 0x7fbe28072ce0 auth_method 0 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2e091640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2e091640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2e091640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2e091640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2e091640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2e091640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:14.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.996+0000 7fbe2d890640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:14.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.3 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 10 monclient(hunting): handle_auth_done global_id 4586 payload 824 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 1 -- 10.20.193.45:0/588682202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe2815c7c0 msgr2=0x7fbe2815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe2815c7c0 0x7fbe2815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 1 -- 10.20.193.45:0/588682202 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe280c82a0 msgr2=0x7fbe2815e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe280c82a0 0x7fbe2815e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 10 monclient: _finish_hunting 0 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 1 monclient: found mon.noname-c 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.998+0000 7fbe2e091640 1 -- 10.20.193.45:0/588682202 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe28159880 con 0x7fbe28072ce0 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.999+0000 7fbe2e091640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe28072ce0 0x7fbe2814a1b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c4d0 tx=0x7fbe1800c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.999+0000 7fbe0effd640 10 client.?.objecter ms_handle_connect 0x7fbe28072ce0 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:14.999+0000 7fbe0effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 1 -- 10.20.193.45:0/588682202 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180052d0 con 0x7fbe28072ce0 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 10 monclient: dump: 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 10 monclient: _finish_auth 0 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 1 -- 10.20.193.45:0/588682202 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe18005470 con 0x7fbe28072ce0 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 1 -- 10.20.193.45:0/588682202 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18003930 con 0x7fbe28072ce0 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe0effd640 10 monclient: dump: 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:14.998 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2c88e640 4 set_mon_vals no callback set 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2f093640 5 monclient: authenticate success, global_id 4586 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2f093640 10 monclient: _renew_subs 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2f093640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe28159b60 con 0x7fbe28072ce0 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2f093640 10 client.4586.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2f093640 10 monclient: _renew_subs 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2f093640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2815a120 con 0x7fbe28072ce0 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.000+0000 7fbe2f093640 1 librados: init done 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.001+0000 7fbe2f093640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.001+0000 7fbe2f093640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.001+0000 7fbe2f093640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.001+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2815a730 con 0x7fbe28072ce0 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.005+0000 7f49a3ae3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.005+0000 7f49a3ae3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:07:14.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.005+0000 7f49a3ae3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.005+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f499c0cc6b0 con 0x7f499c0c9cf0 2026-02-17T21:07:15.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.013+0000 7fbe0effd640 1 -- 10.20.193.45:0/588682202 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fbe18003ad0 con 0x7fbe28072ce0 2026-02-17T21:07:15.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.013+0000 7fbe0effd640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbdf80792b0 0x7fbdf807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.013+0000 7fbe2d890640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbdf80792b0 0x7fbdf807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.013+0000 7fbe2d890640 10 monclient: get_auth_request con 0x7fbdf80792b0 auth_method 0 2026-02-17T21:07:15.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.013+0000 7fbe0effd640 10 client.4586.objecter ms_handle_connect 0x7fbdf80792b0 2026-02-17T21:07:15.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.013+0000 7fbe2d890640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbdf80792b0 0x7fbdf807b770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0098a0 tx=0x7fbe1c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.015+0000 7fbe0effd640 1 -- 10.20.193.45:0/588682202 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fbe1805e440 con 0x7fbe28072ce0 2026-02-17T21:07:15.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.015+0000 7fbe0effd640 10 client.4586.objecter ms_dispatch2 0x7fbe28000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:15.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.015+0000 7fbe0effd640 3 client.4586.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:15.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.015+0000 7fbe0effd640 3 client.4586.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:15.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.015+0000 7fbe0effd640 20 client.4586.objecter dump_active .. 0 homeless 2026-02-17T21:07:15.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.038+0000 7f9ab7096640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:15.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.038+0000 7f9ab7096640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:15.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.038+0000 7f9ab7096640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.038+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f9ab00c8ba0 con 0x7f9ab00c90e0 2026-02-17T21:07:15.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.062+0000 7fcbc1f87640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:07:15.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.062+0000 7fcbc1f87640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:07:15.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.062+0000 7fcbc1f87640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.062+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcbbc0cb7d0 con 0x7fcbbc156220 2026-02-17T21:07:15.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.065+0000 7fcb97fff640 1 -- 10.20.193.45:0/1642553144 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcbb0061e00 con 0x7fcbbc156220 2026-02-17T21:07:15.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.065+0000 7fcb97fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:07:15.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.065+0000 7fcb97fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.057 INFO:teuthology.orchestra.run.trial045.stdout:111669149702 2026-02-17T21:07:15.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 10 librados: watch_flush enter 2026-02-17T21:07:15.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 10 librados: watch_flush exit 2026-02-17T21:07:15.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 20 client.4491.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 10 client.4491.objecter successfully canceled tick 2026-02-17T21:07:15.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcb8c079280 msgr2=0x7fcb8c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcb8c079280 0x7fcb8c07b740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcba80098a0 tx=0x7fcba8006d90 comp rx=0 tx=0).stop 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 10 monclient: shutdown 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 msgr2=0x7fcbbc1585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 0x7fcbbc1585e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000b9c0 tx=0x7fcbb000be90 comp rx=0 tx=0).stop 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 shutdown_connections 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcb8c079280 0x7fcb8c07b740 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcbbc156220 0x7fcbbc1585e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcbbc155e40 0x7fcbbc147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 --2- 10.20.193.45:0/1642553144 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcbbc0ccb80 0x7fcbbc156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 >> 10.20.193.45:0/1642553144 conn(0x7fcbbc0ce270 msgr2=0x7fcbbc0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 shutdown_connections 2026-02-17T21:07:15.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 -- 10.20.193.45:0/1642553144 wait complete. 2026-02-17T21:07:15.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.066+0000 7fcbc1f87640 1 librados: shutdown 2026-02-17T21:07:15.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149703 got 111669149702 for osd.0 2026-02-17T21:07:15.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.089+0000 7f9cdf7fe640 1 -- 10.20.193.45:0/668538713 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9cf4062460 con 0x7f9cec004900 2026-02-17T21:07:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.089+0000 7f9cdf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.089+0000 7f9cdf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.092+0000 7f498a7fc640 1 -- 10.20.193.45:0/2000596819 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4990004640 con 0x7f499c0c9cf0 2026-02-17T21:07:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.092+0000 7f498a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:07:15.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.092+0000 7f498a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.084 INFO:teuthology.orchestra.run.trial045.stdout:111669149703 2026-02-17T21:07:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 10 librados: watch_flush enter 2026-02-17T21:07:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 10 librados: watch_flush exit 2026-02-17T21:07:15.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 20 client.4543.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 10 client.4543.objecter successfully canceled tick 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f496c079300 msgr2=0x7f496c07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f496c079300 0x7f496c07b7c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f499c0c5260 tx=0x7f498c031000 comp rx=0 tx=0).stop 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 10 monclient: shutdown 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c0c9cf0 msgr2=0x7f499c1f5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c0c9cf0 0x7f499c1f5260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f499000b500 tx=0x7f499000b9d0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 shutdown_connections 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f496c079300 0x7f496c07b7c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f499c155fe0 0x7f499c1f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f499c0c9cf0 0x7f499c1f5260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 --2- 10.20.193.45:0/2000596819 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f499c0c98b0 0x7f499c15a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 >> 10.20.193.45:0/2000596819 conn(0x7f499c06d930 msgr2=0x7f499c150500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 shutdown_connections 2026-02-17T21:07:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 -- 10.20.193.45:0/2000596819 wait complete. 2026-02-17T21:07:15.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.094+0000 7f49a3ae3640 1 librados: shutdown 2026-02-17T21:07:15.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149704 got 111669149703 for osd.9 2026-02-17T21:07:15.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.116+0000 7fbe0effd640 1 -- 10.20.193.45:0/588682202 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbe18062b00 con 0x7fbe28072ce0 2026-02-17T21:07:15.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.116+0000 7fbe0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.116+0000 7fbe0effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.114 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.122+0000 7f9aa57fa640 1 -- 10.20.193.45:0/1666693592 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7f9a98062870 con 0x7f9ab00c90e0 2026-02-17T21:07:15.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.122+0000 7f9aa57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:15.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.122+0000 7f9aa57fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.115 INFO:teuthology.orchestra.run.trial045.stdout:94489280515 2026-02-17T21:07:15.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 10 librados: watch_flush enter 2026-02-17T21:07:15.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 10 librados: watch_flush exit 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 20 client.4568.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 10 client.4568.objecter successfully canceled tick 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a800792d0 msgr2=0x7f9a8007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a800792d0 0x7f9a8007b790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ab00c6af0 tx=0x7f9aa0031000 comp rx=0 tx=0).stop 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 10 monclient: shutdown 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab00c90e0 msgr2=0x7f9ab0145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab00c90e0 0x7f9ab0145690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800b500 tx=0x7f9a9800b9d0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 shutdown_connections 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a800792d0 0x7f9a8007b790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9ab015d1e0 0x7f9ab01f4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ab00c90e0 0x7f9ab0145690 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.124+0000 7f9ab7096640 1 --2- 10.20.193.45:0/1666693592 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9ab00748e0 0x7f9ab0074130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.125+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 >> 10.20.193.45:0/1666693592 conn(0x7f9ab00c9d40 msgr2=0x7f9ab006f450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.125+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 shutdown_connections 2026-02-17T21:07:15.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.125+0000 7f9ab7096640 1 -- 10.20.193.45:0/1666693592 wait complete. 2026-02-17T21:07:15.119 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.125+0000 7f9ab7096640 1 librados: shutdown 2026-02-17T21:07:15.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.13 2026-02-17T21:07:15.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.174+0000 7f9d0537e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:07:15.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.174+0000 7f9d0537e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:07:15.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.174+0000 7f9d0537e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.174+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f9d00159770 con 0x7f9cec004900 2026-02-17T21:07:15.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.176+0000 7f9cdf7fe640 1 -- 10.20.193.45:0/668538713 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f9cf4061d60 con 0x7f9cec004900 2026-02-17T21:07:15.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.176+0000 7f9cdf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:07:15.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.176+0000 7f9cdf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.169 INFO:teuthology.orchestra.run.trial045.stdout:115964117000 2026-02-17T21:07:15.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 10 librados: watch_flush enter 2026-02-17T21:07:15.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 10 librados: watch_flush exit 2026-02-17T21:07:15.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 20 client.4546.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 10 client.4546.objecter successfully canceled tick 2026-02-17T21:07:15.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9ccc0792b0 msgr2=0x7f9ccc07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9ccc0792b0 0x7f9ccc07b770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8036000 tx=0x7f9ce8009070 comp rx=0 tx=0).stop 2026-02-17T21:07:15.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 10 monclient: shutdown 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 msgr2=0x7f9d001e9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9d001e9ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400b9a0 tx=0x7f9cf400be70 comp rx=0 tx=0).stop 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 shutdown_connections 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9ccc0792b0 0x7f9ccc07b770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d000ca630 0x7f9d001e7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9d000ca1b0 0x7f9d001e72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 --2- 10.20.193.45:0/668538713 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9cec004900 0x7f9d001e9ba0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 >> 10.20.193.45:0/668538713 conn(0x7f9d000ce270 msgr2=0x7f9d000d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 shutdown_connections 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 -- 10.20.193.45:0/668538713 wait complete. 2026-02-17T21:07:15.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.178+0000 7f9d0537e640 1 librados: shutdown 2026-02-17T21:07:15.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117000 for osd.11 2026-02-17T21:07:15.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.200+0000 7fbe2f093640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:07:15.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.200+0000 7fbe2f093640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:07:15.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.200+0000 7fbe2f093640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.200+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbe280730c0 con 0x7fbe28072ce0 2026-02-17T21:07:15.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.203+0000 7fbe0effd640 1 -- 10.20.193.45:0/588682202 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbe18062400 con 0x7fbe28072ce0 2026-02-17T21:07:15.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.203+0000 7fbe0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:07:15.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.203+0000 7fbe0effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.195 INFO:teuthology.orchestra.run.trial045.stdout:111669149701 2026-02-17T21:07:15.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 10 librados: watch_flush enter 2026-02-17T21:07:15.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 10 librados: watch_flush exit 2026-02-17T21:07:15.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 20 client.4586.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 10 client.4586.objecter successfully canceled tick 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbdf80792b0 msgr2=0x7fbdf807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbdf80792b0 0x7fbdf807b770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0098a0 tx=0x7fbe1c033000 comp rx=0 tx=0).stop 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 10 monclient: shutdown 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe28072ce0 msgr2=0x7fbe2814a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe28072ce0 0x7fbe2814a1b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c4d0 tx=0x7fbe1800c9a0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 shutdown_connections 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbdf80792b0 0x7fbdf807b770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbe2815c7c0 0x7fbe2815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbe280c82a0 0x7fbe2815e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 --2- 10.20.193.45:0/588682202 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbe28072ce0 0x7fbe2814a1b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 >> 10.20.193.45:0/588682202 conn(0x7fbe280ca3a0 msgr2=0x7fbe2806eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 shutdown_connections 2026-02-17T21:07:15.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 -- 10.20.193.45:0/588682202 wait complete. 2026-02-17T21:07:15.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.204+0000 7fbe2f093640 1 librados: shutdown 2026-02-17T21:07:15.204 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-17T21:07:15.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149701 for osd.5 2026-02-17T21:07:15.206 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-17T21:07:15.263 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-17T21:07:15.265 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-17T21:07:15.310 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-17T21:07:15.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.322+0000 7f92b81ce640 10 monclient: get_monmap_and_config 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.322+0000 7f92b81ce640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.322+0000 7f92b81ce640 10 monclient: monmap: 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:15.323488+0000 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:15.323488+0000 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:15.315 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:15.316 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:15.316 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:15.316 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:15.316 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:15.316 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 1 Processor -- start 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 1 -- start start 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 10 monclient: init 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 10 monclient: _add_conns ranks=[0,1,4,5,2,3] 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f92b0155e40 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f92b0074c90 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f92b0156220 0x7f92b01666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 10 monclient(hunting): picked mon.noname-b con 0x7f92b0156220 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:15.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b00734e0 con 0x7f92b0155e40 2026-02-17T21:07:15.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92b00737c0 con 0x7f92b0074c90 2026-02-17T21:07:15.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f92b00cd800 con 0x7f92b0156220 2026-02-17T21:07:15.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.323+0000 7f92b81ce640 10 monclient(hunting): authenticate will time out at 1018.953922s 2026-02-17T21:07:15.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f92b5f43640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f92b0155e40 0x7f92b0074580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46278/0 (socket says 10.20.193.45:46278) 2026-02-17T21:07:15.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f92b5f43640 1 -- 10.20.193.45:0/3140855601 learned_addr learned my addr 10.20.193.45:0/3140855601 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:15.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f3a953b3640 10 monclient: get_monmap_and_config 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f3a953b3640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f3a953b3640 10 monclient: monmap: 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:15.325066+0000 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:15.325066+0000 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:15.320 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:15.321 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:15.321 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:15.321 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f92b6744640 1 --2- 10.20.193.45:0/3140855601 >> v2:10.20.193.86:3300/0 conn(0x7f92b0156220 0x7f92b01666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f3a953b3640 1 Processor -- start 2026-02-17T21:07:15.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f92b6744640 10 monclient(hunting): get_auth_request con 0x7f92b0156220 auth_method 0 2026-02-17T21:07:15.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f92b6744640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f92b6744640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f92b6744640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f3a953b3640 1 -- start start 2026-02-17T21:07:15.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.324+0000 7f3a953b3640 10 monclient: init 2026-02-17T21:07:15.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f92b6744640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f92b6744640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f92b6744640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 10 monclient: _add_conns ranks=[2,5,4,0,3,1] 2026-02-17T21:07:15.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3a90155f90 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:15.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3a900cef10 0x7f3a9015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 10 monclient(hunting): picked mon.noname-c con 0x7f3a900cef10 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:15.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3a90073b50 0x7f3a9015f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 10 monclient(hunting): picked mon.noname-b con 0x7f3a90073b50 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:15.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a900cd200 con 0x7f3a90155f90 2026-02-17T21:07:15.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3a90160220 con 0x7f3a90073b50 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3a900cbb40 con 0x7f3a900cef10 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a953b3640 10 monclient(hunting): authenticate will time out at 1018.955461s 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a8effd640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f3a90155f90 0x7f3a900ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47716/0 (socket says 10.20.193.45:47716) 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.325+0000 7f3a8effd640 1 -- 10.20.193.45:0/4026739933 learned_addr learned my addr 10.20.193.45:0/4026739933 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f3a8e7fc640 1 --2- 10.20.193.45:0/4026739933 >> v2:10.20.193.92:3300/0 conn(0x7f3a900cef10 0x7f3a9015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f3a8e7fc640 10 monclient(hunting): get_auth_request con 0x7f3a900cef10 auth_method 0 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f3a8e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f3a8e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f3a8e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b4f41640 1 -- 10.20.193.45:0/3140855601 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908185567 0 0) 0x7f92b00734e0 con 0x7f92b0155e40 2026-02-17T21:07:15.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b4f41640 10 monclient(hunting): _negotiate 2026-02-17T21:07:15.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b4f41640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b4f41640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b4f41640 10 monclient(hunting): my global_id is 4500 2026-02-17T21:07:15.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b4f41640 1 -- 10.20.193.45:0/3140855601 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9298003620 con 0x7f92b0155e40 2026-02-17T21:07:15.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f3a8e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f3a8e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f3a8e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b6744640 10 monclient(hunting): handle_auth_done global_id 4549 payload 274 2026-02-17T21:07:15.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b6744640 1 -- 10.20.193.45:0/3140855601 >> v1:10.20.193.86:6789/0 conn(0x7f92b0074c90 legacy=0x7f92b00ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b6744640 1 -- 10.20.193.45:0/3140855601 >> v1:10.20.193.45:6789/0 conn(0x7f92b0155e40 legacy=0x7f92b0074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b6744640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b6744640 1 monclient: found mon.noname-b 2026-02-17T21:07:15.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b6744640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b6744640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.326+0000 7f92b6744640 1 -- 10.20.193.45:0/3140855601 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b0073aa0 con 0x7f92b0156220 2026-02-17T21:07:15.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8f7fe640 1 --2- 10.20.193.45:0/4026739933 >> v2:10.20.193.86:3300/0 conn(0x7f3a90073b50 0x7f3a9015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8f7fe640 10 monclient(hunting): get_auth_request con 0x7f3a90073b50 auth_method 0 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8e7fc640 10 monclient(hunting): handle_auth_done global_id 4589 payload 274 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8e7fc640 1 -- 10.20.193.45:0/4026739933 >> v2:10.20.193.86:3300/0 conn(0x7f3a90073b50 msgr2=0x7f3a9015f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8e7fc640 1 --2- 10.20.193.45:0/4026739933 >> v2:10.20.193.86:3300/0 conn(0x7f3a90073b50 0x7f3a9015f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8e7fc640 1 -- 10.20.193.45:0/4026739933 >> v1:10.20.193.92:6789/0 conn(0x7f3a90155f90 legacy=0x7f3a900ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8e7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8e7fc640 1 monclient: found mon.noname-c 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.327+0000 7f3a8e7fc640 1 -- 10.20.193.45:0/4026739933 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900ccc40 con 0x7f3a900cef10 2026-02-17T21:07:15.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.328+0000 7f92b6744640 1 --2- 10.20.193.45:0/3140855601 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f92b0156220 0x7f92b01666d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009d90 tx=0x7f92ac02f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e3bdb70fe98f463 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.329+0000 7f3a8e7fc640 1 --2- 10.20.193.45:0/4026739933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a900cef10 0x7f3a9015f2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3a900c8a50 tx=0x7f3a7802ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a00f41f5932c62d6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 1 -- 10.20.193.45:0/4026739933 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7803c070 con 0x7f3a900cef10 2026-02-17T21:07:15.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:15.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 10 monclient: dump: 2026-02-17T21:07:15.333 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.333 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.333 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 1 -- 10.20.193.45:0/4026739933 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a7802fa60 con 0x7f3a900cef10 2026-02-17T21:07:15.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 1 -- 10.20.193.45:0/4026739933 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7802fe30 con 0x7f3a900cef10 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a8dffb640 10 monclient: dump: 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.335 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.336 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.336 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 5 monclient: authenticate success, global_id 4589 2026-02-17T21:07:15.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:15.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 4 set_mon_vals no callback set 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 1 -- 10.20.193.45:0/3140855601 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac03c070 con 0x7f92b0156220 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 10 monclient: dump: 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.337 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 1 -- 10.20.193.45:0/3140855601 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac037440 con 0x7f92b0156220 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 1 -- 10.20.193.45:0/3140855601 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac037810 con 0x7f92b0156220 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 5 monclient: authenticate success, global_id 4549 2026-02-17T21:07:15.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 4 set_mon_vals no callback set 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b4f41640 10 monclient: dump: 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.339 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.340 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 10 monclient: shutdown 2026-02-17T21:07:15.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 1 -- 10.20.193.45:0/4026739933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a900cef10 msgr2=0x7f3a9015f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 1 --2- 10.20.193.45:0/4026739933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a900cef10 0x7f3a9015f2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3a900c8a50 tx=0x7f3a7802ed50 comp rx=0 tx=0).stop 2026-02-17T21:07:15.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 1 -- 10.20.193.45:0/4026739933 shutdown_connections 2026-02-17T21:07:15.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 1 --2- 10.20.193.45:0/4026739933 >> v2:10.20.193.86:3300/0 conn(0x7f3a90073b50 0x7f3a9015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 1 --2- 10.20.193.45:0/4026739933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a900cef10 0x7f3a9015f2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 1 -- 10.20.193.45:0/4026739933 >> 10.20.193.45:0/4026739933 conn(0x7f3a90073030 msgr2=0x7f3a90073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 1 -- 10.20.193.45:0/4026739933 shutdown_connections 2026-02-17T21:07:15.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 10 monclient: shutdown 2026-02-17T21:07:15.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 1 -- 10.20.193.45:0/3140855601 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f92b0156220 msgr2=0x7f92b01666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 1 --2- 10.20.193.45:0/3140855601 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f92b0156220 0x7f92b01666d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009d90 tx=0x7f92ac02f230 comp rx=0 tx=0).stop 2026-02-17T21:07:15.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f3a953b3640 1 -- 10.20.193.45:0/4026739933 wait complete. 2026-02-17T21:07:15.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 1 -- 10.20.193.45:0/3140855601 shutdown_connections 2026-02-17T21:07:15.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 1 --2- 10.20.193.45:0/3140855601 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f92b0156220 0x7f92b01666d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 1 -- 10.20.193.45:0/3140855601 >> 10.20.193.45:0/3140855601 conn(0x7f92b00ce270 msgr2=0x7f92b00ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 1 -- 10.20.193.45:0/3140855601 shutdown_connections 2026-02-17T21:07:15.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.331+0000 7f92b81ce640 1 -- 10.20.193.45:0/3140855601 wait complete. 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f3a953b3640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f3a953b3640 10 monclient: monmap: 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:15.344 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:15.345 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f92b81ce640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f92b81ce640 10 monclient: monmap: 2026-02-17T21:07:15.345 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.345 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:15.345 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:15.345 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:15.345 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.345 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.346 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:15.346 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:15.346 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:15.346 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f3a953b3640 1 librados: starting msgr at 2026-02-17T21:07:15.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f3a953b3640 1 librados: starting objecter 2026-02-17T21:07:15.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f92b81ce640 1 librados: starting msgr at 2026-02-17T21:07:15.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f92b81ce640 1 librados: starting objecter 2026-02-17T21:07:15.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f3a953b3640 1 Processor -- start 2026-02-17T21:07:15.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f92b81ce640 1 Processor -- start 2026-02-17T21:07:15.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f3a953b3640 1 -- start start 2026-02-17T21:07:15.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f3a953b3640 1 librados: setting wanted keys 2026-02-17T21:07:15.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f3a953b3640 1 librados: calling monclient init 2026-02-17T21:07:15.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f3a953b3640 10 monclient: init 2026-02-17T21:07:15.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f92b81ce640 1 -- start start 2026-02-17T21:07:15.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f92b81ce640 1 librados: setting wanted keys 2026-02-17T21:07:15.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f92b81ce640 1 librados: calling monclient init 2026-02-17T21:07:15.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.332+0000 7f92b81ce640 10 monclient: init 2026-02-17T21:07:15.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:15.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:15.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3a90073b50 0x7f3a901f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient(hunting): picked mon.noname-b con 0x7f3a90073b50 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:15.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f92b0074c90 0x7f92b00c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient(hunting): picked mon.noname-a con 0x7f92b0074c90 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:15.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f92b0155e40 0x7f92b00d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3a900cef10 0x7f3a9014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient(hunting): picked mon.noname-a con 0x7f3a900cef10 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:15.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient(hunting): picked mon.noname-b con 0x7f92b0155e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:15.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f92b0156220 0x7f92b00c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient(hunting): picked mon.noname-c con 0x7f92b0156220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:15.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f92b00c4830 con 0x7f92b0074c90 2026-02-17T21:07:15.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a90155f90 0x7f3a901f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f92b0074060 con 0x7f92b0155e40 2026-02-17T21:07:15.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f92b00c49b0 con 0x7f92b0156220 2026-02-17T21:07:15.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b81ce640 10 monclient(hunting): authenticate will time out at 1018.963092s 2026-02-17T21:07:15.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient(hunting): picked mon.noname-c con 0x7f3a90155f90 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:15.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3a900ce2e0 con 0x7f3a900cef10 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3a900ce000 con 0x7f3a90073b50 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9015fd70 con 0x7f3a90155f90 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a953b3640 10 monclient(hunting): authenticate will time out at 1018.963099s 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a8effd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3a90073b50 0x7f3a901f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f92b0156220 0x7f92b00c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b5742640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f92b0155e40 0x7f92b00d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f92b0156220 0x7f92b00c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36546/0 (socket says 10.20.193.45:36546) 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 1 -- 10.20.193.45:0/2254903324 learned_addr learned my addr 10.20.193.45:0/2254903324 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 10 monclient(hunting): get_auth_request con 0x7f92b0156220 auth_method 0 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a8effd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3a90073b50 0x7f3a901f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57830/0 (socket says 10.20.193.45:57830) 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a8effd640 1 -- 10.20.193.45:0/3108805188 learned_addr learned my addr 10.20.193.45:0/3108805188 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a8effd640 10 monclient(hunting): get_auth_request con 0x7f3a90073b50 auth_method 0 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a8effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a8effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b5742640 10 monclient(hunting): get_auth_request con 0x7f92b0155e40 auth_method 0 2026-02-17T21:07:15.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b5742640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b5742640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b5742640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f92b6744640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.333+0000 7f3a8f7fe640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a90155f90 0x7f3a901f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f92b5742640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f92b5742640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f92b5742640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.356 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-17T21:07:15.357 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-17T21:07:15.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f3a8f7fe640 10 monclient(hunting): get_auth_request con 0x7f3a90155f90 auth_method 0 2026-02-17T21:07:15.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f3a8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f3a8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f3a8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f3a8effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f3a8effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.334+0000 7f3a8effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 10 monclient(hunting): handle_auth_done global_id 4592 payload 824 2026-02-17T21:07:15.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 1 -- 10.20.193.45:0/2254903324 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f92b0155e40 msgr2=0x7f92b00d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f92b0155e40 0x7f92b00d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 1 -- 10.20.193.45:0/2254903324 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f92b0074c90 msgr2=0x7f92b00c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f92b0074c90 0x7f92b00c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 1 monclient: found mon.noname-c 2026-02-17T21:07:15.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.335+0000 7f92b6744640 1 -- 10.20.193.45:0/2254903324 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b00c6980 con 0x7f92b0156220 2026-02-17T21:07:15.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.336+0000 7f3a8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.336+0000 7f3a8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.336+0000 7f3a8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 10 monclient(hunting): handle_auth_done global_id 4558 payload 824 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 1 -- 10.20.193.45:0/3108805188 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a90155f90 msgr2=0x7f3a901f7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a90155f90 0x7f3a901f7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 1 -- 10.20.193.45:0/3108805188 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3a900cef10 msgr2=0x7f3a9014d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3a900cef10 0x7f3a9014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 1 monclient: found mon.noname-b 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.337+0000 7f3a8effd640 1 -- 10.20.193.45:0/3108805188 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a901f8570 con 0x7f3a90073b50 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.338+0000 7f92b6744640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f92b0156220 0x7f92b00c7720 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f92ac03a040 tx=0x7f92ac004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.338+0000 7f929e7fc640 10 client.?.objecter ms_handle_connect 0x7f92b0156220 2026-02-17T21:07:15.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.338+0000 7f929e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:15.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.339+0000 7f3a8effd640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3a90073b50 0x7f3a901f5a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400c700 tx=0x7f3a8400cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.339+0000 7f3a6f7fe640 10 client.?.objecter ms_handle_connect 0x7f3a90073b50 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.339+0000 7f3a6f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 1 -- 10.20.193.45:0/3108805188 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84017070 con 0x7f3a90073b50 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 10 monclient: dump: 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 5 monclient: authenticate success, global_id 4558 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 10 monclient: _renew_subs 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a901f8850 con 0x7f3a90073b50 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 10 client.4558.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 10 monclient: _renew_subs 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a901f4b60 con 0x7f3a90073b50 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 1 librados: init done 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 1 -- 10.20.193.45:0/3108805188 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a84005bb0 con 0x7f3a90073b50 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 1 -- 10.20.193.45:0/3108805188 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84021060 con 0x7f3a90073b50 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a8d7fa640 4 set_mon_vals no callback set 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a6f7fe640 10 monclient: dump: 2026-02-17T21:07:15.363 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.364 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.364 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.364 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.364 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.364 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.364 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.364 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.364 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.364 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 1 -- 10.20.193.45:0/2254903324 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac03c050 con 0x7f92b0156220 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 10 monclient: dump: 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 1 -- 10.20.193.45:0/2254903324 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92ac048070 con 0x7f92b0156220 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f92b81ce640 5 monclient: authenticate success, global_id 4592 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f92b81ce640 10 monclient: _renew_subs 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f92b81ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b00cadb0 con 0x7f92b0156220 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 1 -- 10.20.193.45:0/2254903324 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ac041a30 con 0x7f92b0156220 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929ffff640 4 set_mon_vals no callback set 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f929e7fc640 10 monclient: dump: 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.366 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f92b81ce640 10 client.4592.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f92b81ce640 10 monclient: _renew_subs 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f92b81ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b00c6c40 con 0x7f92b0156220 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f92b81ce640 1 librados: init done 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.340+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a900cd980 con 0x7f3a90073b50 2026-02-17T21:07:15.368 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-17T21:07:15.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.341+0000 7f92b81ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.341+0000 7f92b81ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.341+0000 7f92b81ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.341+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b0074580 con 0x7f92b0156220 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.351+0000 7f929e7fc640 1 -- 10.20.193.45:0/2254903324 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f92ac041bd0 con 0x7f92b0156220 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.352+0000 7f929e7fc640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92800792d0 0x7f928007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.352+0000 7f92b5f43640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92800792d0 0x7f928007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.352+0000 7f92b5f43640 10 monclient: get_auth_request con 0x7f92800792d0 auth_method 0 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.352+0000 7f92b5f43640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92800792d0 0x7f928007b790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f92a0002a30 tx=0x7f92a00079f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.352+0000 7f929e7fc640 10 client.4592.objecter ms_handle_connect 0x7f92800792d0 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.353+0000 7f929e7fc640 1 -- 10.20.193.45:0/2254903324 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f92ac084730 con 0x7f92b0156220 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.353+0000 7f929e7fc640 10 client.4592.objecter ms_dispatch2 0x7f92b0000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.353+0000 7f929e7fc640 3 client.4592.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.353+0000 7f929e7fc640 3 client.4592.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.353+0000 7f929e7fc640 20 client.4592.objecter dump_active .. 0 homeless 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.366+0000 7f135d46d640 10 monclient: get_monmap_and_config 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.366+0000 7f135d46d640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.366+0000 7f135d46d640 10 monclient: monmap: 2026-02-17T21:07:15.369 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:15.367751+0000 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:15.367751+0000 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.366+0000 7f504e9ff640 10 monclient: get_monmap_and_config 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.366+0000 7f504e9ff640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.366+0000 7f504e9ff640 10 monclient: monmap: 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.370 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:15.367813+0000 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:15.367813+0000 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 1 Processor -- start 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 1 -- start start 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient: init 2026-02-17T21:07:15.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f504e9ff640 1 Processor -- start 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f504e9ff640 1 -- start start 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f504e9ff640 10 monclient: init 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient: _add_conns ranks=[5,1,4,0,2,3] 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f1358152620 0x7f135815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient(hunting): picked mon.noname-c con 0x7f1358152620 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1358152a00 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f13580c94a0 0x7f135815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient(hunting): picked mon.noname-b con 0x7f13580c94a0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:15.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13580c71a0 con 0x7f1358152a00 2026-02-17T21:07:15.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f13580c7760 con 0x7f13580c94a0 2026-02-17T21:07:15.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f13580c7480 con 0x7f1358152620 2026-02-17T21:07:15.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.367+0000 7f135d46d640 10 monclient(hunting): authenticate will time out at 1018.997862s 2026-02-17T21:07:15.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 10 monclient: _add_conns ranks=[3,1,2,0,4,5] 2026-02-17T21:07:15.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5048155c50 0x7f5048074d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 10 monclient(hunting): picked mon.noname-a con 0x7f5048155c50 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5048156030 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f504815d220 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50480cc390 con 0x7f5048156030 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50480cc670 con 0x7f504815d220 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f50480cc950 con 0x7f5048155c50 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504e9ff640 10 monclient(hunting): authenticate will time out at 1018.998233s 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5048155c50 0x7f5048074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5048155c50 0x7f5048074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42206/0 (socket says 10.20.193.45:42206) 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 1 -- 10.20.193.45:0/2278849602 learned_addr learned my addr 10.20.193.45:0/2278849602 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 10 monclient(hunting): get_auth_request con 0x7f5048155c50 auth_method 0 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.368+0000 7f504d9fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.369+0000 7f504d9fd640 10 monclient(hunting): handle_auth_done global_id 4503 payload 274 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.369+0000 7f504d9fd640 1 -- 10.20.193.45:0/2278849602 >> v1:10.20.193.92:6789/0 conn(0x7f504815d220 legacy=0x7f504815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.369+0000 7f504d9fd640 1 -- 10.20.193.45:0/2278849602 >> v1:10.20.193.86:6789/0 conn(0x7f5048156030 legacy=0x7f504815c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.369+0000 7f504d9fd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.369+0000 7f504d9fd640 1 monclient: found mon.noname-a 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.369+0000 7f504d9fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.369+0000 7f504d9fd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.369+0000 7f504d9fd640 1 -- 10.20.193.45:0/2278849602 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50480ccc30 con 0x7f5048155c50 2026-02-17T21:07:15.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.370+0000 7f504d9fd640 1 --2- 10.20.193.45:0/2278849602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048155c50 0x7f5048074d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5038009970 tx=0x7f503802ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bb4e16b71b631a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 1 -- 10.20.193.45:0/2278849602 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503803c070 con 0x7f5048155c50 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 10 monclient: dump: 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 1 -- 10.20.193.45:0/2278849602 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503802fac0 con 0x7f5048155c50 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504e9ff640 5 monclient: authenticate success, global_id 4503 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504e9ff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 1 -- 10.20.193.45:0/2278849602 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038037440 con 0x7f5048155c50 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504c9fb640 10 monclient: dump: 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.377 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504e9ff640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.372+0000 7f504e9ff640 4 set_mon_vals no callback set 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 10 monclient: shutdown 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 -- 10.20.193.45:0/2278849602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048155c50 msgr2=0x7f5048074d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 --2- 10.20.193.45:0/2278849602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048155c50 0x7f5048074d50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5038009970 tx=0x7f503802ee90 comp rx=0 tx=0).stop 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 -- 10.20.193.45:0/2278849602 shutdown_connections 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 --2- 10.20.193.45:0/2278849602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048155c50 0x7f5048074d50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 -- 10.20.193.45:0/2278849602 >> 10.20.193.45:0/2278849602 conn(0x7f504806dcf0 msgr2=0x7f504806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 -- 10.20.193.45:0/2278849602 shutdown_connections 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 -- 10.20.193.45:0/2278849602 wait complete. 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 10 monclient: monmap: 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:15.378 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 librados: starting msgr at 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 librados: starting objecter 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 Processor -- start 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 -- start start 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 librados: setting wanted keys 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 1 librados: calling monclient init 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.373+0000 7f504e9ff640 10 monclient: init 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5048155c50 0x7f5048153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient(hunting): picked mon.noname-b con 0x7f5048155c50 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048156030 0x7f50481543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient(hunting): picked mon.noname-a con 0x7f5048156030 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f504815d220 0x7f50480c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient(hunting): picked mon.noname-c con 0x7f504815d220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f50480cc100 con 0x7f5048156030 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50480cbf80 con 0x7f5048155c50 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f50480cedd0 con 0x7f504815d220 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504e9ff640 10 monclient(hunting): authenticate will time out at 1019.004414s 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504d1fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048156030 0x7f50481543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504d1fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048156030 0x7f50481543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42220/0 (socket says 10.20.193.45:42220) 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504d1fc640 1 -- 10.20.193.45:0/2619073864 learned_addr learned my addr 10.20.193.45:0/2619073864 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504d1fc640 10 monclient(hunting): get_auth_request con 0x7f5048156030 auth_method 0 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504d1fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504d1fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.374+0000 7f504d1fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.375+0000 7f504d1fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.375+0000 7f504d1fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.375+0000 7f504d1fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 10 monclient(hunting): handle_auth_done global_id 4506 payload 824 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 1 -- 10.20.193.45:0/2619073864 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f504815d220 msgr2=0x7f50480c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f504815d220 0x7f50480c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 1 -- 10.20.193.45:0/2619073864 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5048155c50 msgr2=0x7f5048153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5048155c50 0x7f5048153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 1 monclient: found mon.noname-a 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.376+0000 7f504d1fc640 1 -- 10.20.193.45:0/2619073864 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5048154a90 con 0x7f5048156030 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.377+0000 7f504d1fc640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048156030 0x7f50481543c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f503c00b550 tx=0x7f503c00ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.377+0000 7f50367fc640 10 client.?.objecter ms_handle_connect 0x7f5048156030 2026-02-17T21:07:15.380 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.377+0000 7f50367fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:15.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.379+0000 7f50367fc640 1 -- 10.20.193.45:0/2619073864 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c004500 con 0x7f5048156030 2026-02-17T21:07:15.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 10 monclient: dump: 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 1 -- 10.20.193.45:0/2619073864 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503c015070 con 0x7f5048156030 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 5 monclient: authenticate success, global_id 4506 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 10 monclient: _renew_subs 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5048154d70 con 0x7f5048156030 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 1 -- 10.20.193.45:0/2619073864 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c002900 con 0x7f5048156030 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f50367fc640 10 monclient: dump: 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.382 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f5037fff640 4 set_mon_vals no callback set 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 10 client.4506.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 10 monclient: _renew_subs 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50480c8d80 con 0x7f5048156030 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 1 librados: init done 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.380+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5048074d50 con 0x7f5048156030 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.392+0000 7f57cae22640 10 monclient: get_monmap_and_config 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.392+0000 7f57cae22640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.392+0000 7f57cae22640 10 monclient: monmap: 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:15.392968+0000 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:15.392968+0000 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.392+0000 7f57cae22640 1 Processor -- start 2026-02-17T21:07:15.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.392+0000 7f57cae22640 1 -- start start 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.392+0000 7f57cae22640 10 monclient: init 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.392+0000 7f50367fc640 1 -- 10.20.193.45:0/2619073864 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f503c002aa0 con 0x7f5048156030 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 10 monclient: _add_conns ranks=[4,0,2,1,5,3] 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f57c415d1e0 0x7f57c415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 10 monclient(hunting): picked mon.noname-b con 0x7f57c415d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f57c40748e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f57c40c92b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c40c5860 con 0x7f57c40748e0 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57c40c5580 con 0x7f57c40c92b0 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f57c40c7de0 con 0x7f57c415d1e0 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f57cae22640 10 monclient(hunting): authenticate will time out at 1019.023210s 2026-02-17T21:07:15.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f50367fc640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5018079280 0x7f501807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f504d9fd640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5018079280 0x7f501807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f504d9fd640 10 monclient: get_auth_request con 0x7f5018079280 auth_method 0 2026-02-17T21:07:15.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f504d9fd640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5018079280 0x7f501807b740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f504808e570 tx=0x7f5038031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.393+0000 7f50367fc640 10 client.4506.objecter ms_handle_connect 0x7f5018079280 2026-02-17T21:07:15.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.444+0000 7f3d72540640 10 monclient: get_monmap_and_config 2026-02-17T21:07:15.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.444+0000 7f3d72540640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.444+0000 7f3d72540640 10 monclient: monmap: 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:15.445661+0000 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:15.445661+0000 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 1 Processor -- start 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 1 -- start start 2026-02-17T21:07:15.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient: init 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f068872c640 10 monclient: get_monmap_and_config 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f068872c640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f068872c640 10 monclient: monmap: 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:15.446295+0000 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:15.446295+0000 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:15.438 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:15.439 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient: _add_conns ranks=[2,5,3,4,0,1] 2026-02-17T21:07:15.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3d6c15d1e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:15.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3d6c0c92b0 0x7f3d6c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient(hunting): picked mon.noname-c con 0x7f3d6c0c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:15.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f3d6c0748e0 0x7f3d6c153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient(hunting): picked mon.noname-a con 0x7f3d6c0748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:15.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d6c0c5860 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f3d6c0c5580 con 0x7f3d6c0748e0 2026-02-17T21:07:15.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3d6c0c7de0 con 0x7f3d6c0c92b0 2026-02-17T21:07:15.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.445+0000 7f3d72540640 10 monclient(hunting): authenticate will time out at 1019.075838s 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 1 Processor -- start 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 1 -- start start 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient: init 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient: _add_conns ranks=[5,4,0,2,1,3] 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0680155fe0 0x7f06800cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient(hunting): picked mon.noname-c con 0x7f0680155fe0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f06800c98b0 0x7f06800c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient(hunting): picked mon.noname-b con 0x7f06800c98b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f06800d16d0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06800c8b60 con 0x7f06800d16d0 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f06800c9420 con 0x7f06800c98b0 2026-02-17T21:07:15.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f068015cbb0 con 0x7f0680155fe0 2026-02-17T21:07:15.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.446+0000 7f068872c640 10 monclient(hunting): authenticate will time out at 1019.076924s 2026-02-17T21:07:15.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.447+0000 7f3a6f7fe640 1 -- 10.20.193.45:0/3108805188 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f3a84024080 con 0x7f3a90073b50 2026-02-17T21:07:15.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.447+0000 7f3a6f7fe640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3a5c0792b0 0x7f3a5c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.447+0000 7f3a8e7fc640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3a5c0792b0 0x7f3a5c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.447+0000 7f3a8e7fc640 10 monclient: get_auth_request con 0x7f3a5c0792b0 auth_method 0 2026-02-17T21:07:15.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.448+0000 7f3a8e7fc640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3a5c0792b0 0x7f3a5c07b770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a78039000 tx=0x7f3a78031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.448+0000 7f3a6f7fe640 10 client.4558.objecter ms_handle_connect 0x7f3a5c0792b0 2026-02-17T21:07:15.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.448+0000 7f1356ffd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f1358152620 0x7f135815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7f3a6f7fe640 1 -- 10.20.193.45:0/3108805188 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f3a8405d970 con 0x7f3a90073b50 2026-02-17T21:07:15.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7f3a6f7fe640 10 client.4558.objecter ms_dispatch2 0x7f3a90000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:15.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7f3a6f7fe640 3 client.4558.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:15.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7f3a6f7fe640 3 client.4558.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:15.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7f3a6f7fe640 20 client.4558.objecter dump_active .. 0 homeless 2026-02-17T21:07:15.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7fb6a09af640 10 monclient: get_monmap_and_config 2026-02-17T21:07:15.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7fb6a09af640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7fb6a09af640 10 monclient: monmap: 2026-02-17T21:07:15.444 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.444 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:15.450305+0000 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:15.450305+0000 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7fb6a09af640 1 Processor -- start 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7fb6a09af640 1 -- start start 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.449+0000 7fb6a09af640 10 monclient: init 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 10 monclient: _add_conns ranks=[0,1,3,5,2,4] 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb698155e40 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fb698074c90 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:15.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fb698156220 0x7fb6981666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 10 monclient(hunting): picked mon.noname-a con 0x7fb698156220 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:15.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980734e0 con 0x7fb698155e40 2026-02-17T21:07:15.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980737c0 con 0x7fb698074c90 2026-02-17T21:07:15.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fb6980cd800 con 0x7fb698156220 2026-02-17T21:07:15.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.450+0000 7fb6a09af640 10 monclient(hunting): authenticate will time out at 1019.080488s 2026-02-17T21:07:15.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.455+0000 7f3a6f7fe640 1 -- 10.20.193.45:0/3108805188 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3a84061930 con 0x7f3a90073b50 2026-02-17T21:07:15.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.455+0000 7f3a6f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.455+0000 7f3a6f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.456+0000 7f1356ffd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f1358152620 0x7f135815a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36568/0 (socket says 10.20.193.45:36568) 2026-02-17T21:07:15.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.456+0000 7f1356ffd640 1 -- 10.20.193.45:0/1371547407 learned_addr learned my addr 10.20.193.45:0/1371547407 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.456+0000 7f1356ffd640 10 monclient(hunting): get_auth_request con 0x7f1358152620 auth_method 0 2026-02-17T21:07:15.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.456+0000 7f1356ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.456+0000 7f1356ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.456+0000 7f1356ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.457+0000 7f57c8b97640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f57c415d1e0 0x7f57c415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.458+0000 7f57c8b97640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f57c415d1e0 0x7f57c415d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57874/0 (socket says 10.20.193.45:57874) 2026-02-17T21:07:15.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.458+0000 7f57c8b97640 1 -- 10.20.193.45:0/1811981279 learned_addr learned my addr 10.20.193.45:0/1811981279 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.458+0000 7f57c8b97640 10 monclient(hunting): get_auth_request con 0x7f57c415d1e0 auth_method 0 2026-02-17T21:07:15.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.458+0000 7f57c8b97640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.458+0000 7f57c8b97640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.458+0000 7f57c8b97640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.487+0000 7f929e7fc640 1 -- 10.20.193.45:0/2254903324 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f92ac088df0 con 0x7f92b0156220 2026-02-17T21:07:15.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.487+0000 7f929e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.487+0000 7f929e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.487+0000 7f1356ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.487+0000 7f1356ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.487+0000 7f1356ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.488+0000 7f3d6b7fe640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3d6c0c92b0 0x7f3d6c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f3d6b7fe640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3d6c0c92b0 0x7f3d6c15d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36586/0 (socket says 10.20.193.45:36586) 2026-02-17T21:07:15.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f3d6b7fe640 1 -- 10.20.193.45:0/28683741 learned_addr learned my addr 10.20.193.45:0/28683741 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f3d6b7fe640 10 monclient(hunting): get_auth_request con 0x7f3d6c0c92b0 auth_method 0 2026-02-17T21:07:15.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f3d6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f3d6b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f3d6b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f1356ffd640 10 monclient(hunting): handle_auth_done global_id 4598 payload 274 2026-02-17T21:07:15.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f1356ffd640 1 -- 10.20.193.45:0/1371547407 >> v2:10.20.193.86:3300/0 conn(0x7f13580c94a0 msgr2=0x7f135815ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f1356ffd640 1 --2- 10.20.193.45:0/1371547407 >> v2:10.20.193.86:3300/0 conn(0x7f13580c94a0 0x7f135815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f1356ffd640 1 -- 10.20.193.45:0/1371547407 >> v1:10.20.193.86:6789/0 conn(0x7f1358152a00 legacy=0x7f13580c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f1356ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f1356ffd640 1 monclient: found mon.noname-c 2026-02-17T21:07:15.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f1356ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f1356ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f1356ffd640 1 -- 10.20.193.45:0/1371547407 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1358159e00 con 0x7f1358152620 2026-02-17T21:07:15.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f57c8b97640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f57c8b97640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.489+0000 7f57c8b97640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.490+0000 7f3d6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.490+0000 7f3d6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.490+0000 7f3d6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f57c8b97640 10 monclient(hunting): handle_auth_done global_id 4561 payload 274 2026-02-17T21:07:15.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f57c8b97640 1 -- 10.20.193.45:0/1811981279 >> v1:10.20.193.92:6789/0 conn(0x7f57c40c92b0 legacy=0x7f57c4153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f57c8b97640 1 -- 10.20.193.45:0/1811981279 >> v1:10.20.193.45:6789/0 conn(0x7f57c40748e0 legacy=0x7f57c40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f57c8b97640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f57c8b97640 1 monclient: found mon.noname-b 2026-02-17T21:07:15.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f57c8b97640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f57c8b97640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f57c8b97640 1 -- 10.20.193.45:0/1811981279 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c40c80c0 con 0x7f57c415d1e0 2026-02-17T21:07:15.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f3d6b7fe640 10 monclient(hunting): handle_auth_done global_id 4601 payload 274 2026-02-17T21:07:15.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f3d6b7fe640 1 -- 10.20.193.45:0/28683741 >> v2:10.20.193.45:3300/0 conn(0x7f3d6c0748e0 msgr2=0x7f3d6c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f3d6b7fe640 1 --2- 10.20.193.45:0/28683741 >> v2:10.20.193.45:3300/0 conn(0x7f3d6c0748e0 0x7f3d6c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f3d6b7fe640 1 -- 10.20.193.45:0/28683741 >> v1:10.20.193.92:6789/0 conn(0x7f3d6c15d1e0 legacy=0x7f3d6c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f3d6b7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f3d6b7fe640 1 monclient: found mon.noname-c 2026-02-17T21:07:15.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f3d6b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f3d6b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.491+0000 7f3d6b7fe640 1 -- 10.20.193.45:0/28683741 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c0c80c0 con 0x7f3d6c0c92b0 2026-02-17T21:07:15.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.492+0000 7f1356ffd640 1 --2- 10.20.193.45:0/1371547407 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 0x7f135815a8e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1358072110 tx=0x7f134c02eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e6627624faf8d47 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.493+0000 7f0685ca0640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f06800c98b0 0x7f06800c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.493+0000 7f57c8b97640 1 --2- 10.20.193.45:0/1811981279 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57c415d1e0 0x7f57c415d5c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f57b40099a0 tx=0x7f57b402ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e10875ce6190ba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.493+0000 7f0685ca0640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f06800c98b0 0x7f06800c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57878/0 (socket says 10.20.193.45:57878) 2026-02-17T21:07:15.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.493+0000 7f0685ca0640 1 -- 10.20.193.45:0/821435569 learned_addr learned my addr 10.20.193.45:0/821435569 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.493+0000 7f0685ca0640 10 monclient(hunting): get_auth_request con 0x7f06800c98b0 auth_method 0 2026-02-17T21:07:15.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.493+0000 7f0685ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.493+0000 7f0685ca0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.493+0000 7f0685ca0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.493+0000 7f3d6b7fe640 1 --2- 10.20.193.45:0/28683741 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d6c0c92b0 0x7f3d6c15d5c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009970 tx=0x7f3d5c02eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae238e3d88135617 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.494+0000 7f0685ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.494+0000 7f0685ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.494+0000 7f0685ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.495+0000 7f06864a1640 1 --2- 10.20.193.45:0/821435569 >> v2:10.20.193.92:3300/0 conn(0x7f0680155fe0 0x7f06800cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.495+0000 7fb69df23640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fb698074c90 0x7fb6980ccb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:52894/0 (socket says 10.20.193.45:52894) 2026-02-17T21:07:15.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.495+0000 7fb69df23640 1 -- 10.20.193.45:0/368100827 learned_addr learned my addr 10.20.193.45:0/368100827 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:15.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.496+0000 7f0685ca0640 10 monclient(hunting): handle_auth_done global_id 4564 payload 274 2026-02-17T21:07:15.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.496+0000 7f0685ca0640 1 -- 10.20.193.45:0/821435569 >> v2:10.20.193.92:3300/0 conn(0x7f0680155fe0 msgr2=0x7f06800cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.496+0000 7f0685ca0640 1 --2- 10.20.193.45:0/821435569 >> v2:10.20.193.92:3300/0 conn(0x7f0680155fe0 0x7f06800cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.496+0000 7f0685ca0640 1 -- 10.20.193.45:0/821435569 >> v1:10.20.193.45:6789/0 conn(0x7f06800d16d0 legacy=0x7f06800ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.496+0000 7f0685ca0640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.496+0000 7f0685ca0640 1 monclient: found mon.noname-b 2026-02-17T21:07:15.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.496+0000 7f0685ca0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.496+0000 7f0685ca0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.496+0000 7f0685ca0640 1 -- 10.20.193.45:0/821435569 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06800d2250 con 0x7f06800c98b0 2026-02-17T21:07:15.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.498+0000 7f0685ca0640 1 --2- 10.20.193.45:0/821435569 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f06800c98b0 0x7f06800c9cf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f068008eba0 tx=0x7f067402ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554dbc18efba8853 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 1 -- 10.20.193.45:0/1811981279 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b403c070 con 0x7f57c415d1e0 2026-02-17T21:07:15.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:15.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 10 monclient: dump: 2026-02-17T21:07:15.493 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.493 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.493 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.493 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 1 -- 10.20.193.45:0/1811981279 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57b402fb80 con 0x7f57c415d1e0 2026-02-17T21:07:15.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 1 -- 10.20.193.45:0/1811981279 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b4037440 con 0x7f57c415d1e0 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 5 monclient: authenticate success, global_id 4561 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 4 set_mon_vals no callback set 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57bb7fe640 10 monclient: dump: 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.495 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.496 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.496 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.496 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.496 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.496 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f50367fc640 1 -- 10.20.193.45:0/2619073864 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f503c098150 con 0x7f5048156030 2026-02-17T21:07:15.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f50367fc640 10 client.4506.objecter ms_dispatch2 0x7f5048000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:15.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645056234 0 0) 0x7fb6980737c0 con 0x7fb698074c90 2026-02-17T21:07:15.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7fb69d722640 10 monclient(hunting): _negotiate 2026-02-17T21:07:15.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7fb69d722640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7fb69d722640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7fb69d722640 10 monclient(hunting): my global_id is 4567 2026-02-17T21:07:15.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f50367fc640 3 client.4506.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:15.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f50367fc640 3 client.4506.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:15.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb688003620 con 0x7fb698074c90 2026-02-17T21:07:15.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f50367fc640 20 client.4506.objecter dump_active .. 0 homeless 2026-02-17T21:07:15.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f50367fc640 1 -- 10.20.193.45:0/2619073864 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f503c062d30 con 0x7f5048156030 2026-02-17T21:07:15.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f50367fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f50367fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 1 -- 10.20.193.45:0/1371547407 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c03c070 con 0x7f1358152620 2026-02-17T21:07:15.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 10 monclient: dump: 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.500 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 10 monclient: shutdown 2026-02-17T21:07:15.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 1 -- 10.20.193.45:0/1811981279 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57c415d1e0 msgr2=0x7f57c415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 1 --2- 10.20.193.45:0/1811981279 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57c415d1e0 0x7f57c415d5c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f57b40099a0 tx=0x7f57b402ef50 comp rx=0 tx=0).stop 2026-02-17T21:07:15.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 1 -- 10.20.193.45:0/1371547407 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f134c02fb20 con 0x7f1358152620 2026-02-17T21:07:15.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 1 -- 10.20.193.45:0/1371547407 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c037440 con 0x7f1358152620 2026-02-17T21:07:15.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f135d46d640 5 monclient: authenticate success, global_id 4598 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f135d46d640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f135d46d640 4 set_mon_vals no callback set 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f1355ffb640 10 monclient: dump: 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.503 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.504 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.504 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 1 -- 10.20.193.45:0/1811981279 shutdown_connections 2026-02-17T21:07:15.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 1 --2- 10.20.193.45:0/1811981279 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57c415d1e0 0x7f57c415d5c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 1 -- 10.20.193.45:0/1811981279 >> 10.20.193.45:0/1811981279 conn(0x7f57c40c9d40 msgr2=0x7f57c40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 1 -- 10.20.193.45:0/1811981279 shutdown_connections 2026-02-17T21:07:15.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.499+0000 7f57cae22640 1 -- 10.20.193.45:0/1811981279 wait complete. 2026-02-17T21:07:15.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 1 -- 10.20.193.45:0/28683741 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c03c070 con 0x7f3d6c0c92b0 2026-02-17T21:07:15.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:15.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 10 monclient: dump: 2026-02-17T21:07:15.505 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.505 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 1 -- 10.20.193.45:0/28683741 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c02fb20 con 0x7f3d6c0c92b0 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 5 monclient: authenticate success, global_id 4601 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:15.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 1 -- 10.20.193.45:0/28683741 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c037440 con 0x7f3d6c0c92b0 2026-02-17T21:07:15.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:15.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 4 set_mon_vals no callback set 2026-02-17T21:07:15.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:15.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d6affd640 10 monclient: dump: 2026-02-17T21:07:15.507 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient: monmap: 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.508 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:15.509 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:15.509 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:15.509 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.509 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.509 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:15.509 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:15.509 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:15.509 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 10 monclient: shutdown 2026-02-17T21:07:15.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 1 -- 10.20.193.45:0/1371547407 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 msgr2=0x7f135815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 1 --2- 10.20.193.45:0/1371547407 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 0x7f135815a8e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1358072110 tx=0x7f134c02eeb0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 1 -- 10.20.193.45:0/1371547407 shutdown_connections 2026-02-17T21:07:15.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 1 --2- 10.20.193.45:0/1371547407 >> v2:10.20.193.86:3300/0 conn(0x7f13580c94a0 0x7f135815ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 1 --2- 10.20.193.45:0/1371547407 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 0x7f135815a8e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 1 -- 10.20.193.45:0/1371547407 >> 10.20.193.45:0/1371547407 conn(0x7f13580c9d40 msgr2=0x7f13580ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 1 -- 10.20.193.45:0/1371547407 shutdown_connections 2026-02-17T21:07:15.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 1 -- 10.20.193.45:0/1371547407 wait complete. 2026-02-17T21:07:15.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 librados: starting msgr at 2026-02-17T21:07:15.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 librados: starting objecter 2026-02-17T21:07:15.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 Processor -- start 2026-02-17T21:07:15.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 -- start start 2026-02-17T21:07:15.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 librados: setting wanted keys 2026-02-17T21:07:15.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 librados: calling monclient init 2026-02-17T21:07:15.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient: init 2026-02-17T21:07:15.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 10 monclient: shutdown 2026-02-17T21:07:15.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 1 -- 10.20.193.45:0/28683741 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d6c0c92b0 msgr2=0x7f3d6c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 1 --2- 10.20.193.45:0/28683741 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d6c0c92b0 0x7f3d6c15d5c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009970 tx=0x7f3d5c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 1 -- 10.20.193.45:0/28683741 shutdown_connections 2026-02-17T21:07:15.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 1 --2- 10.20.193.45:0/28683741 >> v2:10.20.193.45:3300/0 conn(0x7f3d6c0748e0 0x7f3d6c153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 1 --2- 10.20.193.45:0/28683741 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d6c0c92b0 0x7f3d6c15d5c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 1 -- 10.20.193.45:0/28683741 >> 10.20.193.45:0/28683741 conn(0x7f3d6c0c9d40 msgr2=0x7f3d6c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 1 -- 10.20.193.45:0/28683741 shutdown_connections 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f3d72540640 1 -- 10.20.193.45:0/28683741 wait complete. 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f135d46d640 10 monclient: monmap: 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.513 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:15.514 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:15.514 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:15.514 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:15.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57c40748e0 0x7f57c41f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient(hunting): picked mon.noname-b con 0x7f57c40748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57c40c92b0 0x7f57c40c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient(hunting): picked mon.noname-c con 0x7f57c40c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f57c415d1e0 0x7f57c40cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient(hunting): picked mon.noname-a con 0x7f57c415d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f57c4074d30 con 0x7f57c415d1e0 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f57c40c8680 con 0x7f57c40748e0 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f57c4153d20 con 0x7f57c40c92b0 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.500+0000 7f57cae22640 10 monclient(hunting): authenticate will time out at 1019.130917s 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 librados: starting msgr at 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 librados: starting objecter 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 Processor -- start 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f3d72540640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f3d72540640 10 monclient: monmap: 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.516 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:15.517 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:15.517 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:15.517 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 -- start start 2026-02-17T21:07:15.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 librados: setting wanted keys 2026-02-17T21:07:15.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 librados: calling monclient init 2026-02-17T21:07:15.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient: init 2026-02-17T21:07:15.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 1 -- 10.20.193.45:0/821435569 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067403c070 con 0x7f06800c98b0 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 10 monclient: dump: 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 1 -- 10.20.193.45:0/821435569 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067402fbd0 con 0x7f06800c98b0 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 1 -- 10.20.193.45:0/821435569 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674037440 con 0x7f06800c98b0 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 5 monclient: authenticate success, global_id 4564 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 4 set_mon_vals no callback set 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068549f640 10 monclient: dump: 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.519 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f3d72540640 1 librados: starting msgr at 2026-02-17T21:07:15.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f3d72540640 1 librados: starting objecter 2026-02-17T21:07:15.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f3d72540640 1 Processor -- start 2026-02-17T21:07:15.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f3d72540640 1 -- start start 2026-02-17T21:07:15.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f3d72540640 1 librados: setting wanted keys 2026-02-17T21:07:15.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f3d72540640 1 librados: calling monclient init 2026-02-17T21:07:15.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f3d72540640 10 monclient: init 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13580c94a0 0x7f13581f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient(hunting): picked mon.noname-b con 0x7f13580c94a0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 0x7f135814a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient(hunting): picked mon.noname-c con 0x7f1358152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1358152a00 0x7f135814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient(hunting): picked mon.noname-a con 0x7f1358152a00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f13580c5c90 con 0x7f1358152a00 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f135815a3c0 con 0x7f13580c94a0 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13580c5e10 con 0x7f1358152620 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f135d46d640 10 monclient(hunting): authenticate will time out at 1019.131624s 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 10 monclient: shutdown 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 1 -- 10.20.193.45:0/821435569 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f06800c98b0 msgr2=0x7f06800c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 1 --2- 10.20.193.45:0/821435569 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f06800c98b0 0x7f06800c9cf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f068008eba0 tx=0x7f067402ef60 comp rx=0 tx=0).stop 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 1 -- 10.20.193.45:0/821435569 shutdown_connections 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 1 --2- 10.20.193.45:0/821435569 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f06800c98b0 0x7f06800c9cf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 1 --2- 10.20.193.45:0/821435569 >> v2:10.20.193.92:3300/0 conn(0x7f0680155fe0 0x7f06800cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 1 -- 10.20.193.45:0/821435569 >> 10.20.193.45:0/821435569 conn(0x7f068006d930 msgr2=0x7f068006dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 1 -- 10.20.193.45:0/821435569 shutdown_connections 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f068872c640 1 -- 10.20.193.45:0/821435569 wait complete. 2026-02-17T21:07:15.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.501+0000 7f57bbfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57c40c92b0 0x7f57c40c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f57bbfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57c40c92b0 0x7f57c40c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36604/0 (socket says 10.20.193.45:36604) 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f57bbfff640 1 -- 10.20.193.45:0/3905209436 learned_addr learned my addr 10.20.193.45:0/3905209436 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f57bbfff640 10 monclient(hunting): get_auth_request con 0x7f57c40c92b0 auth_method 0 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f57bbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f57bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f57bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d6c0748e0 0x7f3d6c1e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient(hunting): picked mon.noname-c con 0x7f3d6c0748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3d6c0c92b0 0x7f3d6c06eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.523 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient(hunting): picked mon.noname-a con 0x7f3d6c0c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3d6c15d1e0 0x7f3d6c1f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient(hunting): picked mon.noname-b con 0x7f3d6c15d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 0x7f135814a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c074d30 con 0x7f3d6c0c92b0 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c0c8680 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c153b50 con 0x7f3d6c0748e0 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f3d72540640 10 monclient(hunting): authenticate will time out at 1019.132069s 2026-02-17T21:07:15.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 0x7f135814a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36612/0 (socket says 10.20.193.45:36612) 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 1 -- 10.20.193.45:0/1752226720 learned_addr learned my addr 10.20.193.45:0/1752226720 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 10 monclient(hunting): get_auth_request con 0x7f1358152620 auth_method 0 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f068872c640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f068872c640 10 monclient: monmap: 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:15.525 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f57bbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f57bbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f57bbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f068872c640 1 librados: starting msgr at 2026-02-17T21:07:15.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f068872c640 1 librados: starting objecter 2026-02-17T21:07:15.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f068872c640 1 Processor -- start 2026-02-17T21:07:15.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f13567fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f068872c640 1 -- start start 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f068872c640 1 librados: setting wanted keys 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f068872c640 1 librados: calling monclient init 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.502+0000 7f068872c640 10 monclient: init 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f06800c98b0 0x7f0680140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient(hunting): picked mon.noname-a con 0x7f06800c98b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f06800d16d0 0x7f068015e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient(hunting): picked mon.noname-c con 0x7f06800d16d0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0680155fe0 0x7f0680158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient(hunting): picked mon.noname-b con 0x7f0680155fe0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:15.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f06800c90b0 con 0x7f06800c98b0 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f06800c8dd0 con 0x7f0680155fe0 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f06800cc0e0 con 0x7f06800d16d0 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f068872c640 10 monclient(hunting): authenticate will time out at 1019.133226s 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 <== mon.1 v1:10.20.193.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4021090038 0 0) 0x7fb688003620 con 0x7fb698074c90 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 >> v2:10.20.193.45:3300/0 conn(0x7fb698156220 msgr2=0x7fb6981666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 --2- 10.20.193.45:0/368100827 >> v2:10.20.193.45:3300/0 conn(0x7fb698156220 0x7fb6981666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 >> v1:10.20.193.45:6789/0 conn(0x7fb698155e40 legacy=0x7fb698074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.86:6789/0 2026-02-17T21:07:15.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 --> v1:10.20.193.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb698073aa0 con 0x7fb698074c90 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 <== mon.1 v1:10.20.193.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7fb684002f00 con 0x7fb698074c90 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient: dump: 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] but i'm connected to v1:10.20.193.86:6789/0, reconnecting 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 >> v1:10.20.193.86:6789/0 conn(0x7fb698074c90 legacy=0x7fb6980ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57c8b97640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57c40748e0 0x7f57c41f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb688003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient(hunting): picked mon.a con 0x7fb688003ba0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb688004900 0x7fb688004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient(hunting): picked mon.b con 0x7fb688004900 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb688005510 0x7fb68800bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient(hunting): picked mon.c con 0x7fb688005510 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb6980cd800 con 0x7fb688003ba0 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb68800c450 con 0x7fb688004900 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb68800c650 con 0x7fb688005510 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7fb69d722640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 10 monclient(hunting): handle_auth_done global_id 4604 payload 824 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 1 -- 10.20.193.45:0/3905209436 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57c40748e0 msgr2=0x7f57c41f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57c40748e0 0x7f57c41f78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 1 -- 10.20.193.45:0/3905209436 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f57c415d1e0 msgr2=0x7f57c40cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f57c415d1e0 0x7f57c40cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 1 monclient: found mon.noname-c 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.503+0000 7f57bbfff640 1 -- 10.20.193.45:0/3905209436 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c4072490 con 0x7f57c40c92b0 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.504+0000 7f1356ffd640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13580c94a0 0x7f13581f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f0686ca2640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0680155fe0 0x7f0680158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 10 monclient(hunting): handle_auth_done global_id 4607 payload 824 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 1 -- 10.20.193.45:0/1752226720 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13580c94a0 msgr2=0x7f13581f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13580c94a0 0x7f13581f6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 1 -- 10.20.193.45:0/1752226720 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1358152a00 msgr2=0x7f135814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1358152a00 0x7f135814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 1 monclient: found mon.noname-c 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.505+0000 7f13567fc640 1 -- 10.20.193.45:0/1752226720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13580cbfd0 con 0x7f1358152620 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f3d70ab6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3d6c15d1e0 0x7f3d6c1f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7fb69e724640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb688003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f0686ca2640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0680155fe0 0x7f0680158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57910/0 (socket says 10.20.193.45:57910) 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f0686ca2640 1 -- 10.20.193.45:0/570145754 learned_addr learned my addr 10.20.193.45:0/570145754 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f0686ca2640 10 monclient(hunting): get_auth_request con 0x7f0680155fe0 auth_method 0 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f0686ca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f0686ca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f0686ca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f3d70ab6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3d6c15d1e0 0x7f3d6c1f3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57906/0 (socket says 10.20.193.45:57906) 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f3d70ab6640 1 -- 10.20.193.45:0/1822898457 learned_addr learned my addr 10.20.193.45:0/1822898457 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f3d70ab6640 10 monclient(hunting): get_auth_request con 0x7f3d6c15d1e0 auth_method 0 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f3d70ab6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f3d70ab6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.506+0000 7f3d70ab6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7fb69e724640 10 monclient(hunting): get_auth_request con 0x7fb688003ba0 auth_method 0 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7fb69e724640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7fb69e724640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7fb69e724640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:07:15.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f0686ca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f0686ca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f0686ca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f3d6b7fe640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3d6c0c92b0 0x7f3d6c06eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f57bbfff640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57c40c92b0 0x7f57c40c3a80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00b5a0 tx=0x7f57ac00ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7fb69df23640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb688004900 0x7fb688004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f57b97fa640 10 client.?.objecter ms_handle_connect 0x7f57c40c92b0 2026-02-17T21:07:15.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f57b97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f3d70ab6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f3d70ab6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f3d70ab6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7f06864a1640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f06800c98b0 0x7f0680140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7fb69df23640 10 monclient(hunting): get_auth_request con 0x7fb688004900 auth_method 0 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7fb69df23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7fb69df23640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.507+0000 7fb69df23640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7fb69e724640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7fb69e724640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7fb69e724640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f13567fc640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 0x7f135814a710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f134000b580 tx=0x7f134000ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f13377fe640 10 client.?.objecter ms_handle_connect 0x7f1358152620 2026-02-17T21:07:15.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f13377fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f3d6b7fe640 10 monclient(hunting): get_auth_request con 0x7f3d6c0c92b0 auth_method 0 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f3d6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f3d6b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f3d6b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f06864a1640 10 monclient(hunting): get_auth_request con 0x7f06800c98b0 auth_method 0 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f06864a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f06864a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.508+0000 7f06864a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 10 monclient(hunting): handle_auth_done global_id 4570 payload 824 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 1 -- 10.20.193.45:0/570145754 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f06800d16d0 msgr2=0x7f068015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f06800d16d0 0x7f068015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 1 -- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f06800c98b0 msgr2=0x7f0680140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f06800c98b0 0x7f0680140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 1 monclient: found mon.noname-b 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.509+0000 7f0686ca2640 1 -- 10.20.193.45:0/570145754 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068015d410 con 0x7f0680155fe0 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 10 monclient(hunting): handle_auth_done global_id 4573 payload 824 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 1 -- 10.20.193.45:0/1822898457 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d6c0748e0 msgr2=0x7f3d6c1e9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d6c0748e0 0x7f3d6c1e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 1 -- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3d6c0c92b0 msgr2=0x7f3d6c06eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3d6c0c92b0 0x7f3d6c06eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 1 monclient: found mon.noname-b 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f3d70ab6640 1 -- 10.20.193.45:0/1822898457 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c1f4c30 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 1 -- 10.20.193.45:0/3905209436 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac012070 con 0x7f57c40c92b0 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 10 monclient: dump: 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 1 -- 10.20.193.45:0/3905209436 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ac0044a0 con 0x7f57c40c92b0 2026-02-17T21:07:15.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57cae22640 5 monclient: authenticate success, global_id 4604 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57cae22640 10 monclient: _renew_subs 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57cae22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c41f3ed0 con 0x7f57c40c92b0 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 1 -- 10.20.193.45:0/3905209436 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0029c0 con 0x7f57c40c92b0 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57baffd640 4 set_mon_vals no callback set 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57b97fa640 10 monclient: dump: 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57cae22640 10 client.4604.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57cae22640 10 monclient: _renew_subs 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57cae22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c41f4490 con 0x7f57c40c92b0 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.510+0000 7f57cae22640 1 librados: init done 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.511+0000 7f57cae22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.511+0000 7f57cae22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.511+0000 7f57cae22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.511+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c415d5c0 con 0x7f57c40c92b0 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.511+0000 7fb69df23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.511+0000 7fb69df23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.511+0000 7fb69df23640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 10 monclient(hunting): handle_auth_done global_id 4567 payload 293 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 1 -- 10.20.193.45:0/368100827 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb688005510 msgr2=0x7fb68800bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb688005510 0x7fb68800bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 1 -- 10.20.193.45:0/368100827 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb688004900 msgr2=0x7fb688004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb688004900 0x7fb688004d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 1 monclient: found mon.a 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69ef25640 1 -- 10.20.193.45:0/368100827 reap_dead start 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 1 -- 10.20.193.45:0/368100827 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb688003620 con 0x7fb688003ba0 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb69e724640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb6a09af640 5 monclient: authenticate success, global_id 4567 2026-02-17T21:07:15.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.513+0000 7fb6a09af640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.514+0000 7f0686ca2640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0680155fe0 0x7f0680158940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f067c00b990 tx=0x7f067c00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.514+0000 7f0666ffd640 10 client.?.objecter ms_handle_connect 0x7f0680155fe0 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.514+0000 7f0666ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.514+0000 7f3d70ab6640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3d6c15d1e0 0x7f3d6c1f3d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000b970 tx=0x7f3d6000be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.514+0000 7f3d68ff9640 10 client.?.objecter ms_handle_connect 0x7f3d6c15d1e0 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.514+0000 7f3d68ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 1 -- 10.20.193.45:0/1752226720 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340004500 con 0x7f1358152620 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 10 monclient: dump: 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.541 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 1 -- 10.20.193.45:0/1752226720 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1340014070 con 0x7f1358152620 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f135d46d640 5 monclient: authenticate success, global_id 4607 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f135d46d640 10 monclient: _renew_subs 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f135d46d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13580cc2b0 con 0x7f1358152620 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 1 -- 10.20.193.45:0/1752226720 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340002920 con 0x7f1358152620 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13557fa640 4 set_mon_vals no callback set 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f13377fe640 10 monclient: dump: 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f135d46d640 10 client.4607.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:15.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f135d46d640 10 monclient: _renew_subs 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f135d46d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13580cc870 con 0x7f1358152620 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.515+0000 7f135d46d640 1 librados: init done 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.516+0000 7f135d46d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.516+0000 7f135d46d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.516+0000 7f135d46d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.516+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13580c8d90 con 0x7f1358152620 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.516+0000 7fb69e724640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb688003fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb690002f60 tx=0x7fb69002eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d086b51335b2016 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f0666ffd640 1 -- 10.20.193.45:0/570145754 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c006e60 con 0x7f0680155fe0 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f0666ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f0666ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f0666ffd640 10 monclient: dump: 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.543 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f0666ffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f0666ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f0666ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 5 monclient: authenticate success, global_id 4570 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 10 monclient: _renew_subs 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068015d6f0 con 0x7f0680155fe0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 10 client.4570.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 10 monclient: _renew_subs 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068015dcb0 con 0x7f0680155fe0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 1 librados: init done 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.517+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06800c9cf0 con 0x7f0680155fe0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f0666ffd640 1 -- 10.20.193.45:0/570145754 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c010070 con 0x7f0680155fe0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f0666ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f0666ffd640 1 -- 10.20.193.45:0/570145754 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c00c990 con 0x7f0680155fe0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f0666ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f0666ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f0684c9e640 4 set_mon_vals no callback set 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f0666ffd640 10 monclient: dump: 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.544 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 1 -- 10.20.193.45:0/1822898457 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000c790 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 10 monclient: dump: 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.545 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 1 -- 10.20.193.45:0/1822898457 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d60010070 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 1 -- 10.20.193.45:0/1822898457 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000cb90 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d68ff9640 10 monclient: dump: 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d6a7fc640 4 set_mon_vals no callback set 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d72540640 5 monclient: authenticate success, global_id 4573 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d72540640 10 monclient: _renew_subs 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d72540640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6c06e100 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d72540640 10 client.4573.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d72540640 10 monclient: _renew_subs 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d72540640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6c1f4670 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.518+0000 7f3d72540640 1 librados: init done 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.519+0000 7f3d72540640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.519+0000 7f3d72540640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.519+0000 7f3d72540640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.519+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6c153f70 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690002b30 con 0x7fb688003ba0 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 10 monclient: dump: 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.548 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb690005290 con 0x7fb688003ba0 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb6a09af640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb6a09af640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 1 -- 10.20.193.45:0/368100827 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690003710 con 0x7fb688003ba0 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb6a09af640 4 set_mon_vals no callback set 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.520+0000 7fb69d722640 10 monclient: dump: 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 10 monclient: shutdown 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 -- 10.20.193.45:0/368100827 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 msgr2=0x7fb688003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb688003fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb690002f60 tx=0x7fb69002eca0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 -- 10.20.193.45:0/368100827 shutdown_connections 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 --2- 10.20.193.45:0/368100827 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb688003fa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 -- 10.20.193.45:0/368100827 >> 10.20.193.45:0/368100827 conn(0x7fb6980ce270 msgr2=0x7fb6980ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 -- 10.20.193.45:0/368100827 shutdown_connections 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 -- 10.20.193.45:0/368100827 wait complete. 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 10 monclient: monmap: 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:15.549 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 librados: starting msgr at 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 librados: starting objecter 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 Processor -- start 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 -- start start 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 librados: setting wanted keys 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 1 librados: calling monclient init 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.521+0000 7fb6a09af640 10 monclient: init 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb69815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient(hunting): picked mon.noname-a con 0x7fb688003ba0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb6981513a0 0x7fb69815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient(hunting): picked mon.noname-c con 0x7fb6981513a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb698151800 0x7fb69815f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient(hunting): picked mon.noname-b con 0x7fb698151800 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb6980c4830 con 0x7fb688003ba0 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb698074060 con 0x7fb698151800 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb6980c49b0 con 0x7fb6981513a0 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb6a09af640 10 monclient(hunting): authenticate will time out at 1019.152296s 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb69815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb69815d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42294/0 (socket says 10.20.193.45:42294) 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 1 -- 10.20.193.45:0/2641378835 learned_addr learned my addr 10.20.193.45:0/2641378835 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 10 monclient(hunting): get_auth_request con 0x7fb688003ba0 auth_method 0 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:15.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.522+0000 7fb69e724640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 10 monclient(hunting): handle_auth_done global_id 4515 payload 824 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 1 -- 10.20.193.45:0/2641378835 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb6981513a0 msgr2=0x7fb69815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb6981513a0 0x7fb69815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 1 -- 10.20.193.45:0/2641378835 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb698151800 msgr2=0x7fb69815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb698151800 0x7fb69815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 10 monclient: _finish_hunting 0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 1 monclient: found mon.noname-a 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.524+0000 7fb69e724640 1 -- 10.20.193.45:0/2641378835 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6980c8c90 con 0x7fb688003ba0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.525+0000 7fb69e724640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb69815d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb69002f1b0 tx=0x7fb6900027c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.525+0000 7fb682ffd640 10 client.?.objecter ms_handle_connect 0x7fb688003ba0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.525+0000 7fb682ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 1 -- 10.20.193.45:0/2641378835 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690049070 con 0x7fb688003ba0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 10 monclient: dump: 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 1 -- 10.20.193.45:0/2641378835 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb690006ab0 con 0x7fb688003ba0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb6a09af640 5 monclient: authenticate success, global_id 4515 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb6a09af640 10 monclient: _renew_subs 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb6a09af640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6980c8f30 con 0x7fb688003ba0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 1 -- 10.20.193.45:0/2641378835 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb690007030 con 0x7fb688003ba0 2026-02-17T21:07:15.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb69cf21640 4 set_mon_vals no callback set 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb682ffd640 10 monclient: dump: 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb6a09af640 10 client.4515.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb6a09af640 10 monclient: _renew_subs 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb6a09af640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6980c94f0 con 0x7fb688003ba0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.527+0000 7fb6a09af640 1 librados: init done 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.528+0000 7fb6a09af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.528+0000 7fb6a09af640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.528+0000 7fb6a09af640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.528+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb698074ab0 con 0x7fb688003ba0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.539+0000 7fb682ffd640 1 -- 10.20.193.45:0/2641378835 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb6900071d0 con 0x7fb688003ba0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.540+0000 7fb682ffd640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6680792d0 0x7fb66807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.540+0000 7fb69df23640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6680792d0 0x7fb66807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.540+0000 7fb69df23640 10 monclient: get_auth_request con 0x7fb6680792d0 auth_method 0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.540+0000 7fb682ffd640 10 client.4515.objecter ms_handle_connect 0x7fb6680792d0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.540+0000 7fb69df23640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6680792d0 0x7fb66807b790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb684002820 tx=0x7fb684007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.541+0000 7f3a953b3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.541+0000 7f3a953b3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.541+0000 7f3a953b3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.552 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.541+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3a900cdcb0 con 0x7f3a90073b50 2026-02-17T21:07:15.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.542+0000 7fb682ffd640 1 -- 10.20.193.45:0/2641378835 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fb690082cd0 con 0x7fb688003ba0 2026-02-17T21:07:15.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.542+0000 7fb682ffd640 10 client.4515.objecter ms_dispatch2 0x7fb698000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:15.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.542+0000 7fb682ffd640 3 client.4515.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:15.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.542+0000 7fb682ffd640 3 client.4515.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:15.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.542+0000 7fb682ffd640 20 client.4515.objecter dump_active .. 0 homeless 2026-02-17T21:07:15.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.573+0000 7f92b81ce640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:07:15.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.573+0000 7f92b81ce640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:07:15.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.573+0000 7f92b81ce640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.573+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f92b0159770 con 0x7f92b0156220 2026-02-17T21:07:15.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.584+0000 7f504e9ff640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:07:15.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.584+0000 7f504e9ff640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:07:15.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.584+0000 7f504e9ff640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.584+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f50481595a0 con 0x7f5048156030 2026-02-17T21:07:15.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.618+0000 7f57b97fa640 1 -- 10.20.193.45:0/3905209436 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f57ac021480 con 0x7f57c40c92b0 2026-02-17T21:07:15.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.619+0000 7f57b97fa640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57940792d0 0x7f579407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.619+0000 7f57c8b97640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57940792d0 0x7f579407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.619+0000 7f57c8b97640 10 monclient: get_auth_request con 0x7f57940792d0 auth_method 0 2026-02-17T21:07:15.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.619+0000 7f57b97fa640 10 client.4604.objecter ms_handle_connect 0x7f57940792d0 2026-02-17T21:07:15.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.619+0000 7f57c8b97640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57940792d0 0x7f579407b790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009970 tx=0x7f57b4033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.620+0000 7f57b97fa640 1 -- 10.20.193.45:0/3905209436 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f57ac05dd90 con 0x7f57c40c92b0 2026-02-17T21:07:15.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.620+0000 7f57b97fa640 10 client.4604.objecter ms_dispatch2 0x7f57c4000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:15.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.620+0000 7f57b97fa640 3 client.4604.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:15.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.620+0000 7f57b97fa640 3 client.4604.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:15.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.620+0000 7f57b97fa640 20 client.4604.objecter dump_active .. 0 homeless 2026-02-17T21:07:15.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.626+0000 7f57b97fa640 1 -- 10.20.193.45:0/3905209436 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f57ac062450 con 0x7f57c40c92b0 2026-02-17T21:07:15.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.626+0000 7f57b97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.626+0000 7f57b97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.628+0000 7f0666ffd640 1 -- 10.20.193.45:0/570145754 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f067c01d030 con 0x7f0680155fe0 2026-02-17T21:07:15.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.629+0000 7f0666ffd640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f06500792b0 0x7f065007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.629+0000 7f06864a1640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f06500792b0 0x7f065007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.629+0000 7f06864a1640 10 monclient: get_auth_request con 0x7f06500792b0 auth_method 0 2026-02-17T21:07:15.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.629+0000 7f06864a1640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f06500792b0 0x7f065007b770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0670006fd0 tx=0x7f0670008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.629+0000 7f0666ffd640 10 client.4570.objecter ms_handle_connect 0x7f06500792b0 2026-02-17T21:07:15.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.631+0000 7f0666ffd640 1 -- 10.20.193.45:0/570145754 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f067c097800 con 0x7f0680155fe0 2026-02-17T21:07:15.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.631+0000 7f0666ffd640 10 client.4570.objecter ms_dispatch2 0x7f0680000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:15.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.631+0000 7f0666ffd640 3 client.4570.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:15.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.631+0000 7f0666ffd640 3 client.4570.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:15.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.631+0000 7f0666ffd640 20 client.4570.objecter dump_active .. 0 homeless 2026-02-17T21:07:15.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.639+0000 7f3d68ff9640 1 -- 10.20.193.45:0/1822898457 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f3d6001d030 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.640+0000 7f3d68ff9640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3d3c079300 0x7f3d3c07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.640+0000 7f3d6bfff640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3d3c079300 0x7f3d3c07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.640+0000 7f3d6bfff640 10 monclient: get_auth_request con 0x7f3d3c079300 auth_method 0 2026-02-17T21:07:15.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.640+0000 7f3d68ff9640 10 client.4573.objecter ms_handle_connect 0x7f3d3c079300 2026-02-17T21:07:15.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.640+0000 7f3d6bfff640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3d3c079300 0x7f3d3c07b7c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0c3bc0 tx=0x7f3d58006ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.646+0000 7fb682ffd640 1 -- 10.20.193.45:0/2641378835 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb698074ab0 con 0x7fb688003ba0 2026-02-17T21:07:15.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.646+0000 7fb682ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.646+0000 7fb682ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.647+0000 7f3d68ff9640 1 -- 10.20.193.45:0/1822898457 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f3d6001de10 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.647+0000 7f3d68ff9640 10 client.4573.objecter ms_dispatch2 0x7f3d6c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:15.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.647+0000 7f3d68ff9640 3 client.4573.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:15.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.647+0000 7f3d68ff9640 3 client.4573.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:15.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.647+0000 7f3d68ff9640 20 client.4573.objecter dump_active .. 0 homeless 2026-02-17T21:07:15.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.647+0000 7f0666ffd640 1 -- 10.20.193.45:0/570145754 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f067c0622d0 con 0x7f0680155fe0 2026-02-17T21:07:15.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.647+0000 7f0666ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.647+0000 7f0666ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.650+0000 7f50367fc640 1 -- 10.20.193.45:0/2619073864 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f503c062630 con 0x7f5048156030 2026-02-17T21:07:15.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.650+0000 7f50367fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-17T21:07:15.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.650+0000 7f50367fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.642 INFO:teuthology.orchestra.run.trial045.stdout:115964117001 2026-02-17T21:07:15.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 10 librados: watch_flush enter 2026-02-17T21:07:15.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 10 librados: watch_flush exit 2026-02-17T21:07:15.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 20 client.4506.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 10 client.4506.objecter successfully canceled tick 2026-02-17T21:07:15.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5018079280 msgr2=0x7f501807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5018079280 0x7f501807b740 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f504808e570 tx=0x7f5038031000 comp rx=0 tx=0).stop 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 10 monclient: shutdown 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048156030 msgr2=0x7f50481543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048156030 0x7f50481543c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f503c00b550 tx=0x7f503c00ba20 comp rx=0 tx=0).stop 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 shutdown_connections 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5018079280 0x7f501807b740 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f504815d220 0x7f50480c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5048156030 0x7f50481543c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 --2- 10.20.193.45:0/2619073864 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5048155c50 0x7f5048153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 >> 10.20.193.45:0/2619073864 conn(0x7f504806dcf0 msgr2=0x7f50480d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 shutdown_connections 2026-02-17T21:07:15.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 -- 10.20.193.45:0/2619073864 wait complete. 2026-02-17T21:07:15.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.652+0000 7f504e9ff640 1 librados: shutdown 2026-02-17T21:07:15.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117001 for osd.15 2026-02-17T21:07:15.654 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:15.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.714+0000 7f57cae22640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:07:15.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.714+0000 7f57cae22640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:07:15.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.714+0000 7f57cae22640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.714+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f57c40c50a0 con 0x7f57c40c92b0 2026-02-17T21:07:15.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.726+0000 7f929e7fc640 1 -- 10.20.193.45:0/2254903324 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f92ac0886f0 con 0x7f92b0156220 2026-02-17T21:07:15.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.726+0000 7f929e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-17T21:07:15.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.726+0000 7f929e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.719 INFO:teuthology.orchestra.run.trial045.stdout:90194313221 2026-02-17T21:07:15.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 10 librados: watch_flush enter 2026-02-17T21:07:15.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 10 librados: watch_flush exit 2026-02-17T21:07:15.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 20 client.4592.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 10 client.4592.objecter successfully canceled tick 2026-02-17T21:07:15.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92800792d0 msgr2=0x7f928007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92800792d0 0x7f928007b790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f92a0002a30 tx=0x7f92a00079f0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 10 monclient: shutdown 2026-02-17T21:07:15.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f92b0156220 msgr2=0x7f92b00c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f92b0156220 0x7f92b00c7720 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f92ac03a040 tx=0x7f92ac004b40 comp rx=0 tx=0).stop 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 shutdown_connections 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92800792d0 0x7f928007b790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f92b0156220 0x7f92b00c7720 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f92b0155e40 0x7f92b00d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 --2- 10.20.193.45:0/2254903324 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f92b0074c90 0x7f92b00c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 >> 10.20.193.45:0/2254903324 conn(0x7f92b00ce270 msgr2=0x7f92b0154100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 shutdown_connections 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 -- 10.20.193.45:0/2254903324 wait complete. 2026-02-17T21:07:15.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.729+0000 7f92b81ce640 1 librados: shutdown 2026-02-17T21:07:15.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.730+0000 7fb6a09af640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:07:15.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.730+0000 7fb6a09af640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:07:15.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.730+0000 7fb6a09af640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:15.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.730+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7fb698074580 con 0x7fb688003ba0 2026-02-17T21:07:15.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.731+0000 7f068872c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:07:15.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.731+0000 7f068872c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:07:15.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.731+0000 7f068872c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.731+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0680159640 con 0x7f0680155fe0 2026-02-17T21:07:15.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.733+0000 7fb682ffd640 1 -- 10.20.193.45:0/2641378835 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fb690034030 con 0x7fb688003ba0 2026-02-17T21:07:15.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.733+0000 7fb682ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-17T21:07:15.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.733+0000 7fb682ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.726 INFO:teuthology.orchestra.run.trial045.stdout:90194313222 2026-02-17T21:07:15.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 10 librados: watch_flush enter 2026-02-17T21:07:15.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 10 librados: watch_flush exit 2026-02-17T21:07:15.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 20 client.4515.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 10 client.4515.objecter successfully canceled tick 2026-02-17T21:07:15.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6680792d0 msgr2=0x7fb66807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6680792d0 0x7fb66807b790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb684002820 tx=0x7fb684007ca0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 10 monclient: shutdown 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 msgr2=0x7fb69815d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb69815d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb69002f1b0 tx=0x7fb6900027c0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 shutdown_connections 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb6680792d0 0x7fb66807b790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb698151800 0x7fb69815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb6981513a0 0x7fb69815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 --2- 10.20.193.45:0/2641378835 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb688003ba0 0x7fb69815d390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 >> 10.20.193.45:0/2641378835 conn(0x7fb6980ce270 msgr2=0x7fb6980ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 shutdown_connections 2026-02-17T21:07:15.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 -- 10.20.193.45:0/2641378835 wait complete. 2026-02-17T21:07:15.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.735+0000 7fb6a09af640 1 librados: shutdown 2026-02-17T21:07:15.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.736+0000 7f13377fe640 1 -- 10.20.193.45:0/1752226720 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f1340023430 con 0x7f1358152620 2026-02-17T21:07:15.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.736+0000 7f13377fe640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f13240792d0 0x7f132407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:15.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.736+0000 7f1356ffd640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f13240792d0 0x7f132407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:15.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.736+0000 7f1356ffd640 10 monclient: get_auth_request con 0x7f13240792d0 auth_method 0 2026-02-17T21:07:15.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f1356ffd640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f13240792d0 0x7f132407b790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f13581563b0 tx=0x7f134c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:15.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f13377fe640 10 client.4607.objecter ms_handle_connect 0x7f13240792d0 2026-02-17T21:07:15.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f13377fe640 1 -- 10.20.193.45:0/1752226720 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f1340023de0 con 0x7f1358152620 2026-02-17T21:07:15.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f13377fe640 10 client.4607.objecter ms_dispatch2 0x7f1358000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:15.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f13377fe640 3 client.4607.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:15.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f13377fe640 3 client.4607.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:15.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f13377fe640 20 client.4607.objecter dump_active .. 0 homeless 2026-02-17T21:07:15.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f57b97fa640 1 -- 10.20.193.45:0/3905209436 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f57ac061d50 con 0x7f57c40c92b0 2026-02-17T21:07:15.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f57b97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-17T21:07:15.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.737+0000 7f57b97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.732 INFO:teuthology.orchestra.run.trial045.stdout:115964117002 2026-02-17T21:07:15.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.8 2026-02-17T21:07:15.734 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:15.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 10 librados: watch_flush enter 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 10 librados: watch_flush exit 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 20 client.4604.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 10 client.4604.objecter successfully canceled tick 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57940792d0 msgr2=0x7f579407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57940792d0 0x7f579407b790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009970 tx=0x7f57b4033000 comp rx=0 tx=0).stop 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 10 monclient: shutdown 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57c40c92b0 msgr2=0x7f57c40c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57c40c92b0 0x7f57c40c3a80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00b5a0 tx=0x7f57ac00ba70 comp rx=0 tx=0).stop 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 shutdown_connections 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57940792d0 0x7f579407b790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f57c415d1e0 0x7f57c40cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57c40c92b0 0x7f57c40c3a80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 --2- 10.20.193.45:0/3905209436 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57c40748e0 0x7f57c41f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 >> 10.20.193.45:0/3905209436 conn(0x7f57c40c9d40 msgr2=0x7f57c414dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 shutdown_connections 2026-02-17T21:07:15.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 -- 10.20.193.45:0/3905209436 wait complete. 2026-02-17T21:07:15.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.739+0000 7f57cae22640 1 librados: shutdown 2026-02-17T21:07:15.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313222 for osd.12 2026-02-17T21:07:15.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.745+0000 7f13377fe640 1 -- 10.20.193.45:0/1752226720 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1340062920 con 0x7f1358152620 2026-02-17T21:07:15.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.745+0000 7f13377fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.745+0000 7f13377fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.739 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:15.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.748+0000 7f3d68ff9640 1 -- 10.20.193.45:0/1822898457 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3d60062240 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.748+0000 7f3d68ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:15.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.748+0000 7f3d68ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:15.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117002 got 115964117002 for osd.2 2026-02-17T21:07:15.742 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:15.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.751+0000 7f3a6f7fe640 1 -- 10.20.193.45:0/3108805188 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a84065c30 con 0x7f3a90073b50 2026-02-17T21:07:15.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.752+0000 7f3a6f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-17T21:07:15.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.752+0000 7f3a6f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.744 INFO:teuthology.orchestra.run.trial045.stdout:98784247814 2026-02-17T21:07:15.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.752+0000 7f0666ffd640 1 -- 10.20.193.45:0/570145754 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f067c061bd0 con 0x7f0680155fe0 2026-02-17T21:07:15.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.752+0000 7f0666ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-17T21:07:15.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.752+0000 7f0666ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.745 INFO:teuthology.orchestra.run.trial045.stdout:111669149706 2026-02-17T21:07:15.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 10 librados: watch_flush enter 2026-02-17T21:07:15.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 10 librados: watch_flush exit 2026-02-17T21:07:15.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 20 client.4558.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 10 client.4558.objecter successfully canceled tick 2026-02-17T21:07:15.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3a5c0792b0 msgr2=0x7f3a5c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3a5c0792b0 0x7f3a5c07b770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3a78039000 tx=0x7f3a78031000 comp rx=0 tx=0).stop 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 10 monclient: shutdown 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3a90073b50 msgr2=0x7f3a901f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3a90073b50 0x7f3a901f5a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400c700 tx=0x7f3a8400cbd0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 shutdown_connections 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3a5c0792b0 0x7f3a5c07b770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a90155f90 0x7f3a901f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3a900cef10 0x7f3a9014d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 --2- 10.20.193.45:0/3108805188 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3a90073b50 0x7f3a901f5a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 >> 10.20.193.45:0/3108805188 conn(0x7f3a90073030 msgr2=0x7f3a900c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 shutdown_connections 2026-02-17T21:07:15.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 -- 10.20.193.45:0/3108805188 wait complete. 2026-02-17T21:07:15.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f3a953b3640 1 librados: shutdown 2026-02-17T21:07:15.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f068872c640 10 librados: watch_flush enter 2026-02-17T21:07:15.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f068872c640 10 librados: watch_flush exit 2026-02-17T21:07:15.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.754+0000 7f068872c640 20 client.4570.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 10 client.4570.objecter successfully canceled tick 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f06500792b0 msgr2=0x7f065007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f06500792b0 0x7f065007b770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0670006fd0 tx=0x7f0670008040 comp rx=0 tx=0).stop 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 10 monclient: shutdown 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0680155fe0 msgr2=0x7f0680158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0680155fe0 0x7f0680158940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f067c00b990 tx=0x7f067c00be60 comp rx=0 tx=0).stop 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 shutdown_connections 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f06500792b0 0x7f065007b770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0680155fe0 0x7f0680158940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f06800d16d0 0x7f068015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 --2- 10.20.193.45:0/570145754 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f06800c98b0 0x7f0680140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 >> 10.20.193.45:0/570145754 conn(0x7f068006d930 msgr2=0x7f0680153800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 shutdown_connections 2026-02-17T21:07:15.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 -- 10.20.193.45:0/570145754 wait complete. 2026-02-17T21:07:15.752 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.755+0000 7f068872c640 1 librados: shutdown 2026-02-17T21:07:15.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247813 got 98784247814 for osd.6 2026-02-17T21:07:15.755 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:15.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149705 got 111669149706 for osd.1 2026-02-17T21:07:15.756 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:15.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.832+0000 7f3d72540640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:07:15.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.832+0000 7f3d72540640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:07:15.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.832+0000 7f3d72540640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:15.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.832+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3d6c14fab0 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.834+0000 7f3d68ff9640 1 -- 10.20.193.45:0/1822898457 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3d60061b40 con 0x7f3d6c15d1e0 2026-02-17T21:07:15.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.834+0000 7f3d68ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-17T21:07:15.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.834+0000 7f3d68ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.827 INFO:teuthology.orchestra.run.trial045.stdout:103079215109 2026-02-17T21:07:15.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 10 librados: watch_flush enter 2026-02-17T21:07:15.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 10 librados: watch_flush exit 2026-02-17T21:07:15.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 20 client.4573.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 10 client.4573.objecter successfully canceled tick 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3d3c079300 msgr2=0x7f3d3c07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3d3c079300 0x7f3d3c07b7c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0c3bc0 tx=0x7f3d58006ca0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 10 monclient: shutdown 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3d6c15d1e0 msgr2=0x7f3d6c1f3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3d6c15d1e0 0x7f3d6c1f3d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000b970 tx=0x7f3d6000be40 comp rx=0 tx=0).stop 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 shutdown_connections 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3d3c079300 0x7f3d3c07b7c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3d6c15d1e0 0x7f3d6c1f3d30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3d6c0c92b0 0x7f3d6c06eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 --2- 10.20.193.45:0/1822898457 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d6c0748e0 0x7f3d6c1e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 >> 10.20.193.45:0/1822898457 conn(0x7f3d6c0c9d40 msgr2=0x7f3d6c14dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 shutdown_connections 2026-02-17T21:07:15.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 -- 10.20.193.45:0/1822898457 wait complete. 2026-02-17T21:07:15.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.835+0000 7f3d72540640 1 librados: shutdown 2026-02-17T21:07:15.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.837+0000 7f135d46d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:07:15.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.837+0000 7f135d46d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:07:15.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.837+0000 7f135d46d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:15.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.837+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f13580cca70 con 0x7f1358152620 2026-02-17T21:07:15.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.840+0000 7f13377fe640 1 -- 10.20.193.45:0/1752226720 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1340062220 con 0x7f1358152620 2026-02-17T21:07:15.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.840+0000 7f13377fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-17T21:07:15.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.840+0000 7f13377fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:15.832 INFO:teuthology.orchestra.run.trial045.stdout:94489280517 2026-02-17T21:07:15.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 10 librados: watch_flush enter 2026-02-17T21:07:15.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 10 librados: watch_flush exit 2026-02-17T21:07:15.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 20 client.4607.objecter shutdown clearing up homeless session... 2026-02-17T21:07:15.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 10 client.4607.objecter successfully canceled tick 2026-02-17T21:07:15.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f13240792d0 msgr2=0x7f132407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f13240792d0 0x7f132407b790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f13581563b0 tx=0x7f134c033000 comp rx=0 tx=0).stop 2026-02-17T21:07:15.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 10 monclient: shutdown 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 msgr2=0x7f135814a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 0x7f135814a710 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f134000b580 tx=0x7f134000ba50 comp rx=0 tx=0).stop 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 shutdown_connections 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f13240792d0 0x7f132407b790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1358152a00 0x7f135814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1358152620 0x7f135814a710 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 --2- 10.20.193.45:0/1752226720 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f13580c94a0 0x7f13581f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 >> 10.20.193.45:0/1752226720 conn(0x7f13580c9d40 msgr2=0x7f135814f000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 shutdown_connections 2026-02-17T21:07:15.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 -- 10.20.193.45:0/1752226720 wait complete. 2026-02-17T21:07:15.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:15.842+0000 7f135d46d640 1 librados: shutdown 2026-02-17T21:07:15.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215109 got 103079215109 for osd.10 2026-02-17T21:07:15.838 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:15.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280517 for osd.4 2026-02-17T21:07:15.843 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:15.927 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-17T21:07:15.973 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-17T21:07:15.996 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-17T21:07:15.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.004+0000 7f7b815ed640 10 monclient: get_monmap_and_config 2026-02-17T21:07:15.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.004+0000 7f7b815ed640 10 monclient: build_initial_monmap 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.004+0000 7f7b815ed640 10 monclient: monmap: 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:16.005563+0000 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:16.005563+0000 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:15.998 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:15.999 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:15.999 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:15.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 1 Processor -- start 2026-02-17T21:07:15.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 1 -- start start 2026-02-17T21:07:15.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 10 monclient: init 2026-02-17T21:07:16.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 10 monclient: _add_conns ranks=[1,2,4,5,0,3] 2026-02-17T21:07:16.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f7b7c1502b0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:16.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7b7c150690 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f7b7c0c9040 0x7f7b7c15d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 10 monclient(hunting): picked mon.noname-b con 0x7f7b7c0c9040 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7c0c5340 con 0x7f7b7c1502b0 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7c0c5620 con 0x7f7b7c150690 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7b7c074e40 con 0x7f7b7c0c9040 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.005+0000 7f7b815ed640 10 monclient(hunting): authenticate will time out at 1019.635993s 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.006+0000 7f7b7a7fc640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f7b7c150690 0x7f7b7c0c8930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47760/0 (socket says 10.20.193.45:47760) 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.006+0000 7f7b7a7fc640 1 -- 10.20.193.45:0/2772834575 learned_addr learned my addr 10.20.193.45:0/2772834575 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.006+0000 7f7b7b7fe640 1 --2- 10.20.193.45:0/2772834575 >> v2:10.20.193.86:3300/0 conn(0x7f7b7c0c9040 0x7f7b7c15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b7b7fe640 10 monclient(hunting): get_auth_request con 0x7f7b7c0c9040 auth_method 0 2026-02-17T21:07:16.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b79ffb640 1 -- 10.20.193.45:0/2772834575 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317802021 0 0) 0x7f7b7c0c5620 con 0x7f7b7c150690 2026-02-17T21:07:16.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b79ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:07:16.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b79ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b79ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b79ffb640 10 monclient(hunting): my global_id is 4610 2026-02-17T21:07:16.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.007+0000 7f7b79ffb640 1 -- 10.20.193.45:0/2772834575 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b68003620 con 0x7f7b7c150690 2026-02-17T21:07:16.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.008+0000 7f7b7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.008+0000 7f7b7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.008+0000 7f7b7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.008+0000 7f7b79ffb640 1 -- 10.20.193.45:0/2772834575 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 428308693 0 0) 0x7f7b7c0c5340 con 0x7f7b7c1502b0 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.008+0000 7f7b79ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.008+0000 7f7b79ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.008+0000 7f7b79ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.008+0000 7f7b79ffb640 10 monclient(hunting): my global_id is 4576 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.008+0000 7f7b79ffb640 1 -- 10.20.193.45:0/2772834575 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b7c0c5620 con 0x7f7b7c1502b0 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.009+0000 7f7b7b7fe640 10 monclient(hunting): handle_auth_done global_id 4579 payload 274 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.009+0000 7f7b7b7fe640 1 -- 10.20.193.45:0/2772834575 >> v1:10.20.193.92:6789/0 conn(0x7f7b7c150690 legacy=0x7f7b7c0c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.009+0000 7f7b7b7fe640 1 -- 10.20.193.45:0/2772834575 >> v1:10.20.193.86:6789/0 conn(0x7f7b7c1502b0 legacy=0x7f7b7c074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.009+0000 7f7b7b7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.009+0000 7f7b7b7fe640 1 monclient: found mon.noname-b 2026-02-17T21:07:16.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.009+0000 7f7b7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.009+0000 7f7b7b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.009+0000 7f7b7b7fe640 1 -- 10.20.193.45:0/2772834575 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c0c7e50 con 0x7f7b7c0c9040 2026-02-17T21:07:16.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.011+0000 7f7b7b7fe640 1 --2- 10.20.193.45:0/2772834575 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c0c9040 0x7f7b7c15d000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009d90 tx=0x7f7b6c02f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d77708b431e04f2e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 1 -- 10.20.193.45:0/2772834575 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c03c070 con 0x7f7b7c0c9040 2026-02-17T21:07:16.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 10 monclient: dump: 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.014 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 1 -- 10.20.193.45:0/2772834575 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c037440 con 0x7f7b7c0c9040 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 1 -- 10.20.193.45:0/2772834575 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c037810 con 0x7f7b7c0c9040 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:16.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b79ffb640 10 monclient: dump: 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 5 monclient: authenticate success, global_id 4579 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:16.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 4 set_mon_vals no callback set 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 10 monclient: shutdown 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 1 -- 10.20.193.45:0/2772834575 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c0c9040 msgr2=0x7f7b7c15d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 1 --2- 10.20.193.45:0/2772834575 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c0c9040 0x7f7b7c15d000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009d90 tx=0x7f7b6c02f230 comp rx=0 tx=0).stop 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 1 -- 10.20.193.45:0/2772834575 shutdown_connections 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 1 --2- 10.20.193.45:0/2772834575 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c0c9040 0x7f7b7c15d000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 1 -- 10.20.193.45:0/2772834575 >> 10.20.193.45:0/2772834575 conn(0x7f7b7c0c9d40 msgr2=0x7f7b7c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 1 -- 10.20.193.45:0/2772834575 shutdown_connections 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 1 -- 10.20.193.45:0/2772834575 wait complete. 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.014+0000 7f7b815ed640 10 monclient: monmap: 2026-02-17T21:07:16.017 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 librados: starting msgr at 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 librados: starting objecter 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 Processor -- start 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 -- start start 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 librados: setting wanted keys 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 librados: calling monclient init 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient: init 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b7c0c9040 0x7f7b7c146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient(hunting): picked mon.noname-a con 0x7f7b7c0c9040 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c1502b0 0x7f7b7c1f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient(hunting): picked mon.noname-b con 0x7f7b7c1502b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b7c150690 0x7f7b7c1f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient(hunting): picked mon.noname-c con 0x7f7b7c150690 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c15d540 con 0x7f7b7c0c9040 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c0c8410 con 0x7f7b7c1502b0 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7c15d6c0 con 0x7f7b7c150690 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.015+0000 7f7b815ed640 10 monclient(hunting): authenticate will time out at 1019.645665s 2026-02-17T21:07:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7b7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b7c150690 0x7f7b7c1f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c1502b0 0x7f7b7c1f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7affd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b7c0c9040 0x7f7b7c146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c1502b0 0x7f7b7c1f2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:57952/0 (socket says 10.20.193.45:57952) 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 1 -- 10.20.193.45:0/1986835515 learned_addr learned my addr 10.20.193.45:0/1986835515 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 10 monclient(hunting): get_auth_request con 0x7f7b7c1502b0 auth_method 0 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7b7fe640 10 monclient(hunting): get_auth_request con 0x7f7b7c150690 auth_method 0 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7affd640 10 monclient(hunting): get_auth_request con 0x7f7b7c0c9040 auth_method 0 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.016+0000 7f7b7affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 10 monclient(hunting): handle_auth_done global_id 4582 payload 824 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 1 -- 10.20.193.45:0/1986835515 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b7c150690 msgr2=0x7f7b7c1f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b7c150690 0x7f7b7c1f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 1 -- 10.20.193.45:0/1986835515 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b7c0c9040 msgr2=0x7f7b7c146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b7c0c9040 0x7f7b7c146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 1 monclient: found mon.noname-b 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.017+0000 7f7b7a7fc640 1 -- 10.20.193.45:0/1986835515 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7c149400 con 0x7f7b7c1502b0 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.018+0000 7f7b7a7fc640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c1502b0 0x7f7b7c1f2e60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c4f0 tx=0x7f7b6400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.018+0000 7f7b5b7fe640 10 client.?.objecter ms_handle_connect 0x7f7b7c1502b0 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.018+0000 7f7b5b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 1 -- 10.20.193.45:0/1986835515 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64017070 con 0x7f7b7c1502b0 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 10 monclient: dump: 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.024 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 5 monclient: authenticate success, global_id 4582 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 10 monclient: _renew_subs 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7c1496a0 con 0x7f7b7c1502b0 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 10 client.4582.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 10 monclient: _renew_subs 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7c149c60 con 0x7f7b7c1502b0 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 1 librados: init done 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 1 -- 10.20.193.45:0/1986835515 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b64005de0 con 0x7f7b7c1502b0 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 1 -- 10.20.193.45:0/1986835515 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64021060 con 0x7f7b7c1502b0 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b5b7fe640 10 monclient: dump: 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.026 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.027 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.027 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.027 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b797fa640 4 set_mon_vals no callback set 2026-02-17T21:07:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.020+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b7c1f45a0 con 0x7f7b7c1502b0 2026-02-17T21:07:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.032+0000 7f7b5b7fe640 1 -- 10.20.193.45:0/1986835515 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f7b64024080 con 0x7f7b7c1502b0 2026-02-17T21:07:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.032+0000 7f7b5b7fe640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b48079280 0x7f7b4807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.033+0000 7f7b7affd640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b48079280 0x7f7b4807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.033+0000 7f7b7affd640 10 monclient: get_auth_request con 0x7f7b48079280 auth_method 0 2026-02-17T21:07:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.033+0000 7f7b5b7fe640 10 client.4582.objecter ms_handle_connect 0x7f7b48079280 2026-02-17T21:07:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.033+0000 7f7b7affd640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b48079280 0x7f7b4807b740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b70007fd0 tx=0x7f7b70003d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.034+0000 7f7b5b7fe640 1 -- 10.20.193.45:0/1986835515 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f7b64097220 con 0x7f7b7c1502b0 2026-02-17T21:07:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.034+0000 7f7b5b7fe640 10 client.4582.objecter ms_dispatch2 0x7f7b7c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.034+0000 7f7b5b7fe640 3 client.4582.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.034+0000 7f7b5b7fe640 3 client.4582.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.034+0000 7f7b5b7fe640 20 client.4582.objecter dump_active .. 0 homeless 2026-02-17T21:07:16.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.051+0000 7ff3bd4bd640 10 monclient: get_monmap_and_config 2026-02-17T21:07:16.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.051+0000 7ff3bd4bd640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.051+0000 7ff3bd4bd640 10 monclient: monmap: 2026-02-17T21:07:16.043 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.043 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.043 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:16.052117+0000 2026-02-17T21:07:16.043 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:16.052117+0000 2026-02-17T21:07:16.044 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.044 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.044 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:16.044 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:16.044 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:16.044 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:16.044 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:16.044 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:16.044 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.051+0000 7ff3bd4bd640 1 Processor -- start 2026-02-17T21:07:16.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.051+0000 7ff3bd4bd640 1 -- start start 2026-02-17T21:07:16.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.051+0000 7ff3bd4bd640 10 monclient: init 2026-02-17T21:07:16.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 10 monclient: _add_conns ranks=[5,2,4,3,0,1] 2026-02-17T21:07:16.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff3b8155e40 0x7ff3b8074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 10 monclient(hunting): picked mon.noname-c con 0x7ff3b8155e40 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:16.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff3b8156220 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff3b80cd290 0x7ff3b8074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 10 monclient(hunting): picked mon.noname-b con 0x7ff3b80cd290 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b80734e0 con 0x7ff3b8156220 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b80cd800 con 0x7ff3b80cd290 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b80737c0 con 0x7ff3b8155e40 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.052+0000 7ff3bd4bd640 10 monclient(hunting): authenticate will time out at 1019.682598s 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.053+0000 7ff3b67fc640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7ff3b8156220 0x7ff3b80ccb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47772/0 (socket says 10.20.193.45:47772) 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.053+0000 7ff3b67fc640 1 -- 10.20.193.45:0/1778224860 learned_addr learned my addr 10.20.193.45:0/1778224860 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.053+0000 7ff3b6ffd640 1 --2- 10.20.193.45:0/1778224860 >> v2:10.20.193.92:3300/0 conn(0x7ff3b8155e40 0x7ff3b8074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.053+0000 7ff3b6ffd640 10 monclient(hunting): get_auth_request con 0x7ff3b8155e40 auth_method 0 2026-02-17T21:07:16.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.053+0000 7ff3b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.053+0000 7ff3b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.053+0000 7ff3b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.054+0000 7ff3b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.054+0000 7ff3b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.054+0000 7ff3b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.055+0000 7ff3b6ffd640 10 monclient(hunting): handle_auth_done global_id 4616 payload 274 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.055+0000 7ff3b6ffd640 1 -- 10.20.193.45:0/1778224860 >> v2:10.20.193.86:3300/0 conn(0x7ff3b80cd290 msgr2=0x7ff3b8074ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.055+0000 7ff3b6ffd640 1 --2- 10.20.193.45:0/1778224860 >> v2:10.20.193.86:3300/0 conn(0x7ff3b80cd290 0x7ff3b8074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.055+0000 7ff3b6ffd640 1 -- 10.20.193.45:0/1778224860 >> v1:10.20.193.92:6789/0 conn(0x7ff3b8156220 legacy=0x7ff3b80ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.055+0000 7ff3b6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.055+0000 7ff3b6ffd640 1 monclient: found mon.noname-c 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.055+0000 7ff3b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.055+0000 7ff3b6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.055+0000 7ff3b6ffd640 1 -- 10.20.193.45:0/1778224860 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b8073aa0 con 0x7ff3b8155e40 2026-02-17T21:07:16.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.056+0000 7ff3b6ffd640 1 --2- 10.20.193.45:0/1778224860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 0x7ff3b8074580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3b806cf60 tx=0x7ff3ac02ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71599fd5a0b430ba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 1 -- 10.20.193.45:0/1778224860 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac03c070 con 0x7ff3b8155e40 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 10 monclient: dump: 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.054 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 1 -- 10.20.193.45:0/1778224860 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac02faf0 con 0x7ff3b8155e40 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3bd4bd640 5 monclient: authenticate success, global_id 4616 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3bd4bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 1 -- 10.20.193.45:0/1778224860 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac037440 con 0x7ff3b8155e40 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.058+0000 7ff3b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3b5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3b5ffb640 10 monclient: dump: 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.056 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 4 set_mon_vals no callback set 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 10 monclient: shutdown 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/1778224860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 msgr2=0x7ff3b8074580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 --2- 10.20.193.45:0/1778224860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 0x7ff3b8074580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff3b806cf60 tx=0x7ff3ac02ede0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/1778224860 shutdown_connections 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 --2- 10.20.193.45:0/1778224860 >> v2:10.20.193.86:3300/0 conn(0x7ff3b80cd290 0x7ff3b8074ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 --2- 10.20.193.45:0/1778224860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 0x7ff3b8074580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/1778224860 >> 10.20.193.45:0/1778224860 conn(0x7ff3b80ce270 msgr2=0x7ff3b80ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/1778224860 shutdown_connections 2026-02-17T21:07:16.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/1778224860 wait complete. 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 10 monclient: monmap: 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 librados: starting msgr at 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 librados: starting objecter 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.059+0000 7ff3bd4bd640 1 Processor -- start 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 1 -- start start 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 1 librados: setting wanted keys 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 1 librados: calling monclient init 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient: init 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff3b80cd290 0x7ff3b81f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient(hunting): picked mon.noname-b con 0x7ff3b80cd290 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 0x7ff3b80c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient(hunting): picked mon.noname-c con 0x7ff3b8155e40 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3b8156220 0x7ff3b815e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient(hunting): picked mon.noname-a con 0x7ff3b8156220 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b80c4830 con 0x7ff3b8156220 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b8074060 con 0x7ff3b80cd290 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b80c49b0 con 0x7ff3b8155e40 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3bd4bd640 10 monclient(hunting): authenticate will time out at 1019.690418s 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3b67fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 0x7ff3b80c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3b77fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3b8156220 0x7ff3b815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3b67fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 0x7ff3b80c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36690/0 (socket says 10.20.193.45:36690) 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3b67fc640 1 -- 10.20.193.45:0/4169206402 learned_addr learned my addr 10.20.193.45:0/4169206402 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3b67fc640 10 monclient(hunting): get_auth_request con 0x7ff3b8155e40 auth_method 0 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.060+0000 7ff3b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b77fe640 10 monclient(hunting): get_auth_request con 0x7ff3b8156220 auth_method 0 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.061+0000 7ff3b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 10 monclient(hunting): handle_auth_done global_id 4622 payload 824 2026-02-17T21:07:16.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 1 -- 10.20.193.45:0/4169206402 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff3b80cd290 msgr2=0x7ff3b81f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff3b80cd290 0x7ff3b81f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 1 -- 10.20.193.45:0/4169206402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3b8156220 msgr2=0x7ff3b815e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3b8156220 0x7ff3b815e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 1 monclient: found mon.noname-c 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.062+0000 7ff3b67fc640 1 -- 10.20.193.45:0/4169206402 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b8146640 con 0x7ff3b8155e40 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.063+0000 7ff3b67fc640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 0x7ff3b80c7ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000c500 tx=0x7ff3a000c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.063+0000 7ff3977fe640 10 client.?.objecter ms_handle_connect 0x7ff3b8155e40 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.063+0000 7ff3977fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 1 -- 10.20.193.45:0/4169206402 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0017070 con 0x7ff3b8155e40 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 10 monclient: dump: 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.065 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 1 -- 10.20.193.45:0/4169206402 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a0005e00 con 0x7ff3b8155e40 2026-02-17T21:07:16.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 1 -- 10.20.193.45:0/4169206402 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00072b0 con 0x7ff3b8155e40 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3b57fa640 4 set_mon_vals no callback set 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3977fe640 10 monclient: dump: 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.067 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3bd4bd640 5 monclient: authenticate success, global_id 4622 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3bd4bd640 10 monclient: _renew_subs 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3bd4bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b81f4b00 con 0x7ff3b8155e40 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3bd4bd640 10 client.4622.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3bd4bd640 10 monclient: _renew_subs 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3bd4bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b815d730 con 0x7ff3b8155e40 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.065+0000 7ff3bd4bd640 1 librados: init done 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.066+0000 7ff3bd4bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.066+0000 7ff3bd4bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.066+0000 7ff3bd4bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.066+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b80ccb80 con 0x7ff3b8155e40 2026-02-17T21:07:16.069 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-17T21:07:16.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.075+0000 7f1c7bc45640 10 monclient: get_monmap_and_config 2026-02-17T21:07:16.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.075+0000 7f1c7bc45640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.075+0000 7f1c7bc45640 10 monclient: monmap: 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:16.076366+0000 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:16.076366+0000 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.075+0000 7f1c7bc45640 1 Processor -- start 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 1 -- start start 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 10 monclient: init 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 10 monclient: _add_conns ranks=[5,0,2,4,3,1] 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f1c741502b0 0x7f1c74074730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 10 monclient(hunting): picked mon.noname-c con 0x7f1c741502b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1c74150690 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1c740c9040 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c740c5340 con 0x7f1c74150690 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c740c5620 con 0x7f1c740c9040 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f1c740c7e50 con 0x7f1c741502b0 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.076+0000 7f1c7bc45640 10 monclient(hunting): authenticate will time out at 1019.706721s 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.077+0000 7f1c791b9640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f1c74150690 0x7f1c740c8930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46310/0 (socket says 10.20.193.45:46310) 2026-02-17T21:07:16.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.077+0000 7f1c791b9640 1 -- 10.20.193.45:0/3550116514 learned_addr learned my addr 10.20.193.45:0/3550116514 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:16.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.077+0000 7ff3977fe640 1 -- 10.20.193.45:0/4169206402 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff3a0007510 con 0x7ff3b8155e40 2026-02-17T21:07:16.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.077+0000 7ff3977fe640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff384079280 0x7ff38407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.077+0000 7ff3b6ffd640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff384079280 0x7ff38407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.077+0000 7ff3b6ffd640 10 monclient: get_auth_request con 0x7ff384079280 auth_method 0 2026-02-17T21:07:16.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.077+0000 7ff3977fe640 10 client.4622.objecter ms_handle_connect 0x7ff384079280 2026-02-17T21:07:16.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.077+0000 7ff3b6ffd640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff384079280 0x7ff38407b740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac039000 tx=0x7ff3ac031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347001075 0 0) 0x7f1c740c5340 con 0x7f1c74150690 2026-02-17T21:07:16.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7f1c789b8640 10 monclient(hunting): _negotiate 2026-02-17T21:07:16.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7f1c789b8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7f1c789b8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7f1c789b8640 10 monclient(hunting): my global_id is 4524 2026-02-17T21:07:16.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c5c003620 con 0x7f1c74150690 2026-02-17T21:07:16.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7ff3977fe640 1 -- 10.20.193.45:0/4169206402 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7ff3a005d570 con 0x7ff3b8155e40 2026-02-17T21:07:16.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7ff3977fe640 10 client.4622.objecter ms_dispatch2 0x7ff3b8000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:16.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7ff3977fe640 3 client.4622.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:16.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7ff3977fe640 3 client.4622.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:16.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7ff3977fe640 20 client.4622.objecter dump_active .. 0 homeless 2026-02-17T21:07:16.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.078+0000 7f1c799ba640 1 --2- 10.20.193.45:0/3550116514 >> v2:10.20.193.92:3300/0 conn(0x7f1c741502b0 0x7f1c74074730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3935502169 0 0) 0x7f1c5c003620 con 0x7f1c74150690 2026-02-17T21:07:16.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 >> v2:10.20.193.92:3300/0 conn(0x7f1c741502b0 msgr2=0x7f1c74074730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 --2- 10.20.193.45:0/3550116514 >> v2:10.20.193.92:3300/0 conn(0x7f1c741502b0 0x7f1c74074730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 >> v1:10.20.193.92:6789/0 conn(0x7f1c740c9040 legacy=0x7f1c7415d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:07:16.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.45:6789/0 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c740c8130 con 0x7f1c74150690 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f1c68002f00 con 0x7f1c74150690 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient: dump: 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.078 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] but i'm connected to v1:10.20.193.45:6789/0, reconnecting 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 >> v1:10.20.193.45:6789/0 conn(0x7f1c74150690 legacy=0x7f1c740c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 --2- 10.20.193.45:0/3550116514 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c5c003ba0 0x7f1c5c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient(hunting): picked mon.a con 0x7f1c5c003ba0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 --2- 10.20.193.45:0/3550116514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c5c004900 0x7f1c5c004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient(hunting): picked mon.c con 0x7f1c5c004900 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 --2- 10.20.193.45:0/3550116514 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c5c005510 0x7f1c5c00bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient(hunting): picked mon.b con 0x7f1c5c005510 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1c740c7e50 con 0x7f1c5c003ba0 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c00c450 con 0x7f1c5c005510 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5c00c650 con 0x7f1c5c004900 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.080+0000 7f1c789b8640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:07:16.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.081+0000 7f1c799ba640 1 --2- 10.20.193.45:0/3550116514 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c5c003ba0 0x7f1c5c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.081+0000 7f1c799ba640 10 monclient(hunting): get_auth_request con 0x7f1c5c003ba0 auth_method 0 2026-02-17T21:07:16.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.081+0000 7f1c799ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.081+0000 7f1c799ba640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.081+0000 7f1c799ba640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:07:16.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.081+0000 7f1c799ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.081+0000 7f1c799ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.081+0000 7f1c799ba640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 10 monclient(hunting): handle_auth_done global_id 4524 payload 293 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 1 -- 10.20.193.45:0/3550116514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c5c004900 msgr2=0x7f1c5c004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 1 --2- 10.20.193.45:0/3550116514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c5c004900 0x7f1c5c004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 1 -- 10.20.193.45:0/3550116514 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c5c005510 msgr2=0x7f1c5c00bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 1 --2- 10.20.193.45:0/3550116514 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c5c005510 0x7f1c5c00bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 1 monclient: found mon.a 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 1 -- 10.20.193.45:0/3550116514 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5c003620 con 0x7f1c5c003ba0 2026-02-17T21:07:16.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c799ba640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c7a1bb640 1 -- 10.20.193.45:0/3550116514 reap_dead start 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c7bc45640 5 monclient: authenticate success, global_id 4524 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.083+0000 7f1c7bc45640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.084+0000 7f1c799ba640 1 --2- 10.20.193.45:0/3550116514 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c5c003ba0 0x7f1c5c003fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400aaa0 tx=0x7f1c6402f020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b482d4c722f10 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6403c070 con 0x7f1c5c003ba0 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 10 monclient: dump: 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c6402fa40 con 0x7f1c5c003ba0 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c7bc45640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 1 -- 10.20.193.45:0/3550116514 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400a670 con 0x7f1c5c003ba0 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c789b8640 10 monclient: dump: 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c7bc45640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.085+0000 7f1c7bc45640 4 set_mon_vals no callback set 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 10 monclient: shutdown 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 1 -- 10.20.193.45:0/3550116514 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c5c003ba0 msgr2=0x7f1c5c003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 1 --2- 10.20.193.45:0/3550116514 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c5c003ba0 0x7f1c5c003fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400aaa0 tx=0x7f1c6402f020 comp rx=0 tx=0).stop 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 1 -- 10.20.193.45:0/3550116514 shutdown_connections 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 1 --2- 10.20.193.45:0/3550116514 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c5c003ba0 0x7f1c5c003fa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 1 -- 10.20.193.45:0/3550116514 >> 10.20.193.45:0/3550116514 conn(0x7f1c740c9d40 msgr2=0x7f1c740ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 1 -- 10.20.193.45:0/3550116514 shutdown_connections 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 1 -- 10.20.193.45:0/3550116514 wait complete. 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.086+0000 7f1c7bc45640 10 monclient: monmap: 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 librados: starting msgr at 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 librados: starting objecter 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 Processor -- start 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 -- start start 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 librados: setting wanted keys 2026-02-17T21:07:16.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 librados: calling monclient init 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient: init 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c5c003ba0 0x7f1c741f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient(hunting): picked mon.noname-c con 0x7f1c5c003ba0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c74142680 0x7f1c7415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient(hunting): picked mon.noname-b con 0x7f1c74142680 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c74142b00 0x7f1c7415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient(hunting): picked mon.noname-a con 0x7f1c74142b00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1c740c8ab0 con 0x7f1c74142b00 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1c740c8930 con 0x7f1c74142680 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c740c8c30 con 0x7f1c5c003ba0 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7bc45640 10 monclient(hunting): authenticate will time out at 1019.717698s 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.087+0000 7f1c7a1bb640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c74142b00 0x7f1c7415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.088+0000 7f1c7a1bb640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c74142b00 0x7f1c7415d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42334/0 (socket says 10.20.193.45:42334) 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.088+0000 7f1c7a1bb640 1 -- 10.20.193.45:0/1425053008 learned_addr learned my addr 10.20.193.45:0/1425053008 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.088+0000 7f1c7a1bb640 10 monclient(hunting): get_auth_request con 0x7f1c74142b00 auth_method 0 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.088+0000 7f1c7a1bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.088+0000 7f1c7a1bb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.088+0000 7f1c7a1bb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.088+0000 7f1c7a1bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.088+0000 7f1c7a1bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.088+0000 7f1c7a1bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 10 monclient(hunting): handle_auth_done global_id 4527 payload 824 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 1 -- 10.20.193.45:0/1425053008 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c5c003ba0 msgr2=0x7f1c741f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c5c003ba0 0x7f1c741f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 1 -- 10.20.193.45:0/1425053008 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c74142680 msgr2=0x7f1c7415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c74142680 0x7f1c7415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 1 monclient: found mon.noname-a 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.089+0000 7f1c7a1bb640 1 -- 10.20.193.45:0/1425053008 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c74140ca0 con 0x7f1c74142b00 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.090+0000 7f1c7a1bb640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c74142b00 0x7f1c7415d3a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c74076d20 tx=0x7f1c7000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.090+0000 7f1c627fc640 10 client.?.objecter ms_handle_connect 0x7f1c74142b00 2026-02-17T21:07:16.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.090+0000 7f1c627fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:16.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 1 -- 10.20.193.45:0/1425053008 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000aa30 con 0x7f1c74142b00 2026-02-17T21:07:16.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:16.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 10 monclient: dump: 2026-02-17T21:07:16.089 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.089 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.089 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.089 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 1 -- 10.20.193.45:0/1425053008 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7000abd0 con 0x7f1c74142b00 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 5 monclient: authenticate success, global_id 4527 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 10 monclient: _renew_subs 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7415c0a0 con 0x7f1c74142b00 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 1 -- 10.20.193.45:0/1425053008 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70014420 con 0x7f1c74142b00 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c627fc640 10 monclient: dump: 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.090 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c63fff640 4 set_mon_vals no callback set 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 10 client.4527.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 10 monclient: _renew_subs 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c7415c660 con 0x7f1c74142b00 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 1 librados: init done 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.092+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c740698c0 con 0x7f1c74142b00 2026-02-17T21:07:16.096 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-17T21:07:16.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.104+0000 7f1c627fc640 1 -- 10.20.193.45:0/1425053008 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f1c70007030 con 0x7f1c74142b00 2026-02-17T21:07:16.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.105+0000 7f1c627fc640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c44079280 0x7f1c4407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.105+0000 7f1c799ba640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c44079280 0x7f1c4407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.105+0000 7f1c799ba640 10 monclient: get_auth_request con 0x7f1c44079280 auth_method 0 2026-02-17T21:07:16.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.105+0000 7f1c799ba640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c44079280 0x7f1c4407b740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1c64039000 tx=0x7f1c64031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.105+0000 7f1c627fc640 10 client.4527.objecter ms_handle_connect 0x7f1c44079280 2026-02-17T21:07:16.127 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-17T21:07:16.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.135+0000 7f7b5b7fe640 1 -- 10.20.193.45:0/1986835515 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7b7c1f45a0 con 0x7f7b7c1502b0 2026-02-17T21:07:16.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.136+0000 7f7b5b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.136+0000 7f7b5b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:16.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.150+0000 7f9c5368f640 10 monclient: get_monmap_and_config 2026-02-17T21:07:16.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.150+0000 7f9c5368f640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.150+0000 7f9c5368f640 10 monclient: monmap: 2026-02-17T21:07:16.142 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:16.151443+0000 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:16.151443+0000 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:16.143 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 1 Processor -- start 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 1 -- start start 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient: init 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient: _add_conns ranks=[5,4,3,1,2,0] 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9c4c15f530 0x7f9c4c15f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient(hunting): picked mon.noname-c con 0x7f9c4c15f530 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f9c4c0704a0 0x7f9c4c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient(hunting): picked mon.noname-b con 0x7f9c4c0704a0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f9c4c15a460 0x7f9c4c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient(hunting): picked mon.noname-a con 0x7f9c4c15a460 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f9c4c15a8f0 con 0x7f9c4c15a460 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f9c4c15e130 con 0x7f9c4c0704a0 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f9c4c15e410 con 0x7f9c4c15f530 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.151+0000 7f9c5368f640 10 monclient(hunting): authenticate will time out at 1019.781721s 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f9c4c0704a0 0x7f9c4c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f9c4c0704a0 0x7f9c4c159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:58008/0 (socket says 10.20.193.45:58008) 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 1 -- 10.20.193.45:0/3417346894 learned_addr learned my addr 10.20.193.45:0/3417346894 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 10 monclient(hunting): get_auth_request con 0x7f9c4c0704a0 auth_method 0 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.152+0000 7f9c50c03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 10 monclient(hunting): handle_auth_done global_id 4585 payload 274 2026-02-17T21:07:16.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 1 -- 10.20.193.45:0/3417346894 >> v2:10.20.193.92:3300/0 conn(0x7f9c4c15f530 msgr2=0x7f9c4c15f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 1 --2- 10.20.193.45:0/3417346894 >> v2:10.20.193.92:3300/0 conn(0x7f9c4c15f530 0x7f9c4c15f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 1 -- 10.20.193.45:0/3417346894 >> v2:10.20.193.45:3300/0 conn(0x7f9c4c15a460 msgr2=0x7f9c4c1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 1 --2- 10.20.193.45:0/3417346894 >> v2:10.20.193.45:3300/0 conn(0x7f9c4c15a460 0x7f9c4c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 1 monclient: found mon.noname-b 2026-02-17T21:07:16.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.153+0000 7f9c50c03640 1 -- 10.20.193.45:0/3417346894 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c15e6f0 con 0x7f9c4c0704a0 2026-02-17T21:07:16.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.154+0000 7f9c50c03640 1 --2- 10.20.193.45:0/3417346894 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 0x7f9c4c159f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0c9b30 tx=0x7f9c4002ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff6031ae8b3ec1ad server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 1 -- 10.20.193.45:0/3417346894 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4003c070 con 0x7f9c4c0704a0 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 10 monclient: dump: 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.149 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 1 -- 10.20.193.45:0/3417346894 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4002fb50 con 0x7f9c4c0704a0 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 1 -- 10.20.193.45:0/3417346894 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c40037440 con 0x7f9c4c0704a0 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 5 monclient: authenticate success, global_id 4585 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 4 set_mon_vals no callback set 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c3bfff640 10 monclient: dump: 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.150 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 10 monclient: shutdown 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 1 -- 10.20.193.45:0/3417346894 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 msgr2=0x7f9c4c159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 1 --2- 10.20.193.45:0/3417346894 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 0x7f9c4c159f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0c9b30 tx=0x7f9c4002ee90 comp rx=0 tx=0).stop 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 1 -- 10.20.193.45:0/3417346894 shutdown_connections 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 1 --2- 10.20.193.45:0/3417346894 >> v2:10.20.193.45:3300/0 conn(0x7f9c4c15a460 0x7f9c4c1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 1 --2- 10.20.193.45:0/3417346894 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 0x7f9c4c159f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 1 --2- 10.20.193.45:0/3417346894 >> v2:10.20.193.92:3300/0 conn(0x7f9c4c15f530 0x7f9c4c15f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 1 -- 10.20.193.45:0/3417346894 >> 10.20.193.45:0/3417346894 conn(0x7f9c4c0cf510 msgr2=0x7f9c4c0cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 1 -- 10.20.193.45:0/3417346894 shutdown_connections 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.156+0000 7f9c5368f640 1 -- 10.20.193.45:0/3417346894 wait complete. 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.157+0000 7f9c5368f640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.157+0000 7f9c5368f640 10 monclient: monmap: 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:16.152 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.157+0000 7f9c5368f640 1 librados: starting msgr at 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.157+0000 7f9c5368f640 1 librados: starting objecter 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.157+0000 7f9c5368f640 1 Processor -- start 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.157+0000 7f9c5368f640 1 -- start start 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.157+0000 7f9c5368f640 1 librados: setting wanted keys 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.157+0000 7f9c5368f640 1 librados: calling monclient init 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.157+0000 7f9c5368f640 10 monclient: init 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 0x7f9c4c1f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient(hunting): picked mon.noname-b con 0x7f9c4c0704a0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c4c15a460 0x7f9c4c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient(hunting): picked mon.noname-c con 0x7f9c4c15a460 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c4c15f530 0x7f9c4c154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient(hunting): picked mon.noname-a con 0x7f9c4c15f530 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c15ef90 con 0x7f9c4c15f530 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c15ecb0 con 0x7f9c4c0704a0 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c155f00 con 0x7f9c4c15a460 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c5368f640 10 monclient(hunting): authenticate will time out at 1019.788053s 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 0x7f9c4c1f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 0x7f9c4c1f4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:58020/0 (socket says 10.20.193.45:58020) 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 1 -- 10.20.193.45:0/1869695421 learned_addr learned my addr 10.20.193.45:0/1869695421 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 10 monclient(hunting): get_auth_request con 0x7f9c4c0704a0 auth_method 0 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.158+0000 7f9c51404640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 10 monclient(hunting): handle_auth_done global_id 4588 payload 824 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 1 -- 10.20.193.45:0/1869695421 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c4c15a460 msgr2=0x7f9c4c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c4c15a460 0x7f9c4c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 1 -- 10.20.193.45:0/1869695421 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c4c15f530 msgr2=0x7f9c4c154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c4c15f530 0x7f9c4c154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 1 monclient: found mon.noname-b 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 1 -- 10.20.193.45:0/1869695421 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c14ef00 con 0x7f9c4c0704a0 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c51404640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 0x7f9c4c1f4050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00b500 tx=0x7f9c3c00b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c39ffb640 10 client.?.objecter ms_handle_connect 0x7f9c4c0704a0 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.160+0000 7f9c39ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c39ffb640 1 -- 10.20.193.45:0/1869695421 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c004480 con 0x7f9c4c0704a0 2026-02-17T21:07:16.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c39ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c39ffb640 10 monclient: dump: 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c39ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c39ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c39ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c5368f640 5 monclient: authenticate success, global_id 4588 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c5368f640 10 monclient: _renew_subs 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c5368f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4c1f4920 con 0x7f9c4c0704a0 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c5368f640 10 client.4588.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c5368f640 10 monclient: _renew_subs 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c5368f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4c14f1a0 con 0x7f9c4c0704a0 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.161+0000 7f9c5368f640 1 librados: init done 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c5368f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c5368f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c5368f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4c1562b0 con 0x7f9c4c0704a0 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c39ffb640 1 -- 10.20.193.45:0/1869695421 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3c014070 con 0x7f9c4c0704a0 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c39ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c39ffb640 1 -- 10.20.193.45:0/1869695421 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c002900 con 0x7f9c4c0704a0 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c39ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c39ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c3b7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:16.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.162+0000 7f9c39ffb640 10 monclient: dump: 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.160 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.173+0000 7f9add30f640 10 monclient: get_monmap_and_config 2026-02-17T21:07:16.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.173+0000 7f9add30f640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.173+0000 7f9add30f640 10 monclient: monmap: 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:16.174545+0000 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:16.174545+0000 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:16.166 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:16.167 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:16.167 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:16.167 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 1 Processor -- start 2026-02-17T21:07:16.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 1 -- start start 2026-02-17T21:07:16.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient: init 2026-02-17T21:07:16.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient: _add_conns ranks=[1,5,3,0,2,4] 2026-02-17T21:07:16.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f9ad8152620 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:16.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9ad815aff0 0x7f9ad80c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient(hunting): picked mon.noname-c con 0x7f9ad815aff0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:16.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f9ad8152a00 0x7f9ad80c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient(hunting): picked mon.noname-a con 0x7f9ad8152a00 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:16.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad80c71a0 con 0x7f9ad8152620 2026-02-17T21:07:16.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad80c7760 con 0x7f9ad8152a00 2026-02-17T21:07:16.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad80c7480 con 0x7f9ad815aff0 2026-02-17T21:07:16.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.174+0000 7f9add30f640 10 monclient(hunting): authenticate will time out at 1019.804814s 2026-02-17T21:07:16.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.181+0000 7ff3977fe640 1 -- 10.20.193.45:0/4169206402 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff3a0021080 con 0x7ff3b8155e40 2026-02-17T21:07:16.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.181+0000 7ff3977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.181+0000 7ff3977fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:16.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9ad815aff0 0x7f9ad80c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f9ad815aff0 0x7f9ad80c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36758/0 (socket says 10.20.193.45:36758) 2026-02-17T21:07:16.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 1 -- 10.20.193.45:0/1196942430 learned_addr learned my addr 10.20.193.45:0/1196942430 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 10 monclient(hunting): get_auth_request con 0x7f9ad815aff0 auth_method 0 2026-02-17T21:07:16.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.185+0000 7f9ad67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.186+0000 7f9ad67fc640 10 monclient(hunting): handle_auth_done global_id 4625 payload 274 2026-02-17T21:07:16.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.186+0000 7f9ad67fc640 1 -- 10.20.193.45:0/1196942430 >> v2:10.20.193.45:3300/0 conn(0x7f9ad8152a00 msgr2=0x7f9ad80c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.186+0000 7f9ad67fc640 1 --2- 10.20.193.45:0/1196942430 >> v2:10.20.193.45:3300/0 conn(0x7f9ad8152a00 0x7f9ad80c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.186+0000 7f9ad67fc640 1 -- 10.20.193.45:0/1196942430 >> v1:10.20.193.86:6789/0 conn(0x7f9ad8152620 legacy=0x7f9ad815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.186+0000 7f9ad67fc640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.186+0000 7f9ad67fc640 1 monclient: found mon.noname-c 2026-02-17T21:07:16.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.186+0000 7f9ad67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.186+0000 7f9ad67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.186+0000 7f9ad67fc640 1 -- 10.20.193.45:0/1196942430 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad8159e00 con 0x7f9ad815aff0 2026-02-17T21:07:16.180 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-17T21:07:16.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.187+0000 7f9ad67fc640 1 --2- 10.20.193.45:0/1196942430 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad815aff0 0x7f9ad80c8d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8072110 tx=0x7f9ac002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7124fdf322a67d8b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 1 -- 10.20.193.45:0/1196942430 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac003c070 con 0x7f9ad815aff0 2026-02-17T21:07:16.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 10 monclient: dump: 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 1 -- 10.20.193.45:0/1196942430 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac002fb20 con 0x7f9ad815aff0 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 1 -- 10.20.193.45:0/1196942430 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0037440 con 0x7f9ad815aff0 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 5 monclient: authenticate success, global_id 4625 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 4 set_mon_vals no callback set 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9ad5ffb640 10 monclient: dump: 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.183 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.184 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.184 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.184 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.184 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.184 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 10 monclient: shutdown 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 1 -- 10.20.193.45:0/1196942430 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad815aff0 msgr2=0x7f9ad80c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 1 --2- 10.20.193.45:0/1196942430 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad815aff0 0x7f9ad80c8d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8072110 tx=0x7f9ac002eeb0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 1 -- 10.20.193.45:0/1196942430 shutdown_connections 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 1 --2- 10.20.193.45:0/1196942430 >> v2:10.20.193.45:3300/0 conn(0x7f9ad8152a00 0x7f9ad80c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 1 --2- 10.20.193.45:0/1196942430 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad815aff0 0x7f9ad80c8d90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 1 -- 10.20.193.45:0/1196942430 >> 10.20.193.45:0/1196942430 conn(0x7f9ad80c9d40 msgr2=0x7f9ad80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 1 -- 10.20.193.45:0/1196942430 shutdown_connections 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 1 -- 10.20.193.45:0/1196942430 wait complete. 2026-02-17T21:07:16.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.189+0000 7f9add30f640 10 monclient: monmap: 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 librados: starting msgr at 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 librados: starting objecter 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 Processor -- start 2026-02-17T21:07:16.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 -- start start 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 librados: setting wanted keys 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 librados: calling monclient init 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient: init 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad8152620 0x7f9ad8072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient(hunting): picked mon.noname-c con 0x7f9ad8152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9ad8152a00 0x7f9ad81f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient(hunting): picked mon.noname-b con 0x7f9ad8152a00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9ad815aff0 0x7f9ad814fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient(hunting): picked mon.noname-a con 0x7f9ad815aff0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad80c7c40 con 0x7f9ad815aff0 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad815a3c0 con 0x7f9ad8152a00 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad80c7dc0 con 0x7f9ad8152620 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9add30f640 10 monclient(hunting): authenticate will time out at 1019.820534s 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.190+0000 7f9ad6ffd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad8152620 0x7f9ad8072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.191+0000 7f9ad6ffd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad8152620 0x7f9ad8072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36764/0 (socket says 10.20.193.45:36764) 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.191+0000 7f9ad6ffd640 1 -- 10.20.193.45:0/3102762476 learned_addr learned my addr 10.20.193.45:0/3102762476 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.191+0000 7f9ad6ffd640 10 monclient(hunting): get_auth_request con 0x7f9ad8152620 auth_method 0 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.191+0000 7f9ad6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.191+0000 7f9ad6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.191+0000 7f9ad6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.191+0000 7f9ad6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.191+0000 7f9ad6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.191+0000 7f9ad6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 10 monclient(hunting): handle_auth_done global_id 4628 payload 824 2026-02-17T21:07:16.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 1 -- 10.20.193.45:0/3102762476 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9ad8152a00 msgr2=0x7f9ad81f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9ad8152a00 0x7f9ad81f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 1 -- 10.20.193.45:0/3102762476 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9ad815aff0 msgr2=0x7f9ad814fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9ad815aff0 0x7f9ad814fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 1 monclient: found mon.noname-c 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.192+0000 7f9ad6ffd640 1 -- 10.20.193.45:0/3102762476 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad8073e10 con 0x7f9ad8152620 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.193+0000 7f9ad6ffd640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad8152620 0x7f9ad8072490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00b5a0 tx=0x7f9acc00ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.193+0000 7f9ab77fe640 10 client.?.objecter ms_handle_connect 0x7f9ad8152620 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.193+0000 7f9ab77fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 1 -- 10.20.193.45:0/3102762476 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc012070 con 0x7f9ad8152620 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:16.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 10 monclient: dump: 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 1 -- 10.20.193.45:0/3102762476 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc0044a0 con 0x7f9ad8152620 2026-02-17T21:07:16.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 1 -- 10.20.193.45:0/3102762476 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0029c0 con 0x7f9ad8152620 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ab77fe640 10 monclient: dump: 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9ad57fa640 4 set_mon_vals no callback set 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 5 monclient: authenticate success, global_id 4628 2026-02-17T21:07:16.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 10 monclient: _renew_subs 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad8072ab0 con 0x7f9ad8152620 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 10 client.4628.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 10 monclient: _renew_subs 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad8073070 con 0x7f9ad8152620 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 1 librados: init done 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.195+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad815a8e0 con 0x7f9ad8152620 2026-02-17T21:07:16.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.201+0000 7fb5e901b640 10 monclient: get_monmap_and_config 2026-02-17T21:07:16.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.201+0000 7fb5e901b640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.201+0000 7fb5e901b640 10 monclient: monmap: 2026-02-17T21:07:16.196 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:16.202668+0000 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:16.202668+0000 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 1 Processor -- start 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 1 -- start start 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient: init 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient: _add_conns ranks=[5,0,3,4,1,2] 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fb5e415d1e0 0x7fb5e415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient(hunting): picked mon.noname-c con 0x7fb5e415d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb5e40748e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fb5e40c92b0 0x7fb5e4153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient(hunting): picked mon.noname-a con 0x7fb5e40c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e40c5860 con 0x7fb5e40748e0 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e40c5580 con 0x7fb5e40c92b0 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e40c7de0 con 0x7fb5e415d1e0 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.202+0000 7fb5e901b640 10 monclient(hunting): authenticate will time out at 1019.832800s 2026-02-17T21:07:16.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.213+0000 7f1c627fc640 1 -- 10.20.193.45:0/1425053008 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f1c7005df90 con 0x7f1c74142b00 2026-02-17T21:07:16.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.213+0000 7f1c627fc640 10 client.4527.objecter ms_dispatch2 0x7f1c74000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:16.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.213+0000 7f1c627fc640 3 client.4527.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:16.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.213+0000 7f1c627fc640 3 client.4527.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:16.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.213+0000 7f1c627fc640 20 client.4527.objecter dump_active .. 0 homeless 2026-02-17T21:07:16.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.213+0000 7f1c627fc640 1 -- 10.20.193.45:0/1425053008 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1c740698c0 con 0x7f1c74142b00 2026-02-17T21:07:16.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.213+0000 7f1c627fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.213+0000 7f1c627fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:16.207 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-17T21:07:16.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.217+0000 7fb5e2575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fb5e40748e0 0x7fb5e40c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46318/0 (socket says 10.20.193.45:46318) 2026-02-17T21:07:16.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.217+0000 7fb5e2575640 1 -- 10.20.193.45:0/1447815114 learned_addr learned my addr 10.20.193.45:0/1447815114 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:16.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.218+0000 7fb5e3577640 1 --2- 10.20.193.45:0/1447815114 >> v2:10.20.193.45:3300/0 conn(0x7fb5e40c92b0 0x7fb5e4153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.218+0000 7fb5e3577640 10 monclient(hunting): get_auth_request con 0x7fb5e40c92b0 auth_method 0 2026-02-17T21:07:16.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.218+0000 7fb5e3577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.218+0000 7fb5e3577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.218+0000 7fb5e3577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.219+0000 7fb5e3577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.219+0000 7fb5e3577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.219+0000 7fb5e3577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.220+0000 7fb5e1d74640 1 -- 10.20.193.45:0/1447815114 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538002509 0 0) 0x7fb5e40c5860 con 0x7fb5e40748e0 2026-02-17T21:07:16.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.220+0000 7fb5e1d74640 10 monclient(hunting): _negotiate 2026-02-17T21:07:16.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.220+0000 7fb5e1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.220+0000 7fb5e1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.220+0000 7fb5e1d74640 10 monclient(hunting): my global_id is 4530 2026-02-17T21:07:16.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.220+0000 7fb5e1d74640 1 -- 10.20.193.45:0/1447815114 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5d0003620 con 0x7fb5e40748e0 2026-02-17T21:07:16.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7fb5e3577640 10 monclient(hunting): handle_auth_done global_id 4533 payload 274 2026-02-17T21:07:16.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7fb5e3577640 1 -- 10.20.193.45:0/1447815114 >> v2:10.20.193.92:3300/0 conn(0x7fb5e415d1e0 msgr2=0x7fb5e415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7fb5e3577640 1 --2- 10.20.193.45:0/1447815114 >> v2:10.20.193.92:3300/0 conn(0x7fb5e415d1e0 0x7fb5e415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7fb5e3577640 1 -- 10.20.193.45:0/1447815114 >> v1:10.20.193.45:6789/0 conn(0x7fb5e40748e0 legacy=0x7fb5e40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7fb5e3577640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7fb5e3577640 1 monclient: found mon.noname-a 2026-02-17T21:07:16.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7fb5e3577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7fb5e3577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7fb5e3577640 1 -- 10.20.193.45:0/1447815114 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e40c80c0 con 0x7fb5e40c92b0 2026-02-17T21:07:16.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7f7b815ed640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:07:16.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7f7b815ed640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:07:16.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7f7b815ed640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.221+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7b7c15d000 con 0x7f7b7c1502b0 2026-02-17T21:07:16.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.222+0000 7fb5e3577640 1 --2- 10.20.193.45:0/1447815114 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40c92b0 0x7fb5e4153610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009d90 tx=0x7fb5d402f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9c173683014392 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 1 -- 10.20.193.45:0/1447815114 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d403c070 con 0x7fb5e40c92b0 2026-02-17T21:07:16.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:16.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 10 monclient: dump: 2026-02-17T21:07:16.217 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.217 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.217 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 1 -- 10.20.193.45:0/1447815114 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d4037440 con 0x7fb5e40c92b0 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 1 -- 10.20.193.45:0/1447815114 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4037810 con 0x7fb5e40c92b0 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 5 monclient: authenticate success, global_id 4533 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 4 set_mon_vals no callback set 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:16.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e1d74640 10 monclient: dump: 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 10 monclient: shutdown 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 1 -- 10.20.193.45:0/1447815114 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40c92b0 msgr2=0x7fb5e4153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 1 --2- 10.20.193.45:0/1447815114 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40c92b0 0x7fb5e4153610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009d90 tx=0x7fb5d402f1e0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 1 -- 10.20.193.45:0/1447815114 shutdown_connections 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 1 --2- 10.20.193.45:0/1447815114 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40c92b0 0x7fb5e4153610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 1 --2- 10.20.193.45:0/1447815114 >> v2:10.20.193.92:3300/0 conn(0x7fb5e415d1e0 0x7fb5e415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 1 -- 10.20.193.45:0/1447815114 >> 10.20.193.45:0/1447815114 conn(0x7fb5e40c9d40 msgr2=0x7fb5e40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 1 -- 10.20.193.45:0/1447815114 shutdown_connections 2026-02-17T21:07:16.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 1 -- 10.20.193.45:0/1447815114 wait complete. 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.225+0000 7fb5e901b640 10 monclient: monmap: 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 librados: starting msgr at 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 librados: starting objecter 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 Processor -- start 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 -- start start 2026-02-17T21:07:16.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 librados: setting wanted keys 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 librados: calling monclient init 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient: init 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 0x7fb5e4152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient(hunting): picked mon.noname-a con 0x7fb5e40748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb5e40c92b0 0x7fb5e4145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient(hunting): picked mon.noname-b con 0x7fb5e40c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb5e415d1e0 0x7fb5e40cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient(hunting): picked mon.noname-c con 0x7fb5e415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4074d30 con 0x7fb5e40748e0 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40c8680 con 0x7fb5e40c92b0 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4153b50 con 0x7fb5e415d1e0 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e901b640 10 monclient(hunting): authenticate will time out at 1019.856653s 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.226+0000 7fb5e2d76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 0x7fb5e4152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.223 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.227+0000 7fb5e2d76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 0x7fb5e4152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42396/0 (socket says 10.20.193.45:42396) 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.227+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 learned_addr learned my addr 10.20.193.45:0/818513867 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.227+0000 7fb5e2d76640 10 monclient(hunting): get_auth_request con 0x7fb5e40748e0 auth_method 0 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.227+0000 7fb5e2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.227+0000 7fb5e2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.227+0000 7fb5e2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.227+0000 7fb5e2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.227+0000 7fb5e2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.227+0000 7fb5e2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 10 monclient(hunting): handle_auth_done global_id 4536 payload 824 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb5e415d1e0 msgr2=0x7fb5e40cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb5e415d1e0 0x7fb5e40cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb5e40c92b0 msgr2=0x7fb5e4145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb5e40c92b0 0x7fb5e4145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 1 monclient: found mon.noname-a 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.228+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e4140100 con 0x7fb5e40748e0 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.229+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 0x7fb5e4152410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800b530 tx=0x7fb5d800ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.229+0000 7fb5c37fe640 10 client.?.objecter ms_handle_connect 0x7fb5e40748e0 2026-02-17T21:07:16.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.229+0000 7fb5c37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:16.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8013020 con 0x7fb5e40748e0 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 10 monclient: dump: 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e901b640 5 monclient: authenticate success, global_id 4536 2026-02-17T21:07:16.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d8004480 con 0x7fb5e40748e0 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e901b640 10 monclient: _renew_subs 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e901b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e41f78c0 con 0x7fb5e40748e0 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8002920 con 0x7fb5e40748e0 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5c37fe640 10 monclient: dump: 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e1573640 4 set_mon_vals no callback set 2026-02-17T21:07:16.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e901b640 10 client.4536.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:16.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e901b640 10 monclient: _renew_subs 2026-02-17T21:07:16.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e901b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e41f3b70 con 0x7fb5e40748e0 2026-02-17T21:07:16.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.231+0000 7fb5e901b640 1 librados: init done 2026-02-17T21:07:16.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.232+0000 7fb5e901b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.232+0000 7fb5e901b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.232+0000 7fb5e901b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.232+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e4153f30 con 0x7fb5e40748e0 2026-02-17T21:07:16.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.257+0000 7f4a89901640 10 monclient: get_monmap_and_config 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.257+0000 7f4a89901640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.257+0000 7f4a89901640 10 monclient: monmap: 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:16.258709+0000 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:16.258709+0000 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:16.250 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.258+0000 7f4a89901640 1 Processor -- start 2026-02-17T21:07:16.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.258+0000 7f4a89901640 1 -- start start 2026-02-17T21:07:16.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.258+0000 7f4a89901640 10 monclient: init 2026-02-17T21:07:16.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 10 monclient: _add_conns ranks=[4,2,3,1,0,5] 2026-02-17T21:07:16.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f4a84152620 0x7f4a8415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 10 monclient(hunting): picked mon.noname-b con 0x7f4a84152620 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4a84152a00 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4a840c94a0 0x7f4a8415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 10 monclient(hunting): picked mon.noname-a con 0x7f4a840c94a0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a840c71a0 con 0x7f4a84152a00 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f4a840c7760 con 0x7f4a840c94a0 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f4a840c7480 con 0x7f4a84152620 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.259+0000 7f4a89901640 10 monclient(hunting): authenticate will time out at 1019.889139s 2026-02-17T21:07:16.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.266+0000 7ff3bd4bd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:07:16.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.266+0000 7ff3bd4bd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:07:16.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.266+0000 7ff3bd4bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.266+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7ff3b80ccf70 con 0x7ff3b8155e40 2026-02-17T21:07:16.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.268+0000 7f9c39ffb640 1 -- 10.20.193.45:0/1869695421 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f9c3c019460 con 0x7f9c4c0704a0 2026-02-17T21:07:16.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.269+0000 7f9c39ffb640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9c1c0792b0 0x7f9c1c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.269+0000 7f9c50c03640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9c1c0792b0 0x7f9c1c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.269+0000 7f9c50c03640 10 monclient: get_auth_request con 0x7f9c1c0792b0 auth_method 0 2026-02-17T21:07:16.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.269+0000 7f9c39ffb640 10 client.4588.objecter ms_handle_connect 0x7f9c1c0792b0 2026-02-17T21:07:16.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.269+0000 7f9c50c03640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9c1c0792b0 0x7f9c1c07b770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c15fe50 tx=0x7f9c40031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.271+0000 7f9c39ffb640 1 -- 10.20.193.45:0/1869695421 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f9c3c097c80 con 0x7f9c4c0704a0 2026-02-17T21:07:16.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.271+0000 7f9c39ffb640 10 client.4588.objecter ms_dispatch2 0x7f9c4c000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:16.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.271+0000 7f9c39ffb640 3 client.4588.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:16.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.271+0000 7f9c39ffb640 3 client.4588.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:16.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.271+0000 7f9c39ffb640 20 client.4588.objecter dump_active .. 0 homeless 2026-02-17T21:07:16.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.277+0000 7f9c39ffb640 1 -- 10.20.193.45:0/1869695421 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9c3c062860 con 0x7f9c4c0704a0 2026-02-17T21:07:16.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.277+0000 7f9c39ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.277+0000 7f9c39ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:16.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.280+0000 7f7b5b7fe640 1 -- 10.20.193.45:0/1986835515 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7b640617b0 con 0x7f7b7c1502b0 2026-02-17T21:07:16.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.280+0000 7f7b5b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-17T21:07:16.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.280+0000 7f7b5b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:16.273 INFO:teuthology.orchestra.run.trial045.stdout:111669149706 2026-02-17T21:07:16.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 10 librados: watch_flush enter 2026-02-17T21:07:16.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 10 librados: watch_flush exit 2026-02-17T21:07:16.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 20 client.4582.objecter shutdown clearing up homeless session... 2026-02-17T21:07:16.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 10 client.4582.objecter successfully canceled tick 2026-02-17T21:07:16.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b48079280 msgr2=0x7f7b4807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b48079280 0x7f7b4807b740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b70007fd0 tx=0x7f7b70003d90 comp rx=0 tx=0).stop 2026-02-17T21:07:16.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 10 monclient: shutdown 2026-02-17T21:07:16.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c1502b0 msgr2=0x7f7b7c1f2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c1502b0 0x7f7b7c1f2e60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400c4f0 tx=0x7f7b6400c9c0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f4a82ffd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f4a84152620 0x7f4a8415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 shutdown_connections 2026-02-17T21:07:16.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b48079280 0x7f7b4807b740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b7c150690 0x7f7b7c1f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b7c1502b0 0x7f7b7c1f2e60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 --2- 10.20.193.45:0/1986835515 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b7c0c9040 0x7f7b7c146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 >> 10.20.193.45:0/1986835515 conn(0x7f7b7c0c9d40 msgr2=0x7f7b7c14a820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 shutdown_connections 2026-02-17T21:07:16.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 -- 10.20.193.45:0/1986835515 wait complete. 2026-02-17T21:07:16.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f7b815ed640 1 librados: shutdown 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f4a82ffd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f4a84152620 0x7f4a8415a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:58038/0 (socket says 10.20.193.45:58038) 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f4a82ffd640 1 -- 10.20.193.45:0/2528655718 learned_addr learned my addr 10.20.193.45:0/2528655718 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f4a82ffd640 10 monclient(hunting): get_auth_request con 0x7f4a84152620 auth_method 0 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f4a82ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f4a82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.283+0000 7f4a82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.284+0000 7f4a82ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.284+0000 7f4a82ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.284+0000 7f4a82ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.285+0000 7f4a82ffd640 10 monclient(hunting): handle_auth_done global_id 4591 payload 274 2026-02-17T21:07:16.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.285+0000 7f4a82ffd640 1 -- 10.20.193.45:0/2528655718 >> v2:10.20.193.45:3300/0 conn(0x7f4a840c94a0 msgr2=0x7f4a8415ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.285+0000 7f4a82ffd640 1 --2- 10.20.193.45:0/2528655718 >> v2:10.20.193.45:3300/0 conn(0x7f4a840c94a0 0x7f4a8415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.285+0000 7f4a82ffd640 1 -- 10.20.193.45:0/2528655718 >> v1:10.20.193.92:6789/0 conn(0x7f4a84152a00 legacy=0x7f4a840c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.285+0000 7f4a82ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.285+0000 7f4a82ffd640 1 monclient: found mon.noname-b 2026-02-17T21:07:16.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.285+0000 7f4a82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.285+0000 7f4a82ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.285+0000 7f4a82ffd640 1 -- 10.20.193.45:0/2528655718 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a84159e00 con 0x7f4a84152620 2026-02-17T21:07:16.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.286+0000 7f4a82ffd640 1 --2- 10.20.193.45:0/2528655718 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a84152620 0x7f4a8415a8e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4a84072110 tx=0x7f4a7802eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b5eec18dc6ba79 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.286+0000 7fb8e73c3640 10 monclient: get_monmap_and_config 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.286+0000 7fb8e73c3640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.286+0000 7fb8e73c3640 10 monclient: monmap: 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:16.287654+0000 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:16.287654+0000 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:16.282 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 1 Processor -- start 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 1 -- start start 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 10 monclient: init 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 10 monclient: _add_conns ranks=[0,2,4,1,5,3] 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb8e015d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb8e00c92b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:16.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fb8e0153d20 0x7fb8e015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 10 monclient(hunting): picked mon.noname-b con 0x7fb8e0153d20 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:16.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e00c5860 con 0x7fb8e015d1e0 2026-02-17T21:07:16.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e00c5580 con 0x7fb8e00c92b0 2026-02-17T21:07:16.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e00c7de0 con 0x7fb8e0153d20 2026-02-17T21:07:16.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.287+0000 7fb8e73c3640 10 monclient(hunting): authenticate will time out at 1019.917828s 2026-02-17T21:07:16.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 1 -- 10.20.193.45:0/2528655718 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7803c070 con 0x7f4a84152620 2026-02-17T21:07:16.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:16.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 10 monclient: dump: 2026-02-17T21:07:16.285 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.285 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.285 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.285 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 1 -- 10.20.193.45:0/2528655718 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a7802fb20 con 0x7f4a84152620 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 1 -- 10.20.193.45:0/2528655718 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78037440 con 0x7f4a84152620 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a89901640 5 monclient: authenticate success, global_id 4591 2026-02-17T21:07:16.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a89901640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a89901640 4 set_mon_vals no callback set 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.288+0000 7f4a81ffb640 10 monclient: dump: 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.287 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fb8e0153d20 0x7fb8e015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 10 monclient: shutdown 2026-02-17T21:07:16.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 -- 10.20.193.45:0/2528655718 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a84152620 msgr2=0x7f4a8415a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 --2- 10.20.193.45:0/2528655718 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a84152620 0x7f4a8415a8e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4a84072110 tx=0x7f4a7802eeb0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fb8e0153d20 0x7fb8e015d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:58050/0 (socket says 10.20.193.45:58050) 2026-02-17T21:07:16.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 1 -- 10.20.193.45:0/1735374972 learned_addr learned my addr 10.20.193.45:0/1735374972 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 -- 10.20.193.45:0/2528655718 shutdown_connections 2026-02-17T21:07:16.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 --2- 10.20.193.45:0/2528655718 >> v2:10.20.193.45:3300/0 conn(0x7f4a840c94a0 0x7f4a8415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 --2- 10.20.193.45:0/2528655718 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a84152620 0x7f4a8415a8e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 -- 10.20.193.45:0/2528655718 >> 10.20.193.45:0/2528655718 conn(0x7f4a840c9d40 msgr2=0x7f4a840ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 10 monclient(hunting): get_auth_request con 0x7fb8e0153d20 auth_method 0 2026-02-17T21:07:16.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 -- 10.20.193.45:0/2528655718 shutdown_connections 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 -- 10.20.193.45:0/2528655718 wait complete. 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 10 monclient: monmap: 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:16.291 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7fb8e5939640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 librados: starting msgr at 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.289+0000 7f4a89901640 1 librados: starting objecter 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 Processor -- start 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 -- start start 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 librados: setting wanted keys 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 librados: calling monclient init 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient: init 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a840c94a0 0x7f4a84073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient(hunting): picked mon.noname-b con 0x7f4a840c94a0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4a84152620 0x7f4a84073970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient(hunting): picked mon.noname-c con 0x7f4a84152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a84152a00 0x7f4a8414bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient(hunting): picked mon.noname-a con 0x7f4a84152a00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4a840c5c90 con 0x7f4a84152a00 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8415a3c0 con 0x7f4a840c94a0 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4a840c5e10 con 0x7f4a84152620 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.290+0000 7f4a89901640 10 monclient(hunting): authenticate will time out at 1019.920465s 2026-02-17T21:07:16.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.291+0000 7fb8e5939640 10 monclient(hunting): handle_auth_done global_id 4594 payload 274 2026-02-17T21:07:16.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.291+0000 7fb8e5939640 1 -- 10.20.193.45:0/1735374972 >> v1:10.20.193.92:6789/0 conn(0x7fb8e00c92b0 legacy=0x7fb8e0153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.291+0000 7fb8e5939640 1 -- 10.20.193.45:0/1735374972 >> v1:10.20.193.45:6789/0 conn(0x7fb8e015d1e0 legacy=0x7fb8e00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.291+0000 7fb8e5939640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.291+0000 7fb8e5939640 1 monclient: found mon.noname-b 2026-02-17T21:07:16.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.291+0000 7fb8e5939640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.291+0000 7fb8e5939640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.291+0000 7fb8e5939640 1 -- 10.20.193.45:0/1735374972 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e00c80c0 con 0x7fb8e0153d20 2026-02-17T21:07:16.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149705 got 111669149706 for osd.7 2026-02-17T21:07:16.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a840c94a0 0x7f4a84073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7fb8e5939640 1 --2- 10.20.193.45:0/1735374972 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e0153d20 0x7fb8e015d5c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009e80 tx=0x7fb8dc02f2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cfb51b95b78e1af server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.297 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:16.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a840c94a0 0x7f4a84073010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:58056/0 (socket says 10.20.193.45:58056) 2026-02-17T21:07:16.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 1 -- 10.20.193.45:0/18237382 learned_addr learned my addr 10.20.193.45:0/18237382 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 10 monclient(hunting): get_auth_request con 0x7f4a840c94a0 auth_method 0 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.292+0000 7f4a82ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.294+0000 7f4a82ffd640 10 monclient(hunting): handle_auth_done global_id 4597 payload 824 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7f4a82ffd640 1 -- 10.20.193.45:0/18237382 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4a84152620 msgr2=0x7f4a84073970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7f4a82ffd640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4a84152620 0x7f4a84073970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7f4a82ffd640 1 -- 10.20.193.45:0/18237382 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a84152a00 msgr2=0x7f4a8414bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7f4a82ffd640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a84152a00 0x7f4a8414bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7f4a82ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7f4a82ffd640 1 monclient: found mon.noname-b 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7f4a82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7f4a82ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7f4a82ffd640 1 -- 10.20.193.45:0/18237382 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a841f4310 con 0x7f4a840c94a0 2026-02-17T21:07:16.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7fb8cffff640 1 -- 10.20.193.45:0/1735374972 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc02fcf0 con 0x7fb8e0153d20 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7fb8cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7fb8cffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7fb8cffff640 10 monclient: dump: 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7fb8cffff640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7fb8cffff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7fb8cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7fb8e73c3640 5 monclient: authenticate success, global_id 4594 2026-02-17T21:07:16.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.295+0000 7fb8e73c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8cffff640 1 -- 10.20.193.45:0/1735374972 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8dc0373f0 con 0x7fb8e0153d20 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8cffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8cffff640 1 -- 10.20.193.45:0/1735374972 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0377c0 con 0x7fb8e0153d20 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8cffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8cffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8cffff640 10 monclient: dump: 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 4 set_mon_vals no callback set 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 10 monclient: shutdown 2026-02-17T21:07:16.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 1 -- 10.20.193.45:0/1735374972 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e0153d20 msgr2=0x7fb8e015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 1 --2- 10.20.193.45:0/1735374972 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e0153d20 0x7fb8e015d5c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc009e80 tx=0x7fb8dc02f2d0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 1 -- 10.20.193.45:0/1735374972 shutdown_connections 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 1 --2- 10.20.193.45:0/1735374972 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e0153d20 0x7fb8e015d5c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 1 -- 10.20.193.45:0/1735374972 >> 10.20.193.45:0/1735374972 conn(0x7fb8e00c9d40 msgr2=0x7fb8e00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 1 -- 10.20.193.45:0/1735374972 shutdown_connections 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.296+0000 7fb8e73c3640 1 -- 10.20.193.45:0/1735374972 wait complete. 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7f4a82ffd640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a840c94a0 0x7f4a84073010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a78002410 tx=0x7f4a780047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7f4a5bfff640 10 client.?.objecter ms_handle_connect 0x7f4a840c94a0 2026-02-17T21:07:16.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7f4a5bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:16.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7fb8e73c3640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7fb8e73c3640 10 monclient: monmap: 2026-02-17T21:07:16.303 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.303 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:16.303 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7fb8e73c3640 1 librados: starting msgr at 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7fb8e73c3640 1 librados: starting objecter 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7fb8e73c3640 1 Processor -- start 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7fb8e73c3640 1 -- start start 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7fb8e73c3640 1 librados: setting wanted keys 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7fb8e73c3640 1 librados: calling monclient init 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.297+0000 7fb8e73c3640 10 monclient: init 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb8e00c92b0 0x7fb8e01e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient(hunting): picked mon.noname-c con 0x7fb8e00c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb8e0153d20 0x7fb8e014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient(hunting): picked mon.noname-a con 0x7fb8e0153d20 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e015d1e0 0x7fb8e0072800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient(hunting): picked mon.noname-b con 0x7fb8e015d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e00748e0 con 0x7fb8e0153d20 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e00c8680 con 0x7fb8e015d1e0 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e0074a60 con 0x7fb8e00c92b0 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.298+0000 7fb8e73c3640 10 monclient(hunting): authenticate will time out at 1019.928141s 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 1 -- 10.20.193.45:0/18237382 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78044070 con 0x7f4a840c94a0 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f1c7bc45640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 10 monclient: dump: 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 1 -- 10.20.193.45:0/18237382 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a78040630 con 0x7f4a840c94a0 2026-02-17T21:07:16.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f1c7bc45640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:07:16.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f1c7bc45640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a89901640 5 monclient: authenticate success, global_id 4597 2026-02-17T21:07:16.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a89901640 10 monclient: _renew_subs 2026-02-17T21:07:16.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a89901640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a84074340 con 0x7f4a840c94a0 2026-02-17T21:07:16.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1c74074730 con 0x7f1c74142b00 2026-02-17T21:07:16.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 1 -- 10.20.193.45:0/18237382 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7803c040 con 0x7f4a840c94a0 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a817fa640 4 set_mon_vals no callback set 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a5bfff640 10 monclient: dump: 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7fb8e5939640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e015d1e0 0x7fb8e0072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a89901640 10 client.4597.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a89901640 10 monclient: _renew_subs 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a89901640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a84074900 con 0x7f4a840c94a0 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.299+0000 7f4a89901640 1 librados: init done 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7fb8e5939640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e015d1e0 0x7fb8e0072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:58072/0 (socket says 10.20.193.45:58072) 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7fb8e5939640 1 -- 10.20.193.45:0/2772838509 learned_addr learned my addr 10.20.193.45:0/2772838509 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7fb8e5939640 10 monclient(hunting): get_auth_request con 0x7fb8e015d1e0 auth_method 0 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7fb8e5939640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7fb8e5939640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7fb8e5939640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7f4a89901640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7f4a89901640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7f4a89901640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a840c8d90 con 0x7f4a840c94a0 2026-02-17T21:07:16.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7fb8e5939640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7fb8e5939640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7fb8e5939640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.300+0000 7f9ab77fe640 1 -- 10.20.193.45:0/3102762476 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f9acc021480 con 0x7f9ad8152620 2026-02-17T21:07:16.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.302+0000 7f9ab77fe640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9aa40792d0 0x7f9aa407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.302+0000 7f9ad67fc640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9aa40792d0 0x7f9aa407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.302+0000 7f9ad67fc640 10 monclient: get_auth_request con 0x7f9aa40792d0 auth_method 0 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.302+0000 7f9ad67fc640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9aa40792d0 0x7f9aa407b790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8076d30 tx=0x7f9ac0031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.302+0000 7f9ab77fe640 10 client.4628.objecter ms_handle_connect 0x7f9aa40792d0 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.303+0000 7f9ab77fe640 1 -- 10.20.193.45:0/3102762476 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f9acc05dd20 con 0x7f9ad8152620 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.303+0000 7f9ab77fe640 10 client.4628.objecter ms_dispatch2 0x7f9ad8000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.303+0000 7f9ab77fe640 3 client.4628.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.303+0000 7f9ab77fe640 3 client.4628.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.303+0000 7f9ab77fe640 20 client.4628.objecter dump_active .. 0 homeless 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 10 monclient(hunting): handle_auth_done global_id 4600 payload 824 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 1 -- 10.20.193.45:0/2772838509 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb8e00c92b0 msgr2=0x7fb8e01e8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb8e00c92b0 0x7fb8e01e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 1 -- 10.20.193.45:0/2772838509 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb8e0153d20 msgr2=0x7fb8e014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb8e0153d20 0x7fb8e014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 1 monclient: found mon.noname-b 2026-02-17T21:07:16.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.305+0000 7fb8e5939640 1 -- 10.20.193.45:0/2772838509 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e014c720 con 0x7fb8e015d1e0 2026-02-17T21:07:16.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.310+0000 7f9ab77fe640 1 -- 10.20.193.45:0/3102762476 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9acc0623e0 con 0x7f9ad8152620 2026-02-17T21:07:16.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.310+0000 7f9ab77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.310+0000 7f9ab77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:16.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.317+0000 7ff3977fe640 1 -- 10.20.193.45:0/4169206402 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff3a0061530 con 0x7ff3b8155e40 2026-02-17T21:07:16.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.317+0000 7ff3977fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-17T21:07:16.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.317+0000 7ff3977fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:16.312 INFO:teuthology.orchestra.run.trial045.stdout:115964117001 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 10 librados: watch_flush enter 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 10 librados: watch_flush exit 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 20 client.4622.objecter shutdown clearing up homeless session... 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 10 client.4622.objecter successfully canceled tick 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff384079280 msgr2=0x7ff38407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff384079280 0x7ff38407b740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac039000 tx=0x7ff3ac031000 comp rx=0 tx=0).stop 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 10 monclient: shutdown 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 msgr2=0x7ff3b80c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 0x7ff3b80c7ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000c500 tx=0x7ff3a000c9d0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 shutdown_connections 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff384079280 0x7ff38407b740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff3b8156220 0x7ff3b815e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff3b8155e40 0x7ff3b80c7ed0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 --2- 10.20.193.45:0/4169206402 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff3b80cd290 0x7ff3b81f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 >> 10.20.193.45:0/4169206402 conn(0x7ff3b80ce270 msgr2=0x7ff3b81e72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 shutdown_connections 2026-02-17T21:07:16.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 -- 10.20.193.45:0/4169206402 wait complete. 2026-02-17T21:07:16.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.320+0000 7ff3bd4bd640 1 librados: shutdown 2026-02-17T21:07:16.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117001 for osd.14 2026-02-17T21:07:16.322 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:16.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.339+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb5d8002ac0 con 0x7fb5e40748e0 2026-02-17T21:07:16.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.340+0000 7fb5c37fe640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb5b00792b0 0x7fb5b007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.340+0000 7fb5e2575640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb5b00792b0 0x7fb5b007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.340+0000 7fb5e2575640 10 monclient: get_auth_request con 0x7fb5b00792b0 auth_method 0 2026-02-17T21:07:16.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.340+0000 7fb5c37fe640 10 client.4536.objecter ms_handle_connect 0x7fb5b00792b0 2026-02-17T21:07:16.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.340+0000 7fb5e2575640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb5b00792b0 0x7fb5b007b770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc002a30 tx=0x7fb5cc0079f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.348+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fb5d805e2b0 con 0x7fb5e40748e0 2026-02-17T21:07:16.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.348+0000 7fb5c37fe640 10 client.4536.objecter ms_dispatch2 0x7fb5e4000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:16.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.348+0000 7fb5c37fe640 3 client.4536.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:16.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.348+0000 7fb5c37fe640 3 client.4536.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:16.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.348+0000 7fb5c37fe640 20 client.4536.objecter dump_active .. 0 homeless 2026-02-17T21:07:16.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.348+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb5d801d020 con 0x7fb5e40748e0 2026-02-17T21:07:16.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.348+0000 7fb5c37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.348+0000 7fb5c37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:16.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.359+0000 7f1c627fc640 1 -- 10.20.193.45:0/1425053008 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1c7001a060 con 0x7f1c74142b00 2026-02-17T21:07:16.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.359+0000 7f1c627fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-17T21:07:16.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.359+0000 7f1c627fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:16.352 INFO:teuthology.orchestra.run.trial045.stdout:94489280518 2026-02-17T21:07:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 10 librados: watch_flush enter 2026-02-17T21:07:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 10 librados: watch_flush exit 2026-02-17T21:07:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 20 client.4527.objecter shutdown clearing up homeless session... 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 10 client.4527.objecter successfully canceled tick 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c44079280 msgr2=0x7f1c4407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c44079280 0x7f1c4407b740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1c64039000 tx=0x7f1c64031000 comp rx=0 tx=0).stop 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 10 monclient: shutdown 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c74142b00 msgr2=0x7f1c7415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c74142b00 0x7f1c7415d3a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1c74076d20 tx=0x7f1c7000cf10 comp rx=0 tx=0).stop 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 shutdown_connections 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c44079280 0x7f1c4407b740 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c74142b00 0x7f1c7415d3a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c74142680 0x7f1c7415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 --2- 10.20.193.45:0/1425053008 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c5c003ba0 0x7f1c741f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 >> 10.20.193.45:0/1425053008 conn(0x7f1c740c9d40 msgr2=0x7f1c7414aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.361+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 shutdown_connections 2026-02-17T21:07:16.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.362+0000 7f1c7bc45640 1 -- 10.20.193.45:0/1425053008 wait complete. 2026-02-17T21:07:16.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.362+0000 7f1c7bc45640 1 librados: shutdown 2026-02-17T21:07:16.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.365+0000 7f9c5368f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:07:16.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.365+0000 7f9c5368f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:07:16.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.365+0000 7f9c5368f640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.365+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9c4c1596f0 con 0x7f9c4c0704a0 2026-02-17T21:07:16.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280518 for osd.3 2026-02-17T21:07:16.363 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:16.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.394+0000 7f9add30f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:07:16.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.394+0000 7f9add30f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:07:16.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.394+0000 7f9add30f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.395+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f9ad814a080 con 0x7f9ad8152620 2026-02-17T21:07:16.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.397+0000 7f9ab77fe640 1 -- 10.20.193.45:0/3102762476 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9acc061ce0 con 0x7f9ad8152620 2026-02-17T21:07:16.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.397+0000 7f9ab77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-17T21:07:16.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.397+0000 7f9ab77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:16.390 INFO:teuthology.orchestra.run.trial045.stdout:111669149705 2026-02-17T21:07:16.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 10 librados: watch_flush enter 2026-02-17T21:07:16.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 10 librados: watch_flush exit 2026-02-17T21:07:16.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 20 client.4628.objecter shutdown clearing up homeless session... 2026-02-17T21:07:16.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 10 client.4628.objecter successfully canceled tick 2026-02-17T21:07:16.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9aa40792d0 msgr2=0x7f9aa407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9aa40792d0 0x7f9aa407b790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8076d30 tx=0x7f9ac0031000 comp rx=0 tx=0).stop 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 10 monclient: shutdown 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad8152620 msgr2=0x7f9ad8072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad8152620 0x7f9ad8072490 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00b5a0 tx=0x7f9acc00ba70 comp rx=0 tx=0).stop 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 shutdown_connections 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9aa40792d0 0x7f9aa407b790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9ad815aff0 0x7f9ad814fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9ad8152a00 0x7f9ad81f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 --2- 10.20.193.45:0/3102762476 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9ad8152620 0x7f9ad8072490 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 >> 10.20.193.45:0/3102762476 conn(0x7f9ad80c9d40 msgr2=0x7f9ad806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 shutdown_connections 2026-02-17T21:07:16.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 -- 10.20.193.45:0/3102762476 wait complete. 2026-02-17T21:07:16.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.399+0000 7f9add30f640 1 librados: shutdown 2026-02-17T21:07:16.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.407+0000 7f4a5bfff640 1 -- 10.20.193.45:0/18237382 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4a7803f050 con 0x7f4a840c94a0 2026-02-17T21:07:16.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.407+0000 7f4a5bfff640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a540792d0 0x7f4a5407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.407+0000 7f4a827fc640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a540792d0 0x7f4a5407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.407+0000 7f4a827fc640 10 monclient: get_auth_request con 0x7f4a540792d0 auth_method 0 2026-02-17T21:07:16.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.407+0000 7f4a827fc640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a540792d0 0x7f4a5407b790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4a8415c1e0 tx=0x7f4a6c006ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.407+0000 7f4a5bfff640 10 client.4597.objecter ms_handle_connect 0x7f4a540792d0 2026-02-17T21:07:16.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149704 got 111669149705 for osd.9 2026-02-17T21:07:16.402 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:16.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.409+0000 7f4a5bfff640 1 -- 10.20.193.45:0/18237382 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f4a780832e0 con 0x7f4a840c94a0 2026-02-17T21:07:16.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.409+0000 7f4a5bfff640 10 client.4597.objecter ms_dispatch2 0x7f4a84000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:16.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.409+0000 7f4a5bfff640 3 client.4597.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:16.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.409+0000 7f4a5bfff640 3 client.4597.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:16.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.409+0000 7f4a5bfff640 20 client.4597.objecter dump_active .. 0 homeless 2026-02-17T21:07:16.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.415+0000 7fb8e5939640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e015d1e0 0x7fb8e0072800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc039040 tx=0x7fb8dc004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.415+0000 7fb8cdffb640 10 client.?.objecter ms_handle_connect 0x7fb8e015d1e0 2026-02-17T21:07:16.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.415+0000 7fb8cdffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:16.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.416+0000 7f4a5bfff640 1 -- 10.20.193.45:0/18237382 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4a780879a0 con 0x7f4a840c94a0 2026-02-17T21:07:16.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.416+0000 7f4a5bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.416+0000 7f4a5bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:16.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.420+0000 7f9c39ffb640 1 -- 10.20.193.45:0/1869695421 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9c3c062160 con 0x7f9c4c0704a0 2026-02-17T21:07:16.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.420+0000 7f9c39ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-17T21:07:16.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.420+0000 7f9c39ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:16.412 INFO:teuthology.orchestra.run.trial045.stdout:111669149704 2026-02-17T21:07:16.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 10 librados: watch_flush enter 2026-02-17T21:07:16.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 10 librados: watch_flush exit 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 20 client.4588.objecter shutdown clearing up homeless session... 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 10 client.4588.objecter successfully canceled tick 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9c1c0792b0 msgr2=0x7f9c1c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9c1c0792b0 0x7f9c1c07b770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c15fe50 tx=0x7f9c40031000 comp rx=0 tx=0).stop 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 10 monclient: shutdown 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 msgr2=0x7f9c4c1f4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 0x7f9c4c1f4050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00b500 tx=0x7f9c3c00b9d0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 shutdown_connections 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9c1c0792b0 0x7f9c1c07b770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9c4c15f530 0x7f9c4c154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c4c15a460 0x7f9c4c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 --2- 10.20.193.45:0/1869695421 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9c4c0704a0 0x7f9c4c1f4050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 >> 10.20.193.45:0/1869695421 conn(0x7f9c4c0cf510 msgr2=0x7f9c4c15b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 shutdown_connections 2026-02-17T21:07:16.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 -- 10.20.193.45:0/1869695421 wait complete. 2026-02-17T21:07:16.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7f9c5368f640 1 librados: shutdown 2026-02-17T21:07:16.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 1 -- 10.20.193.45:0/2772838509 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc046020 con 0x7fb8e015d1e0 2026-02-17T21:07:16.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:16.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 10 monclient: dump: 2026-02-17T21:07:16.418 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 1 -- 10.20.193.45:0/2772838509 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8dc037de0 con 0x7fb8e015d1e0 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8e73c3640 5 monclient: authenticate success, global_id 4600 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8e73c3640 10 monclient: _renew_subs 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8e73c3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e014ca00 con 0x7fb8e015d1e0 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 1 -- 10.20.193.45:0/2772838509 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc041690 con 0x7fb8e015d1e0 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cdffb640 10 monclient: dump: 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.420 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.421 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.421 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.421 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.421 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.421 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.421 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.421 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.421 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8cf7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:16.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8e73c3640 10 client.4600.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:16.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8e73c3640 10 monclient: _renew_subs 2026-02-17T21:07:16.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8e73c3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e014cfc0 con 0x7fb8e015d1e0 2026-02-17T21:07:16.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.422+0000 7fb8e73c3640 1 librados: init done 2026-02-17T21:07:16.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.423+0000 7fb8e73c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.423+0000 7fb8e73c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.423+0000 7fb8e73c3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.423+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e00c68b0 con 0x7fb8e015d1e0 2026-02-17T21:07:16.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149703 got 111669149704 for osd.0 2026-02-17T21:07:16.424 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:16.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.434+0000 7fb5e901b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:16.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.434+0000 7fb5e901b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:16.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.434+0000 7fb5e901b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.434+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7fb5e41f4160 con 0x7fb5e40748e0 2026-02-17T21:07:16.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.434+0000 7fb8cdffb640 1 -- 10.20.193.45:0/2772838509 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb8dc041830 con 0x7fb8e015d1e0 2026-02-17T21:07:16.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.435+0000 7fb8cdffb640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb8b00792b0 0x7fb8b007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.435+0000 7fb8e5138640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb8b00792b0 0x7fb8b007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.435+0000 7fb8e5138640 10 monclient: get_auth_request con 0x7fb8b00792b0 auth_method 0 2026-02-17T21:07:16.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.435+0000 7fb8e5138640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb8b00792b0 0x7fb8b007b770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0074630 tx=0x7fb8d0006ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.435+0000 7fb8cdffb640 10 client.4600.objecter ms_handle_connect 0x7fb8b00792b0 2026-02-17T21:07:16.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.437+0000 7fb8cdffb640 1 -- 10.20.193.45:0/2772838509 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7fb8dc083f10 con 0x7fb8e015d1e0 2026-02-17T21:07:16.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.437+0000 7fb8cdffb640 10 client.4600.objecter ms_dispatch2 0x7fb8e0000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:16.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.437+0000 7fb8cdffb640 3 client.4600.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:16.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.437+0000 7fb8cdffb640 3 client.4600.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:16.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.437+0000 7fb8cdffb640 20 client.4600.objecter dump_active .. 0 homeless 2026-02-17T21:07:16.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 msgr2=0x7fb5e4152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2026-02-17T21:07:16.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 msgr2=0x7fb5e4152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 0x7fb5e4152410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800b530 tx=0x7fb5d800ba00 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 0x7fb5e4152410 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5d800b530 tx=0x7fb5d800ba00 comp rx=0 tx=0).stop 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient: ms_handle_reset current mon [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 msgr2=0x7fb5e4152410 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5e40748e0 0x7fb5e4152410 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5b0081500 0x7fb5b0083910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient(hunting): picked mon.a con 0x7fb5b0081500 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb5e40c92b0 0x7fb5b00861b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient(hunting): picked mon.b con 0x7fb5e40c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb5e415d1e0 0x7fb5b0088bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient(hunting): picked mon.c con 0x7fb5e415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0089570 con 0x7fb5b0081500 2026-02-17T21:07:16.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00896f0 con 0x7fb5e40c92b0 2026-02-17T21:07:16.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b00898c0 con 0x7fb5e415d1e0 2026-02-17T21:07:16.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.465+0000 7fb5c37fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.467+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5b0081500 0x7fb5b0083910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.467+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb5e415d1e0 0x7fb5b0088bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.467+0000 7fb5e2d76640 10 monclient(hunting): get_auth_request con 0x7fb5e415d1e0 auth_method 0 2026-02-17T21:07:16.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.467+0000 7fb5e2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.467+0000 7fb5e2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.467+0000 7fb5e2d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.468+0000 7fb5e2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.468+0000 7fb5e2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.468+0000 7fb5e2d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.468+0000 7fb5e2d76640 10 monclient(hunting): get_auth_request con 0x7fb5b0081500 auth_method 0 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.468+0000 7fb5e2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.468+0000 7fb5e2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.468+0000 7fb5e2d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 10 monclient(hunting): handle_auth_done global_id 4536 payload 293 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb5e40c92b0 msgr2=0x7fb5b00861b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb5e40c92b0 0x7fb5b00861b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5b0081500 msgr2=0x7fb5b0083910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5b0081500 0x7fb5b0083910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 1 monclient: found mon.c 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7fb5b0089a90 con 0x7fb5e415d1e0 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 1 -- 10.20.193.45:0/818513867 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7fb5e41f4160 con 0x7fb5e415d1e0 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.469+0000 7fb5e2d76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.470+0000 7fb5c37fe640 10 client.4536.objecter ms_handle_connect 0x7fb5e415d1e0 2026-02-17T21:07:16.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.470+0000 7fb5c37fe640 10 client.4536.objecter resend_mon_ops 2026-02-17T21:07:16.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.470+0000 7fb5e2d76640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb5e415d1e0 0x7fb5b0088bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8097d30 tx=0x7fb5d8009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.482+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8062970 con 0x7fb5e415d1e0 2026-02-17T21:07:16.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.482+0000 7fb5c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.482+0000 7fb5c37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:16.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.482+0000 7fb5c37fe640 10 monclient: dump: 2026-02-17T21:07:16.475 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.475 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.475 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.482+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d80624d0 con 0x7fb5e415d1e0 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.482+0000 7fb5c37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.482+0000 7fb5e1573640 4 set_mon_vals no callback set 2026-02-17T21:07:16.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.483+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb5d806b040 con 0x7fb5e415d1e0 2026-02-17T21:07:16.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.484+0000 7fb5c37fe640 1 -- 10.20.193.45:0/818513867 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (secure 0 0 0) 0x7fb5d8062970 con 0x7fb5e415d1e0 2026-02-17T21:07:16.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.484+0000 7fb5c37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-17T21:07:16.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.484+0000 7fb5c37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:16.477 INFO:teuthology.orchestra.run.trial045.stdout:94489280517 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 10 librados: watch_flush enter 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 10 librados: watch_flush exit 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 20 client.4536.objecter shutdown clearing up homeless session... 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 10 client.4536.objecter successfully canceled tick 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb5b00792b0 msgr2=0x7fb5b007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb5b00792b0 0x7fb5b007b770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc002a30 tx=0x7fb5cc0079f0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 10 monclient: shutdown 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb5e415d1e0 msgr2=0x7fb5b0088bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb5e415d1e0 0x7fb5b0088bf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8097d30 tx=0x7fb5d8009240 comp rx=0 tx=0).stop 2026-02-17T21:07:16.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 shutdown_connections 2026-02-17T21:07:16.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb5e415d1e0 0x7fb5b0088bf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb5e40c92b0 0x7fb5b00861b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb5b0081500 0x7fb5b0083910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 --2- 10.20.193.45:0/818513867 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb5b00792b0 0x7fb5b007b770 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 >> 10.20.193.45:0/818513867 conn(0x7fb5e40c9d40 msgr2=0x7fb5e41533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 shutdown_connections 2026-02-17T21:07:16.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 -- 10.20.193.45:0/818513867 wait complete. 2026-02-17T21:07:16.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.487+0000 7fb5e901b640 1 librados: shutdown 2026-02-17T21:07:16.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280517 for osd.13 2026-02-17T21:07:16.488 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:16.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.501+0000 7f4a89901640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:07:16.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.501+0000 7f4a89901640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:07:16.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.501+0000 7f4a89901640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.501+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f4a8415b000 con 0x7f4a840c94a0 2026-02-17T21:07:16.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.540+0000 7fb8cdffb640 1 -- 10.20.193.45:0/2772838509 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb8e00c68b0 con 0x7fb8e015d1e0 2026-02-17T21:07:16.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.540+0000 7fb8cdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.540+0000 7fb8cdffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:16.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.572+0000 7f4a5bfff640 1 -- 10.20.193.45:0/18237382 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4a780872a0 con 0x7f4a840c94a0 2026-02-17T21:07:16.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.572+0000 7f4a5bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-17T21:07:16.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.572+0000 7f4a5bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:16.564 INFO:teuthology.orchestra.run.trial045.stdout:115964117001 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 10 librados: watch_flush enter 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 10 librados: watch_flush exit 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 20 client.4597.objecter shutdown clearing up homeless session... 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 10 client.4597.objecter successfully canceled tick 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a540792d0 msgr2=0x7f4a5407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a540792d0 0x7f4a5407b790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4a8415c1e0 tx=0x7f4a6c006ca0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 10 monclient: shutdown 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a840c94a0 msgr2=0x7f4a84073010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a840c94a0 0x7f4a84073010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a78002410 tx=0x7f4a780047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 shutdown_connections 2026-02-17T21:07:16.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a540792d0 0x7f4a5407b790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a84152a00 0x7f4a8414bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4a84152620 0x7f4a84073970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 --2- 10.20.193.45:0/18237382 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a840c94a0 0x7f4a84073010 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 >> 10.20.193.45:0/18237382 conn(0x7f4a840c9d40 msgr2=0x7f4a8414c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 shutdown_connections 2026-02-17T21:07:16.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 -- 10.20.193.45:0/18237382 wait complete. 2026-02-17T21:07:16.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.574+0000 7f4a89901640 1 librados: shutdown 2026-02-17T21:07:16.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964117001 got 115964117001 for osd.11 2026-02-17T21:07:16.575 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:16.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.624+0000 7fb8e73c3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:07:16.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.624+0000 7fb8e73c3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:07:16.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.624+0000 7fb8e73c3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:16.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.624+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb8e015d5c0 con 0x7fb8e015d1e0 2026-02-17T21:07:16.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.626+0000 7fb8cdffb640 1 -- 10.20.193.45:0/2772838509 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb8dc050070 con 0x7fb8e015d1e0 2026-02-17T21:07:16.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.626+0000 7fb8cdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-17T21:07:16.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.626+0000 7fb8cdffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:16.618 INFO:teuthology.orchestra.run.trial045.stdout:111669149703 2026-02-17T21:07:16.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 10 librados: watch_flush enter 2026-02-17T21:07:16.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 10 librados: watch_flush exit 2026-02-17T21:07:16.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 20 client.4600.objecter shutdown clearing up homeless session... 2026-02-17T21:07:16.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 10 client.4600.objecter successfully canceled tick 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb8b00792b0 msgr2=0x7fb8b007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb8b00792b0 0x7fb8b007b770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0074630 tx=0x7fb8d0006ca0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 10 monclient: shutdown 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e015d1e0 msgr2=0x7fb8e0072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e015d1e0 0x7fb8e0072800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc039040 tx=0x7fb8dc004b40 comp rx=0 tx=0).stop 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 shutdown_connections 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb8b00792b0 0x7fb8b007b770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb8e015d1e0 0x7fb8e0072800 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb8e0153d20 0x7fb8e014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 --2- 10.20.193.45:0/2772838509 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb8e00c92b0 0x7fb8e01e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 >> 10.20.193.45:0/2772838509 conn(0x7fb8e00c9d40 msgr2=0x7fb8e00ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 shutdown_connections 2026-02-17T21:07:16.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 -- 10.20.193.45:0/2772838509 wait complete. 2026-02-17T21:07:16.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.627+0000 7fb8e73c3640 1 librados: shutdown 2026-02-17T21:07:16.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149702 got 111669149703 for osd.5 2026-02-17T21:07:16.629 DEBUG:teuthology.parallel:result is None 2026-02-17T21:07:16.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T21:07:16.629 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:07:16.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.706+0000 7f00207a9640 10 monclient: get_monmap_and_config 2026-02-17T21:07:16.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.706+0000 7f00207a9640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.706+0000 7f00207a9640 10 monclient: monmap: 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:16.707368+0000 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:16.707368+0000 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:16.699 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:16.700 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:16.700 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:16.700 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.706+0000 7f00207a9640 1 Processor -- start 2026-02-17T21:07:16.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.706+0000 7f00207a9640 1 -- start start 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.706+0000 7f00207a9640 10 monclient: init 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 10 monclient: _add_conns ranks=[1,3,4,5,0,2] 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f001815d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f00180c92b0 0x7f001815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 10 monclient(hunting): picked mon.noname-a con 0x7f00180c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f00180748e0 0x7f0018153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 10 monclient(hunting): picked mon.noname-b con 0x7f00180748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00180c5860 con 0x7f001815d1e0 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f00180c5580 con 0x7f00180c92b0 2026-02-17T21:07:16.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f00180c7de0 con 0x7f00180748e0 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f00207a9640 10 monclient(hunting): authenticate will time out at 1020.337493s 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f001dd1d640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f00180c92b0 0x7f001815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.707+0000 7f001ed1f640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f00180748e0 0x7f0018153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001dd1d640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f00180c92b0 0x7f001815d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42440/0 (socket says 10.20.193.45:42440) 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001dd1d640 1 -- 10.20.193.45:0/3021119311 learned_addr learned my addr 10.20.193.45:0/3021119311 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001dd1d640 10 monclient(hunting): get_auth_request con 0x7f00180c92b0 auth_method 0 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001dd1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001dd1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001dd1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001ed1f640 10 monclient(hunting): get_auth_request con 0x7f00180748e0 auth_method 0 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001ed1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001ed1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001ed1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001dd1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001dd1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001dd1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001ed1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001ed1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.708+0000 7f001ed1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.709+0000 7f001dd1d640 10 monclient(hunting): handle_auth_done global_id 4539 payload 274 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.709+0000 7f001dd1d640 1 -- 10.20.193.45:0/3021119311 >> v2:10.20.193.86:3300/0 conn(0x7f00180748e0 msgr2=0x7f0018153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.709+0000 7f001dd1d640 1 --2- 10.20.193.45:0/3021119311 >> v2:10.20.193.86:3300/0 conn(0x7f00180748e0 0x7f0018153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.709+0000 7f001dd1d640 1 -- 10.20.193.45:0/3021119311 >> v1:10.20.193.86:6789/0 conn(0x7f001815d1e0 legacy=0x7f00180c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.709+0000 7f001dd1d640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.709+0000 7f001dd1d640 1 monclient: found mon.noname-a 2026-02-17T21:07:16.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.709+0000 7f001dd1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.709+0000 7f001dd1d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.709+0000 7f001dd1d640 1 -- 10.20.193.45:0/3021119311 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00180c80c0 con 0x7f00180c92b0 2026-02-17T21:07:16.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.710+0000 7f001dd1d640 1 --2- 10.20.193.45:0/3021119311 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 0x7f001815d5c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f000c009970 tx=0x7f000c02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6a506e49e59141 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 1 -- 10.20.193.45:0/3021119311 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c03c070 con 0x7f00180c92b0 2026-02-17T21:07:16.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:16.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 10 monclient: dump: 2026-02-17T21:07:16.713 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.713 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.713 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.713 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 1 -- 10.20.193.45:0/3021119311 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c02fbc0 con 0x7f00180c92b0 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 1 -- 10.20.193.45:0/3021119311 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c037440 con 0x7f00180c92b0 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f001d51c640 10 monclient: dump: 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.715 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 5 monclient: authenticate success, global_id 4539 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 4 set_mon_vals no callback set 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 10 monclient: shutdown 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 1 -- 10.20.193.45:0/3021119311 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 msgr2=0x7f001815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 1 --2- 10.20.193.45:0/3021119311 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 0x7f001815d5c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f000c009970 tx=0x7f000c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 1 -- 10.20.193.45:0/3021119311 shutdown_connections 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 1 --2- 10.20.193.45:0/3021119311 >> v2:10.20.193.86:3300/0 conn(0x7f00180748e0 0x7f0018153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 1 --2- 10.20.193.45:0/3021119311 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 0x7f001815d5c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 1 -- 10.20.193.45:0/3021119311 >> 10.20.193.45:0/3021119311 conn(0x7f00180c9d40 msgr2=0x7f00180ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 1 -- 10.20.193.45:0/3021119311 shutdown_connections 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 1 -- 10.20.193.45:0/3021119311 wait complete. 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.712+0000 7f00207a9640 10 monclient: monmap: 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:16.717 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 librados: starting msgr at 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 librados: starting objecter 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 Processor -- start 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 -- start start 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 librados: setting wanted keys 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 librados: calling monclient init 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient: init 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00180748e0 0x7f00181f1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient(hunting): picked mon.noname-b con 0x7f00180748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 0x7f001806b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient(hunting): picked mon.noname-a con 0x7f00180c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f001815d1e0 0x7f001815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient(hunting): picked mon.noname-c con 0x7f001815d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0018074d30 con 0x7f00180c92b0 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f00180c8680 con 0x7f00180748e0 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0018153b50 con 0x7f001815d1e0 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f00207a9640 10 monclient(hunting): authenticate will time out at 1020.343649s 2026-02-17T21:07:16.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f001dd1d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 0x7f001806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.713+0000 7f001e51e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00180748e0 0x7f00181f1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001dd1d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 0x7f001806b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42448/0 (socket says 10.20.193.45:42448) 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001dd1d640 1 -- 10.20.193.45:0/666853654 learned_addr learned my addr 10.20.193.45:0/666853654 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001dd1d640 10 monclient(hunting): get_auth_request con 0x7f00180c92b0 auth_method 0 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001dd1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001dd1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001dd1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001ed1f640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f001815d1e0 0x7f001815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001e51e640 10 monclient(hunting): get_auth_request con 0x7f00180748e0 auth_method 0 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001e51e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001e51e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001e51e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001dd1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001dd1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001dd1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001ed1f640 10 monclient(hunting): get_auth_request con 0x7f001815d1e0 auth_method 0 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001ed1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001ed1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001ed1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001e51e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001e51e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001e51e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001ed1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001ed1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:16.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.714+0000 7f001ed1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 10 monclient(hunting): handle_auth_done global_id 4542 payload 824 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 1 -- 10.20.193.45:0/666853654 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f001815d1e0 msgr2=0x7f001815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f001815d1e0 0x7f001815c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 1 -- 10.20.193.45:0/666853654 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00180748e0 msgr2=0x7f00181f1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00180748e0 0x7f00181f1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 10 monclient: _finish_hunting 0 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 1 monclient: found mon.noname-a 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.715+0000 7f001dd1d640 1 -- 10.20.193.45:0/666853654 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00181f2140 con 0x7f00180c92b0 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.716+0000 7f001dd1d640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 0x7f001806b870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f000c02f4a0 tx=0x7f000c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.716+0000 7efffeffd640 10 client.?.objecter ms_handle_connect 0x7f00180c92b0 2026-02-17T21:07:16.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.716+0000 7efffeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 1 -- 10.20.193.45:0/666853654 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c03c040 con 0x7f00180c92b0 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 10 monclient: dump: 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.723 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 1 -- 10.20.193.45:0/666853654 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c042410 con 0x7f00180c92b0 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f00207a9640 5 monclient: authenticate success, global_id 4542 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f00207a9640 10 monclient: _renew_subs 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f00207a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00181f2420 con 0x7f00180c92b0 2026-02-17T21:07:16.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 1 -- 10.20.193.45:0/666853654 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c0427e0 con 0x7f00180c92b0 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f001cd1b640 4 set_mon_vals no callback set 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7efffeffd640 10 monclient: dump: 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.725 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f00207a9640 10 client.4542.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f00207a9640 10 monclient: _renew_subs 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f00207a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00181f3000 con 0x7f00180c92b0 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.718+0000 7f00207a9640 1 librados: init done 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.719+0000 7f00207a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.719+0000 7f00207a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.719+0000 7f00207a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:16.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.719+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0018153f30 con 0x7f00180c92b0 2026-02-17T21:07:16.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.730+0000 7efffeffd640 1 -- 10.20.193.45:0/666853654 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f000c042980 con 0x7f00180c92b0 2026-02-17T21:07:16.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.730+0000 7efffeffd640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7effe80792d0 0x7effe807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.730+0000 7f001e51e640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7effe80792d0 0x7effe807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.730+0000 7f001e51e640 10 monclient: get_auth_request con 0x7effe80792d0 auth_method 0 2026-02-17T21:07:16.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.731+0000 7f001e51e640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7effe80792d0 0x7effe807b790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0008005110 tx=0x7f0008007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:16.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.731+0000 7efffeffd640 10 client.4542.objecter ms_handle_connect 0x7effe80792d0 2026-02-17T21:07:16.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.835+0000 7efffeffd640 1 -- 10.20.193.45:0/666853654 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f000c0839f0 con 0x7f00180c92b0 2026-02-17T21:07:16.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.835+0000 7efffeffd640 10 client.4542.objecter ms_dispatch2 0x7f0018000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:16.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.835+0000 7efffeffd640 3 client.4542.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:16.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.835+0000 7efffeffd640 3 client.4542.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:16.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.835+0000 7efffeffd640 20 client.4542.objecter dump_active .. 0 homeless 2026-02-17T21:07:16.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.835+0000 7efffeffd640 1 -- 10.20.193.45:0/666853654 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f000c0879b0 con 0x7f00180c92b0 2026-02-17T21:07:16.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.835+0000 7efffeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:16.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.835+0000 7efffeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:16.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.919+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00180c9b20 con 0x7effe80792d0 2026-02-17T21:07:16.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.920+0000 7efffeffd640 1 -- 10.20.193.45:0/666853654 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44985 (secure 0 0 0) 0x7f00180c9b20 con 0x7effe80792d0 2026-02-17T21:07:16.913 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:16.914 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-17T21:07:16.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 10 librados: watch_flush enter 2026-02-17T21:07:16.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 10 librados: watch_flush exit 2026-02-17T21:07:16.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 20 client.4542.objecter shutdown clearing up homeless session... 2026-02-17T21:07:16.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 10 client.4542.objecter successfully canceled tick 2026-02-17T21:07:16.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7effe80792d0 msgr2=0x7effe807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7effe80792d0 0x7effe807b790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0008005110 tx=0x7f0008007f30 comp rx=0 tx=0).stop 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 10 monclient: shutdown 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 msgr2=0x7f001806b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 0x7f001806b870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f000c02f4a0 tx=0x7f000c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 shutdown_connections 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7effe80792d0 0x7effe807b790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f001815d1e0 0x7f001815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00180c92b0 0x7f001806b870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 --2- 10.20.193.45:0/666853654 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00180748e0 0x7f00181f1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:16.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 >> 10.20.193.45:0/666853654 conn(0x7f00180c9d40 msgr2=0x7f0018152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:16.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 shutdown_connections 2026-02-17T21:07:16.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 -- 10.20.193.45:0/666853654 wait complete. 2026-02-17T21:07:16.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:16.922+0000 7f00207a9640 1 librados: shutdown 2026-02-17T21:07:16.923 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2026-02-17T21:07:16.667966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":437576,"kb_used_data":6104,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511864,"statfs":{"total":1546188226560,"available":1545740148736,"internally_reserved":0,"allocated":6250496,"data_stored":3116630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25498,"internal_metadata":441424998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.337976"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.541544+0000","last_change":"2026-02-17T21:07:11.541544+0000","last_active":"2026-02-17T21:07:11.541544+0000","last_peered":"2026-02-17T21:07:11.541544+0000","last_clean":"2026-02-17T21:07:11.541544+0000","last_became_active":"2026-02-17T21:07:09.672479+0000","last_became_peered":"2026-02-17T21:07:09.672479+0000","last_unstale":"2026-02-17T21:07:11.541544+0000","last_undegraded":"2026-02-17T21:07:11.541544+0000","last_fullsized":"2026-02-17T21:07:11.541544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:18:00.047244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048238970999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.966086+0000","last_change":"2026-02-17T21:07:11.966086+0000","last_active":"2026-02-17T21:07:11.966086+0000","last_peered":"2026-02-17T21:07:11.966086+0000","last_clean":"2026-02-17T21:07:11.966086+0000","last_became_active":"2026-02-17T21:07:09.634301+0000","last_became_peered":"2026-02-17T21:07:09.634301+0000","last_unstale":"2026-02-17T21:07:11.966086+0000","last_undegraded":"2026-02-17T21:07:11.966086+0000","last_fullsized":"2026-02-17T21:07:11.966086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:14:59.089621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032567963999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.999073+0000","last_change":"2026-02-17T21:07:12.020919+0000","last_active":"2026-02-17T21:07:11.999073+0000","last_peered":"2026-02-17T21:07:11.999073+0000","last_clean":"2026-02-17T21:07:11.999073+0000","last_became_active":"2026-02-17T21:07:09.505342+0000","last_became_peered":"2026-02-17T21:07:09.505342+0000","last_unstale":"2026-02-17T21:07:11.999073+0000","last_undegraded":"2026-02-17T21:07:11.999073+0000","last_fullsized":"2026-02-17T21:07:11.999073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:24:24.816438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036804456999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.520216+0000","last_change":"2026-02-17T21:07:11.520216+0000","last_active":"2026-02-17T21:07:11.520216+0000","last_peered":"2026-02-17T21:07:11.520216+0000","last_clean":"2026-02-17T21:07:11.520216+0000","last_became_active":"2026-02-17T21:07:09.674257+0000","last_became_peered":"2026-02-17T21:07:09.674257+0000","last_unstale":"2026-02-17T21:07:11.520216+0000","last_undegraded":"2026-02-17T21:07:11.520216+0000","last_fullsized":"2026-02-17T21:07:11.520216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:40:26.586387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033871934999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.572445+0000","last_change":"2026-02-17T21:07:11.525598+0000","last_active":"2026-02-17T21:07:11.572445+0000","last_peered":"2026-02-17T21:07:11.572445+0000","last_clean":"2026-02-17T21:07:11.572445+0000","last_became_active":"2026-02-17T21:07:09.679096+0000","last_became_peered":"2026-02-17T21:07:09.679096+0000","last_unstale":"2026-02-17T21:07:11.572445+0000","last_undegraded":"2026-02-17T21:07:11.572445+0000","last_fullsized":"2026-02-17T21:07:11.572445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:24:33.818275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036788098999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:12.003865+0000","last_change":"2026-02-17T21:07:12.033028+0000","last_active":"2026-02-17T21:07:12.003865+0000","last_peered":"2026-02-17T21:07:12.003865+0000","last_clean":"2026-02-17T21:07:12.003865+0000","last_became_active":"2026-02-17T21:07:09.677404+0000","last_became_peered":"2026-02-17T21:07:09.677404+0000","last_unstale":"2026-02-17T21:07:12.003865+0000","last_undegraded":"2026-02-17T21:07:12.003865+0000","last_fullsized":"2026-02-17T21:07:12.003865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:08:16.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047884902999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.507447+0000","last_change":"2026-02-17T21:07:11.526917+0000","last_active":"2026-02-17T21:07:11.507447+0000","last_peered":"2026-02-17T21:07:11.507447+0000","last_clean":"2026-02-17T21:07:11.507447+0000","last_became_active":"2026-02-17T21:07:09.663986+0000","last_became_peered":"2026-02-17T21:07:09.663986+0000","last_unstale":"2026-02-17T21:07:11.507447+0000","last_undegraded":"2026-02-17T21:07:11.507447+0000","last_fullsized":"2026-02-17T21:07:11.507447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:14:51.518524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039512685999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"30'1","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:12.010281+0000","last_change":"2026-02-17T21:07:12.029142+0000","last_active":"2026-02-17T21:07:12.010281+0000","last_peered":"2026-02-17T21:07:12.010281+0000","last_clean":"2026-02-17T21:07:12.010281+0000","last_became_active":"2026-02-17T21:07:09.717514+0000","last_became_peered":"2026-02-17T21:07:09.717514+0000","last_unstale":"2026-02-17T21:07:12.010281+0000","last_undegraded":"2026-02-17T21:07:12.010281+0000","last_fullsized":"2026-02-17T21:07:12.010281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T03:32:38.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031434124000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"28'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.978392+0000","last_change":"2026-02-17T21:07:07.293203+0000","last_active":"2026-02-17T21:07:11.978392+0000","last_peered":"2026-02-17T21:07:11.978392+0000","last_clean":"2026-02-17T21:07:11.978392+0000","last_became_active":"2026-02-17T21:07:06.988047+0000","last_became_peered":"2026-02-17T21:07:06.988047+0000","last_unstale":"2026-02-17T21:07:11.978392+0000","last_undegraded":"2026-02-17T21:07:11.978392+0000","last_fullsized":"2026-02-17T21:07:11.978392+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_clean_scrub_stamp":"2026-02-17T21:06:59.073039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:10.662342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":27,"seq":115964117002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":741376,"data_stored":542897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,9,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":27,"seq":115964117002,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":27,"seq":115964117002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,3,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":344064,"data_stored":145076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":344064,"data_stored":145076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149704,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":23,"seq":98784247814,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":741376,"data_stored":542897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":24,"seq":103079215110,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":26,"seq":111669149706,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,2,4,5,6,7,8,9,10,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":26,"seq":111669149703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,4,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":26,"seq":111669149706,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,3,4,6,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,3,4,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":27,"seq":115964117003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27304,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:07:16.925 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:07:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.001+0000 7ff9dae5b640 10 monclient: get_monmap_and_config 2026-02-17T21:07:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.001+0000 7ff9dae5b640 10 monclient: build_initial_monmap 2026-02-17T21:07:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.001+0000 7ff9dae5b640 10 monclient: monmap: 2026-02-17T21:07:16.993 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:16.993 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:16.993 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:17.001934+0000 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:17.001934+0000 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:16.994 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:16.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.001+0000 7ff9dae5b640 1 Processor -- start 2026-02-17T21:07:16.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.001+0000 7ff9dae5b640 1 -- start start 2026-02-17T21:07:16.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.001+0000 7ff9dae5b640 10 monclient: init 2026-02-17T21:07:16.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:16.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 10 monclient: _add_conns ranks=[1,5,4,2,0,3] 2026-02-17T21:07:16.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff9d415d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff9d40c92b0 0x7ff9d415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 10 monclient(hunting): picked mon.noname-c con 0x7ff9d40c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff9d40748e0 0x7ff9d4153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 10 monclient(hunting): picked mon.noname-b con 0x7ff9d40748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9d40c5860 con 0x7ff9d415d1e0 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d40c5580 con 0x7ff9d40748e0 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d40c7de0 con 0x7ff9d40c92b0 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9dae5b640 10 monclient(hunting): authenticate will time out at 1020.632152s 2026-02-17T21:07:16.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9d93d1640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff9d40748e0 0x7ff9d4153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9cbfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff9d40c92b0 0x7ff9d415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9cbfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff9d40c92b0 0x7ff9d415d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36848/0 (socket says 10.20.193.45:36848) 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9cbfff640 1 -- 10.20.193.45:0/4034906283 learned_addr learned my addr 10.20.193.45:0/4034906283 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9cbfff640 10 monclient(hunting): get_auth_request con 0x7ff9d40c92b0 auth_method 0 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9d93d1640 10 monclient(hunting): get_auth_request con 0x7ff9d40748e0 auth_method 0 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9d93d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9d93d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.002+0000 7ff9d93d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.003+0000 7ff9cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:16.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.003+0000 7ff9cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.003+0000 7ff9cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.003+0000 7ff9d93d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.003+0000 7ff9d93d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.003+0000 7ff9d93d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.004+0000 7ff9cbfff640 10 monclient(hunting): handle_auth_done global_id 4634 payload 274 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.004+0000 7ff9cbfff640 1 -- 10.20.193.45:0/4034906283 >> v2:10.20.193.86:3300/0 conn(0x7ff9d40748e0 msgr2=0x7ff9d4153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.004+0000 7ff9cbfff640 1 --2- 10.20.193.45:0/4034906283 >> v2:10.20.193.86:3300/0 conn(0x7ff9d40748e0 0x7ff9d4153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.004+0000 7ff9cbfff640 1 -- 10.20.193.45:0/4034906283 >> v1:10.20.193.86:6789/0 conn(0x7ff9d415d1e0 legacy=0x7ff9d40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.004+0000 7ff9cbfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.004+0000 7ff9cbfff640 1 monclient: found mon.noname-c 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.004+0000 7ff9cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.004+0000 7ff9cbfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:17.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.004+0000 7ff9cbfff640 1 -- 10.20.193.45:0/4034906283 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d40c80c0 con 0x7ff9d40c92b0 2026-02-17T21:07:17.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.005+0000 7ff9cbfff640 1 --2- 10.20.193.45:0/4034906283 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9d40c92b0 0x7ff9d415d5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009970 tx=0x7ff9bc02eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1bcc6827a29f352 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:17.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 1 -- 10.20.193.45:0/4034906283 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc03c070 con 0x7ff9d40c92b0 2026-02-17T21:07:17.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:17.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:17.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 10 monclient: dump: 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 1 -- 10.20.193.45:0/4034906283 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc02fbc0 con 0x7ff9d40c92b0 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9dae5b640 5 monclient: authenticate success, global_id 4634 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 1 -- 10.20.193.45:0/4034906283 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc037440 con 0x7ff9d40c92b0 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9dae5b640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9dae5b640 4 set_mon_vals no callback set 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.006+0000 7ff9cb7fe640 10 monclient: dump: 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:17.009 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 10 monclient: shutdown 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 1 -- 10.20.193.45:0/4034906283 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9d40c92b0 msgr2=0x7ff9d415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 1 --2- 10.20.193.45:0/4034906283 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9d40c92b0 0x7ff9d415d5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009970 tx=0x7ff9bc02eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 1 -- 10.20.193.45:0/4034906283 shutdown_connections 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 1 --2- 10.20.193.45:0/4034906283 >> v2:10.20.193.86:3300/0 conn(0x7ff9d40748e0 0x7ff9d4153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 1 --2- 10.20.193.45:0/4034906283 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9d40c92b0 0x7ff9d415d5c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 1 -- 10.20.193.45:0/4034906283 >> 10.20.193.45:0/4034906283 conn(0x7ff9d40c9d40 msgr2=0x7ff9d40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 1 -- 10.20.193.45:0/4034906283 shutdown_connections 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 1 -- 10.20.193.45:0/4034906283 wait complete. 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 10 monclient: build_initial_monmap 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.007+0000 7ff9dae5b640 10 monclient: monmap: 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:17.011 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 librados: starting msgr at 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 librados: starting objecter 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 Processor -- start 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 -- start start 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 librados: setting wanted keys 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 librados: calling monclient init 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient: init 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9d40748e0 0x7ff9d4073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient(hunting): picked mon.noname-b con 0x7ff9d40748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9d40c92b0 0x7ff9d41f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient(hunting): picked mon.noname-c con 0x7ff9d40c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 0x7ff9d40cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient(hunting): picked mon.noname-a con 0x7ff9d415d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4074d30 con 0x7ff9d415d1e0 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d40c8680 con 0x7ff9d40748e0 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4153b50 con 0x7ff9d40c92b0 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.008+0000 7ff9dae5b640 10 monclient(hunting): authenticate will time out at 1020.638648s 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 0x7ff9d40cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d8bd0640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9d40748e0 0x7ff9d4073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9cbfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9d40c92b0 0x7ff9d41f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 0x7ff9d40cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42462/0 (socket says 10.20.193.45:42462) 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 1 -- 10.20.193.45:0/2896475170 learned_addr learned my addr 10.20.193.45:0/2896475170 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 10 monclient(hunting): get_auth_request con 0x7ff9d415d1e0 auth_method 0 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9cbfff640 10 monclient(hunting): get_auth_request con 0x7ff9d40c92b0 auth_method 0 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d8bd0640 10 monclient(hunting): get_auth_request con 0x7ff9d40748e0 auth_method 0 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d8bd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d8bd0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d8bd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 1 -- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 msgr2=0x7ff9d40cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 1 -- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 msgr2=0x7ff9d40cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 0x7ff9d40cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d93d1640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 0x7ff9d40cca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d8bd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d8bd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9d8bd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.009+0000 7ff9cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 10 monclient(hunting): handle_auth_done global_id 4615 payload 824 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 1 -- 10.20.193.45:0/2896475170 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9d40c92b0 msgr2=0x7ff9d41f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9d40c92b0 0x7ff9d41f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 1 -- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 msgr2=0x7ff9d40cca70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 0x7ff9d40cca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 10 monclient: _finish_hunting 0 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 1 monclient: found mon.noname-b 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.010+0000 7ff9d8bd0640 1 -- 10.20.193.45:0/2896475170 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d41f4e50 con 0x7ff9d40748e0 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.012+0000 7ff9d8bd0640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9d40748e0 0x7ff9d4073060 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400c430 tx=0x7ff9c400c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.012+0000 7ff9c97fa640 10 client.?.objecter ms_handle_connect 0x7ff9d40748e0 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.012+0000 7ff9c97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 1 -- 10.20.193.45:0/2896475170 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40052d0 con 0x7ff9d40748e0 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 10 monclient: dump: 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.017 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 1 -- 10.20.193.45:0/2896475170 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c4005470 con 0x7ff9d40748e0 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9dae5b640 5 monclient: authenticate success, global_id 4615 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9dae5b640 10 monclient: _renew_subs 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9dae5b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d40725c0 con 0x7ff9d40748e0 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 1 -- 10.20.193.45:0/2896475170 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c40038c0 con 0x7ff9d40748e0 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9c97fa640 10 monclient: dump: 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9caffd640 4 set_mon_vals no callback set 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9dae5b640 10 client.4615.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9dae5b640 10 monclient: _renew_subs 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9dae5b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d41f4b70 con 0x7ff9d40748e0 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.013+0000 7ff9dae5b640 1 librados: init done 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.014+0000 7ff9dae5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.014+0000 7ff9dae5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.014+0000 7ff9dae5b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.014+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d4153f30 con 0x7ff9d40748e0 2026-02-17T21:07:17.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.026+0000 7ff9c97fa640 1 -- 10.20.193.45:0/2896475170 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff9c4003a60 con 0x7ff9d40748e0 2026-02-17T21:07:17.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.026+0000 7ff9c97fa640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9a4079280 0x7ff9a407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:17.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.026+0000 7ff9cbfff640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9a4079280 0x7ff9a407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:17.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.026+0000 7ff9cbfff640 10 monclient: get_auth_request con 0x7ff9a4079280 auth_method 0 2026-02-17T21:07:17.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.026+0000 7ff9cbfff640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9a4079280 0x7ff9a407b740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4076cd0 tx=0x7ff9bc039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:17.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.026+0000 7ff9c97fa640 10 client.4615.objecter ms_handle_connect 0x7ff9a4079280 2026-02-17T21:07:17.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.027+0000 7ff9c97fa640 1 -- 10.20.193.45:0/2896475170 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7ff9c405e2d0 con 0x7ff9d40748e0 2026-02-17T21:07:17.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.027+0000 7ff9c97fa640 10 client.4615.objecter ms_dispatch2 0x7ff9d4000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:17.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.027+0000 7ff9c97fa640 3 client.4615.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:17.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.027+0000 7ff9c97fa640 3 client.4615.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:17.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.028+0000 7ff9c97fa640 20 client.4615.objecter dump_active .. 0 homeless 2026-02-17T21:07:17.120 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.127+0000 7ff9c97fa640 1 -- 10.20.193.45:0/2896475170 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff9c4062990 con 0x7ff9d40748e0 2026-02-17T21:07:17.120 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.127+0000 7ff9c97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:17.120 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.127+0000 7ff9c97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:17.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.210+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9d41573a0 con 0x7ff9a4079280 2026-02-17T21:07:17.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.211+0000 7ff9c97fa640 1 -- 10.20.193.45:0/2896475170 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44985 (secure 0 0 0) 0x7ff9d41573a0 con 0x7ff9a4079280 2026-02-17T21:07:17.204 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 10 librados: watch_flush enter 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 10 librados: watch_flush exit 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 20 client.4615.objecter shutdown clearing up homeless session... 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 10 client.4615.objecter successfully canceled tick 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9a4079280 msgr2=0x7ff9a407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9a4079280 0x7ff9a407b740 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4076cd0 tx=0x7ff9bc039040 comp rx=0 tx=0).stop 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 10 monclient: shutdown 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:17.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9d40748e0 msgr2=0x7ff9d4073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9d40748e0 0x7ff9d4073060 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400c430 tx=0x7ff9c400c900 comp rx=0 tx=0).stop 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 shutdown_connections 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9a4079280 0x7ff9a407b740 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9d415d1e0 0x7ff9d40cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9d40c92b0 0x7ff9d41f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 --2- 10.20.193.45:0/2896475170 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9d40748e0 0x7ff9d4073060 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 >> 10.20.193.45:0/2896475170 conn(0x7ff9d40c9d40 msgr2=0x7ff9d40ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 shutdown_connections 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 -- 10.20.193.45:0/2896475170 wait complete. 2026-02-17T21:07:17.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.212+0000 7ff9dae5b640 1 librados: shutdown 2026-02-17T21:07:17.213 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2026-02-17T21:07:16.667966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":437576,"kb_used_data":6104,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511864,"statfs":{"total":1546188226560,"available":1545740148736,"internally_reserved":0,"allocated":6250496,"data_stored":3116630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25498,"internal_metadata":441424998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.337976"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.541544+0000","last_change":"2026-02-17T21:07:11.541544+0000","last_active":"2026-02-17T21:07:11.541544+0000","last_peered":"2026-02-17T21:07:11.541544+0000","last_clean":"2026-02-17T21:07:11.541544+0000","last_became_active":"2026-02-17T21:07:09.672479+0000","last_became_peered":"2026-02-17T21:07:09.672479+0000","last_unstale":"2026-02-17T21:07:11.541544+0000","last_undegraded":"2026-02-17T21:07:11.541544+0000","last_fullsized":"2026-02-17T21:07:11.541544+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:18:00.047244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048238970999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.966086+0000","last_change":"2026-02-17T21:07:11.966086+0000","last_active":"2026-02-17T21:07:11.966086+0000","last_peered":"2026-02-17T21:07:11.966086+0000","last_clean":"2026-02-17T21:07:11.966086+0000","last_became_active":"2026-02-17T21:07:09.634301+0000","last_became_peered":"2026-02-17T21:07:09.634301+0000","last_unstale":"2026-02-17T21:07:11.966086+0000","last_undegraded":"2026-02-17T21:07:11.966086+0000","last_fullsized":"2026-02-17T21:07:11.966086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:14:59.089621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032567963999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.999073+0000","last_change":"2026-02-17T21:07:12.020919+0000","last_active":"2026-02-17T21:07:11.999073+0000","last_peered":"2026-02-17T21:07:11.999073+0000","last_clean":"2026-02-17T21:07:11.999073+0000","last_became_active":"2026-02-17T21:07:09.505342+0000","last_became_peered":"2026-02-17T21:07:09.505342+0000","last_unstale":"2026-02-17T21:07:11.999073+0000","last_undegraded":"2026-02-17T21:07:11.999073+0000","last_fullsized":"2026-02-17T21:07:11.999073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:24:24.816438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036804456999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.520216+0000","last_change":"2026-02-17T21:07:11.520216+0000","last_active":"2026-02-17T21:07:11.520216+0000","last_peered":"2026-02-17T21:07:11.520216+0000","last_clean":"2026-02-17T21:07:11.520216+0000","last_became_active":"2026-02-17T21:07:09.674257+0000","last_became_peered":"2026-02-17T21:07:09.674257+0000","last_unstale":"2026-02-17T21:07:11.520216+0000","last_undegraded":"2026-02-17T21:07:11.520216+0000","last_fullsized":"2026-02-17T21:07:11.520216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:40:26.586387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033871934999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.572445+0000","last_change":"2026-02-17T21:07:11.525598+0000","last_active":"2026-02-17T21:07:11.572445+0000","last_peered":"2026-02-17T21:07:11.572445+0000","last_clean":"2026-02-17T21:07:11.572445+0000","last_became_active":"2026-02-17T21:07:09.679096+0000","last_became_peered":"2026-02-17T21:07:09.679096+0000","last_unstale":"2026-02-17T21:07:11.572445+0000","last_undegraded":"2026-02-17T21:07:11.572445+0000","last_fullsized":"2026-02-17T21:07:11.572445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:24:33.818275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036788098999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:12.003865+0000","last_change":"2026-02-17T21:07:12.033028+0000","last_active":"2026-02-17T21:07:12.003865+0000","last_peered":"2026-02-17T21:07:12.003865+0000","last_clean":"2026-02-17T21:07:12.003865+0000","last_became_active":"2026-02-17T21:07:09.677404+0000","last_became_peered":"2026-02-17T21:07:09.677404+0000","last_unstale":"2026-02-17T21:07:12.003865+0000","last_undegraded":"2026-02-17T21:07:12.003865+0000","last_fullsized":"2026-02-17T21:07:12.003865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:08:16.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047884902999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.507447+0000","last_change":"2026-02-17T21:07:11.526917+0000","last_active":"2026-02-17T21:07:11.507447+0000","last_peered":"2026-02-17T21:07:11.507447+0000","last_clean":"2026-02-17T21:07:11.507447+0000","last_became_active":"2026-02-17T21:07:09.663986+0000","last_became_peered":"2026-02-17T21:07:09.663986+0000","last_unstale":"2026-02-17T21:07:11.507447+0000","last_undegraded":"2026-02-17T21:07:11.507447+0000","last_fullsized":"2026-02-17T21:07:11.507447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:14:51.518524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039512685999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"30'1","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:12.010281+0000","last_change":"2026-02-17T21:07:12.029142+0000","last_active":"2026-02-17T21:07:12.010281+0000","last_peered":"2026-02-17T21:07:12.010281+0000","last_clean":"2026-02-17T21:07:12.010281+0000","last_became_active":"2026-02-17T21:07:09.717514+0000","last_became_peered":"2026-02-17T21:07:09.717514+0000","last_unstale":"2026-02-17T21:07:12.010281+0000","last_undegraded":"2026-02-17T21:07:12.010281+0000","last_fullsized":"2026-02-17T21:07:12.010281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T03:32:38.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031434124000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"28'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-17T21:07:11.978392+0000","last_change":"2026-02-17T21:07:07.293203+0000","last_active":"2026-02-17T21:07:11.978392+0000","last_peered":"2026-02-17T21:07:11.978392+0000","last_clean":"2026-02-17T21:07:11.978392+0000","last_became_active":"2026-02-17T21:07:06.988047+0000","last_became_peered":"2026-02-17T21:07:06.988047+0000","last_unstale":"2026-02-17T21:07:11.978392+0000","last_undegraded":"2026-02-17T21:07:11.978392+0000","last_fullsized":"2026-02-17T21:07:11.978392+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_clean_scrub_stamp":"2026-02-17T21:06:59.073039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:10.662342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":27,"seq":115964117002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":741376,"data_stored":542897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,9,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":27,"seq":115964117002,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":27,"seq":115964117002,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,3,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":344064,"data_stored":145076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":344064,"data_stored":145076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149704,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":23,"seq":98784247814,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":741376,"data_stored":542897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":24,"seq":103079215110,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":26,"seq":111669149706,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,2,4,5,6,7,8,9,10,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":26,"seq":111669149703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,4,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":26,"seq":111669149706,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,3,4,6,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149705,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,3,4,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":27,"seq":115964117003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27304,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":339968,"data_stored":145057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:07:17.215 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T21:07:17.215 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T21:07:17.215 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-17T21:07:17.215 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:17.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.290+0000 7f8be1ebd640 10 monclient: get_monmap_and_config 2026-02-17T21:07:17.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.290+0000 7f8be1ebd640 10 monclient: build_initial_monmap 2026-02-17T21:07:17.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.290+0000 7f8be1ebd640 10 monclient: monmap: 2026-02-17T21:07:17.283 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:17.283 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:17.283 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:17.291506+0000 2026-02-17T21:07:17.283 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:17.291506+0000 2026-02-17T21:07:17.283 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:17.283 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.284 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:17.284 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:17.284 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:17.284 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:17.284 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:17.284 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:17.284 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 1 Processor -- start 2026-02-17T21:07:17.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 1 -- start start 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 10 monclient: init 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 10 monclient: _add_conns ranks=[3,1,2,0,4,5] 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f8bdc152620 0x7f8bdc15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 10 monclient(hunting): picked mon.noname-a con 0x7f8bdc152620 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f8bdc152a00 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8bdc0c94a0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc0c71a0 con 0x7f8bdc152a00 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc0c7480 con 0x7f8bdc0c94a0 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:17.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f8bdc0c7760 con 0x7f8bdc152620 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.291+0000 7f8be1ebd640 10 monclient(hunting): authenticate will time out at 1020.921730s 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdbfff640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f8bdc0c94a0 0x7f8bdc0c5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:47818/0 (socket says 10.20.193.45:47818) 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdbfff640 1 -- 10.20.193.45:0/3135412486 learned_addr learned my addr 10.20.193.45:0/3135412486 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdb7fe640 1 --2- 10.20.193.45:0/3135412486 >> v2:10.20.193.45:3300/0 conn(0x7f8bdc152620 0x7f8bdc15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdb7fe640 10 monclient(hunting): get_auth_request con 0x7f8bdc152620 auth_method 0 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:17.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.292+0000 7f8bdb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 1 -- 10.20.193.45:0/3135412486 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586908253 0 0) 0x7f8bdc0c71a0 con 0x7f8bdc152a00 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 10 monclient(hunting): my global_id is 4618 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 1 -- 10.20.193.45:0/3135412486 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bc0003620 con 0x7f8bdc152a00 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 1 -- 10.20.193.45:0/3135412486 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447119341 0 0) 0x7f8bdc0c7480 con 0x7f8bdc0c94a0 2026-02-17T21:07:17.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 10 monclient(hunting): my global_id is 4640 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.293+0000 7f8bda7fc640 1 -- 10.20.193.45:0/3135412486 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bdc0c71a0 con 0x7f8bdc0c94a0 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.294+0000 7f8bdb7fe640 10 monclient(hunting): handle_auth_done global_id 4548 payload 274 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.294+0000 7f8bdb7fe640 1 -- 10.20.193.45:0/3135412486 >> v1:10.20.193.92:6789/0 conn(0x7f8bdc0c94a0 legacy=0x7f8bdc0c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.294+0000 7f8bdb7fe640 1 -- 10.20.193.45:0/3135412486 >> v1:10.20.193.86:6789/0 conn(0x7f8bdc152a00 legacy=0x7f8bdc0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.294+0000 7f8bdb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.294+0000 7f8bdb7fe640 1 monclient: found mon.noname-a 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.294+0000 7f8bdb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.294+0000 7f8bdb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:17.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.294+0000 7f8bdb7fe640 1 -- 10.20.193.45:0/3135412486 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc159e00 con 0x7f8bdc152620 2026-02-17T21:07:17.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.295+0000 7f8bdb7fe640 1 --2- 10.20.193.45:0/3135412486 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152620 0x7f8bdc15a8e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80098a0 tx=0x7f8bc802ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6088ccefe9220d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 1 -- 10.20.193.45:0/3135412486 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc803c070 con 0x7f8bdc152620 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 10 monclient: dump: 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.299 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 1 -- 10.20.193.45:0/3135412486 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc802fb70 con 0x7f8bdc152620 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 1 -- 10.20.193.45:0/3135412486 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8037440 con 0x7f8bdc152620 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8be1ebd640 5 monclient: authenticate success, global_id 4548 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8be1ebd640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:17.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8be1ebd640 4 set_mon_vals no callback set 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.296+0000 7f8bda7fc640 10 monclient: dump: 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:17.301 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 10 monclient: shutdown 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 1 -- 10.20.193.45:0/3135412486 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152620 msgr2=0x7f8bdc15a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 1 --2- 10.20.193.45:0/3135412486 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152620 0x7f8bdc15a8e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80098a0 tx=0x7f8bc802ee60 comp rx=0 tx=0).stop 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 1 -- 10.20.193.45:0/3135412486 shutdown_connections 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 1 --2- 10.20.193.45:0/3135412486 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152620 0x7f8bdc15a8e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 1 -- 10.20.193.45:0/3135412486 >> 10.20.193.45:0/3135412486 conn(0x7f8bdc0c9d40 msgr2=0x7f8bdc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 1 -- 10.20.193.45:0/3135412486 shutdown_connections 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 1 -- 10.20.193.45:0/3135412486 wait complete. 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 10 monclient: build_initial_monmap 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 10 monclient: monmap: 2026-02-17T21:07:17.302 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 1 librados: starting msgr at 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.297+0000 7f8be1ebd640 1 librados: starting objecter 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 Processor -- start 2026-02-17T21:07:17.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 -- start start 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 librados: setting wanted keys 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 librados: calling monclient init 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient: init 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8bdc0c94a0 0x7f8bdc14bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient(hunting): picked mon.noname-b con 0x7f8bdc0c94a0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8bdc152620 0x7f8bdc073d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient(hunting): picked mon.noname-c con 0x7f8bdc152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152a00 0x7f8bdc1577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient(hunting): picked mon.noname-a con 0x7f8bdc152a00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:17.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc15ae20 con 0x7f8bdc152a00 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc15a3c0 con 0x7f8bdc0c94a0 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc15afa0 con 0x7f8bdc152620 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8be1ebd640 10 monclient(hunting): authenticate will time out at 1020.928454s 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8bdbfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152a00 0x7f8bdc1577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8bdb7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8bdc0c94a0 0x7f8bdc14bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8bdaffd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8bdc152620 0x7f8bdc073d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8bdbfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152a00 0x7f8bdc1577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42484/0 (socket says 10.20.193.45:42484) 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8bdbfff640 1 -- 10.20.193.45:0/782285942 learned_addr learned my addr 10.20.193.45:0/782285942 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:17.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8bdbfff640 10 monclient(hunting): get_auth_request con 0x7f8bdc152a00 auth_method 0 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8bdbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8bdbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.298+0000 7f8bdbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdaffd640 10 monclient(hunting): get_auth_request con 0x7f8bdc152620 auth_method 0 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdb7fe640 10 monclient(hunting): get_auth_request con 0x7f8bdc0c94a0 auth_method 0 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:17.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.299+0000 7f8bdb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 10 monclient(hunting): handle_auth_done global_id 4643 payload 824 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 1 -- 10.20.193.45:0/782285942 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8bdc0c94a0 msgr2=0x7f8bdc14bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8bdc0c94a0 0x7f8bdc14bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 1 -- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152a00 msgr2=0x7f8bdc1577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152a00 0x7f8bdc1577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 1 monclient: found mon.noname-c 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdaffd640 1 -- 10.20.193.45:0/782285942 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc156760 con 0x7f8bdc152620 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.300+0000 7f8bdbfff640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152a00 0x7f8bdc1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.301+0000 7f8bdaffd640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8bdc152620 0x7f8bdc073d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc15bd30 tx=0x7f8bcc00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.301+0000 7f8bb7fff640 10 client.?.objecter ms_handle_connect 0x7f8bdc152620 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.301+0000 7f8bb7fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8bb7fff640 1 -- 10.20.193.45:0/782285942 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc017070 con 0x7f8bdc152620 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8bb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8bb7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:17.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8bb7fff640 10 monclient: dump: 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8bb7fff640 10 monclient: _finish_auth 0 2026-02-17T21:07:17.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8bb7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8bb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8be1ebd640 5 monclient: authenticate success, global_id 4643 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8be1ebd640 10 monclient: _renew_subs 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8be1ebd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bdc156a20 con 0x7f8bdc152620 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8be1ebd640 10 client.4643.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8be1ebd640 10 monclient: _renew_subs 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8be1ebd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bdc156fe0 con 0x7f8bdc152620 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.302+0000 7f8be1ebd640 1 librados: init done 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8be1ebd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8be1ebd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:17.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8be1ebd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bdc15a8e0 con 0x7f8bdc152620 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8bb7fff640 1 -- 10.20.193.45:0/782285942 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bcc0052d0 con 0x7f8bdc152620 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8bb7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8bb7fff640 1 -- 10.20.193.45:0/782285942 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc021060 con 0x7f8bdc152620 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8bb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8bb7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8bd9ffb640 4 set_mon_vals no callback set 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.303+0000 7f8bb7fff640 10 monclient: dump: 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:17.311 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:17.312 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:17.312 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:17.312 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:17.312 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:17.312 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:17.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.408+0000 7f8bb7fff640 1 -- 10.20.193.45:0/782285942 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f8bcc024080 con 0x7f8bdc152620 2026-02-17T21:07:17.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.408+0000 7f8bb7fff640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bac079280 0x7f8bac07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:17.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.408+0000 7f8bdb7fe640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bac079280 0x7f8bac07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:17.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.408+0000 7f8bdb7fe640 10 monclient: get_auth_request con 0x7f8bac079280 auth_method 0 2026-02-17T21:07:17.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.408+0000 7f8bdb7fe640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bac079280 0x7f8bac07b740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8039000 tx=0x7f8bc8033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:17.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.408+0000 7f8bb7fff640 10 client.4643.objecter ms_handle_connect 0x7f8bac079280 2026-02-17T21:07:17.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.409+0000 7f8bb7fff640 1 -- 10.20.193.45:0/782285942 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 8972+0+0 (secure 0 0 0) 0x7f8bcc05d910 con 0x7f8bdc152620 2026-02-17T21:07:17.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.409+0000 7f8bb7fff640 10 client.4643.objecter ms_dispatch2 0x7f8bdc000b90 osd_map(32..32 src has 1..32) 2026-02-17T21:07:17.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.409+0000 7f8bb7fff640 3 client.4643.objecter handle_osd_map got epochs [32,32] > 0 2026-02-17T21:07:17.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.409+0000 7f8bb7fff640 3 client.4643.objecter handle_osd_map decoding full epoch 32 2026-02-17T21:07:17.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.410+0000 7f8bb7fff640 20 client.4643.objecter dump_active .. 0 homeless 2026-02-17T21:07:17.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.416+0000 7f8bb7fff640 1 -- 10.20.193.45:0/782285942 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8bcc0618d0 con 0x7f8bdc152620 2026-02-17T21:07:17.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.416+0000 7f8bb7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:17.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.416+0000 7f8bb7fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:17.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.522+0000 7f8be1ebd640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:17.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.522+0000 7f8be1ebd640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:17.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.522+0000 7f8be1ebd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:17.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.522+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8bdc158800 con 0x7f8bdc152620 2026-02-17T21:07:17.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.525+0000 7f8bb7fff640 1 -- 10.20.193.45:0/782285942 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f8bcc065bd0 con 0x7f8bdc152620 2026-02-17T21:07:17.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.525+0000 7f8bb7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:17.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.525+0000 7f8bb7fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:17.518 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:17.518 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:17.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 10 librados: watch_flush enter 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 10 librados: watch_flush exit 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 20 client.4643.objecter shutdown clearing up homeless session... 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 10 client.4643.objecter successfully canceled tick 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bac079280 msgr2=0x7f8bac07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bac079280 0x7f8bac07b740 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8039000 tx=0x7f8bc8033000 comp rx=0 tx=0).stop 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 10 monclient: shutdown 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8bdc152620 msgr2=0x7f8bdc073d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8bdc152620 0x7f8bdc073d10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc15bd30 tx=0x7f8bcc00c8c0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 shutdown_connections 2026-02-17T21:07:17.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bac079280 0x7f8bac07b740 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8bdc152a00 0x7f8bdc1577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8bdc152620 0x7f8bdc073d10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 --2- 10.20.193.45:0/782285942 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8bdc0c94a0 0x7f8bdc14bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:17.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 >> 10.20.193.45:0/782285942 conn(0x7f8bdc0c9d40 msgr2=0x7f8bdc150d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:17.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 shutdown_connections 2026-02-17T21:07:17.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 -- 10.20.193.45:0/782285942 wait complete. 2026-02-17T21:07:17.522 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:17.527+0000 7f8be1ebd640 1 librados: shutdown 2026-02-17T21:07:20.529 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.605+0000 7f32f7bf7640 10 monclient: get_monmap_and_config 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.605+0000 7f32f7bf7640 10 monclient: build_initial_monmap 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.605+0000 7f32f7bf7640 10 monclient: monmap: 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:20.606208+0000 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:20.606208+0000 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:20.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.605+0000 7f32f7bf7640 1 Processor -- start 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.605+0000 7f32f7bf7640 1 -- start start 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.605+0000 7f32f7bf7640 10 monclient: init 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 10 monclient: _add_conns ranks=[5,3,0,4,2,1] 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f32f015d1e0 0x7f32f015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 10 monclient(hunting): picked mon.noname-c con 0x7f32f015d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f32f00748e0 0x7f32f00c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 10 monclient(hunting): picked mon.noname-a con 0x7f32f00748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f32f00c90e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32f00c9570 con 0x7f32f00c90e0 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f32f00c5860 con 0x7f32f00748e0 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f32f00c5580 con 0x7f32f015d1e0 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f7bf7640 10 monclient(hunting): authenticate will time out at 1024.236350s 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f516b640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f32f00748e0 0x7f32f00c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f596c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f32f015d1e0 0x7f32f015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:20.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f516b640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f32f00748e0 0x7f32f00c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42196/0 (socket says 10.20.193.45:42196) 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f516b640 1 -- 10.20.193.45:0/2663733332 learned_addr learned my addr 10.20.193.45:0/2663733332 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f516b640 10 monclient(hunting): get_auth_request con 0x7f32f00748e0 auth_method 0 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f516b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f516b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.606+0000 7f32f516b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f596c640 10 monclient(hunting): get_auth_request con 0x7f32f015d1e0 auth_method 0 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f596c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f596c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f596c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f596c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f596c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f596c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f516b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f516b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:20.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.607+0000 7f32f516b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:20.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.608+0000 7f32f516b640 10 monclient(hunting): handle_auth_done global_id 4554 payload 274 2026-02-17T21:07:20.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.608+0000 7f32f516b640 1 -- 10.20.193.45:0/2663733332 >> v2:10.20.193.92:3300/0 conn(0x7f32f015d1e0 msgr2=0x7f32f015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:20.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.608+0000 7f32f516b640 1 --2- 10.20.193.45:0/2663733332 >> v2:10.20.193.92:3300/0 conn(0x7f32f015d1e0 0x7f32f015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.608+0000 7f32f516b640 1 -- 10.20.193.45:0/2663733332 >> v1:10.20.193.45:6789/0 conn(0x7f32f00c90e0 legacy=0x7f32f0153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:20.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.608+0000 7f32f516b640 10 monclient: _finish_hunting 0 2026-02-17T21:07:20.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.608+0000 7f32f516b640 1 monclient: found mon.noname-a 2026-02-17T21:07:20.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.608+0000 7f32f516b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:20.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.608+0000 7f32f516b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:20.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.608+0000 7f32f516b640 1 -- 10.20.193.45:0/2663733332 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f00c7de0 con 0x7f32f00748e0 2026-02-17T21:07:20.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.610+0000 7f32f516b640 1 --2- 10.20.193.45:0/2663733332 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f00748e0 0x7f32f00c8ba0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009970 tx=0x7f32e402eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09c822963dc42f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 1 -- 10.20.193.45:0/2663733332 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e403c070 con 0x7f32f00748e0 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 10 monclient: dump: 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 10 monclient: _finish_auth 0 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 10 monclient: _check_auth_tickets 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 1 -- 10.20.193.45:0/2663733332 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e402fbc0 con 0x7f32f00748e0 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 1 -- 10.20.193.45:0/2663733332 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4037440 con 0x7f32f00748e0 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f496a640 10 monclient: dump: 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 5 monclient: authenticate success, global_id 4554 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:20.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 4 set_mon_vals no callback set 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 10 monclient: shutdown 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 1 -- 10.20.193.45:0/2663733332 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f00748e0 msgr2=0x7f32f00c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 1 --2- 10.20.193.45:0/2663733332 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f00748e0 0x7f32f00c8ba0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009970 tx=0x7f32e402eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 1 -- 10.20.193.45:0/2663733332 shutdown_connections 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 1 --2- 10.20.193.45:0/2663733332 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f00748e0 0x7f32f00c8ba0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 1 --2- 10.20.193.45:0/2663733332 >> v2:10.20.193.92:3300/0 conn(0x7f32f015d1e0 0x7f32f015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 1 -- 10.20.193.45:0/2663733332 >> 10.20.193.45:0/2663733332 conn(0x7f32f00c9d40 msgr2=0x7f32f00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 1 -- 10.20.193.45:0/2663733332 shutdown_connections 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.613+0000 7f32f7bf7640 1 -- 10.20.193.45:0/2663733332 wait complete. 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient: build_initial_monmap 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient: monmap: 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 librados: starting msgr at 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 librados: starting objecter 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 Processor -- start 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 -- start start 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 librados: setting wanted keys 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 librados: calling monclient init 2026-02-17T21:07:20.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient: init 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32f00748e0 0x7f32f01e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient(hunting): picked mon.noname-b con 0x7f32f00748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32f00c90e0 0x7f32f01e8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient(hunting): picked mon.noname-c con 0x7f32f00c90e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f015d1e0 0x7f32f006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient(hunting): picked mon.noname-a con 0x7f32f015d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00c8680 con 0x7f32f015d1e0 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:20.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f32f00c83a0 con 0x7f32f00748e0 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32f0074d30 con 0x7f32f00c90e0 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.614+0000 7f32f7bf7640 10 monclient(hunting): authenticate will time out at 1024.244738s 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f015d1e0 0x7f32f006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f596c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32f00748e0 0x7f32f01e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f516b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32f00c90e0 0x7f32f01e8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f015d1e0 0x7f32f006da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42198/0 (socket says 10.20.193.45:42198) 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 1 -- 10.20.193.45:0/1074269143 learned_addr learned my addr 10.20.193.45:0/1074269143 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 10 monclient(hunting): get_auth_request con 0x7f32f015d1e0 auth_method 0 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f516b640 10 monclient(hunting): get_auth_request con 0x7f32f00c90e0 auth_method 0 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f516b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f516b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f516b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f596c640 10 monclient(hunting): get_auth_request con 0x7f32f00748e0 auth_method 0 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f596c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f596c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f596c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f616d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f516b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f516b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f516b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f596c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f596c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.615+0000 7f32f596c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 10 monclient(hunting): handle_auth_done global_id 4560 payload 824 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 1 -- 10.20.193.45:0/1074269143 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32f00c90e0 msgr2=0x7f32f01e8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32f00c90e0 0x7f32f01e8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 1 -- 10.20.193.45:0/1074269143 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32f00748e0 msgr2=0x7f32f01e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:20.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32f00748e0 0x7f32f01e78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 10 monclient: _finish_hunting 0 2026-02-17T21:07:20.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 1 monclient: found mon.noname-a 2026-02-17T21:07:20.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:20.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:20.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.616+0000 7f32f616d640 1 -- 10.20.193.45:0/1074269143 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f01e5a60 con 0x7f32f015d1e0 2026-02-17T21:07:20.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.617+0000 7f32f616d640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f015d1e0 0x7f32f006da10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00cc80 tx=0x7f32ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:20.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.617+0000 7f32de7fc640 10 client.?.objecter ms_handle_connect 0x7f32f015d1e0 2026-02-17T21:07:20.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.617+0000 7f32de7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 1 -- 10.20.193.45:0/1074269143 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec003a70 con 0x7f32f015d1e0 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 10 monclient: dump: 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:20.611 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 1 -- 10.20.193.45:0/1074269143 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ec003c10 con 0x7f32f015d1e0 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32f7bf7640 5 monclient: authenticate success, global_id 4560 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 1 -- 10.20.193.45:0/1074269143 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ec0050d0 con 0x7f32f015d1e0 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32dffff640 4 set_mon_vals no callback set 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32de7fc640 10 monclient: dump: 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32f7bf7640 10 monclient: _renew_subs 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32f7bf7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f01e5d40 con 0x7f32f015d1e0 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32f7bf7640 10 client.4560.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32f7bf7640 10 monclient: _renew_subs 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32f7bf7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f006d210 con 0x7f32f015d1e0 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.619+0000 7f32f7bf7640 1 librados: init done 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.620+0000 7f32f7bf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.620+0000 7f32f7bf7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.620+0000 7f32f7bf7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:20.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.620+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f00c8ba0 con 0x7f32f015d1e0 2026-02-17T21:07:20.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.631+0000 7f32de7fc640 1 -- 10.20.193.45:0/1074269143 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f32ec005270 con 0x7f32f015d1e0 2026-02-17T21:07:20.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.631+0000 7f32de7fc640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32c0079300 0x7f32c007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:20.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.631+0000 7f32f596c640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32c0079300 0x7f32c007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:20.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.631+0000 7f32f596c640 10 monclient: get_auth_request con 0x7f32c0079300 auth_method 0 2026-02-17T21:07:20.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.632+0000 7f32f596c640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32c0079300 0x7f32c007b7c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009ba0 tx=0x7f32e0009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:20.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.632+0000 7f32de7fc640 10 client.4560.objecter ms_handle_connect 0x7f32c0079300 2026-02-17T21:07:20.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.632+0000 7f32de7fc640 1 -- 10.20.193.45:0/1074269143 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f32ec05ea90 con 0x7f32f015d1e0 2026-02-17T21:07:20.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.632+0000 7f32de7fc640 10 client.4560.objecter ms_dispatch2 0x7f32f0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:20.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.632+0000 7f32de7fc640 3 client.4560.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:20.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.632+0000 7f32de7fc640 3 client.4560.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:20.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.632+0000 7f32de7fc640 20 client.4560.objecter dump_active .. 0 homeless 2026-02-17T21:07:20.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.735+0000 7f32de7fc640 1 -- 10.20.193.45:0/1074269143 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f32ec062a50 con 0x7f32f015d1e0 2026-02-17T21:07:20.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.736+0000 7f32de7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:20.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.736+0000 7f32de7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:20.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.836+0000 7f32f7bf7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:20.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.836+0000 7f32f7bf7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:20.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.836+0000 7f32f7bf7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:20.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.836+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f32f00c9b20 con 0x7f32f015d1e0 2026-02-17T21:07:20.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.840+0000 7f32de7fc640 1 -- 10.20.193.45:0/1074269143 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f32ec066d50 con 0x7f32f015d1e0 2026-02-17T21:07:20.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.841+0000 7f32de7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:20.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.841+0000 7f32de7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:20.833 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:20.833 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:20.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 10 librados: watch_flush enter 2026-02-17T21:07:20.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 10 librados: watch_flush exit 2026-02-17T21:07:20.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 20 client.4560.objecter shutdown clearing up homeless session... 2026-02-17T21:07:20.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 10 client.4560.objecter successfully canceled tick 2026-02-17T21:07:20.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32c0079300 msgr2=0x7f32c007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:20.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32c0079300 0x7f32c007b7c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009ba0 tx=0x7f32e0009290 comp rx=0 tx=0).stop 2026-02-17T21:07:20.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 10 monclient: shutdown 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f015d1e0 msgr2=0x7f32f006da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f015d1e0 0x7f32f006da10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00cc80 tx=0x7f32ec00a430 comp rx=0 tx=0).stop 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 shutdown_connections 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f32c0079300 0x7f32c007b7c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f32f015d1e0 0x7f32f006da10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f32f00c90e0 0x7f32f01e8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 --2- 10.20.193.45:0/1074269143 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f32f00748e0 0x7f32f01e78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 >> 10.20.193.45:0/1074269143 conn(0x7f32f00c9d40 msgr2=0x7f32f014de90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 shutdown_connections 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 -- 10.20.193.45:0/1074269143 wait complete. 2026-02-17T21:07:20.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:20.842+0000 7f32f7bf7640 1 librados: shutdown 2026-02-17T21:07:23.844 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:23.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.918+0000 7f2a07555640 10 monclient: get_monmap_and_config 2026-02-17T21:07:23.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.918+0000 7f2a07555640 10 monclient: build_initial_monmap 2026-02-17T21:07:23.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.918+0000 7f2a07555640 10 monclient: monmap: 2026-02-17T21:07:23.911 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:23.912 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:23.912 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:23.919591+0000 2026-02-17T21:07:23.912 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:23.919591+0000 2026-02-17T21:07:23.912 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:23.912 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:23.912 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:23.912 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:23.912 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:23.913 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:23.913 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:23.913 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:23.913 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:23.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 1 Processor -- start 2026-02-17T21:07:23.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 1 -- start start 2026-02-17T21:07:23.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 10 monclient: init 2026-02-17T21:07:23.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:23.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 10 monclient: _add_conns ranks=[0,3,2,1,5,4] 2026-02-17T21:07:23.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2a0015d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:23.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f2a000c92b0 0x7f2a0015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:23.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 10 monclient(hunting): picked mon.noname-a con 0x7f2a000c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:23.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2a000748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:23.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a000c5860 con 0x7f2a0015d1e0 2026-02-17T21:07:23.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a000c5580 con 0x7f2a000748e0 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f2a000c7de0 con 0x7f2a000c92b0 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.919+0000 7f2a07555640 10 monclient(hunting): authenticate will time out at 1027.549862s 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a05acb640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f2a000748e0 0x7f2a00153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:41662/0 (socket says 10.20.193.45:41662) 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a05acb640 1 -- 10.20.193.45:0/986561097 learned_addr learned my addr 10.20.193.45:0/986561097 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a04ac9640 1 --2- 10.20.193.45:0/986561097 >> v2:10.20.193.45:3300/0 conn(0x7f2a000c92b0 0x7f2a0015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a04ac9640 10 monclient(hunting): get_auth_request con 0x7f2a000c92b0 auth_method 0 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a04ac9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a04ac9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a04ac9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a04ac9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:23.917 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a04ac9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.920+0000 7f2a04ac9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f29effff640 1 -- 10.20.193.45:0/986561097 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469076584 0 0) 0x7f2a000c5580 con 0x7f2a000748e0 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f29effff640 10 monclient(hunting): _negotiate 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f29effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f29effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f29effff640 10 monclient(hunting): my global_id is 4652 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f29effff640 1 -- 10.20.193.45:0/986561097 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29e8003620 con 0x7f2a000748e0 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f2a04ac9640 10 monclient(hunting): handle_auth_done global_id 4563 payload 274 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f2a04ac9640 1 -- 10.20.193.45:0/986561097 >> v1:10.20.193.92:6789/0 conn(0x7f2a000748e0 legacy=0x7f2a00153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f2a04ac9640 1 -- 10.20.193.45:0/986561097 >> v1:10.20.193.45:6789/0 conn(0x7f2a0015d1e0 legacy=0x7f2a000c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f2a04ac9640 10 monclient: _finish_hunting 0 2026-02-17T21:07:23.918 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f2a04ac9640 1 monclient: found mon.noname-a 2026-02-17T21:07:23.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f2a04ac9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:23.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f2a04ac9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:23.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.922+0000 7f2a04ac9640 1 -- 10.20.193.45:0/986561097 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a000c80c0 con 0x7f2a000c92b0 2026-02-17T21:07:23.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.924+0000 7f2a04ac9640 1 --2- 10.20.193.45:0/986561097 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2a000c92b0 0x7f2a0015d5c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29f40098d0 tx=0x7f29f402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84924d3f3000c6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:23.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 1 -- 10.20.193.45:0/986561097 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f403c070 con 0x7f2a000c92b0 2026-02-17T21:07:23.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:23.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:23.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 10 monclient: dump: 2026-02-17T21:07:23.924 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:23.924 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:23.924 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 10 monclient: _finish_auth 0 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:23.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 1 -- 10.20.193.45:0/986561097 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f402fba0 con 0x7f2a000c92b0 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 1 -- 10.20.193.45:0/986561097 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4037440 con 0x7f2a000c92b0 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 5 monclient: authenticate success, global_id 4563 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 4 set_mon_vals no callback set 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f29effff640 10 monclient: dump: 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:23.926 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 10 monclient: shutdown 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 1 -- 10.20.193.45:0/986561097 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2a000c92b0 msgr2=0x7f2a0015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 1 --2- 10.20.193.45:0/986561097 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2a000c92b0 0x7f2a0015d5c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f29f40098d0 tx=0x7f29f402eed0 comp rx=0 tx=0).stop 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 1 -- 10.20.193.45:0/986561097 shutdown_connections 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 1 --2- 10.20.193.45:0/986561097 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2a000c92b0 0x7f2a0015d5c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:23.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 1 -- 10.20.193.45:0/986561097 >> 10.20.193.45:0/986561097 conn(0x7f2a000c9d40 msgr2=0x7f2a000ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.927+0000 7f2a07555640 1 -- 10.20.193.45:0/986561097 shutdown_connections 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 1 -- 10.20.193.45:0/986561097 wait complete. 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 10 monclient: build_initial_monmap 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 10 monclient: monmap: 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:23.928 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 1 librados: starting msgr at 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 1 librados: starting objecter 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 1 Processor -- start 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 1 -- start start 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 1 librados: setting wanted keys 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 1 librados: calling monclient init 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.928+0000 7f2a07555640 10 monclient: init 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2a000748e0 0x7f2a0015c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:23.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient(hunting): picked mon.noname-a con 0x7f2a000748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2a000c92b0 0x7f2a0006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient(hunting): picked mon.noname-c con 0x7f2a000c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2a0015d1e0 0x7f2a0006df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient(hunting): picked mon.noname-b con 0x7f2a0015d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00074d30 con 0x7f2a000748e0 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2a000c8680 con 0x7f2a0015d1e0 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a00153d20 con 0x7f2a000c92b0 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a07555640 10 monclient(hunting): authenticate will time out at 1027.559426s 2026-02-17T21:07:23.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a04ac9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2a000c92b0 0x7f2a0006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a04ac9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2a000c92b0 0x7f2a0006b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:43714/0 (socket says 10.20.193.45:43714) 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a04ac9640 1 -- 10.20.193.45:0/4076438774 learned_addr learned my addr 10.20.193.45:0/4076438774 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a04ac9640 10 monclient(hunting): get_auth_request con 0x7f2a000c92b0 auth_method 0 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a04ac9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a04ac9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a04ac9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.929+0000 7f2a05acb640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2a0015d1e0 0x7f2a0006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a04ac9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a04ac9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a04ac9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:23.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a05acb640 10 monclient(hunting): get_auth_request con 0x7f2a0015d1e0 auth_method 0 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a05acb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a05acb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a05acb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a05acb640 1 -- 10.20.193.45:0/4076438774 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2a0015d1e0 msgr2=0x7f2a0006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a05acb640 1 -- 10.20.193.45:0/4076438774 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2a0015d1e0 msgr2=0x7f2a0006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a05acb640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2a0015d1e0 0x7f2a0006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a05acb640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2a0015d1e0 0x7f2a0006df10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a052ca640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2a000748e0 0x7f2a0015c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a052ca640 10 monclient(hunting): get_auth_request con 0x7f2a000748e0 auth_method 0 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a052ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a052ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.930+0000 7f2a052ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:23.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 10 monclient(hunting): handle_auth_done global_id 4655 payload 824 2026-02-17T21:07:23.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 1 -- 10.20.193.45:0/4076438774 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2a0015d1e0 msgr2=0x7f2a0006df10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T21:07:23.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2a0015d1e0 0x7f2a0006df10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:23.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 1 -- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2a000748e0 msgr2=0x7f2a0015c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:23.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2a000748e0 0x7f2a0015c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:23.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 10 monclient: _finish_hunting 0 2026-02-17T21:07:23.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 1 monclient: found mon.noname-c 2026-02-17T21:07:23.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:23.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:23.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.931+0000 7f2a04ac9640 1 -- 10.20.193.45:0/4076438774 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0006d170 con 0x7f2a000c92b0 2026-02-17T21:07:23.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.932+0000 7f2a04ac9640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2a000c92b0 0x7f2a0006b7e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29f403a040 tx=0x7f29f40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:23.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.932+0000 7f29edffb640 10 client.?.objecter ms_handle_connect 0x7f2a000c92b0 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.932+0000 7f29edffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f29edffb640 1 -- 10.20.193.45:0/4076438774 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f403c040 con 0x7f2a000c92b0 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f29edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f29edffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f29edffb640 10 monclient: dump: 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:23.936 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f29edffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f29edffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f29edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f2a07555640 5 monclient: authenticate success, global_id 4655 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f2a07555640 10 monclient: _renew_subs 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f2a07555640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:23.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0015b8f0 con 0x7f2a000c92b0 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f2a07555640 10 client.4655.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f2a07555640 10 monclient: _renew_subs 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f2a07555640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0006d430 con 0x7f2a000c92b0 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.933+0000 7f2a07555640 1 librados: init done 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f2a07555640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f2a07555640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f2a07555640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a0015d5c0 con 0x7f2a000c92b0 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f29edffb640 1 -- 10.20.193.45:0/4076438774 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f402fa60 con 0x7f2a000c92b0 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f29edffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:23.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f29edffb640 1 -- 10.20.193.45:0/4076438774 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f4004430 con 0x7f2a000c92b0 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f29edffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f29edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f29edffb640 10 monclient: dump: 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:23.939 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:23.940 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:23.940 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:23.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.934+0000 7f29ef7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:23.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.947+0000 7f29edffb640 1 -- 10.20.193.45:0/4076438774 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f29f4003710 con 0x7f2a000c92b0 2026-02-17T21:07:23.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.947+0000 7f29edffb640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f29d0079280 0x7f29d007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:23.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.947+0000 7f2a052ca640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f29d0079280 0x7f29d007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:23.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.947+0000 7f2a052ca640 10 monclient: get_auth_request con 0x7f29d0079280 auth_method 0 2026-02-17T21:07:23.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.947+0000 7f2a052ca640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f29d0079280 0x7f29d007b740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f29f0004f50 tx=0x7f29f0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:23.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:23.947+0000 7f29edffb640 10 client.4655.objecter ms_handle_connect 0x7f29d0079280 2026-02-17T21:07:24.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.069+0000 7f29edffb640 1 -- 10.20.193.45:0/4076438774 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f29f40834e0 con 0x7f2a000c92b0 2026-02-17T21:07:24.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.069+0000 7f29edffb640 10 client.4655.objecter ms_dispatch2 0x7f2a00000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:24.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.069+0000 7f29edffb640 3 client.4655.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.070+0000 7f29edffb640 3 client.4655.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.070+0000 7f29edffb640 20 client.4655.objecter dump_active .. 0 homeless 2026-02-17T21:07:24.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.076+0000 7f29edffb640 1 -- 10.20.193.45:0/4076438774 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f29f4050070 con 0x7f2a000c92b0 2026-02-17T21:07:24.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.076+0000 7f29edffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:24.068 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.076+0000 7f29edffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:24.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.178+0000 7f2a07555640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:24.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.178+0000 7f2a07555640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.178+0000 7f2a07555640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.178+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2a000c9b20 con 0x7f2a000c92b0 2026-02-17T21:07:24.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.182+0000 7f29edffb640 1 -- 10.20.193.45:0/4076438774 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f29f4046020 con 0x7f2a000c92b0 2026-02-17T21:07:24.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.182+0000 7f29edffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:24.175 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.182+0000 7f29edffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:24.175 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:24.175 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:24.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 10 librados: watch_flush enter 2026-02-17T21:07:24.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 10 librados: watch_flush exit 2026-02-17T21:07:24.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 20 client.4655.objecter shutdown clearing up homeless session... 2026-02-17T21:07:24.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 10 client.4655.objecter successfully canceled tick 2026-02-17T21:07:24.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f29d0079280 msgr2=0x7f29d007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:24.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f29d0079280 0x7f29d007b740 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f29f0004f50 tx=0x7f29f0009040 comp rx=0 tx=0).stop 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 10 monclient: shutdown 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2a000c92b0 msgr2=0x7f2a0006b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2a000c92b0 0x7f2a0006b7e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29f403a040 tx=0x7f29f40047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 shutdown_connections 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f29d0079280 0x7f29d007b740 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2a0015d1e0 0x7f2a0006df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2a000c92b0 0x7f2a0006b7e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 --2- 10.20.193.45:0/4076438774 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2a000748e0 0x7f2a0015c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 >> 10.20.193.45:0/4076438774 conn(0x7f2a000c9d40 msgr2=0x7f2a001489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 shutdown_connections 2026-02-17T21:07:24.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 -- 10.20.193.45:0/4076438774 wait complete. 2026-02-17T21:07:24.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:24.184+0000 7f2a07555640 1 librados: shutdown 2026-02-17T21:07:27.187 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:27.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.264+0000 7f71b2396640 10 monclient: get_monmap_and_config 2026-02-17T21:07:27.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.264+0000 7f71b2396640 10 monclient: build_initial_monmap 2026-02-17T21:07:27.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.264+0000 7f71b2396640 10 monclient: monmap: 2026-02-17T21:07:27.262 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:27.262 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:27.262 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:27.265235+0000 2026-02-17T21:07:27.262 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:27.265235+0000 2026-02-17T21:07:27.263 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:27.263 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:27.263 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:27.263 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:27.263 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:27.264 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:27.264 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:27.264 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:27.264 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:27.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.264+0000 7f71b2396640 1 Processor -- start 2026-02-17T21:07:27.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.264+0000 7f71b2396640 1 -- start start 2026-02-17T21:07:27.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.264+0000 7f71b2396640 10 monclient: init 2026-02-17T21:07:27.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:27.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 10 monclient: _add_conns ranks=[5,2,3,4,1,0] 2026-02-17T21:07:27.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f71ac152620 0x7f71ac15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:27.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 10 monclient(hunting): picked mon.noname-c con 0x7f71ac152620 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:27.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f71ac152a00 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:27.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f71ac0c94a0 0x7f71ac15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:27.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 10 monclient(hunting): picked mon.noname-a con 0x7f71ac0c94a0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:27.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ac0c71a0 con 0x7f71ac152a00 2026-02-17T21:07:27.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:27.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f71ac0c7760 con 0x7f71ac0c94a0 2026-02-17T21:07:27.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:27.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f71ac0c7480 con 0x7f71ac152620 2026-02-17T21:07:27.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:27.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b2396640 10 monclient(hunting): authenticate will time out at 1030.895381s 2026-02-17T21:07:27.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b090c640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f71ac0c94a0 0x7f71ac15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:27.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71abfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f71ac152620 0x7f71ac15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:27.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b090c640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f71ac0c94a0 0x7f71ac15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42218/0 (socket says 10.20.193.45:42218) 2026-02-17T21:07:27.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b090c640 1 -- 10.20.193.45:0/584518734 learned_addr learned my addr 10.20.193.45:0/584518734 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:27.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b090c640 10 monclient(hunting): get_auth_request con 0x7f71ac0c94a0 auth_method 0 2026-02-17T21:07:27.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b090c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:27.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b090c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:27.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.265+0000 7f71b090c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:27.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71abfff640 10 monclient(hunting): get_auth_request con 0x7f71ac152620 auth_method 0 2026-02-17T21:07:27.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:27.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:27.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:27.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71b090c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:27.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71b090c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:27.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71b090c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:27.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:27.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:27.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.266+0000 7f71abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:27.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.267+0000 7f71b090c640 10 monclient(hunting): handle_auth_done global_id 4569 payload 274 2026-02-17T21:07:27.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.267+0000 7f71b090c640 1 -- 10.20.193.45:0/584518734 >> v2:10.20.193.92:3300/0 conn(0x7f71ac152620 msgr2=0x7f71ac15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:27.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.267+0000 7f71b090c640 1 --2- 10.20.193.45:0/584518734 >> v2:10.20.193.92:3300/0 conn(0x7f71ac152620 0x7f71ac15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:27.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.267+0000 7f71b090c640 1 -- 10.20.193.45:0/584518734 >> v1:10.20.193.92:6789/0 conn(0x7f71ac152a00 legacy=0x7f71ac0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:27.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.267+0000 7f71b090c640 10 monclient: _finish_hunting 0 2026-02-17T21:07:27.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.267+0000 7f71b090c640 1 monclient: found mon.noname-a 2026-02-17T21:07:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.267+0000 7f71b090c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.267+0000 7f71b090c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.267+0000 7f71b090c640 1 -- 10.20.193.45:0/584518734 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac159e00 con 0x7f71ac0c94a0 2026-02-17T21:07:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.268+0000 7f71b090c640 1 --2- 10.20.193.45:0/584518734 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 0x7f71ac15ae20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f71ac072110 tx=0x7f71a002f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc16b82e9eed4ab server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.269+0000 7f71aaffd640 1 -- 10.20.193.45:0/584518734 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a002fcd0 con 0x7f71ac0c94a0 2026-02-17T21:07:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.269+0000 7f71aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.269+0000 7f71aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.269+0000 7f71aaffd640 10 monclient: dump: 2026-02-17T21:07:27.288 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:27.288 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:27.289 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:27.289 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:27.289 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:27.289 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:27.289 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:27.289 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:27.290 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:27.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71aaffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:27.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71aaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:27.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:27.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71aaffd640 1 -- 10.20.193.45:0/584518734 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a00373f0 con 0x7f71ac0c94a0 2026-02-17T21:07:27.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 5 monclient: authenticate success, global_id 4569 2026-02-17T21:07:27.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:27.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71aaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:27.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71aaffd640 1 -- 10.20.193.45:0/584518734 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a00377c0 con 0x7f71ac0c94a0 2026-02-17T21:07:27.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:27.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 4 set_mon_vals no callback set 2026-02-17T21:07:27.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:27.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:27.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71aaffd640 10 monclient: dump: 2026-02-17T21:07:27.292 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:27.292 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:27.292 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:27.292 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:27.292 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:27.292 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:27.292 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:27.293 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:27.293 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 10 monclient: shutdown 2026-02-17T21:07:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 1 -- 10.20.193.45:0/584518734 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 msgr2=0x7f71ac15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 1 --2- 10.20.193.45:0/584518734 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 0x7f71ac15ae20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f71ac072110 tx=0x7f71a002f270 comp rx=0 tx=0).stop 2026-02-17T21:07:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 1 -- 10.20.193.45:0/584518734 shutdown_connections 2026-02-17T21:07:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 1 --2- 10.20.193.45:0/584518734 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 0x7f71ac15ae20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 1 --2- 10.20.193.45:0/584518734 >> v2:10.20.193.92:3300/0 conn(0x7f71ac152620 0x7f71ac15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 1 -- 10.20.193.45:0/584518734 >> 10.20.193.45:0/584518734 conn(0x7f71ac0c9d40 msgr2=0x7f71ac0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 1 -- 10.20.193.45:0/584518734 shutdown_connections 2026-02-17T21:07:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 1 -- 10.20.193.45:0/584518734 wait complete. 2026-02-17T21:07:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 10 monclient: build_initial_monmap 2026-02-17T21:07:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.270+0000 7f71b2396640 10 monclient: monmap: 2026-02-17T21:07:27.295 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:27.295 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:27.295 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:27.295 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:27.295 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:27.295 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:27.295 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:27.295 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:27.296 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:27.296 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:27.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 librados: starting msgr at 2026-02-17T21:07:27.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 librados: starting objecter 2026-02-17T21:07:27.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 Processor -- start 2026-02-17T21:07:27.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 -- start start 2026-02-17T21:07:27.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 librados: setting wanted keys 2026-02-17T21:07:27.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 librados: calling monclient init 2026-02-17T21:07:27.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient: init 2026-02-17T21:07:27.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:27.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:27.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 0x7f71ac144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:27.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient(hunting): picked mon.noname-a con 0x7f71ac0c94a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:27.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71ac152620 0x7f71ac1469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:27.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient(hunting): picked mon.noname-c con 0x7f71ac152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:27.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71ac152a00 0x7f71ac13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:27.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient(hunting): picked mon.noname-b con 0x7f71ac152a00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:27.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:27.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac0c7c40 con 0x7f71ac0c94a0 2026-02-17T21:07:27.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:27.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac15a3c0 con 0x7f71ac152a00 2026-02-17T21:07:27.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:27.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac0c7dc0 con 0x7f71ac152620 2026-02-17T21:07:27.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:27.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71b2396640 10 monclient(hunting): authenticate will time out at 1030.901493s 2026-02-17T21:07:27.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71abfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 0x7f71ac144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:27.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71ab7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71ac152620 0x7f71ac1469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:27.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71abfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 0x7f71ac144f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42222/0 (socket says 10.20.193.45:42222) 2026-02-17T21:07:27.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71abfff640 1 -- 10.20.193.45:0/1095718616 learned_addr learned my addr 10.20.193.45:0/1095718616 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:27.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71abfff640 10 monclient(hunting): get_auth_request con 0x7f71ac0c94a0 auth_method 0 2026-02-17T21:07:27.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:27.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71abfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:27.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.271+0000 7f71abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:27.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71b090c640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71ac152a00 0x7f71ac13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:27.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71ab7fe640 10 monclient(hunting): get_auth_request con 0x7f71ac152620 auth_method 0 2026-02-17T21:07:27.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:27.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:27.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:27.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:27.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:27.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:27.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71b090c640 10 monclient(hunting): get_auth_request con 0x7f71ac152a00 auth_method 0 2026-02-17T21:07:27.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71b090c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:27.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71b090c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:27.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71b090c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:27.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:27.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:27.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:27.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71b090c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:27.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71b090c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:27.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.272+0000 7f71b090c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:27.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 10 monclient(hunting): handle_auth_done global_id 4572 payload 824 2026-02-17T21:07:27.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 1 -- 10.20.193.45:0/1095718616 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71ac152620 msgr2=0x7f71ac1469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:27.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71ac152620 0x7f71ac1469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:27.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 1 -- 10.20.193.45:0/1095718616 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71ac152a00 msgr2=0x7f71ac13f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:27.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71ac152a00 0x7f71ac13f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:27.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 1 monclient: found mon.noname-a 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.273+0000 7f71abfff640 1 -- 10.20.193.45:0/1095718616 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac1f4420 con 0x7f71ac0c94a0 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.274+0000 7f71abfff640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 0x7f71ac144f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f719800ec10 tx=0x7f719800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.274+0000 7f71a8ff9640 10 client.?.objecter ms_handle_connect 0x7f71ac0c94a0 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.274+0000 7f71a8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 1 -- 10.20.193.45:0/1095718616 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198017070 con 0x7f71ac0c94a0 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:27.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:27.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 10 monclient: dump: 2026-02-17T21:07:27.304 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:27.304 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:27.304 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:27.304 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:27.304 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:27.304 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:27.304 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:27.304 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 10 monclient: _finish_auth 0 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 1 -- 10.20.193.45:0/1095718616 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719800cc40 con 0x7f71ac0c94a0 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 1 -- 10.20.193.45:0/1095718616 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198013470 con 0x7f71ac0c94a0 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:27.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71aa7fc640 4 set_mon_vals no callback set 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71a8ff9640 10 monclient: dump: 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:27.306 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 5 monclient: authenticate success, global_id 4572 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 10 monclient: _renew_subs 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac1400f0 con 0x7f71ac0c94a0 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 10 client.4572.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 10 monclient: _renew_subs 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:27.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1406b0 con 0x7f71ac0c94a0 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 1 librados: init done 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.276+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac15a8e0 con 0x7f71ac0c94a0 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.288+0000 7f71a8ff9640 1 -- 10.20.193.45:0/1095718616 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f7198013630 con 0x7f71ac0c94a0 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.289+0000 7f71a8ff9640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f717c079280 0x7f717c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.289+0000 7f71ab7fe640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f717c079280 0x7f717c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.289+0000 7f71ab7fe640 10 monclient: get_auth_request con 0x7f717c079280 auth_method 0 2026-02-17T21:07:27.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.289+0000 7f71a8ff9640 10 client.4572.objecter ms_handle_connect 0x7f717c079280 2026-02-17T21:07:27.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.289+0000 7f71ab7fe640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f717c079280 0x7f717c07b740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f71ac1652e0 tx=0x7f719c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:27.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.291+0000 7f71a8ff9640 1 -- 10.20.193.45:0/1095718616 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f719805e900 con 0x7f71ac0c94a0 2026-02-17T21:07:27.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.291+0000 7f71a8ff9640 10 client.4572.objecter ms_dispatch2 0x7f71ac000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:27.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.291+0000 7f71a8ff9640 3 client.4572.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:27.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.291+0000 7f71a8ff9640 3 client.4572.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:27.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.291+0000 7f71a8ff9640 20 client.4572.objecter dump_active .. 0 homeless 2026-02-17T21:07:27.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.392+0000 7f71a8ff9640 1 -- 10.20.193.45:0/1095718616 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f71980628c0 con 0x7f71ac0c94a0 2026-02-17T21:07:27.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.392+0000 7f71a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:27.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.392+0000 7f71a8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:27.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.491+0000 7f71b2396640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:27.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.491+0000 7f71b2396640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:27.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.491+0000 7f71b2396640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:27.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.491+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f71ac144440 con 0x7f71ac0c94a0 2026-02-17T21:07:27.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.494+0000 7f71a8ff9640 1 -- 10.20.193.45:0/1095718616 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f7198066bc0 con 0x7f71ac0c94a0 2026-02-17T21:07:27.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.494+0000 7f71a8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:27.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.494+0000 7f71a8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:27.486 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:27.486 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:27.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 10 librados: watch_flush enter 2026-02-17T21:07:27.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 10 librados: watch_flush exit 2026-02-17T21:07:27.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 20 client.4572.objecter shutdown clearing up homeless session... 2026-02-17T21:07:27.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 10 client.4572.objecter successfully canceled tick 2026-02-17T21:07:27.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f717c079280 msgr2=0x7f717c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:27.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f717c079280 0x7f717c07b740 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f71ac1652e0 tx=0x7f719c009190 comp rx=0 tx=0).stop 2026-02-17T21:07:27.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 10 monclient: shutdown 2026-02-17T21:07:27.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:27.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 msgr2=0x7f71ac144f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 0x7f71ac144f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f719800ec10 tx=0x7f719800c520 comp rx=0 tx=0).stop 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 shutdown_connections 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f717c079280 0x7f717c07b740 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71ac152a00 0x7f71ac13f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71ac152620 0x7f71ac1469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 --2- 10.20.193.45:0/1095718616 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71ac0c94a0 0x7f71ac144f90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 >> 10.20.193.45:0/1095718616 conn(0x7f71ac0c9d40 msgr2=0x7f71ac14d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 shutdown_connections 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 -- 10.20.193.45:0/1095718616 wait complete. 2026-02-17T21:07:27.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:27.495+0000 7f71b2396640 1 librados: shutdown 2026-02-17T21:07:29.870 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:37.083 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:29.872 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:37.086 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:29.874 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:02:37.084 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:29.876 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:02:37.085 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:29.884 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:37.097 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:29.887 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:02:37.096 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:29.901 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:02:37.075 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:29.902 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:02:37.076 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:29.912 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:02:37.086 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:30.496 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:30.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.572+0000 7efda2cae640 10 monclient: get_monmap_and_config 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.572+0000 7efda2cae640 10 monclient: build_initial_monmap 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.572+0000 7efda2cae640 10 monclient: monmap: 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:30.574478+0000 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:30.574478+0000 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:30.566 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:30.567 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:30.567 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:30.567 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:30.567 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:30.567 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:30.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 1 Processor -- start 2026-02-17T21:07:30.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 1 -- start start 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient: init 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient: _add_conns ranks=[5,2,3,4,1,0] 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7efd9c15d1e0 0x7efd9c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient(hunting): picked mon.noname-c con 0x7efd9c15d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7efd9c0748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7efd9c0c92b0 0x7efd9c153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient(hunting): picked mon.noname-a con 0x7efd9c0c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c0c5860 con 0x7efd9c0748e0 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:30.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7efd9c0c5580 con 0x7efd9c0c92b0 2026-02-17T21:07:30.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:30.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7efd9c0c7de0 con 0x7efd9c15d1e0 2026-02-17T21:07:30.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:30.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.573+0000 7efda2cae640 10 monclient(hunting): authenticate will time out at 1034.204703s 2026-02-17T21:07:30.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7efd9c15d1e0 0x7efd9c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:30.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7efd9c15d1e0 0x7efd9c15d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:42074/0 (socket says 10.20.193.45:42074) 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 1 -- 10.20.193.45:0/3510371538 learned_addr learned my addr 10.20.193.45:0/3510371538 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 10 monclient(hunting): get_auth_request con 0x7efd9c15d1e0 auth_method 0 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda0a23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.576+0000 7efda1224640 1 --2- 10.20.193.45:0/3510371538 >> v2:10.20.193.45:3300/0 conn(0x7efd9c0c92b0 0x7efd9c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.577+0000 7efda0a23640 10 monclient(hunting): handle_auth_done global_id 4664 payload 274 2026-02-17T21:07:30.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.577+0000 7efda0a23640 1 -- 10.20.193.45:0/3510371538 >> v2:10.20.193.45:3300/0 conn(0x7efd9c0c92b0 msgr2=0x7efd9c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:30.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.577+0000 7efda0a23640 1 --2- 10.20.193.45:0/3510371538 >> v2:10.20.193.45:3300/0 conn(0x7efd9c0c92b0 0x7efd9c153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.577+0000 7efda0a23640 1 -- 10.20.193.45:0/3510371538 >> v1:10.20.193.92:6789/0 conn(0x7efd9c0748e0 legacy=0x7efd9c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:30.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.577+0000 7efda0a23640 10 monclient: _finish_hunting 0 2026-02-17T21:07:30.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.577+0000 7efda0a23640 1 monclient: found mon.noname-c 2026-02-17T21:07:30.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.577+0000 7efda0a23640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:30.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.577+0000 7efda0a23640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:30.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.577+0000 7efda0a23640 1 -- 10.20.193.45:0/3510371538 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c0c80c0 con 0x7efd9c15d1e0 2026-02-17T21:07:30.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.579+0000 7efda0a23640 1 --2- 10.20.193.45:0/3510371538 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c15d1e0 0x7efd9c15d5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009970 tx=0x7efd8c02eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9d079e944a833ba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:30.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 1 -- 10.20.193.45:0/3510371538 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c03c070 con 0x7efd9c15d1e0 2026-02-17T21:07:30.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:30.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:30.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 10 monclient: dump: 2026-02-17T21:07:30.577 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:30.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 5 monclient: authenticate success, global_id 4664 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 1 -- 10.20.193.45:0/3510371538 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd8c02fb20 con 0x7efd9c15d1e0 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 1 -- 10.20.193.45:0/3510371538 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8c037440 con 0x7efd9c15d1e0 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 4 set_mon_vals no callback set 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efd937fe640 10 monclient: dump: 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:30.579 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 10 monclient: shutdown 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 1 -- 10.20.193.45:0/3510371538 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c15d1e0 msgr2=0x7efd9c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:30.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 1 --2- 10.20.193.45:0/3510371538 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c15d1e0 0x7efd9c15d5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efd8c009970 tx=0x7efd8c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 1 -- 10.20.193.45:0/3510371538 shutdown_connections 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 1 --2- 10.20.193.45:0/3510371538 >> v2:10.20.193.45:3300/0 conn(0x7efd9c0c92b0 0x7efd9c153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 1 --2- 10.20.193.45:0/3510371538 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c15d1e0 0x7efd9c15d5c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 1 -- 10.20.193.45:0/3510371538 >> 10.20.193.45:0/3510371538 conn(0x7efd9c0c9d40 msgr2=0x7efd9c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 1 -- 10.20.193.45:0/3510371538 shutdown_connections 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.581+0000 7efda2cae640 1 -- 10.20.193.45:0/3510371538 wait complete. 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient: build_initial_monmap 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient: monmap: 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:30.581 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 librados: starting msgr at 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 librados: starting objecter 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 Processor -- start 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 -- start start 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 librados: setting wanted keys 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 librados: calling monclient init 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient: init 2026-02-17T21:07:30.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd9c0748e0 0x7efd9c148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient(hunting): picked mon.noname-a con 0x7efd9c0748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c0c92b0 0x7efd9c1e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient(hunting): picked mon.noname-c con 0x7efd9c0c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efd9c15d1e0 0x7efd9c145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient(hunting): picked mon.noname-b con 0x7efd9c15d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c074d30 con 0x7efd9c0748e0 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c0c8680 con 0x7efd9c15d1e0 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:30.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c153b50 con 0x7efd9c0c92b0 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.582+0000 7efda2cae640 10 monclient(hunting): authenticate will time out at 1034.213689s 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c0c92b0 0x7efd9c1e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c0c92b0 0x7efd9c1e4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:42082/0 (socket says 10.20.193.45:42082) 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 1 -- 10.20.193.45:0/3185907276 learned_addr learned my addr 10.20.193.45:0/3185907276 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 10 monclient(hunting): get_auth_request con 0x7efd9c0c92b0 auth_method 0 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efda1224640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efd9c15d1e0 0x7efd9c145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:30.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:30.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efd93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:30.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efda1224640 10 monclient(hunting): get_auth_request con 0x7efd9c15d1e0 auth_method 0 2026-02-17T21:07:30.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efda1224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:30.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efda1224640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:30.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efda1224640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:30.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efda1224640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:30.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efda1224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:30.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.583+0000 7efda1224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:30.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 10 monclient(hunting): handle_auth_done global_id 4667 payload 824 2026-02-17T21:07:30.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 1 -- 10.20.193.45:0/3185907276 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efd9c15d1e0 msgr2=0x7efd9c145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:30.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efd9c15d1e0 0x7efd9c145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 1 -- 10.20.193.45:0/3185907276 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd9c0748e0 msgr2=0x7efd9c148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd9c0748e0 0x7efd9c148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 1 monclient: found mon.noname-c 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.584+0000 7efd93fff640 1 -- 10.20.193.45:0/3185907276 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c1f2d70 con 0x7efd9c0c92b0 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.585+0000 7efd93fff640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c0c92b0 0x7efd9c1e4f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efd8400b570 tx=0x7efd8400ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.585+0000 7efd917fa640 10 client.?.objecter ms_handle_connect 0x7efd9c0c92b0 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.586+0000 7efd917fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 1 -- 10.20.193.45:0/3185907276 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84013020 con 0x7efd9c0c92b0 2026-02-17T21:07:30.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 10 monclient: dump: 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:30.589 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 1 -- 10.20.193.45:0/3185907276 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd840044a0 con 0x7efd9c0c92b0 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 1 -- 10.20.193.45:0/3185907276 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840029c0 con 0x7efd9c0c92b0 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd917fa640 10 monclient: dump: 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:30.590 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efd92ffd640 4 set_mon_vals no callback set 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 5 monclient: authenticate success, global_id 4667 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 10 monclient: _renew_subs 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c073270 con 0x7efd9c0c92b0 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 10 client.4667.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:30.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 10 monclient: _renew_subs 2026-02-17T21:07:30.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:30.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c1f32c0 con 0x7efd9c0c92b0 2026-02-17T21:07:30.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 1 librados: init done 2026-02-17T21:07:30.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:30.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:30.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:30.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.588+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c15e0c0 con 0x7efd9c0c92b0 2026-02-17T21:07:30.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.695+0000 7efd917fa640 1 -- 10.20.193.45:0/3185907276 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7efd84002b60 con 0x7efd9c0c92b0 2026-02-17T21:07:30.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.696+0000 7efd917fa640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd6c079280 0x7efd6c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:30.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.696+0000 7efda0a23640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd6c079280 0x7efd6c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:30.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.696+0000 7efda0a23640 10 monclient: get_auth_request con 0x7efd6c079280 auth_method 0 2026-02-17T21:07:30.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.696+0000 7efd917fa640 10 client.4667.objecter ms_handle_connect 0x7efd6c079280 2026-02-17T21:07:30.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.696+0000 7efda0a23640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd6c079280 0x7efd6c07b740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd9c076cd0 tx=0x7efd8c031000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:30.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.698+0000 7efd917fa640 1 -- 10.20.193.45:0/3185907276 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7efd8405e3c0 con 0x7efd9c0c92b0 2026-02-17T21:07:30.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.698+0000 7efd917fa640 10 client.4667.objecter ms_dispatch2 0x7efd9c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:30.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.698+0000 7efd917fa640 3 client.4667.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:30.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.698+0000 7efd917fa640 3 client.4667.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:30.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.698+0000 7efd917fa640 20 client.4667.objecter dump_active .. 0 homeless 2026-02-17T21:07:30.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.705+0000 7efd917fa640 1 -- 10.20.193.45:0/3185907276 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efd9c15e0c0 con 0x7efd9c0c92b0 2026-02-17T21:07:30.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.705+0000 7efd917fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:30.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.705+0000 7efd917fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:30.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.804+0000 7efda2cae640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:30.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.804+0000 7efda2cae640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:30.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.804+0000 7efda2cae640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:30.798 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.804+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efd9c153f30 con 0x7efd9c0c92b0 2026-02-17T21:07:30.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.806+0000 7efd917fa640 1 -- 10.20.193.45:0/3185907276 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7efd8401d020 con 0x7efd9c0c92b0 2026-02-17T21:07:30.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.806+0000 7efd917fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:30.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.806+0000 7efd917fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:30.800 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:30.800 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:30.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 10 librados: watch_flush enter 2026-02-17T21:07:30.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 10 librados: watch_flush exit 2026-02-17T21:07:30.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 20 client.4667.objecter shutdown clearing up homeless session... 2026-02-17T21:07:30.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 10 client.4667.objecter successfully canceled tick 2026-02-17T21:07:30.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd6c079280 msgr2=0x7efd6c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:30.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd6c079280 0x7efd6c07b740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efd9c076cd0 tx=0x7efd8c031000 comp rx=0 tx=0).stop 2026-02-17T21:07:30.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 10 monclient: shutdown 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c0c92b0 msgr2=0x7efd9c1e4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c0c92b0 0x7efd9c1e4f20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efd8400b570 tx=0x7efd8400ba40 comp rx=0 tx=0).stop 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 shutdown_connections 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd6c079280 0x7efd6c07b740 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efd9c15d1e0 0x7efd9c145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd9c0c92b0 0x7efd9c1e4f20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 --2- 10.20.193.45:0/3185907276 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd9c0748e0 0x7efd9c148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 >> 10.20.193.45:0/3185907276 conn(0x7efd9c0c9d40 msgr2=0x7efd9c1510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 shutdown_connections 2026-02-17T21:07:30.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 -- 10.20.193.45:0/3185907276 wait complete. 2026-02-17T21:07:30.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:30.808+0000 7efda2cae640 1 librados: shutdown 2026-02-17T21:07:33.810 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.886+0000 7f88d2f48640 10 monclient: get_monmap_and_config 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.886+0000 7f88d2f48640 10 monclient: build_initial_monmap 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.886+0000 7f88d2f48640 10 monclient: monmap: 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:33.888809+0000 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:33.888809+0000 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.887+0000 7f88d2f48640 1 Processor -- start 2026-02-17T21:07:33.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.887+0000 7f88d2f48640 1 -- start start 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.887+0000 7f88d2f48640 10 monclient: init 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 10 monclient: _add_conns ranks=[0,5,2,3,1,4] 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f88cc151fb0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f88cc152390 0x7f88cc06e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 10 monclient(hunting): picked mon.noname-c con 0x7f88cc152390 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f88cc06edc0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88cc0c8350 con 0x7f88cc151fb0 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88cc0c85d0 con 0x7f88cc06edc0 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f88cc06dcc0 con 0x7f88cc152390 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d2f48640 10 monclient(hunting): authenticate will time out at 1037.519274s 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d0cbd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f88cc151fb0 0x7f88cc0c7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:49932/0 (socket says 10.20.193.45:49932) 2026-02-17T21:07:33.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.888+0000 7f88d0cbd640 1 -- 10.20.193.45:0/1595914022 learned_addr learned my addr 10.20.193.45:0/1595914022 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:33.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c3fff640 1 --2- 10.20.193.45:0/1595914022 >> v2:10.20.193.92:3300/0 conn(0x7f88cc152390 0x7f88cc06e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c3fff640 10 monclient(hunting): get_auth_request con 0x7f88cc152390 auth_method 0 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 1 -- 10.20.193.45:0/1595914022 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537439874 0 0) 0x7f88bc002920 con 0x7f88cc151fb0 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 10 monclient(hunting): _negotiate 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 10 monclient(hunting): my global_id is 4575 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 1 -- 10.20.193.45:0/1595914022 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88b8003540 con 0x7f88cc151fb0 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 1 -- 10.20.193.45:0/1595914022 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285374418 0 0) 0x7f88cc0c85d0 con 0x7f88cc06edc0 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 10 monclient(hunting): _negotiate 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 10 monclient(hunting): my global_id is 4670 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c37fe640 1 -- 10.20.193.45:0/1595914022 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88bc002920 con 0x7f88cc06edc0 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:33.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.890+0000 7f88c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:33.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.891+0000 7f88c3fff640 10 monclient(hunting): handle_auth_done global_id 4673 payload 274 2026-02-17T21:07:33.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.891+0000 7f88c3fff640 1 -- 10.20.193.45:0/1595914022 >> v1:10.20.193.92:6789/0 conn(0x7f88cc06edc0 legacy=0x7f88cc159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:33.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.891+0000 7f88c3fff640 1 -- 10.20.193.45:0/1595914022 >> v1:10.20.193.45:6789/0 conn(0x7f88cc151fb0 legacy=0x7f88cc0c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:33.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.891+0000 7f88c3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:33.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.891+0000 7f88c3fff640 1 monclient: found mon.noname-c 2026-02-17T21:07:33.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.891+0000 7f88c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:33.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.891+0000 7f88c3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:33.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.891+0000 7f88c3fff640 1 -- 10.20.193.45:0/1595914022 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc0c88b0 con 0x7f88cc152390 2026-02-17T21:07:33.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.893+0000 7f88c3fff640 1 --2- 10.20.193.45:0/1595914022 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc152390 0x7f88cc06e880 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f88b40098a0 tx=0x7f88b402ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe4b9756b04f1b21 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 1 -- 10.20.193.45:0/1595914022 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b403c070 con 0x7f88cc152390 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 10 monclient: dump: 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 1 -- 10.20.193.45:0/1595914022 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b402fb70 con 0x7f88cc152390 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:33.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 1 -- 10.20.193.45:0/1595914022 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b4037440 con 0x7f88cc152390 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 5 monclient: authenticate success, global_id 4673 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 4 set_mon_vals no callback set 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88c37fe640 10 monclient: dump: 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:33.889 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 10 monclient: shutdown 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 -- 10.20.193.45:0/1595914022 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc152390 msgr2=0x7f88cc06e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 --2- 10.20.193.45:0/1595914022 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc152390 0x7f88cc06e880 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f88b40098a0 tx=0x7f88b402ee60 comp rx=0 tx=0).stop 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 -- 10.20.193.45:0/1595914022 shutdown_connections 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 --2- 10.20.193.45:0/1595914022 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc152390 0x7f88cc06e880 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 -- 10.20.193.45:0/1595914022 >> 10.20.193.45:0/1595914022 conn(0x7f88cc0c9d40 msgr2=0x7f88cc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 -- 10.20.193.45:0/1595914022 shutdown_connections 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 -- 10.20.193.45:0/1595914022 wait complete. 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 10 monclient: build_initial_monmap 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 10 monclient: monmap: 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 librados: starting msgr at 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 librados: starting objecter 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 Processor -- start 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 -- start start 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 librados: setting wanted keys 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 librados: calling monclient init 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 10 monclient: init 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f88cc06edc0 0x7f88cc1f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.896+0000 7f88d2f48640 10 monclient(hunting): picked mon.noname-b con 0x7f88cc06edc0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc151fb0 0x7f88cc1e55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 10 monclient(hunting): picked mon.noname-c con 0x7f88cc151fb0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:33.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88cc152390 0x7f88cc1f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 10 monclient(hunting): picked mon.noname-a con 0x7f88cc152390 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc0c9150 con 0x7f88cc152390 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc0c8e70 con 0x7f88cc06edc0 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc0c9430 con 0x7f88cc151fb0 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d2f48640 10 monclient(hunting): authenticate will time out at 1037.528031s 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc151fb0 0x7f88cc1e55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d14be640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88cc152390 0x7f88cc1f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d0cbd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f88cc06edc0 0x7f88cc1f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc151fb0 0x7f88cc1e55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:42100/0 (socket says 10.20.193.45:42100) 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 1 -- 10.20.193.45:0/548143946 learned_addr learned my addr 10.20.193.45:0/548143946 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:33.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 10 monclient(hunting): get_auth_request con 0x7f88cc151fb0 auth_method 0 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d14be640 10 monclient(hunting): get_auth_request con 0x7f88cc152390 auth_method 0 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d14be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d14be640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d14be640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d0cbd640 10 monclient(hunting): get_auth_request con 0x7f88cc06edc0 auth_method 0 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d0cbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d0cbd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d0cbd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d14be640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d14be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.897+0000 7f88d14be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.898+0000 7f88d0cbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.898+0000 7f88d0cbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.898+0000 7f88d0cbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 10 monclient(hunting): handle_auth_done global_id 4676 payload 824 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 1 -- 10.20.193.45:0/548143946 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f88cc06edc0 msgr2=0x7f88cc1f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f88cc06edc0 0x7f88cc1f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 1 -- 10.20.193.45:0/548143946 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88cc152390 msgr2=0x7f88cc1f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88cc152390 0x7f88cc1f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 1 monclient: found mon.noname-c 2026-02-17T21:07:33.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:33.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:33.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.899+0000 7f88c3fff640 1 -- 10.20.193.45:0/548143946 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc0c59e0 con 0x7f88cc151fb0 2026-02-17T21:07:33.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c3fff640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc151fb0 0x7f88cc1e55b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009130 tx=0x7f88b40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:33.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c17fa640 10 client.?.objecter ms_handle_connect 0x7f88cc151fb0 2026-02-17T21:07:33.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c17fa640 1 -- 10.20.193.45:0/548143946 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b4046020 con 0x7f88cc151fb0 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c17fa640 10 monclient: dump: 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c17fa640 10 monclient: _finish_auth 0 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c17fa640 10 monclient: _check_auth_tickets 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.900+0000 7f88c17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 5 monclient: authenticate success, global_id 4676 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 10 monclient: _renew_subs 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88cc0c5cc0 con 0x7f88cc151fb0 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 10 client.4676.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 10 monclient: _renew_subs 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88cc0c6280 con 0x7f88cc151fb0 2026-02-17T21:07:33.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 1 librados: init done 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88cc06e880 con 0x7f88cc151fb0 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88c17fa640 1 -- 10.20.193.45:0/548143946 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b402fa30 con 0x7f88cc151fb0 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88c17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88c17fa640 1 -- 10.20.193.45:0/548143946 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b403c040 con 0x7f88cc151fb0 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88c17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88c17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88c17fa640 10 monclient: dump: 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:33.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:33.901+0000 7f88c2ffd640 4 set_mon_vals no callback set 2026-02-17T21:07:34.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.007+0000 7f88c17fa640 1 -- 10.20.193.45:0/548143946 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f88b4004420 con 0x7f88cc151fb0 2026-02-17T21:07:34.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.007+0000 7f88c17fa640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f889c0792b0 0x7f889c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:34.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.008+0000 7f88d0cbd640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f889c0792b0 0x7f889c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:34.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.008+0000 7f88d0cbd640 10 monclient: get_auth_request con 0x7f889c0792b0 auth_method 0 2026-02-17T21:07:34.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.008+0000 7f88c17fa640 10 client.4676.objecter ms_handle_connect 0x7f889c0792b0 2026-02-17T21:07:34.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.008+0000 7f88d0cbd640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f889c0792b0 0x7f889c07b770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88bc005980 tx=0x7f88bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:34.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.008+0000 7f88c17fa640 1 -- 10.20.193.45:0/548143946 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f88b4082d70 con 0x7f88cc151fb0 2026-02-17T21:07:34.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.008+0000 7f88c17fa640 10 client.4676.objecter ms_dispatch2 0x7f88cc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:34.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.008+0000 7f88c17fa640 3 client.4676.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:34.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.008+0000 7f88c17fa640 3 client.4676.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:34.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.008+0000 7f88c17fa640 20 client.4676.objecter dump_active .. 0 homeless 2026-02-17T21:07:34.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.015+0000 7f88c17fa640 1 -- 10.20.193.45:0/548143946 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f88b4050020 con 0x7f88cc151fb0 2026-02-17T21:07:34.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.015+0000 7f88c17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:34.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.015+0000 7f88c17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:34.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.121+0000 7f88d2f48640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:34.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.121+0000 7f88d2f48640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:34.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.121+0000 7f88d2f48640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:07:34.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.121+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f88cc1f53c0 con 0x7f88cc151fb0 2026-02-17T21:07:34.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.123+0000 7f88c17fa640 1 -- 10.20.193.45:0/548143946 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f88b4086d30 con 0x7f88cc151fb0 2026-02-17T21:07:34.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.123+0000 7f88c17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:34.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.123+0000 7f88c17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:34.115 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:34.115 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 10 librados: watch_flush enter 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 10 librados: watch_flush exit 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 20 client.4676.objecter shutdown clearing up homeless session... 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 10 client.4676.objecter successfully canceled tick 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f889c0792b0 msgr2=0x7f889c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f889c0792b0 0x7f889c07b770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88bc005980 tx=0x7f88bc009040 comp rx=0 tx=0).stop 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 10 monclient: shutdown 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc151fb0 msgr2=0x7f88cc1e55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.124+0000 7f88d2f48640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc151fb0 0x7f88cc1e55b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009130 tx=0x7f88b40047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.125+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 shutdown_connections 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.125+0000 7f88d2f48640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f889c0792b0 0x7f889c07b770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.125+0000 7f88d2f48640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88cc152390 0x7f88cc1f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.125+0000 7f88d2f48640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88cc151fb0 0x7f88cc1e55b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.125+0000 7f88d2f48640 1 --2- 10.20.193.45:0/548143946 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f88cc06edc0 0x7f88cc1f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.125+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 >> 10.20.193.45:0/548143946 conn(0x7f88cc0c9d40 msgr2=0x7f88cc06e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.125+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 shutdown_connections 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.125+0000 7f88d2f48640 1 -- 10.20.193.45:0/548143946 wait complete. 2026-02-17T21:07:34.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:34.125+0000 7f88d2f48640 1 librados: shutdown 2026-02-17T21:07:37.127 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:37.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.203+0000 7f780a0d6640 10 monclient: get_monmap_and_config 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.203+0000 7f780a0d6640 10 monclient: build_initial_monmap 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.203+0000 7f780a0d6640 10 monclient: monmap: 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:37.204460+0000 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:37.204460+0000 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:37.196 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:37.197 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:37.197 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:37.197 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:37.197 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:37.197 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:37.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 1 Processor -- start 2026-02-17T21:07:37.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 1 -- start start 2026-02-17T21:07:37.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient: init 2026-02-17T21:07:37.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient: _add_conns ranks=[5,3,4,1,2,0] 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f7804152620 0x7f780415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient(hunting): picked mon.noname-c con 0x7f7804152620 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f7804152a00 0x7f780415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient(hunting): picked mon.noname-a con 0x7f7804152a00 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f78040c8d90 0x7f78040c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient(hunting): picked mon.noname-b con 0x7f78040c8d90 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f78040c7760 con 0x7f7804152a00 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f78040c71a0 con 0x7f78040c8d90 2026-02-17T21:07:37.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f78040c7480 con 0x7f7804152620 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.204+0000 7f780a0d6640 10 monclient(hunting): authenticate will time out at 1040.834683s 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f7804152a00 0x7f780415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f7804152a00 0x7f780415ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:33622/0 (socket says 10.20.193.45:33622) 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 1 -- 10.20.193.45:0/3961512047 learned_addr learned my addr 10.20.193.45:0/3961512047 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 10 monclient(hunting): get_auth_request con 0x7f7804152a00 auth_method 0 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:37.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.205+0000 7f7802ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 10 monclient(hunting): handle_auth_done global_id 4581 payload 274 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 1 -- 10.20.193.45:0/3961512047 >> v2:10.20.193.92:3300/0 conn(0x7f7804152620 msgr2=0x7f780415a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 1 --2- 10.20.193.45:0/3961512047 >> v2:10.20.193.92:3300/0 conn(0x7f7804152620 0x7f780415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 1 -- 10.20.193.45:0/3961512047 >> v2:10.20.193.86:3300/0 conn(0x7f78040c8d90 msgr2=0x7f78040c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 1 --2- 10.20.193.45:0/3961512047 >> v2:10.20.193.86:3300/0 conn(0x7f78040c8d90 0x7f78040c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 1 monclient: found mon.noname-a 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.206+0000 7f7802ffd640 1 -- 10.20.193.45:0/3961512047 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7804159e00 con 0x7f7804152a00 2026-02-17T21:07:37.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.207+0000 7f7802ffd640 1 --2- 10.20.193.45:0/3961512047 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152a00 0x7f780415ae20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7804072110 tx=0x7f77f402ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36eb32753acf7219 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:37.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 1 -- 10.20.193.45:0/3961512047 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f403c070 con 0x7f7804152a00 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 10 monclient: dump: 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:37.207 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f780a0d6640 5 monclient: authenticate success, global_id 4581 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f780a0d6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 1 -- 10.20.193.45:0/3961512047 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f402fb50 con 0x7f7804152a00 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 1 -- 10.20.193.45:0/3961512047 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4037440 con 0x7f7804152a00 2026-02-17T21:07:37.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.208+0000 7f78027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f78027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f78027fc640 10 monclient: dump: 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:37.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 4 set_mon_vals no callback set 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 10 monclient: shutdown 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 1 -- 10.20.193.45:0/3961512047 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152a00 msgr2=0x7f780415ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 1 --2- 10.20.193.45:0/3961512047 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152a00 0x7f780415ae20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7804072110 tx=0x7f77f402ee90 comp rx=0 tx=0).stop 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 1 -- 10.20.193.45:0/3961512047 shutdown_connections 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 1 --2- 10.20.193.45:0/3961512047 >> v2:10.20.193.86:3300/0 conn(0x7f78040c8d90 0x7f78040c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 1 --2- 10.20.193.45:0/3961512047 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152a00 0x7f780415ae20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 1 --2- 10.20.193.45:0/3961512047 >> v2:10.20.193.92:3300/0 conn(0x7f7804152620 0x7f780415a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 1 -- 10.20.193.45:0/3961512047 >> 10.20.193.45:0/3961512047 conn(0x7f78040c9d40 msgr2=0x7f78040ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 1 -- 10.20.193.45:0/3961512047 shutdown_connections 2026-02-17T21:07:37.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 1 -- 10.20.193.45:0/3961512047 wait complete. 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 10 monclient: build_initial_monmap 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.209+0000 7f780a0d6640 10 monclient: monmap: 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:37.211 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 librados: starting msgr at 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 librados: starting objecter 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 Processor -- start 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 -- start start 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 librados: setting wanted keys 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 librados: calling monclient init 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient: init 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f78040c8d90 0x7f78041569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient(hunting): picked mon.noname-b con 0x7f78040c8d90 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:37.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152620 0x7f7804156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient(hunting): picked mon.noname-a con 0x7f7804152620 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7804152a00 0x7f7804072730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient(hunting): picked mon.noname-c con 0x7f7804152a00 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78040c96b0 con 0x7f7804152620 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f780415a3c0 con 0x7f78040c8d90 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f780415bdd0 con 0x7f7804152a00 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f780a0d6640 10 monclient(hunting): authenticate will time out at 1040.840670s 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.210+0000 7f7802ffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152620 0x7f7804156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:37.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.211+0000 7f7802ffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152620 0x7f7804156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:33626/0 (socket says 10.20.193.45:33626) 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.211+0000 7f7802ffd640 1 -- 10.20.193.45:0/266606935 learned_addr learned my addr 10.20.193.45:0/266606935 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.211+0000 7f7802ffd640 10 monclient(hunting): get_auth_request con 0x7f7804152620 auth_method 0 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.211+0000 7f7802ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.211+0000 7f7802ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.211+0000 7f7802ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.211+0000 7f7802ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.211+0000 7f7802ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.211+0000 7f7802ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 10 monclient(hunting): handle_auth_done global_id 4584 payload 824 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 1 -- 10.20.193.45:0/266606935 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7804152a00 msgr2=0x7f7804072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7804152a00 0x7f7804072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 1 -- 10.20.193.45:0/266606935 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f78040c8d90 msgr2=0x7f78041569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:37.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f78040c8d90 0x7f78041569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:37.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 1 monclient: found mon.noname-a 2026-02-17T21:07:37.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:37.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:37.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.212+0000 7f7802ffd640 1 -- 10.20.193.45:0/266606935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78041575c0 con 0x7f7804152620 2026-02-17T21:07:37.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.213+0000 7f7802ffd640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152620 0x7f7804156ef0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f77f4002410 tx=0x7f77f40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:37.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.213+0000 7f77dffff640 10 client.?.objecter ms_handle_connect 0x7f7804152620 2026-02-17T21:07:37.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.213+0000 7f77dffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:37.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 1 -- 10.20.193.45:0/266606935 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4044070 con 0x7f7804152620 2026-02-17T21:07:37.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:37.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:37.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 10 monclient: dump: 2026-02-17T21:07:37.217 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:37.217 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:37.217 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:37.217 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:37.217 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 10 monclient: _finish_auth 0 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 1 -- 10.20.193.45:0/266606935 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f4040610 con 0x7f7804152620 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 1 -- 10.20.193.45:0/266606935 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f403c040 con 0x7f7804152620 2026-02-17T21:07:37.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f7801ffb640 4 set_mon_vals no callback set 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f77dffff640 10 monclient: dump: 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:37.219 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 5 monclient: authenticate success, global_id 4584 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 10 monclient: _renew_subs 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78041578a0 con 0x7f7804152620 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 10 client.4584.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 10 monclient: _renew_subs 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7804157e60 con 0x7f7804152620 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 1 librados: init done 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:37.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:37.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.215+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78040c9170 con 0x7f7804152620 2026-02-17T21:07:37.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.322+0000 7f77dffff640 1 -- 10.20.193.45:0/266606935 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f77f403f050 con 0x7f7804152620 2026-02-17T21:07:37.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.322+0000 7f77dffff640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f77d40792d0 0x7f77d407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:37.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.322+0000 7f78037fe640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f77d40792d0 0x7f77d407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:37.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.322+0000 7f78037fe640 10 monclient: get_auth_request con 0x7f77d40792d0 auth_method 0 2026-02-17T21:07:37.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.323+0000 7f77dffff640 10 client.4584.objecter ms_handle_connect 0x7f77d40792d0 2026-02-17T21:07:37.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.323+0000 7f78037fe640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f77d40792d0 0x7f77d407b790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77f00098a0 tx=0x7f77f0006d90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:37.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.330+0000 7f77dffff640 1 -- 10.20.193.45:0/266606935 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f77f4083380 con 0x7f7804152620 2026-02-17T21:07:37.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.330+0000 7f77dffff640 10 client.4584.objecter ms_dispatch2 0x7f7804000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:37.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.330+0000 7f77dffff640 3 client.4584.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:37.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.330+0000 7f77dffff640 3 client.4584.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:37.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.330+0000 7f77dffff640 20 client.4584.objecter dump_active .. 0 homeless 2026-02-17T21:07:37.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.330+0000 7f77dffff640 1 -- 10.20.193.45:0/266606935 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f77f4087a40 con 0x7f7804152620 2026-02-17T21:07:37.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.330+0000 7f77dffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:37.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.330+0000 7f77dffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:37.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.434+0000 7f780a0d6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:37.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.434+0000 7f780a0d6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:37.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.434+0000 7f780a0d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:37.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.434+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f78040c51d0 con 0x7f7804152620 2026-02-17T21:07:37.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.436+0000 7f77dffff640 1 -- 10.20.193.45:0/266606935 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f77f4087340 con 0x7f7804152620 2026-02-17T21:07:37.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.436+0000 7f77dffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:37.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.436+0000 7f77dffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:37.428 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:37.429 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 10 librados: watch_flush enter 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 10 librados: watch_flush exit 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 20 client.4584.objecter shutdown clearing up homeless session... 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 10 client.4584.objecter successfully canceled tick 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f77d40792d0 msgr2=0x7f77d407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f77d40792d0 0x7f77d407b790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f77f00098a0 tx=0x7f77f0006d90 comp rx=0 tx=0).stop 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 10 monclient: shutdown 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152620 msgr2=0x7f7804156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:37.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.437+0000 7f780a0d6640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152620 0x7f7804156ef0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f77f4002410 tx=0x7f77f40047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.438+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 shutdown_connections 2026-02-17T21:07:37.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.438+0000 7f780a0d6640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f77d40792d0 0x7f77d407b790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.438+0000 7f780a0d6640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7804152a00 0x7f7804072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.438+0000 7f780a0d6640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7804152620 0x7f7804156ef0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.438+0000 7f780a0d6640 1 --2- 10.20.193.45:0/266606935 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f78040c8d90 0x7f78041569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:37.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.438+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 >> 10.20.193.45:0/266606935 conn(0x7f78040c9d40 msgr2=0x7f78040c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:37.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.438+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 shutdown_connections 2026-02-17T21:07:37.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.438+0000 7f780a0d6640 1 -- 10.20.193.45:0/266606935 wait complete. 2026-02-17T21:07:37.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:37.438+0000 7f780a0d6640 1 librados: shutdown 2026-02-17T21:07:40.440 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.516+0000 7f25c35bc640 10 monclient: get_monmap_and_config 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.516+0000 7f25c35bc640 10 monclient: build_initial_monmap 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.516+0000 7f25c35bc640 10 monclient: monmap: 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:40.517187+0000 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:40.517187+0000 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:40.508 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.516+0000 7f25c35bc640 1 Processor -- start 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.516+0000 7f25c35bc640 1 -- start start 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.516+0000 7f25c35bc640 10 monclient: init 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 10 monclient: _add_conns ranks=[4,2,5,3,1,0] 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f25bc152620 0x7f25bc15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 10 monclient(hunting): picked mon.noname-b con 0x7f25bc152620 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f25bc152a00 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f25bc0c94a0 0x7f25bc15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 10 monclient(hunting): picked mon.noname-c con 0x7f25bc0c94a0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25bc0c71a0 con 0x7f25bc152a00 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f25bc0c7760 con 0x7f25bc152620 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f25bc0c7480 con 0x7f25bc0c94a0 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c35bc640 10 monclient(hunting): authenticate will time out at 1044.147332s 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c1331640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f25bc152620 0x7f25bc15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:40.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.517+0000 7f25c1b32640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f25bc0c94a0 0x7f25bc15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1331640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f25bc152620 0x7f25bc15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:55462/0 (socket says 10.20.193.45:55462) 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1331640 1 -- 10.20.193.45:0/2223024013 learned_addr learned my addr 10.20.193.45:0/2223024013 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1331640 10 monclient(hunting): get_auth_request con 0x7f25bc152620 auth_method 0 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1331640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1331640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1331640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1b32640 10 monclient(hunting): get_auth_request con 0x7f25bc0c94a0 auth_method 0 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1b32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1b32640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1b32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1331640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1331640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1331640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1b32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1b32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:40.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.518+0000 7f25c1b32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:40.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.519+0000 7f25c1331640 10 monclient(hunting): handle_auth_done global_id 4639 payload 274 2026-02-17T21:07:40.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.519+0000 7f25c1331640 1 -- 10.20.193.45:0/2223024013 >> v2:10.20.193.92:3300/0 conn(0x7f25bc0c94a0 msgr2=0x7f25bc15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:40.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.519+0000 7f25c1331640 1 --2- 10.20.193.45:0/2223024013 >> v2:10.20.193.92:3300/0 conn(0x7f25bc0c94a0 0x7f25bc15ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.519+0000 7f25c1331640 1 -- 10.20.193.45:0/2223024013 >> v1:10.20.193.92:6789/0 conn(0x7f25bc152a00 legacy=0x7f25bc0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:40.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.519+0000 7f25c1331640 10 monclient: _finish_hunting 0 2026-02-17T21:07:40.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.519+0000 7f25c1331640 1 monclient: found mon.noname-b 2026-02-17T21:07:40.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.519+0000 7f25c1331640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:40.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.519+0000 7f25c1331640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:40.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.519+0000 7f25c1331640 1 -- 10.20.193.45:0/2223024013 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25bc159e00 con 0x7f25bc152620 2026-02-17T21:07:40.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.520+0000 7f25c1331640 1 --2- 10.20.193.45:0/2223024013 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152620 0x7f25bc15a8e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25bc076d30 tx=0x7f25ac02eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ef966159361b69 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25abfff640 1 -- 10.20.193.45:0/2223024013 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac03c070 con 0x7f25bc152620 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25abfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25abfff640 10 monclient: dump: 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25abfff640 10 monclient: _finish_auth 0 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25abfff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25c35bc640 5 monclient: authenticate success, global_id 4639 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25c35bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.521+0000 7f25abfff640 1 -- 10.20.193.45:0/2223024013 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ac02fb20 con 0x7f25bc152620 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25abfff640 1 -- 10.20.193.45:0/2223024013 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac037440 con 0x7f25bc152620 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25abfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25abfff640 10 monclient: dump: 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:40.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 4 set_mon_vals no callback set 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 10 monclient: shutdown 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 1 -- 10.20.193.45:0/2223024013 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152620 msgr2=0x7f25bc15a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 1 --2- 10.20.193.45:0/2223024013 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152620 0x7f25bc15a8e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f25bc076d30 tx=0x7f25ac02eeb0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 1 -- 10.20.193.45:0/2223024013 shutdown_connections 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 1 --2- 10.20.193.45:0/2223024013 >> v2:10.20.193.92:3300/0 conn(0x7f25bc0c94a0 0x7f25bc15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 1 --2- 10.20.193.45:0/2223024013 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152620 0x7f25bc15a8e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 1 -- 10.20.193.45:0/2223024013 >> 10.20.193.45:0/2223024013 conn(0x7f25bc0c9d40 msgr2=0x7f25bc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 1 -- 10.20.193.45:0/2223024013 shutdown_connections 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 1 -- 10.20.193.45:0/2223024013 wait complete. 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 10 monclient: build_initial_monmap 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.522+0000 7f25c35bc640 10 monclient: monmap: 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 librados: starting msgr at 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 librados: starting objecter 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 Processor -- start 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 -- start start 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 librados: setting wanted keys 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 librados: calling monclient init 2026-02-17T21:07:40.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient: init 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25bc0c94a0 0x7f25bc1f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient(hunting): picked mon.noname-c con 0x7f25bc0c94a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25bc152620 0x7f25bc1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient(hunting): picked mon.noname-a con 0x7f25bc152620 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152a00 0x7f25bc1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient(hunting): picked mon.noname-b con 0x7f25bc152a00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc0c5c90 con 0x7f25bc152620 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc15a3c0 con 0x7f25bc152a00 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:40.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc0c5e10 con 0x7f25bc0c94a0 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c35bc640 10 monclient(hunting): authenticate will time out at 1044.153521s 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c1b32640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152a00 0x7f25bc1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c1331640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25bc0c94a0 0x7f25bc1f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.523+0000 7f25c0b30640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25bc152620 0x7f25bc1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1b32640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152a00 0x7f25bc1530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:55468/0 (socket says 10.20.193.45:55468) 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1b32640 1 -- 10.20.193.45:0/4102382542 learned_addr learned my addr 10.20.193.45:0/4102382542 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1b32640 10 monclient(hunting): get_auth_request con 0x7f25bc152a00 auth_method 0 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1b32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1b32640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1b32640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1331640 10 monclient(hunting): get_auth_request con 0x7f25bc0c94a0 auth_method 0 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1331640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1331640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1331640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c0b30640 10 monclient(hunting): get_auth_request con 0x7f25bc152620 auth_method 0 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c0b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c0b30640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c0b30640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1b32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1b32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1b32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1331640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1331640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c1331640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c0b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c0b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.524+0000 7f25c0b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 10 monclient(hunting): handle_auth_done global_id 4642 payload 824 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 1 -- 10.20.193.45:0/4102382542 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25bc0c94a0 msgr2=0x7f25bc1f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25bc0c94a0 0x7f25bc1f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 1 -- 10.20.193.45:0/4102382542 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25bc152620 msgr2=0x7f25bc1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25bc152620 0x7f25bc1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 10 monclient: _finish_hunting 0 2026-02-17T21:07:40.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 1 monclient: found mon.noname-b 2026-02-17T21:07:40.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:40.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:40.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.525+0000 7f25c1b32640 1 -- 10.20.193.45:0/4102382542 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25bc156750 con 0x7f25bc152a00 2026-02-17T21:07:40.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.526+0000 7f25c1b32640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152a00 0x7f25bc1530d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009dd0 tx=0x7f25b800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:40.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.526+0000 7f25a9ffb640 10 client.?.objecter ms_handle_connect 0x7f25bc152a00 2026-02-17T21:07:40.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.526+0000 7f25a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 1 -- 10.20.193.45:0/4102382542 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8018020 con 0x7f25bc152a00 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 10 monclient: dump: 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:40.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25c35bc640 5 monclient: authenticate success, global_id 4642 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 1 -- 10.20.193.45:0/4102382542 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b8014480 con 0x7f25bc152a00 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25c35bc640 10 monclient: _renew_subs 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25c35bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25bc1f3c00 con 0x7f25bc152a00 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 1 -- 10.20.193.45:0/4102382542 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b8014870 con 0x7f25bc152a00 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25ab7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25a9ffb640 10 monclient: dump: 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25c35bc640 10 client.4642.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25c35bc640 10 monclient: _renew_subs 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25c35bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25bc1f41b0 con 0x7f25bc152a00 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.528+0000 7f25c35bc640 1 librados: init done 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.529+0000 7f25c35bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.529+0000 7f25c35bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.529+0000 7f25c35bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:40.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.529+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25bc0c8d90 con 0x7f25bc152a00 2026-02-17T21:07:40.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.636+0000 7f25a9ffb640 1 -- 10.20.193.45:0/4102382542 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f25b8014a10 con 0x7f25bc152a00 2026-02-17T21:07:40.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.636+0000 7f25a9ffb640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f258c0792d0 0x7f258c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:40.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.636+0000 7f25c1331640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f258c0792d0 0x7f258c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:40.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.636+0000 7f25c1331640 10 monclient: get_auth_request con 0x7f258c0792d0 auth_method 0 2026-02-17T21:07:40.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.636+0000 7f25c1331640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f258c0792d0 0x7f258c07b790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f25bc1563b0 tx=0x7f25ac033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:40.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.636+0000 7f25a9ffb640 10 client.4642.objecter ms_handle_connect 0x7f258c0792d0 2026-02-17T21:07:40.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.638+0000 7f25a9ffb640 1 -- 10.20.193.45:0/4102382542 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f25b805f250 con 0x7f25bc152a00 2026-02-17T21:07:40.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.638+0000 7f25a9ffb640 10 client.4642.objecter ms_dispatch2 0x7f25bc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:40.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.638+0000 7f25a9ffb640 3 client.4642.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:40.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.638+0000 7f25a9ffb640 3 client.4642.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:40.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.638+0000 7f25a9ffb640 20 client.4642.objecter dump_active .. 0 homeless 2026-02-17T21:07:40.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.644+0000 7f25a9ffb640 1 -- 10.20.193.45:0/4102382542 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f25b8022070 con 0x7f25bc152a00 2026-02-17T21:07:40.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.644+0000 7f25a9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:40.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.644+0000 7f25a9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:40.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.744+0000 7f25c35bc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:40.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.744+0000 7f25c35bc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:40.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.744+0000 7f25c35bc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:40.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.744+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f25bc14cc80 con 0x7f25bc152a00 2026-02-17T21:07:40.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.748+0000 7f25a9ffb640 1 -- 10.20.193.45:0/4102382542 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f25b8010040 con 0x7f25bc152a00 2026-02-17T21:07:40.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.748+0000 7f25a9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:40.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.748+0000 7f25a9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:40.740 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:40.740 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 10 librados: watch_flush enter 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 10 librados: watch_flush exit 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 20 client.4642.objecter shutdown clearing up homeless session... 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 10 client.4642.objecter successfully canceled tick 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f258c0792d0 msgr2=0x7f258c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f258c0792d0 0x7f258c07b790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f25bc1563b0 tx=0x7f25ac033000 comp rx=0 tx=0).stop 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 10 monclient: shutdown 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152a00 msgr2=0x7f25bc1530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152a00 0x7f25bc1530d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009dd0 tx=0x7f25b800c490 comp rx=0 tx=0).stop 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 shutdown_connections 2026-02-17T21:07:40.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f258c0792d0 0x7f258c07b790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25bc152a00 0x7f25bc1530d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25bc152620 0x7f25bc1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 --2- 10.20.193.45:0/4102382542 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25bc0c94a0 0x7f25bc1f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:40.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 >> 10.20.193.45:0/4102382542 conn(0x7f25bc0c9d40 msgr2=0x7f25bc14cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:40.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 shutdown_connections 2026-02-17T21:07:40.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 -- 10.20.193.45:0/4102382542 wait complete. 2026-02-17T21:07:40.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:40.749+0000 7f25c35bc640 1 librados: shutdown 2026-02-17T21:07:43.751 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:43.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.827+0000 7fe1f24d3640 10 monclient: get_monmap_and_config 2026-02-17T21:07:43.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.827+0000 7fe1f24d3640 10 monclient: build_initial_monmap 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.827+0000 7fe1f24d3640 10 monclient: monmap: 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:43.828605+0000 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:43.828605+0000 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:43.821 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:43.822 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:43.822 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:43.822 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:43.822 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:43.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 1 Processor -- start 2026-02-17T21:07:43.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 1 -- start start 2026-02-17T21:07:43.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient: init 2026-02-17T21:07:43.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient: _add_conns ranks=[3,2,4,5,0,1] 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe1ec155e40 0x7fe1ec074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient(hunting): picked mon.noname-a con 0x7fe1ec155e40 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe1ec156220 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fe1ec0cd290 0x7fe1ec074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient(hunting): picked mon.noname-b con 0x7fe1ec0cd290 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ec0734e0 con 0x7fe1ec156220 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ec0cd800 con 0x7fe1ec155e40 2026-02-17T21:07:43.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ec0737c0 con 0x7fe1ec0cd290 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.828+0000 7fe1f24d3640 10 monclient(hunting): authenticate will time out at 1047.458830s 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1ebfff640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe1ec155e40 0x7fe1ec074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1eb7fe640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7fe1ec156220 0x7fe1ec0ccb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:58680/0 (socket says 10.20.193.45:58680) 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1eb7fe640 1 -- 10.20.193.45:0/509736548 learned_addr learned my addr 10.20.193.45:0/509736548 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1f0a49640 1 --2- 10.20.193.45:0/509736548 >> v2:10.20.193.86:3300/0 conn(0x7fe1ec0cd290 0x7fe1ec074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1ebfff640 10 monclient(hunting): get_auth_request con 0x7fe1ec155e40 auth_method 0 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:43.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1f0a49640 10 monclient(hunting): get_auth_request con 0x7fe1ec0cd290 auth_method 0 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1f0a49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1f0a49640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1f0a49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.829+0000 7fe1ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.830+0000 7fe1f0a49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.830+0000 7fe1f0a49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.830+0000 7fe1f0a49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.830+0000 7fe1eaffd640 1 -- 10.20.193.45:0/509736548 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761412743 0 0) 0x7fe1ec0734e0 con 0x7fe1ec156220 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.830+0000 7fe1eaffd640 10 monclient(hunting): _negotiate 2026-02-17T21:07:43.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.830+0000 7fe1eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.830+0000 7fe1eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.830+0000 7fe1eaffd640 10 monclient(hunting): my global_id is 4685 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.830+0000 7fe1eaffd640 1 -- 10.20.193.45:0/509736548 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d0003620 con 0x7fe1ec156220 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.831+0000 7fe1ebfff640 10 monclient(hunting): handle_auth_done global_id 4590 payload 274 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.831+0000 7fe1ebfff640 1 -- 10.20.193.45:0/509736548 >> v2:10.20.193.86:3300/0 conn(0x7fe1ec0cd290 msgr2=0x7fe1ec074ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.831+0000 7fe1ebfff640 1 --2- 10.20.193.45:0/509736548 >> v2:10.20.193.86:3300/0 conn(0x7fe1ec0cd290 0x7fe1ec074ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.831+0000 7fe1ebfff640 1 -- 10.20.193.45:0/509736548 >> v1:10.20.193.92:6789/0 conn(0x7fe1ec156220 legacy=0x7fe1ec0ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.831+0000 7fe1ebfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.831+0000 7fe1ebfff640 1 monclient: found mon.noname-a 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.831+0000 7fe1ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.831+0000 7fe1ebfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:43.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.831+0000 7fe1ebfff640 1 -- 10.20.193.45:0/509736548 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec073aa0 con 0x7fe1ec155e40 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.832+0000 7fe1ebfff640 1 --2- 10.20.193.45:0/509736548 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe1ec155e40 0x7fe1ec074580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec08f310 tx=0x7fe1d802ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c30a78d8bcf3c90 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.833+0000 7fe1eaffd640 1 -- 10.20.193.45:0/509736548 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d803c070 con 0x7fe1ec155e40 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.833+0000 7fe1eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 10 monclient: dump: 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:43.835 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 10 monclient: _finish_auth 0 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 5 monclient: authenticate success, global_id 4590 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 1 -- 10.20.193.45:0/509736548 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d802faf0 con 0x7fe1ec155e40 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:43.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 1 -- 10.20.193.45:0/509736548 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8037440 con 0x7fe1ec155e40 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 4 set_mon_vals no callback set 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1eaffd640 10 monclient: dump: 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:43.837 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 10 monclient: shutdown 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 1 -- 10.20.193.45:0/509736548 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe1ec155e40 msgr2=0x7fe1ec074580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 1 --2- 10.20.193.45:0/509736548 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe1ec155e40 0x7fe1ec074580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec08f310 tx=0x7fe1d802ede0 comp rx=0 tx=0).stop 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 1 -- 10.20.193.45:0/509736548 shutdown_connections 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 1 --2- 10.20.193.45:0/509736548 >> v2:10.20.193.86:3300/0 conn(0x7fe1ec0cd290 0x7fe1ec074ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 1 --2- 10.20.193.45:0/509736548 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe1ec155e40 0x7fe1ec074580 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 1 -- 10.20.193.45:0/509736548 >> 10.20.193.45:0/509736548 conn(0x7fe1ec0ce270 msgr2=0x7fe1ec0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 1 -- 10.20.193.45:0/509736548 shutdown_connections 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.834+0000 7fe1f24d3640 1 -- 10.20.193.45:0/509736548 wait complete. 2026-02-17T21:07:43.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient: build_initial_monmap 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient: monmap: 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:43.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 librados: starting msgr at 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 librados: starting objecter 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 Processor -- start 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 -- start start 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 librados: setting wanted keys 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 librados: calling monclient init 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient: init 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe1ec0cd290 0x7fe1ec0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient(hunting): picked mon.noname-b con 0x7fe1ec0cd290 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe1ec155e40 0x7fe1ec0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:43.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient(hunting): picked mon.noname-a con 0x7fe1ec155e40 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1ec156220 0x7fe1ec1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient(hunting): picked mon.noname-c con 0x7fe1ec156220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec0c4830 con 0x7fe1ec155e40 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec074060 con 0x7fe1ec0cd290 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec0c49b0 con 0x7fe1ec156220 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.835+0000 7fe1f24d3640 10 monclient(hunting): authenticate will time out at 1047.465791s 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe1ec0cd290 0x7fe1ec0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1eb7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe1ec155e40 0x7fe1ec0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1f0a49640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1ec156220 0x7fe1ec1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:43.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe1ec0cd290 0x7fe1ec0caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:55488/0 (socket says 10.20.193.45:55488) 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 1 -- 10.20.193.45:0/3350077725 learned_addr learned my addr 10.20.193.45:0/3350077725 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 10 monclient(hunting): get_auth_request con 0x7fe1ec0cd290 auth_method 0 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1eb7fe640 10 monclient(hunting): get_auth_request con 0x7fe1ec155e40 auth_method 0 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1f0a49640 10 monclient(hunting): get_auth_request con 0x7fe1ec156220 auth_method 0 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1f0a49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1f0a49640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:43.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1f0a49640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1f0a49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1f0a49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.836+0000 7fe1f0a49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 10 monclient(hunting): handle_auth_done global_id 4648 payload 824 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 1 -- 10.20.193.45:0/3350077725 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1ec156220 msgr2=0x7fe1ec1f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:43.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1ec156220 0x7fe1ec1f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:43.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 1 -- 10.20.193.45:0/3350077725 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe1ec155e40 msgr2=0x7fe1ec0c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:43.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe1ec155e40 0x7fe1ec0c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:43.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 10 monclient: _finish_hunting 0 2026-02-17T21:07:43.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 1 monclient: found mon.noname-b 2026-02-17T21:07:43.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:43.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:43.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1ebfff640 1 -- 10.20.193.45:0/3350077725 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec158830 con 0x7fe1ec0cd290 2026-02-17T21:07:43.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.838+0000 7fe1f0a49640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1ec156220 0x7fe1ec1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:07:43.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.839+0000 7fe1ebfff640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe1ec0cd290 0x7fe1ec0caf30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe1d803a040 tx=0x7fe1d80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:43.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.839+0000 7fe1e8ff9640 10 client.?.objecter ms_handle_connect 0x7fe1ec0cd290 2026-02-17T21:07:43.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.839+0000 7fe1e8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:43.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 1 -- 10.20.193.45:0/3350077725 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8046020 con 0x7fe1ec0cd290 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 10 monclient: dump: 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:43.848 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 10 monclient: _finish_auth 0 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 1 -- 10.20.193.45:0/3350077725 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d8042630 con 0x7fe1ec0cd290 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 5 monclient: authenticate success, global_id 4648 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 10 monclient: _renew_subs 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ec1574b0 con 0x7fe1ec0cd290 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 1 -- 10.20.193.45:0/3350077725 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d803c040 con 0x7fe1ec0cd290 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:43.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1e8ff9640 10 monclient: dump: 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1ea7fc640 4 set_mon_vals no callback set 2026-02-17T21:07:43.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 10 client.4648.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 10 monclient: _renew_subs 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ec157a70 con 0x7fe1ec0cd290 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 1 librados: init done 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.841+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ec158360 con 0x7fe1ec0cd290 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.853+0000 7fe1e8ff9640 1 -- 10.20.193.45:0/3350077725 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fe1d8053070 con 0x7fe1ec0cd290 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.853+0000 7fe1e8ff9640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1bc0792d0 0x7fe1bc07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.853+0000 7fe1eb7fe640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1bc0792d0 0x7fe1bc07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:43.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.853+0000 7fe1eb7fe640 10 monclient: get_auth_request con 0x7fe1bc0792d0 auth_method 0 2026-02-17T21:07:43.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.853+0000 7fe1e8ff9640 10 client.4648.objecter ms_handle_connect 0x7fe1bc0792d0 2026-02-17T21:07:43.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.853+0000 7fe1eb7fe640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1bc0792d0 0x7fe1bc07b790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc007b60 tx=0x7fe1dc007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:43.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.855+0000 7fe1e8ff9640 1 -- 10.20.193.45:0/3350077725 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fe1d802f9b0 con 0x7fe1ec0cd290 2026-02-17T21:07:43.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.855+0000 7fe1e8ff9640 10 client.4648.objecter ms_dispatch2 0x7fe1ec000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:43.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.855+0000 7fe1e8ff9640 3 client.4648.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:43.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.855+0000 7fe1e8ff9640 3 client.4648.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:43.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.855+0000 7fe1e8ff9640 20 client.4648.objecter dump_active .. 0 homeless 2026-02-17T21:07:43.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.959+0000 7fe1e8ff9640 1 -- 10.20.193.45:0/3350077725 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe1d8050020 con 0x7fe1ec0cd290 2026-02-17T21:07:43.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.959+0000 7fe1e8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:43.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:43.959+0000 7fe1e8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:44.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.060+0000 7fe1f24d3640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:44.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.060+0000 7fe1f24d3640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:44.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.060+0000 7fe1f24d3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:07:44.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.060+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe1ec0ccb80 con 0x7fe1ec0cd290 2026-02-17T21:07:44.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.063+0000 7fe1e8ff9640 1 -- 10.20.193.45:0/3350077725 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fe1d8087980 con 0x7fe1ec0cd290 2026-02-17T21:07:44.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.063+0000 7fe1e8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:44.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.063+0000 7fe1e8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:44.055 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:44.055 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:44.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 10 librados: watch_flush enter 2026-02-17T21:07:44.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 10 librados: watch_flush exit 2026-02-17T21:07:44.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 20 client.4648.objecter shutdown clearing up homeless session... 2026-02-17T21:07:44.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 10 client.4648.objecter successfully canceled tick 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1bc0792d0 msgr2=0x7fe1bc07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1bc0792d0 0x7fe1bc07b790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc007b60 tx=0x7fe1dc007ab0 comp rx=0 tx=0).stop 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 10 monclient: shutdown 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe1ec0cd290 msgr2=0x7fe1ec0caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe1ec0cd290 0x7fe1ec0caf30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe1d803a040 tx=0x7fe1d80047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 shutdown_connections 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe1bc0792d0 0x7fe1bc07b790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1ec156220 0x7fe1ec1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe1ec155e40 0x7fe1ec0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:44.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 --2- 10.20.193.45:0/3350077725 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe1ec0cd290 0x7fe1ec0caf30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:44.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 >> 10.20.193.45:0/3350077725 conn(0x7fe1ec0ce270 msgr2=0x7fe1ec153660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:44.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 shutdown_connections 2026-02-17T21:07:44.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 -- 10.20.193.45:0/3350077725 wait complete. 2026-02-17T21:07:44.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:44.064+0000 7fe1f24d3640 1 librados: shutdown 2026-02-17T21:07:47.066 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:47.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.144+0000 7f61d5f2a640 10 monclient: get_monmap_and_config 2026-02-17T21:07:47.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.144+0000 7f61d5f2a640 10 monclient: build_initial_monmap 2026-02-17T21:07:47.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.144+0000 7f61d5f2a640 10 monclient: monmap: 2026-02-17T21:07:47.137 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:47.137 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:47.137 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:47.144969+0000 2026-02-17T21:07:47.137 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:47.144969+0000 2026-02-17T21:07:47.137 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:47.137 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.144+0000 7f61d5f2a640 1 Processor -- start 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.144+0000 7f61d5f2a640 1 -- start start 2026-02-17T21:07:47.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.144+0000 7f61d5f2a640 10 monclient: init 2026-02-17T21:07:47.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 10 monclient: _add_conns ranks=[5,3,2,4,0,1] 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f61d015d1e0 0x7f61d015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 10 monclient(hunting): picked mon.noname-c con 0x7f61d015d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f61d00748e0 0x7f61d00c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 10 monclient(hunting): picked mon.noname-a con 0x7f61d00748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f61d00c90e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d00c9570 con 0x7f61d00c90e0 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f61d00c5860 con 0x7f61d00748e0 2026-02-17T21:07:47.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f61d00c5580 con 0x7f61d015d1e0 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61d5f2a640 10 monclient(hunting): authenticate will time out at 1050.775101s 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61ceffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f61d00748e0 0x7f61d00c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61cf7fe640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f61d015d1e0 0x7f61d015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61ceffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f61d00748e0 0x7f61d00c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:33998/0 (socket says 10.20.193.45:33998) 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61ceffd640 1 -- 10.20.193.45:0/2465472752 learned_addr learned my addr 10.20.193.45:0/2465472752 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61ceffd640 10 monclient(hunting): get_auth_request con 0x7f61d00748e0 auth_method 0 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:47.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61cf7fe640 10 monclient(hunting): get_auth_request con 0x7f61d015d1e0 auth_method 0 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.145+0000 7f61cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.146+0000 7f61ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.146+0000 7f61ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.146+0000 7f61ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.146+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.146+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.146+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.146+0000 7f61ceffd640 10 monclient(hunting): handle_auth_done global_id 4596 payload 274 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.147+0000 7f61ceffd640 1 -- 10.20.193.45:0/2465472752 >> v2:10.20.193.92:3300/0 conn(0x7f61d015d1e0 msgr2=0x7f61d015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:47.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.147+0000 7f61ceffd640 1 --2- 10.20.193.45:0/2465472752 >> v2:10.20.193.92:3300/0 conn(0x7f61d015d1e0 0x7f61d015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.147+0000 7f61ceffd640 1 -- 10.20.193.45:0/2465472752 >> v1:10.20.193.92:6789/0 conn(0x7f61d00c90e0 legacy=0x7f61d0153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.147+0000 7f61ceffd640 10 monclient: _finish_hunting 0 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.147+0000 7f61ceffd640 1 monclient: found mon.noname-a 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.147+0000 7f61ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.147+0000 7f61ceffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.147+0000 7f61ceffd640 1 -- 10.20.193.45:0/2465472752 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d00c7de0 con 0x7f61d00748e0 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.147+0000 7f61ceffd640 1 --2- 10.20.193.45:0/2465472752 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 0x7f61d00c8ba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009970 tx=0x7f61c002eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2c89677b316392 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 1 -- 10.20.193.45:0/2465472752 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c003c070 con 0x7f61d00748e0 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 10 monclient: dump: 2026-02-17T21:07:47.150 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 10 monclient: _finish_auth 0 2026-02-17T21:07:47.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 1 -- 10.20.193.45:0/2465472752 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c002fb20 con 0x7f61d00748e0 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61d5f2a640 5 monclient: authenticate success, global_id 4596 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61d5f2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 1 -- 10.20.193.45:0/2465472752 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0037440 con 0x7f61d00748e0 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61ce7fc640 10 monclient: dump: 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:47.152 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61d5f2a640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.149+0000 7f61d5f2a640 4 set_mon_vals no callback set 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 10 monclient: shutdown 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:47.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 -- 10.20.193.45:0/2465472752 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 msgr2=0x7f61d00c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 --2- 10.20.193.45:0/2465472752 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 0x7f61d00c8ba0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009970 tx=0x7f61c002eef0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 -- 10.20.193.45:0/2465472752 shutdown_connections 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 --2- 10.20.193.45:0/2465472752 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 0x7f61d00c8ba0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 --2- 10.20.193.45:0/2465472752 >> v2:10.20.193.92:3300/0 conn(0x7f61d015d1e0 0x7f61d015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 -- 10.20.193.45:0/2465472752 >> 10.20.193.45:0/2465472752 conn(0x7f61d00c9d40 msgr2=0x7f61d00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 -- 10.20.193.45:0/2465472752 shutdown_connections 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 -- 10.20.193.45:0/2465472752 wait complete. 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 10 monclient: build_initial_monmap 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 10 monclient: monmap: 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:47.154 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 librados: starting msgr at 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.150+0000 7f61d5f2a640 1 librados: starting objecter 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 Processor -- start 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 -- start start 2026-02-17T21:07:47.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 librados: setting wanted keys 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 librados: calling monclient init 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient: init 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 0x7f61d0074270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient(hunting): picked mon.noname-a con 0x7f61d00748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f61d00c90e0 0x7f61d014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient(hunting): picked mon.noname-b con 0x7f61d00c90e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f61d015d1e0 0x7f61d0144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient(hunting): picked mon.noname-c con 0x7f61d015d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:47.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00c8680 con 0x7f61d00748e0 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f61d00c83a0 con 0x7f61d00c90e0 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f61d0074d30 con 0x7f61d015d1e0 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61d5f2a640 10 monclient(hunting): authenticate will time out at 1050.781515s 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61cf7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 0x7f61d0074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61cffff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f61d015d1e0 0x7f61d0144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61cf7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 0x7f61d0074270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:34012/0 (socket says 10.20.193.45:34012) 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61cf7fe640 1 -- 10.20.193.45:0/3397280545 learned_addr learned my addr 10.20.193.45:0/3397280545 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61cf7fe640 10 monclient(hunting): get_auth_request con 0x7f61d00748e0 auth_method 0 2026-02-17T21:07:47.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.151+0000 7f61ceffd640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f61d00c90e0 0x7f61d014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cffff640 10 monclient(hunting): get_auth_request con 0x7f61d015d1e0 auth_method 0 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61ceffd640 10 monclient(hunting): get_auth_request con 0x7f61d00c90e0 auth_method 0 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61ceffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:47.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61ceffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61ceffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.152+0000 7f61ceffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_done global_id 4599 payload 824 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 1 -- 10.20.193.45:0/3397280545 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f61d015d1e0 msgr2=0x7f61d0144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f61d015d1e0 0x7f61d0144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 1 -- 10.20.193.45:0/3397280545 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f61d00c90e0 msgr2=0x7f61d014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:47.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f61d00c90e0 0x7f61d014a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:47.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 1 monclient: found mon.noname-a 2026-02-17T21:07:47.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:47.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:47.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.153+0000 7f61cf7fe640 1 -- 10.20.193.45:0/3397280545 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d0072810 con 0x7f61d00748e0 2026-02-17T21:07:47.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.154+0000 7f61cf7fe640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 0x7f61d0074270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00e890 tx=0x7f61bc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:47.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.154+0000 7f61abfff640 10 client.?.objecter ms_handle_connect 0x7f61d00748e0 2026-02-17T21:07:47.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.154+0000 7f61abfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:47.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 1 -- 10.20.193.45:0/3397280545 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc017070 con 0x7f61d00748e0 2026-02-17T21:07:47.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:47.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:47.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 10 monclient: dump: 2026-02-17T21:07:47.164 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:47.164 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:47.164 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:47.164 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:47.164 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:47.164 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:47.164 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:47.164 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:47.164 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:47.165 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:47.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 10 monclient: _finish_auth 0 2026-02-17T21:07:47.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:47.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:47.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 1 -- 10.20.193.45:0/3397280545 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61bc00c940 con 0x7f61d00748e0 2026-02-17T21:07:47.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 5 monclient: authenticate success, global_id 4599 2026-02-17T21:07:47.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:47.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 1 -- 10.20.193.45:0/3397280545 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc00cd30 con 0x7f61d00748e0 2026-02-17T21:07:47.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:47.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:47.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61abfff640 10 monclient: dump: 2026-02-17T21:07:47.166 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:47.166 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:47.166 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:47.166 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61cdffb640 4 set_mon_vals no callback set 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 10 monclient: _renew_subs 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d0072af0 con 0x7f61d00748e0 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 10 client.4599.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:47.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 10 monclient: _renew_subs 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d00730b0 con 0x7f61d00748e0 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 1 librados: init done 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.156+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d00c8ba0 con 0x7f61d00748e0 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.168+0000 7f61abfff640 1 -- 10.20.193.45:0/3397280545 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f61bc013470 con 0x7f61d00748e0 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.169+0000 7f61abfff640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f61a0079300 0x7f61a007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.169+0000 7f61ceffd640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f61a0079300 0x7f61a007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.169+0000 7f61ceffd640 10 monclient: get_auth_request con 0x7f61a0079300 auth_method 0 2026-02-17T21:07:47.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.169+0000 7f61ceffd640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f61a0079300 0x7f61a007b7c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61d00c6af0 tx=0x7f61c0033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:47.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.169+0000 7f61abfff640 10 client.4599.objecter ms_handle_connect 0x7f61a0079300 2026-02-17T21:07:47.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.171+0000 7f61abfff640 1 -- 10.20.193.45:0/3397280545 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f61bc05e6d0 con 0x7f61d00748e0 2026-02-17T21:07:47.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.171+0000 7f61abfff640 10 client.4599.objecter ms_dispatch2 0x7f61d0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:47.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.171+0000 7f61abfff640 3 client.4599.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:47.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.171+0000 7f61abfff640 3 client.4599.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:47.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.171+0000 7f61abfff640 20 client.4599.objecter dump_active .. 0 homeless 2026-02-17T21:07:47.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.274+0000 7f61abfff640 1 -- 10.20.193.45:0/3397280545 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f61bc062690 con 0x7f61d00748e0 2026-02-17T21:07:47.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.274+0000 7f61abfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:47.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.274+0000 7f61abfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:47.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.378+0000 7f61d5f2a640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:47.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.378+0000 7f61d5f2a640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:47.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.378+0000 7f61d5f2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:47.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.378+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f61d00c9b20 con 0x7f61d00748e0 2026-02-17T21:07:47.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.381+0000 7f61abfff640 1 -- 10.20.193.45:0/3397280545 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f61bc066990 con 0x7f61d00748e0 2026-02-17T21:07:47.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.381+0000 7f61abfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:47.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.381+0000 7f61abfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:47.374 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:47.374 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:47.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 10 librados: watch_flush enter 2026-02-17T21:07:47.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 10 librados: watch_flush exit 2026-02-17T21:07:47.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 20 client.4599.objecter shutdown clearing up homeless session... 2026-02-17T21:07:47.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 10 client.4599.objecter successfully canceled tick 2026-02-17T21:07:47.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f61a0079300 msgr2=0x7f61a007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:47.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f61a0079300 0x7f61a007b7c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f61d00c6af0 tx=0x7f61c0033000 comp rx=0 tx=0).stop 2026-02-17T21:07:47.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 10 monclient: shutdown 2026-02-17T21:07:47.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:47.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 msgr2=0x7f61d0074270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 0x7f61d0074270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00e890 tx=0x7f61bc00ed60 comp rx=0 tx=0).stop 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 shutdown_connections 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f61a0079300 0x7f61a007b7c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f61d015d1e0 0x7f61d0144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f61d00c90e0 0x7f61d014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 --2- 10.20.193.45:0/3397280545 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f61d00748e0 0x7f61d0074270 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 >> 10.20.193.45:0/3397280545 conn(0x7f61d00c9d40 msgr2=0x7f61d0152b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 shutdown_connections 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 -- 10.20.193.45:0/3397280545 wait complete. 2026-02-17T21:07:47.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:47.382+0000 7f61d5f2a640 1 librados: shutdown 2026-02-17T21:07:49.897 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:57.110 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:49.898 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:57.111 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:49.906 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:02:57.119 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:49.927 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:02:57.136 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:49.928 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:02:57.101 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:49.929 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:02:57.138 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:49.929 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:02:57.102 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:49.936 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:02:57.145 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:49.937 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:02:57.110 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:07:50.385 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:50.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.463+0000 7f29d35ce640 10 monclient: get_monmap_and_config 2026-02-17T21:07:50.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.463+0000 7f29d35ce640 10 monclient: build_initial_monmap 2026-02-17T21:07:50.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.463+0000 7f29d35ce640 10 monclient: monmap: 2026-02-17T21:07:50.456 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:50.456 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:50.456 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:50.463990+0000 2026-02-17T21:07:50.456 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:50.463990+0000 2026-02-17T21:07:50.456 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:50.456 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.463+0000 7f29d35ce640 1 Processor -- start 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.463+0000 7f29d35ce640 1 -- start start 2026-02-17T21:07:50.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.463+0000 7f29d35ce640 10 monclient: init 2026-02-17T21:07:50.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:50.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 10 monclient: _add_conns ranks=[0,5,4,2,3,1] 2026-02-17T21:07:50.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f29cc15d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:50.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f29cc0c92b0 0x7f29cc15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:50.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 10 monclient(hunting): picked mon.noname-c con 0x7f29cc0c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:50.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f29cc0748e0 0x7f29cc153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:50.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 10 monclient(hunting): picked mon.noname-b con 0x7f29cc0748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29cc0c5860 con 0x7f29cc15d1e0 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f29cc0c5580 con 0x7f29cc0748e0 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f29cc0c7de0 con 0x7f29cc0c92b0 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d35ce640 10 monclient(hunting): authenticate will time out at 1054.094129s 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d1343640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f29cc15d1e0 0x7f29cc0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:33426/0 (socket says 10.20.193.45:33426) 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d1343640 1 -- 10.20.193.45:0/4075764876 learned_addr learned my addr 10.20.193.45:0/4075764876 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d0b42640 1 --2- 10.20.193.45:0/4075764876 >> v2:10.20.193.92:3300/0 conn(0x7f29cc0c92b0 0x7f29cc15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:50.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d1b44640 1 --2- 10.20.193.45:0/4075764876 >> v2:10.20.193.86:3300/0 conn(0x7f29cc0748e0 0x7f29cc153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d0b42640 10 monclient(hunting): get_auth_request con 0x7f29cc0c92b0 auth_method 0 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d0b42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d0b42640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d0b42640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d1b44640 10 monclient(hunting): get_auth_request con 0x7f29cc0748e0 auth_method 0 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d1b44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d1b44640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.464+0000 7f29d1b44640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29d0b42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29d0b42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:50.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29d0b42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29d1b44640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29d1b44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29d1b44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29bbfff640 1 -- 10.20.193.45:0/4075764876 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261725089 0 0) 0x7f29cc0c5860 con 0x7f29cc15d1e0 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29bbfff640 10 monclient(hunting): _negotiate 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29bbfff640 10 monclient(hunting): my global_id is 4602 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29bbfff640 1 -- 10.20.193.45:0/4075764876 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29b4003620 con 0x7f29cc15d1e0 2026-02-17T21:07:50.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29d0b42640 10 monclient(hunting): handle_auth_done global_id 4697 payload 274 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29d0b42640 1 -- 10.20.193.45:0/4075764876 >> v2:10.20.193.86:3300/0 conn(0x7f29cc0748e0 msgr2=0x7f29cc153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.465+0000 7f29d0b42640 1 --2- 10.20.193.45:0/4075764876 >> v2:10.20.193.86:3300/0 conn(0x7f29cc0748e0 0x7f29cc153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.466+0000 7f29d0b42640 1 -- 10.20.193.45:0/4075764876 >> v1:10.20.193.45:6789/0 conn(0x7f29cc15d1e0 legacy=0x7f29cc0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.466+0000 7f29d0b42640 10 monclient: _finish_hunting 0 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.466+0000 7f29d0b42640 1 monclient: found mon.noname-c 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.466+0000 7f29d0b42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.466+0000 7f29d0b42640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.466+0000 7f29d0b42640 1 -- 10.20.193.45:0/4075764876 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc0c80c0 con 0x7f29cc0c92b0 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.466+0000 7f29d0b42640 1 --2- 10.20.193.45:0/4075764876 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f29cc0c92b0 0x7f29cc15d5c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29c00098a0 tx=0x7f29c002ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab381c5534d59c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 1 -- 10.20.193.45:0/4075764876 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c003c070 con 0x7f29cc0c92b0 2026-02-17T21:07:50.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 10 monclient: dump: 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:50.471 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 10 monclient: _finish_auth 0 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 1 -- 10.20.193.45:0/4075764876 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c002fae0 con 0x7f29cc0c92b0 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29d35ce640 5 monclient: authenticate success, global_id 4697 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 1 -- 10.20.193.45:0/4075764876 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0037440 con 0x7f29cc0c92b0 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29d35ce640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:50.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29d35ce640 4 set_mon_vals no callback set 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.468+0000 7f29bbfff640 10 monclient: dump: 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:50.473 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 10 monclient: shutdown 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 -- 10.20.193.45:0/4075764876 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f29cc0c92b0 msgr2=0x7f29cc15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 --2- 10.20.193.45:0/4075764876 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f29cc0c92b0 0x7f29cc15d5c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29c00098a0 tx=0x7f29c002ee10 comp rx=0 tx=0).stop 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 -- 10.20.193.45:0/4075764876 shutdown_connections 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 --2- 10.20.193.45:0/4075764876 >> v2:10.20.193.86:3300/0 conn(0x7f29cc0748e0 0x7f29cc153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 --2- 10.20.193.45:0/4075764876 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f29cc0c92b0 0x7f29cc15d5c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 -- 10.20.193.45:0/4075764876 >> 10.20.193.45:0/4075764876 conn(0x7f29cc0c9d40 msgr2=0x7f29cc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 -- 10.20.193.45:0/4075764876 shutdown_connections 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 -- 10.20.193.45:0/4075764876 wait complete. 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 10 monclient: build_initial_monmap 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 10 monclient: monmap: 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:50.475 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 librados: starting msgr at 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 librados: starting objecter 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 Processor -- start 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 -- start start 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 librados: setting wanted keys 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 1 librados: calling monclient init 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.469+0000 7f29d35ce640 10 monclient: init 2026-02-17T21:07:50.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f29cc0748e0 0x7f29cc06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient(hunting): picked mon.noname-b con 0x7f29cc0748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f29cc0c92b0 0x7f29cc1480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient(hunting): picked mon.noname-c con 0x7f29cc0c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f29cc15d1e0 0x7f29cc151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient(hunting): picked mon.noname-a con 0x7f29cc15d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc074d30 con 0x7f29cc15d1e0 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:50.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc0c8680 con 0x7f29cc0748e0 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc153b50 con 0x7f29cc0c92b0 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d35ce640 10 monclient(hunting): authenticate will time out at 1054.100383s 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d1b44640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f29cc15d1e0 0x7f29cc151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d1343640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f29cc0748e0 0x7f29cc06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d0b42640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f29cc0c92b0 0x7f29cc1480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d1b44640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f29cc15d1e0 0x7f29cc151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:58160/0 (socket says 10.20.193.45:58160) 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d1b44640 1 -- 10.20.193.45:0/2216079429 learned_addr learned my addr 10.20.193.45:0/2216079429 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:50.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d1b44640 10 monclient(hunting): get_auth_request con 0x7f29cc15d1e0 auth_method 0 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d1b44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d1b44640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d1b44640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d0b42640 10 monclient(hunting): get_auth_request con 0x7f29cc0c92b0 auth_method 0 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d0b42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d0b42640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.470+0000 7f29d0b42640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1343640 10 monclient(hunting): get_auth_request con 0x7f29cc0748e0 auth_method 0 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1343640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1343640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:50.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1343640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1b44640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1b44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1b44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d0b42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d0b42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d0b42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1343640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1343640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.471+0000 7f29d1343640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 10 monclient(hunting): handle_auth_done global_id 4605 payload 824 2026-02-17T21:07:50.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 1 -- 10.20.193.45:0/2216079429 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f29cc0c92b0 msgr2=0x7f29cc1480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f29cc0c92b0 0x7f29cc1480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 1 -- 10.20.193.45:0/2216079429 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f29cc0748e0 msgr2=0x7f29cc06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f29cc0748e0 0x7f29cc06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 10 monclient: _finish_hunting 0 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 1 monclient: found mon.noname-a 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.472+0000 7f29d1b44640 1 -- 10.20.193.45:0/2216079429 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc1f4a10 con 0x7f29cc15d1e0 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.473+0000 7f29d1b44640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f29cc15d1e0 0x7f29cc151310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29c800efc0 tx=0x7f29c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:50.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.473+0000 7f29b9ffb640 10 client.?.objecter ms_handle_connect 0x7f29cc15d1e0 2026-02-17T21:07:50.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.473+0000 7f29b9ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:50.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 1 -- 10.20.193.45:0/2216079429 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8018020 con 0x7f29cc15d1e0 2026-02-17T21:07:50.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:50.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:50.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 10 monclient: dump: 2026-02-17T21:07:50.485 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:50.485 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:50.485 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:50.485 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:50.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 1 -- 10.20.193.45:0/2216079429 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c8014480 con 0x7f29cc15d1e0 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 1 -- 10.20.193.45:0/2216079429 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8014870 con 0x7f29cc15d1e0 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 5 monclient: authenticate success, global_id 4605 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 10 monclient: _renew_subs 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29cc06d4f0 con 0x7f29cc15d1e0 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29bb7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29b9ffb640 10 monclient: dump: 2026-02-17T21:07:50.487 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:50.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 10 client.4605.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 10 monclient: _renew_subs 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29cc1f3f30 con 0x7f29cc15d1e0 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 1 librados: init done 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.475+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29cc153f30 con 0x7f29cc15d1e0 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.487+0000 7f29b9ffb640 1 -- 10.20.193.45:0/2216079429 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f29c8014a10 con 0x7f29cc15d1e0 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.488+0000 7f29b9ffb640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f299c079300 0x7f299c07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:50.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.488+0000 7f29d1343640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f299c079300 0x7f299c07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.488+0000 7f29d1343640 10 monclient: get_auth_request con 0x7f299c079300 auth_method 0 2026-02-17T21:07:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.488+0000 7f29d1343640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f299c079300 0x7f299c07b7c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29bc007b60 tx=0x7f29bc007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.488+0000 7f29b9ffb640 10 client.4605.objecter ms_handle_connect 0x7f299c079300 2026-02-17T21:07:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.490+0000 7f29b9ffb640 1 -- 10.20.193.45:0/2216079429 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f29c805f190 con 0x7f29cc15d1e0 2026-02-17T21:07:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.490+0000 7f29b9ffb640 10 client.4605.objecter ms_dispatch2 0x7f29cc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.490+0000 7f29b9ffb640 3 client.4605.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.490+0000 7f29b9ffb640 3 client.4605.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:50.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.490+0000 7f29b9ffb640 20 client.4605.objecter dump_active .. 0 homeless 2026-02-17T21:07:50.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.593+0000 7f29b9ffb640 1 -- 10.20.193.45:0/2216079429 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f29c8022070 con 0x7f29cc15d1e0 2026-02-17T21:07:50.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.593+0000 7f29b9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:50.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.593+0000 7f29b9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:50.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.699+0000 7f29d35ce640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:50.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.699+0000 7f29d35ce640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:50.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.699+0000 7f29d35ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:50.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.699+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f29cc1573a0 con 0x7f29cc15d1e0 2026-02-17T21:07:50.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.701+0000 7f29b9ffb640 1 -- 10.20.193.45:0/2216079429 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f29c8010040 con 0x7f29cc15d1e0 2026-02-17T21:07:50.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.701+0000 7f29b9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:50.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.701+0000 7f29b9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:50.694 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:50.694 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:50.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 10 librados: watch_flush enter 2026-02-17T21:07:50.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 10 librados: watch_flush exit 2026-02-17T21:07:50.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 20 client.4605.objecter shutdown clearing up homeless session... 2026-02-17T21:07:50.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 10 client.4605.objecter successfully canceled tick 2026-02-17T21:07:50.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f299c079300 msgr2=0x7f299c07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:50.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f299c079300 0x7f299c07b7c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29bc007b60 tx=0x7f29bc007ab0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 10 monclient: shutdown 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f29cc15d1e0 msgr2=0x7f29cc151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f29cc15d1e0 0x7f29cc151310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29c800efc0 tx=0x7f29c800c490 comp rx=0 tx=0).stop 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 shutdown_connections 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f299c079300 0x7f299c07b7c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f29cc15d1e0 0x7f29cc151310 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f29cc0c92b0 0x7f29cc1480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 --2- 10.20.193.45:0/2216079429 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f29cc0748e0 0x7f29cc06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 >> 10.20.193.45:0/2216079429 conn(0x7f29cc0c9d40 msgr2=0x7f29cc0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 shutdown_connections 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 -- 10.20.193.45:0/2216079429 wait complete. 2026-02-17T21:07:50.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:50.702+0000 7f29d35ce640 1 librados: shutdown 2026-02-17T21:07:53.705 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:53.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.781+0000 7f72012ae640 10 monclient: get_monmap_and_config 2026-02-17T21:07:53.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.781+0000 7f72012ae640 10 monclient: build_initial_monmap 2026-02-17T21:07:53.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.781+0000 7f72012ae640 10 monclient: monmap: 2026-02-17T21:07:53.774 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:53.774 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:53.774 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:53.782703+0000 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:53.782703+0000 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:53.775 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:53.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 1 Processor -- start 2026-02-17T21:07:53.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 1 -- start start 2026-02-17T21:07:53.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 10 monclient: init 2026-02-17T21:07:53.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:53.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 10 monclient: _add_conns ranks=[1,0,4,2,3,5] 2026-02-17T21:07:53.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f71fc15d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:53.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f71fc0c92b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:53.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f71fc153d20 0x7f71fc15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:53.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 10 monclient(hunting): picked mon.noname-b con 0x7f71fc153d20 addr v2:10.20.193.86:3300/0 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71fc0c5860 con 0x7f71fc0c92b0 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71fc0c5580 con 0x7f71fc15d1e0 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f71fc0c7de0 con 0x7f71fc153d20 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.782+0000 7f72012ae640 10 monclient(hunting): authenticate will time out at 1057.412938s 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.783+0000 7f71fa7fc640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f71fc0c92b0 0x7f71fc153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:33440/0 (socket says 10.20.193.45:33440) 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.783+0000 7f71fa7fc640 1 -- 10.20.193.45:0/3649647484 learned_addr learned my addr 10.20.193.45:0/3649647484 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.783+0000 7f71fb7fe640 1 --2- 10.20.193.45:0/3649647484 >> v2:10.20.193.86:3300/0 conn(0x7f71fc153d20 0x7f71fc15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71fb7fe640 10 monclient(hunting): get_auth_request con 0x7f71fc153d20 auth_method 0 2026-02-17T21:07:53.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71f9ffb640 1 -- 10.20.193.45:0/3649647484 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027066796 0 0) 0x7f71fc0c5860 con 0x7f71fc0c92b0 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71f9ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71f9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71f9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71f9ffb640 10 monclient(hunting): my global_id is 4608 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.784+0000 7f71f9ffb640 1 -- 10.20.193.45:0/3649647484 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e8003620 con 0x7f71fc0c92b0 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.785+0000 7f71fb7fe640 10 monclient(hunting): handle_auth_done global_id 4660 payload 274 2026-02-17T21:07:53.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.785+0000 7f71fb7fe640 1 -- 10.20.193.45:0/3649647484 >> v1:10.20.193.86:6789/0 conn(0x7f71fc15d1e0 legacy=0x7f71fc0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:53.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.785+0000 7f71fb7fe640 1 -- 10.20.193.45:0/3649647484 >> v1:10.20.193.45:6789/0 conn(0x7f71fc0c92b0 legacy=0x7f71fc153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:53.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.785+0000 7f71fb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:53.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.785+0000 7f71fb7fe640 1 monclient: found mon.noname-b 2026-02-17T21:07:53.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.785+0000 7f71fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:53.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.785+0000 7f71fb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:07:53.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.785+0000 7f71fb7fe640 1 -- 10.20.193.45:0/3649647484 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc0c80c0 con 0x7f71fc153d20 2026-02-17T21:07:53.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.788+0000 7f71fb7fe640 1 --2- 10.20.193.45:0/3649647484 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 0x7f71fc15d5c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009dc0 tx=0x7f71ec02f280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb1d04ea7000c98 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:53.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 1 -- 10.20.193.45:0/3649647484 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec03c070 con 0x7f71fc153d20 2026-02-17T21:07:53.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:53.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:07:53.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 10 monclient: dump: 2026-02-17T21:07:53.787 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:53.787 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:53.787 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:53.787 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 1 -- 10.20.193.45:0/3649647484 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ec037440 con 0x7f71fc153d20 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 5 monclient: authenticate success, global_id 4660 2026-02-17T21:07:53.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 1 -- 10.20.193.45:0/3649647484 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec037810 con 0x7f71fc153d20 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 4 set_mon_vals no callback set 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f71f9ffb640 10 monclient: dump: 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:53.789 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 10 monclient: shutdown 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 1 -- 10.20.193.45:0/3649647484 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 msgr2=0x7f71fc15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 1 --2- 10.20.193.45:0/3649647484 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 0x7f71fc15d5c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009dc0 tx=0x7f71ec02f280 comp rx=0 tx=0).stop 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 1 -- 10.20.193.45:0/3649647484 shutdown_connections 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 1 --2- 10.20.193.45:0/3649647484 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 0x7f71fc15d5c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:53.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 1 -- 10.20.193.45:0/3649647484 >> 10.20.193.45:0/3649647484 conn(0x7f71fc0c9d40 msgr2=0x7f71fc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 1 -- 10.20.193.45:0/3649647484 shutdown_connections 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.790+0000 7f72012ae640 1 -- 10.20.193.45:0/3649647484 wait complete. 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient: build_initial_monmap 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient: monmap: 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:53.791 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 librados: starting msgr at 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 librados: starting objecter 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 Processor -- start 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 -- start start 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 librados: setting wanted keys 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 librados: calling monclient init 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient: init 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71fc0c92b0 0x7f71fc1f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:53.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient(hunting): picked mon.noname-c con 0x7f71fc0c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 0x7f71fc1f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient(hunting): picked mon.noname-b con 0x7f71fc153d20 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71fc15d1e0 0x7f71fc073530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient(hunting): picked mon.noname-a con 0x7f71fc15d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc0748e0 con 0x7f71fc15d1e0 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc0c8680 con 0x7f71fc153d20 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc074a60 con 0x7f71fc0c92b0 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:53.793 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.791+0000 7f72012ae640 10 monclient(hunting): authenticate will time out at 1057.421896s 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 0x7f71fc1f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fb7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71fc15d1e0 0x7f71fc073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 0x7f71fc1f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:47230/0 (socket says 10.20.193.45:47230) 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 1 -- 10.20.193.45:0/3821009955 learned_addr learned my addr 10.20.193.45:0/3821009955 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fb7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71fc15d1e0 0x7f71fc073530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:58174/0 (socket says 10.20.193.45:58174) 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fb7fe640 10 monclient(hunting): get_auth_request con 0x7f71fc15d1e0 auth_method 0 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 10 monclient(hunting): get_auth_request con 0x7f71fc153d20 auth_method 0 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:53.794 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71faffd640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71fc0c92b0 0x7f71fc1f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71faffd640 10 monclient(hunting): get_auth_request con 0x7f71fc0c92b0 auth_method 0 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71faffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.792+0000 7f71faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:53.795 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 10 monclient(hunting): handle_auth_done global_id 4611 payload 824 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 1 -- 10.20.193.45:0/3821009955 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71fc0c92b0 msgr2=0x7f71fc1f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71fc0c92b0 0x7f71fc1f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 1 -- 10.20.193.45:0/3821009955 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 msgr2=0x7f71fc1f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 0x7f71fc1f52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 1 monclient: found mon.noname-a 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:53.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.793+0000 7f71fb7fe640 1 -- 10.20.193.45:0/3821009955 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc15b9c0 con 0x7f71fc15d1e0 2026-02-17T21:07:53.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.794+0000 7f71fb7fe640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71fc15d1e0 0x7f71fc073530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71ec036000 tx=0x7f71ec004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:53.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.794+0000 7f71db7fe640 10 client.?.objecter ms_handle_connect 0x7f71fc15d1e0 2026-02-17T21:07:53.797 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.795+0000 7f71db7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 1 -- 10.20.193.45:0/3821009955 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec047020 con 0x7f71fc15d1e0 2026-02-17T21:07:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:53.799 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 10 monclient: dump: 2026-02-17T21:07:53.799 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:53.799 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:53.799 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:53.799 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 10 monclient: _finish_auth 0 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 1 -- 10.20.193.45:0/3821009955 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ec03d040 con 0x7f71fc15d1e0 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f72012ae640 5 monclient: authenticate success, global_id 4611 2026-02-17T21:07:53.800 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f72012ae640 10 monclient: _renew_subs 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f72012ae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc15bca0 con 0x7f71fc15d1e0 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 1 -- 10.20.193.45:0/3821009955 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec03c050 con 0x7f71fc15d1e0 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71db7fe640 10 monclient: dump: 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:53.801 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.796+0000 7f71f97fa640 4 set_mon_vals no callback set 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.797+0000 7f72012ae640 10 client.4611.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.797+0000 7f72012ae640 10 monclient: _renew_subs 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.797+0000 7f72012ae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.797+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc072770 con 0x7f71fc15d1e0 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.797+0000 7f72012ae640 1 librados: init done 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.797+0000 7f72012ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.797+0000 7f72012ae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:53.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.797+0000 7f72012ae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:53.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.797+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc15d5c0 con 0x7f71fc15d1e0 2026-02-17T21:07:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.809+0000 7f71db7fe640 1 -- 10.20.193.45:0/3821009955 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f71ec041a10 con 0x7f71fc15d1e0 2026-02-17T21:07:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.809+0000 7f71db7fe640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f71c8079300 0x7f71c807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.809+0000 7f71faffd640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f71c8079300 0x7f71c807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.809+0000 7f71faffd640 10 monclient: get_auth_request con 0x7f71c8079300 auth_method 0 2026-02-17T21:07:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.810+0000 7f71faffd640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f71c8079300 0x7f71c807b7c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f71f0002770 tx=0x7f71f0007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.810+0000 7f71db7fe640 10 client.4611.objecter ms_handle_connect 0x7f71c8079300 2026-02-17T21:07:53.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.810+0000 7f71db7fe640 1 -- 10.20.193.45:0/3821009955 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f71ec083470 con 0x7f71fc15d1e0 2026-02-17T21:07:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.810+0000 7f71db7fe640 10 client.4611.objecter ms_dispatch2 0x7f71fc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.810+0000 7f71db7fe640 3 client.4611.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.810+0000 7f71db7fe640 3 client.4611.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:53.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.810+0000 7f71db7fe640 20 client.4611.objecter dump_active .. 0 homeless 2026-02-17T21:07:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.913+0000 7f71db7fe640 1 -- 10.20.193.45:0/3821009955 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f71ec051080 con 0x7f71fc15d1e0 2026-02-17T21:07:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.913+0000 7f71db7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:53.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:53.913+0000 7f71db7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:54.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.013+0000 7f72012ae640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:54.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.013+0000 7f72012ae640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:54.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.013+0000 7f72012ae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:54.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.013+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f71fc1573a0 con 0x7f71fc15d1e0 2026-02-17T21:07:54.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.016+0000 7f71db7fe640 1 -- 10.20.193.45:0/3821009955 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f71ec087430 con 0x7f71fc15d1e0 2026-02-17T21:07:54.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.016+0000 7f71db7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:54.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.016+0000 7f71db7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:54.009 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:54.009 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:54.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 10 librados: watch_flush enter 2026-02-17T21:07:54.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 10 librados: watch_flush exit 2026-02-17T21:07:54.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 20 client.4611.objecter shutdown clearing up homeless session... 2026-02-17T21:07:54.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 10 client.4611.objecter successfully canceled tick 2026-02-17T21:07:54.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f71c8079300 msgr2=0x7f71c807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:54.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f71c8079300 0x7f71c807b7c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f71f0002770 tx=0x7f71f0007ef0 comp rx=0 tx=0).stop 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 10 monclient: shutdown 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71fc15d1e0 msgr2=0x7f71fc073530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71fc15d1e0 0x7f71fc073530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71ec036000 tx=0x7f71ec004b40 comp rx=0 tx=0).stop 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 shutdown_connections 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f71c8079300 0x7f71c807b7c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f71fc15d1e0 0x7f71fc073530 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f71fc153d20 0x7f71fc1f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 --2- 10.20.193.45:0/3821009955 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71fc0c92b0 0x7f71fc1f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 >> 10.20.193.45:0/3821009955 conn(0x7f71fc0c9d40 msgr2=0x7f71fc152410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:54.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.017+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 shutdown_connections 2026-02-17T21:07:54.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.018+0000 7f72012ae640 1 -- 10.20.193.45:0/3821009955 wait complete. 2026-02-17T21:07:54.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:54.018+0000 7f72012ae640 1 librados: shutdown 2026-02-17T21:07:57.019 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.095+0000 7f44e39ce640 10 monclient: get_monmap_and_config 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.095+0000 7f44e39ce640 10 monclient: build_initial_monmap 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.095+0000 7f44e39ce640 10 monclient: monmap: 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:07:57.097211+0000 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:07:57.097211+0000 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:07:57.088 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.095+0000 7f44e39ce640 1 Processor -- start 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.095+0000 7f44e39ce640 1 -- start start 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.095+0000 7f44e39ce640 10 monclient: init 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 10 monclient: _add_conns ranks=[1,5,0,2,4,3] 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f44dc15d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f44dc0c92b0 0x7f44dc15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:57.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 10 monclient(hunting): picked mon.noname-c con 0x7f44dc0c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f44dc0748e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44dc0c5860 con 0x7f44dc0748e0 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44dc0c5580 con 0x7f44dc15d1e0 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f44dc0c7de0 con 0x7f44dc0c92b0 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e39ce640 10 monclient(hunting): authenticate will time out at 1060.727460s 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e1f44640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f44dc0748e0 0x7f44dc153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:33444/0 (socket says 10.20.193.45:33444) 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e1f44640 1 -- 10.20.193.45:0/799138089 learned_addr learned my addr 10.20.193.45:0/799138089 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.096+0000 7f44e0f42640 1 --2- 10.20.193.45:0/799138089 >> v2:10.20.193.92:3300/0 conn(0x7f44dc0c92b0 0x7f44dc15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.097+0000 7f44e0f42640 10 monclient(hunting): get_auth_request con 0x7f44dc0c92b0 auth_method 0 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.097+0000 7f44e0f42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.097+0000 7f44e0f42640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.097+0000 7f44e0f42640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.097+0000 7f44e0f42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.097+0000 7f44e0f42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:57.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.097+0000 7f44e0f42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 1 -- 10.20.193.45:0/799138089 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492725219 0 0) 0x7f44dc0c5860 con 0x7f44dc0748e0 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 10 monclient(hunting): _negotiate 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 10 monclient(hunting): my global_id is 4614 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 1 -- 10.20.193.45:0/799138089 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c4003620 con 0x7f44dc0748e0 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 1 -- 10.20.193.45:0/799138089 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167452664 0 0) 0x7f44dc0c5580 con 0x7f44dc15d1e0 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 10 monclient(hunting): _negotiate 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:57.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 10 monclient(hunting): my global_id is 4666 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44cbfff640 1 -- 10.20.193.45:0/799138089 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44dc0c5860 con 0x7f44dc15d1e0 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44e0f42640 10 monclient(hunting): handle_auth_done global_id 4706 payload 274 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44e0f42640 1 -- 10.20.193.45:0/799138089 >> v1:10.20.193.86:6789/0 conn(0x7f44dc15d1e0 legacy=0x7f44dc0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44e0f42640 1 -- 10.20.193.45:0/799138089 >> v1:10.20.193.45:6789/0 conn(0x7f44dc0748e0 legacy=0x7f44dc153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44e0f42640 10 monclient: _finish_hunting 0 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44e0f42640 1 monclient: found mon.noname-c 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44e0f42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44e0f42640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.098+0000 7f44e0f42640 1 -- 10.20.193.45:0/799138089 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc0c80c0 con 0x7f44dc0c92b0 2026-02-17T21:07:57.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.099+0000 7f44e0f42640 1 --2- 10.20.193.45:0/799138089 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc0c92b0 0x7f44dc15d5c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f44d00098d0 tx=0x7f44d002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec32f6f2db1d7fa9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 1 -- 10.20.193.45:0/799138089 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d003c070 con 0x7f44dc0c92b0 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 10 monclient: dump: 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 10 monclient: _finish_auth 0 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 10 monclient: _check_auth_tickets 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 1 -- 10.20.193.45:0/799138089 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d002fba0 con 0x7f44dc0c92b0 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44e39ce640 5 monclient: authenticate success, global_id 4706 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44e39ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 1 -- 10.20.193.45:0/799138089 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0037440 con 0x7f44dc0c92b0 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44e39ce640 10 monclient: get_monmap_and_config success 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44e39ce640 4 set_mon_vals no callback set 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44cbfff640 10 monclient: dump: 2026-02-17T21:07:57.095 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44e39ce640 10 monclient: shutdown 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44e39ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44e39ce640 1 -- 10.20.193.45:0/799138089 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc0c92b0 msgr2=0x7f44dc15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.101+0000 7f44e39ce640 1 --2- 10.20.193.45:0/799138089 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc0c92b0 0x7f44dc15d5c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f44d00098d0 tx=0x7f44d002eed0 comp rx=0 tx=0).stop 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 -- 10.20.193.45:0/799138089 shutdown_connections 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 --2- 10.20.193.45:0/799138089 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc0c92b0 0x7f44dc15d5c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 -- 10.20.193.45:0/799138089 >> 10.20.193.45:0/799138089 conn(0x7f44dc0c9d40 msgr2=0x7f44dc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 -- 10.20.193.45:0/799138089 shutdown_connections 2026-02-17T21:07:57.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 -- 10.20.193.45:0/799138089 wait complete. 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 10 monclient: build_initial_monmap 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 10 monclient: monmap: 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:07:57.097 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 librados: starting msgr at 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 librados: starting objecter 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 Processor -- start 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 -- start start 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 librados: setting wanted keys 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 1 librados: calling monclient init 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.102+0000 7f44e39ce640 10 monclient: init 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient: _reopen_session rank -1 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f44dc0748e0 0x7f44dc13cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient(hunting): picked mon.noname-b con 0x7f44dc0748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f44dc0c92b0 0x7f44dc140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient(hunting): picked mon.noname-a con 0x7f44dc0c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc15d1e0 0x7f44dc141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient(hunting): picked mon.noname-c con 0x7f44dc15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc074d30 con 0x7f44dc0c92b0 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc0c8680 con 0x7f44dc0748e0 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient(hunting): start opening mon connection 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc153d20 con 0x7f44dc15d1e0 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient(hunting): _renew_subs 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e39ce640 10 monclient(hunting): authenticate will time out at 1060.734377s 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e0f42640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f44dc0c92b0 0x7f44dc140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1f44640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc15d1e0 0x7f44dc141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1743640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f44dc0748e0 0x7f44dc13cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e0f42640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f44dc0c92b0 0x7f44dc140ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:58180/0 (socket says 10.20.193.45:58180) 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1f44640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc15d1e0 0x7f44dc141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:58708/0 (socket says 10.20.193.45:58708) 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e0f42640 1 -- 10.20.193.45:0/1419733487 learned_addr learned my addr 10.20.193.45:0/1419733487 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e0f42640 10 monclient(hunting): get_auth_request con 0x7f44dc0c92b0 auth_method 0 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e0f42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e0f42640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:57.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e0f42640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1f44640 10 monclient(hunting): get_auth_request con 0x7f44dc15d1e0 auth_method 0 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1f44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1f44640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1f44640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1743640 10 monclient(hunting): get_auth_request con 0x7f44dc0748e0 auth_method 0 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1743640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1743640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.103+0000 7f44e1743640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.104+0000 7f44e1f44640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.104+0000 7f44e1f44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.104+0000 7f44e1f44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.104+0000 7f44e0f42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.104+0000 7f44e0f42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.104+0000 7f44e0f42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.104+0000 7f44e1743640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.104+0000 7f44e1743640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.104+0000 7f44e1743640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 10 monclient(hunting): handle_auth_done global_id 4617 payload 824 2026-02-17T21:07:57.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 1 -- 10.20.193.45:0/1419733487 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc15d1e0 msgr2=0x7f44dc141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc15d1e0 0x7f44dc141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 1 -- 10.20.193.45:0/1419733487 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f44dc0748e0 msgr2=0x7f44dc13cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f44dc0748e0 0x7f44dc13cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 10 monclient: _finish_hunting 0 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 1 monclient: found mon.noname-a 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e0f42640 1 -- 10.20.193.45:0/1419733487 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc0cbec0 con 0x7f44dc0c92b0 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.105+0000 7f44e1f44640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc15d1e0 0x7f44dc141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.106+0000 7f44e0f42640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f44dc0c92b0 0x7f44dc140ee0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f44d003a040 tx=0x7f44d00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.106+0000 7f44c9ffb640 10 client.?.objecter ms_handle_connect 0x7f44dc0c92b0 2026-02-17T21:07:57.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.106+0000 7f44c9ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 1 -- 10.20.193.45:0/1419733487 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0046020 con 0x7f44dc0c92b0 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 10 monclient: dump: 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:57.101 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 1 -- 10.20.193.45:0/1419733487 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d0042450 con 0x7f44dc0c92b0 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 5 monclient: authenticate success, global_id 4617 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 1 -- 10.20.193.45:0/1419733487 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d003c040 con 0x7f44dc0c92b0 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44c9ffb640 10 monclient: dump: 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44cb7fe640 4 set_mon_vals no callback set 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 10 monclient: _renew_subs 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44dc0cc1a0 con 0x7f44dc0c92b0 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 10 client.4617.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 10 monclient: _renew_subs 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44dc0cc760 con 0x7f44dc0c92b0 2026-02-17T21:07:57.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 1 librados: init done 2026-02-17T21:07:57.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:57.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:57.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:57.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.108+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44dc15d5c0 con 0x7f44dc0c92b0 2026-02-17T21:07:57.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.217+0000 7f44c9ffb640 1 -- 10.20.193.45:0/1419733487 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f44d004a3b0 con 0x7f44dc0c92b0 2026-02-17T21:07:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.217+0000 7f44c9ffb640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f44ac079280 0x7f44ac07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:07:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.217+0000 7f44e1743640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f44ac079280 0x7f44ac07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:07:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.217+0000 7f44e1743640 10 monclient: get_auth_request con 0x7f44ac079280 auth_method 0 2026-02-17T21:07:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.218+0000 7f44c9ffb640 10 client.4617.objecter ms_handle_connect 0x7f44ac079280 2026-02-17T21:07:57.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.217+0000 7f44e1743640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f44ac079280 0x7f44ac07b740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f44cc003fd0 tx=0x7f44cc002a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:07:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.225+0000 7f44c9ffb640 1 -- 10.20.193.45:0/1419733487 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f44d0082d30 con 0x7f44dc0c92b0 2026-02-17T21:07:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.225+0000 7f44c9ffb640 10 client.4617.objecter ms_dispatch2 0x7f44dc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:07:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.225+0000 7f44c9ffb640 3 client.4617.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:07:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.225+0000 7f44c9ffb640 3 client.4617.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:07:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.225+0000 7f44c9ffb640 20 client.4617.objecter dump_active .. 0 homeless 2026-02-17T21:07:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.225+0000 7f44c9ffb640 1 -- 10.20.193.45:0/1419733487 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f44d0050020 con 0x7f44dc0c92b0 2026-02-17T21:07:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.225+0000 7f44c9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:07:57.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.225+0000 7f44c9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:07:57.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.328+0000 7f44e39ce640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:07:57.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.328+0000 7f44e39ce640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:57.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.328+0000 7f44e39ce640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:07:57.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.328+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f44dc1573a0 con 0x7f44dc0c92b0 2026-02-17T21:07:57.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.330+0000 7f44c9ffb640 1 -- 10.20.193.45:0/1419733487 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f44d0086cf0 con 0x7f44dc0c92b0 2026-02-17T21:07:57.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.330+0000 7f44c9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:07:57.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.330+0000 7f44c9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:07:57.324 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:07:57.324 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:07:57.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 10 librados: watch_flush enter 2026-02-17T21:07:57.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 10 librados: watch_flush exit 2026-02-17T21:07:57.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 20 client.4617.objecter shutdown clearing up homeless session... 2026-02-17T21:07:57.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 10 client.4617.objecter successfully canceled tick 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f44ac079280 msgr2=0x7f44ac07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f44ac079280 0x7f44ac07b740 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f44cc003fd0 tx=0x7f44cc002a40 comp rx=0 tx=0).stop 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 10 monclient: shutdown 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f44dc0c92b0 msgr2=0x7f44dc140ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f44dc0c92b0 0x7f44dc140ee0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f44d003a040 tx=0x7f44d00047c0 comp rx=0 tx=0).stop 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 shutdown_connections 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f44ac079280 0x7f44ac07b740 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f44dc15d1e0 0x7f44dc141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f44dc0c92b0 0x7f44dc140ee0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:57.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 --2- 10.20.193.45:0/1419733487 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f44dc0748e0 0x7f44dc13cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:07:57.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 >> 10.20.193.45:0/1419733487 conn(0x7f44dc0c9d40 msgr2=0x7f44dc14db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:07:57.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 shutdown_connections 2026-02-17T21:07:57.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 -- 10.20.193.45:0/1419733487 wait complete. 2026-02-17T21:07:57.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:07:57.332+0000 7f44e39ce640 1 librados: shutdown 2026-02-17T21:08:00.335 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:00.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.412+0000 7f5b2c755640 10 monclient: get_monmap_and_config 2026-02-17T21:08:00.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.412+0000 7f5b2c755640 10 monclient: build_initial_monmap 2026-02-17T21:08:00.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.412+0000 7f5b2c755640 10 monclient: monmap: 2026-02-17T21:08:00.405 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:00.405 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:00.405 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:00.413352+0000 2026-02-17T21:08:00.405 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:00.413352+0000 2026-02-17T21:08:00.405 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:00.405 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:00.405 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:00.406 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:00.406 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:00.406 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:00.406 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:00.406 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:00.406 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:00.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.412+0000 7f5b2c755640 1 Processor -- start 2026-02-17T21:08:00.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.412+0000 7f5b2c755640 1 -- start start 2026-02-17T21:08:00.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.412+0000 7f5b2c755640 10 monclient: init 2026-02-17T21:08:00.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:00.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 10 monclient: _add_conns ranks=[4,5,1,3,0,2] 2026-02-17T21:08:00.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5b2415d1e0 0x7f5b2415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:00.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 10 monclient(hunting): picked mon.noname-b con 0x7f5b2415d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:00.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f5b240748e0 0x7f5b240c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:00.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 10 monclient(hunting): picked mon.noname-c con 0x7f5b240748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f5b240c90e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b240c9570 con 0x7f5b240c90e0 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5b240c5860 con 0x7f5b2415d1e0 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5b240c5580 con 0x7f5b240748e0 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2c755640 10 monclient(hunting): authenticate will time out at 1064.043504s 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b29cc9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f5b240748e0 0x7f5b240c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.413+0000 7f5b2a4ca640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5b2415d1e0 0x7f5b2415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b29cc9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f5b240748e0 0x7f5b240c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:42978/0 (socket says 10.20.193.45:42978) 2026-02-17T21:08:00.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b29cc9640 1 -- 10.20.193.45:0/3777784303 learned_addr learned my addr 10.20.193.45:0/3777784303 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b29cc9640 10 monclient(hunting): get_auth_request con 0x7f5b240748e0 auth_method 0 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b29cc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b29cc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b29cc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b2a4ca640 10 monclient(hunting): get_auth_request con 0x7f5b2415d1e0 auth_method 0 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b2a4ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b2a4ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b2a4ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b29cc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b29cc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b29cc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b2a4ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:00.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b2a4ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.414+0000 7f5b2a4ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.415+0000 7f5b29cc9640 10 monclient(hunting): handle_auth_done global_id 4712 payload 274 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.415+0000 7f5b29cc9640 1 -- 10.20.193.45:0/3777784303 >> v2:10.20.193.86:3300/0 conn(0x7f5b2415d1e0 msgr2=0x7f5b2415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.415+0000 7f5b29cc9640 1 --2- 10.20.193.45:0/3777784303 >> v2:10.20.193.86:3300/0 conn(0x7f5b2415d1e0 0x7f5b2415d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.415+0000 7f5b29cc9640 1 -- 10.20.193.45:0/3777784303 >> v1:10.20.193.86:6789/0 conn(0x7f5b240c90e0 legacy=0x7f5b24153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.415+0000 7f5b29cc9640 10 monclient: _finish_hunting 0 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.415+0000 7f5b29cc9640 1 monclient: found mon.noname-c 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.415+0000 7f5b29cc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.415+0000 7f5b29cc9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.415+0000 7f5b29cc9640 1 -- 10.20.193.45:0/3777784303 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b240c7de0 con 0x7f5b240748e0 2026-02-17T21:08:00.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.416+0000 7f5b29cc9640 1 --2- 10.20.193.45:0/3777784303 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b240748e0 0x7f5b240c8ba0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009970 tx=0x7f5b1802eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=372d1c8488a2c7b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:00.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 1 -- 10.20.193.45:0/3777784303 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1803c070 con 0x7f5b240748e0 2026-02-17T21:08:00.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:00.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:08:00.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 10 monclient: dump: 2026-02-17T21:08:00.419 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:00.419 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:00.419 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:00.419 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 10 monclient: _finish_auth 0 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 10 monclient: _check_auth_tickets 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 1 -- 10.20.193.45:0/3777784303 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1802fb20 con 0x7f5b240748e0 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:00.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 1 -- 10.20.193.45:0/3777784303 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b18037440 con 0x7f5b240748e0 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 5 monclient: authenticate success, global_id 4712 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b294c8640 10 monclient: dump: 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:00.421 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 4 set_mon_vals no callback set 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 10 monclient: shutdown 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 1 -- 10.20.193.45:0/3777784303 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b240748e0 msgr2=0x7f5b240c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 1 --2- 10.20.193.45:0/3777784303 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b240748e0 0x7f5b240c8ba0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009970 tx=0x7f5b1802eef0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 1 -- 10.20.193.45:0/3777784303 shutdown_connections 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 1 --2- 10.20.193.45:0/3777784303 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b240748e0 0x7f5b240c8ba0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 1 --2- 10.20.193.45:0/3777784303 >> v2:10.20.193.86:3300/0 conn(0x7f5b2415d1e0 0x7f5b2415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 1 -- 10.20.193.45:0/3777784303 >> 10.20.193.45:0/3777784303 conn(0x7f5b240c9d40 msgr2=0x7f5b240ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:00.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 1 -- 10.20.193.45:0/3777784303 shutdown_connections 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.418+0000 7f5b2c755640 1 -- 10.20.193.45:0/3777784303 wait complete. 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient: build_initial_monmap 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient: monmap: 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:00.423 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 librados: starting msgr at 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 librados: starting objecter 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 Processor -- start 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 -- start start 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 librados: setting wanted keys 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 librados: calling monclient init 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient: init 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b240748e0 0x7f5b241f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient(hunting): picked mon.noname-a con 0x7f5b240748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b240c90e0 0x7f5b241f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:00.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient(hunting): picked mon.noname-b con 0x7f5b240c90e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b2415d1e0 0x7f5b241439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient(hunting): picked mon.noname-c con 0x7f5b2415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5b240c8680 con 0x7f5b240748e0 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5b240c83a0 con 0x7f5b240c90e0 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b24074d30 con 0x7f5b2415d1e0 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.419+0000 7f5b2c755640 10 monclient(hunting): authenticate will time out at 1064.049887s 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b240c90e0 0x7f5b241f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2accb640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b2415d1e0 0x7f5b241439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:00.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b240c90e0 0x7f5b241f2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:39568/0 (socket says 10.20.193.45:39568) 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 1 -- 10.20.193.45:0/396936720 learned_addr learned my addr 10.20.193.45:0/396936720 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 10 monclient(hunting): get_auth_request con 0x7f5b240c90e0 auth_method 0 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2a4ca640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b240748e0 0x7f5b241f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2accb640 10 monclient(hunting): get_auth_request con 0x7f5b2415d1e0 auth_method 0 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2accb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2accb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2accb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:00.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b29cc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2a4ca640 10 monclient(hunting): get_auth_request con 0x7f5b240748e0 auth_method 0 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2a4ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2a4ca640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2a4ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2accb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2accb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2accb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2a4ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2a4ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.420+0000 7f5b2a4ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 10 monclient(hunting): handle_auth_done global_id 4715 payload 824 2026-02-17T21:08:00.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 1 -- 10.20.193.45:0/396936720 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b240c90e0 msgr2=0x7f5b241f2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b240c90e0 0x7f5b241f2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 1 -- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b240748e0 msgr2=0x7f5b241f2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b240748e0 0x7f5b241f2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 10 monclient: _finish_hunting 0 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 1 monclient: found mon.noname-c 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.421+0000 7f5b2accb640 1 -- 10.20.193.45:0/396936720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b24144860 con 0x7f5b2415d1e0 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.423+0000 7f5b2accb640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b2415d1e0 0x7f5b241439c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000be50 tx=0x7f5b2000bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.423+0000 7f5b0affd640 10 client.?.objecter ms_handle_connect 0x7f5b2415d1e0 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.423+0000 7f5b0affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.423+0000 7f5b0affd640 1 -- 10.20.193.45:0/396936720 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b20006e60 con 0x7f5b2415d1e0 2026-02-17T21:08:00.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.423+0000 7f5b0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.423+0000 7f5b0affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.423+0000 7f5b0affd640 10 monclient: dump: 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:00.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b0affd640 10 monclient: _finish_auth 0 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b0affd640 10 monclient: _check_auth_tickets 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b0affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 5 monclient: authenticate success, global_id 4715 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 10 monclient: _renew_subs 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b241e5d70 con 0x7f5b2415d1e0 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 10 client.4715.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 10 monclient: _renew_subs 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b241e6330 con 0x7f5b2415d1e0 2026-02-17T21:08:00.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 1 librados: init done 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b240c8ba0 con 0x7f5b2415d1e0 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b0affd640 1 -- 10.20.193.45:0/396936720 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b20010070 con 0x7f5b2415d1e0 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b0affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b0affd640 1 -- 10.20.193.45:0/396936720 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b20002d20 con 0x7f5b2415d1e0 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b0affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b0affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b0affd640 10 monclient: dump: 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:00.431 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:00.432 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:00.432 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:00.432 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:00.432 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:00.432 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:00.432 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:00.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.424+0000 7f5b28cc7640 4 set_mon_vals no callback set 2026-02-17T21:08:00.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.532+0000 7f5b0affd640 1 -- 10.20.193.45:0/396936720 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f5b2001d030 con 0x7f5b2415d1e0 2026-02-17T21:08:00.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.532+0000 7f5b0affd640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5af4079280 0x7f5af407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:00.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.532+0000 7f5b2a4ca640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5af4079280 0x7f5af407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:00.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.532+0000 7f5b2a4ca640 10 monclient: get_auth_request con 0x7f5af4079280 auth_method 0 2026-02-17T21:08:00.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.533+0000 7f5b2a4ca640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5af4079280 0x7f5af407b740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009ba0 tx=0x7f5b14009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:00.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.533+0000 7f5b0affd640 10 client.4715.objecter ms_handle_connect 0x7f5af4079280 2026-02-17T21:08:00.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.534+0000 7f5b0affd640 1 -- 10.20.193.45:0/396936720 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f5b2005de70 con 0x7f5b2415d1e0 2026-02-17T21:08:00.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.534+0000 7f5b0affd640 10 client.4715.objecter ms_dispatch2 0x7f5b24000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:00.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.534+0000 7f5b0affd640 3 client.4715.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:00.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.534+0000 7f5b0affd640 3 client.4715.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:00.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.534+0000 7f5b0affd640 20 client.4715.objecter dump_active .. 0 homeless 2026-02-17T21:08:00.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.540+0000 7f5b0affd640 1 -- 10.20.193.45:0/396936720 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5b20061e30 con 0x7f5b2415d1e0 2026-02-17T21:08:00.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.540+0000 7f5b0affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:00.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.540+0000 7f5b0affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:00.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.641+0000 7f5b2c755640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:00.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.641+0000 7f5b2c755640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:00.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.641+0000 7f5b2c755640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:00.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.641+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5b240c9b20 con 0x7f5b2415d1e0 2026-02-17T21:08:00.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.645+0000 7f5b0affd640 1 -- 10.20.193.45:0/396936720 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5b20066130 con 0x7f5b2415d1e0 2026-02-17T21:08:00.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.645+0000 7f5b0affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:00.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.645+0000 7f5b0affd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:00.638 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:00.638 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:00.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 10 librados: watch_flush enter 2026-02-17T21:08:00.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 10 librados: watch_flush exit 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 20 client.4715.objecter shutdown clearing up homeless session... 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 10 client.4715.objecter successfully canceled tick 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5af4079280 msgr2=0x7f5af407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5af4079280 0x7f5af407b740 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009ba0 tx=0x7f5b14009290 comp rx=0 tx=0).stop 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 10 monclient: shutdown 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b2415d1e0 msgr2=0x7f5b241439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b2415d1e0 0x7f5b241439c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000be50 tx=0x7f5b2000bf50 comp rx=0 tx=0).stop 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 shutdown_connections 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5af4079280 0x7f5af407b740 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5b2415d1e0 0x7f5b241439c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5b240c90e0 0x7f5b241f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 --2- 10.20.193.45:0/396936720 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5b240748e0 0x7f5b241f2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:00.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 >> 10.20.193.45:0/396936720 conn(0x7f5b240c9d40 msgr2=0x7f5b2414ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:00.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 shutdown_connections 2026-02-17T21:08:00.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 -- 10.20.193.45:0/396936720 wait complete. 2026-02-17T21:08:00.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:00.646+0000 7f5b2c755640 1 librados: shutdown 2026-02-17T21:08:03.649 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:03.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.725+0000 7f82dad86640 10 monclient: get_monmap_and_config 2026-02-17T21:08:03.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.725+0000 7f82dad86640 10 monclient: build_initial_monmap 2026-02-17T21:08:03.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.725+0000 7f82dad86640 10 monclient: monmap: 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:03.726461+0000 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:03.726461+0000 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:03.719 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:03.720 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:03.720 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:03.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 1 Processor -- start 2026-02-17T21:08:03.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 1 -- start start 2026-02-17T21:08:03.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 10 monclient: init 2026-02-17T21:08:03.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:03.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 10 monclient: _add_conns ranks=[0,4,2,1,5,3] 2026-02-17T21:08:03.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f82d415d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:08:03.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f82d40c92b0 0x7f82d415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:03.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 10 monclient(hunting): picked mon.noname-b con 0x7f82d40c92b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:03.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f82d40748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:08:03.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d40c5860 con 0x7f82d415d1e0 2026-02-17T21:08:03.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d40c5580 con 0x7f82d40748e0 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f82d40c7de0 con 0x7f82d40c92b0 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.726+0000 7f82dad86640 10 monclient(hunting): authenticate will time out at 1067.356595s 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82d8afb640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f82d415d1e0 0x7f82d40c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:37782/0 (socket says 10.20.193.45:37782) 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82d8afb640 1 -- 10.20.193.45:0/1950428759 learned_addr learned my addr 10.20.193.45:0/1950428759 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82cbfff640 1 --2- 10.20.193.45:0/1950428759 >> v2:10.20.193.86:3300/0 conn(0x7f82d40c92b0 0x7f82d415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82cbfff640 10 monclient(hunting): get_auth_request con 0x7f82d40c92b0 auth_method 0 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:03.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.727+0000 7f82cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 1 -- 10.20.193.45:0/1950428759 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3289082409 0 0) 0x7f82d40c5860 con 0x7f82d415d1e0 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 10 monclient(hunting): my global_id is 4623 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 1 -- 10.20.193.45:0/1950428759 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82c0003620 con 0x7f82d415d1e0 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 1 -- 10.20.193.45:0/1950428759 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657522495 0 0) 0x7f82d40c5580 con 0x7f82d40748e0 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:03.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 10 monclient(hunting): my global_id is 4718 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cb7fe640 1 -- 10.20.193.45:0/1950428759 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d40c5860 con 0x7f82d40748e0 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cbfff640 10 monclient(hunting): handle_auth_done global_id 4678 payload 274 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cbfff640 1 -- 10.20.193.45:0/1950428759 >> v1:10.20.193.92:6789/0 conn(0x7f82d40748e0 legacy=0x7f82d4153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cbfff640 1 -- 10.20.193.45:0/1950428759 >> v1:10.20.193.45:6789/0 conn(0x7f82d415d1e0 legacy=0x7f82d40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cbfff640 10 monclient: _finish_hunting 0 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cbfff640 1 monclient: found mon.noname-b 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.728+0000 7f82cbfff640 1 -- 10.20.193.45:0/1950428759 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d40c80c0 con 0x7f82d40c92b0 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.729+0000 7f82cbfff640 1 --2- 10.20.193.45:0/1950428759 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f82d40c92b0 0x7f82d415d5c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0098d0 tx=0x7f82bc02eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae0375e2125ca73 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 1 -- 10.20.193.45:0/1950428759 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc03c070 con 0x7f82d40c92b0 2026-02-17T21:08:03.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 10 monclient: dump: 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:03.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 5 monclient: authenticate success, global_id 4678 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 1 -- 10.20.193.45:0/1950428759 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82bc02fba0 con 0x7f82d40c92b0 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 1 -- 10.20.193.45:0/1950428759 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc037440 con 0x7f82d40c92b0 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82cb7fe640 10 monclient: dump: 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:03.733 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 4 set_mon_vals no callback set 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 10 monclient: shutdown 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:03.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 1 -- 10.20.193.45:0/1950428759 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f82d40c92b0 msgr2=0x7f82d415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 1 --2- 10.20.193.45:0/1950428759 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f82d40c92b0 0x7f82d415d5c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0098d0 tx=0x7f82bc02eed0 comp rx=0 tx=0).stop 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 1 -- 10.20.193.45:0/1950428759 shutdown_connections 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 1 --2- 10.20.193.45:0/1950428759 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f82d40c92b0 0x7f82d415d5c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 1 -- 10.20.193.45:0/1950428759 >> 10.20.193.45:0/1950428759 conn(0x7f82d40c9d40 msgr2=0x7f82d40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 1 -- 10.20.193.45:0/1950428759 shutdown_connections 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.731+0000 7f82dad86640 1 -- 10.20.193.45:0/1950428759 wait complete. 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 10 monclient: build_initial_monmap 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 10 monclient: monmap: 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:03.735 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 1 librados: starting msgr at 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 1 librados: starting objecter 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 1 Processor -- start 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 1 -- start start 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 1 librados: setting wanted keys 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 1 librados: calling monclient init 2026-02-17T21:08:03.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 10 monclient: init 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.732+0000 7f82dad86640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f82d40748e0 0x7f82d4073a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 10 monclient(hunting): picked mon.noname-b con 0x7f82d40748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f82d40c92b0 0x7f82d406b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 10 monclient(hunting): picked mon.noname-c con 0x7f82d40c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f82d415d1e0 0x7f82d415bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 10 monclient(hunting): picked mon.noname-a con 0x7f82d415d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f82d4074d30 con 0x7f82d415d1e0 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f82d40c8680 con 0x7f82d40748e0 2026-02-17T21:08:03.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f82d4153d20 con 0x7f82d40c92b0 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82dad86640 10 monclient(hunting): authenticate will time out at 1067.363040s 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f82d415d1e0 0x7f82d415bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d8afb640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f82d40748e0 0x7f82d4073a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f82d415d1e0 0x7f82d415bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42426/0 (socket says 10.20.193.45:42426) 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 1 -- 10.20.193.45:0/3330736980 learned_addr learned my addr 10.20.193.45:0/3330736980 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 10 monclient(hunting): get_auth_request con 0x7f82d415d1e0 auth_method 0 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d8afb640 10 monclient(hunting): get_auth_request con 0x7f82d40748e0 auth_method 0 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d8afb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:03.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d8afb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d8afb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82cbfff640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f82d40c92b0 0x7f82d406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d92fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82cbfff640 10 monclient(hunting): get_auth_request con 0x7f82d40c92b0 auth_method 0 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d8afb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d8afb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.733+0000 7f82d8afb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:03.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.734+0000 7f82cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.734+0000 7f82cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.734+0000 7f82cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 10 monclient(hunting): handle_auth_done global_id 4626 payload 824 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 1 -- 10.20.193.45:0/3330736980 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f82d40c92b0 msgr2=0x7f82d406b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f82d40c92b0 0x7f82d406b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 1 -- 10.20.193.45:0/3330736980 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f82d40748e0 msgr2=0x7f82d4073a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f82d40748e0 0x7f82d4073a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 10 monclient: _finish_hunting 0 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 1 monclient: found mon.noname-a 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:03.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.735+0000 7f82d92fc640 1 -- 10.20.193.45:0/3330736980 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d41f7610 con 0x7f82d415d1e0 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.736+0000 7f82d92fc640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f82d415d1e0 0x7f82d415bef0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82d000cc20 tx=0x7f82d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.736+0000 7f82c97fa640 10 client.?.objecter ms_handle_connect 0x7f82d415d1e0 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.736+0000 7f82c97fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 1 -- 10.20.193.45:0/3330736980 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d000ce40 con 0x7f82d415d1e0 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 10 monclient: dump: 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:03.743 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 10 monclient: _finish_auth 0 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 10 monclient: _check_auth_tickets 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 1 -- 10.20.193.45:0/3330736980 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d0003a70 con 0x7f82d415d1e0 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 5 monclient: authenticate success, global_id 4626 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 10 monclient: _renew_subs 2026-02-17T21:08:03.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d40726e0 con 0x7f82d415d1e0 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 1 -- 10.20.193.45:0/3330736980 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d0003e60 con 0x7f82d415d1e0 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82c97fa640 10 monclient: dump: 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:03.745 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82caffd640 4 set_mon_vals no callback set 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 10 client.4626.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 10 monclient: _renew_subs 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d4072ca0 con 0x7f82d415d1e0 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 1 librados: init done 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:03.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:03.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:03.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.738+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d415d5c0 con 0x7f82d415d1e0 2026-02-17T21:08:03.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.849+0000 7f82c97fa640 1 -- 10.20.193.45:0/3330736980 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f82d00050d0 con 0x7f82d415d1e0 2026-02-17T21:08:03.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.849+0000 7f82c97fa640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f82a40792d0 0x7f82a407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:03.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.850+0000 7f82d8afb640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f82a40792d0 0x7f82a407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:03.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.850+0000 7f82d8afb640 10 monclient: get_auth_request con 0x7f82a40792d0 auth_method 0 2026-02-17T21:08:03.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.850+0000 7f82d8afb640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f82a40792d0 0x7f82a407b790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82c4005980 tx=0x7f82c4006ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:03.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.850+0000 7f82c97fa640 10 client.4626.objecter ms_handle_connect 0x7f82a40792d0 2026-02-17T21:08:03.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.858+0000 7f82c97fa640 1 -- 10.20.193.45:0/3330736980 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f82d005ea80 con 0x7f82d415d1e0 2026-02-17T21:08:03.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.858+0000 7f82c97fa640 10 client.4626.objecter ms_dispatch2 0x7f82d4000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:03.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.858+0000 7f82c97fa640 3 client.4626.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:03.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.858+0000 7f82c97fa640 3 client.4626.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:03.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.858+0000 7f82c97fa640 20 client.4626.objecter dump_active .. 0 homeless 2026-02-17T21:08:03.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.858+0000 7f82c97fa640 1 -- 10.20.193.45:0/3330736980 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f82d0062a40 con 0x7f82d415d1e0 2026-02-17T21:08:03.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.858+0000 7f82c97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:03.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.858+0000 7f82c97fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:03.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.959+0000 7f82dad86640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:03.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.959+0000 7f82dad86640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:03.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.959+0000 7f82dad86640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:03.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.959+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f82d4153b00 con 0x7f82d415d1e0 2026-02-17T21:08:03.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.961+0000 7f82c97fa640 1 -- 10.20.193.45:0/3330736980 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f82d0066d40 con 0x7f82d415d1e0 2026-02-17T21:08:03.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.962+0000 7f82c97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:03.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.962+0000 7f82c97fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:03.954 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:03.955 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:03.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 10 librados: watch_flush enter 2026-02-17T21:08:03.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 10 librados: watch_flush exit 2026-02-17T21:08:03.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 20 client.4626.objecter shutdown clearing up homeless session... 2026-02-17T21:08:03.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 10 client.4626.objecter successfully canceled tick 2026-02-17T21:08:03.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f82a40792d0 msgr2=0x7f82a407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:03.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f82a40792d0 0x7f82a407b790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82c4005980 tx=0x7f82c4006ba0 comp rx=0 tx=0).stop 2026-02-17T21:08:03.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 10 monclient: shutdown 2026-02-17T21:08:03.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:03.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f82d415d1e0 msgr2=0x7f82d415bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:03.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f82d415d1e0 0x7f82d415bef0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82d000cc20 tx=0x7f82d000a430 comp rx=0 tx=0).stop 2026-02-17T21:08:03.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 shutdown_connections 2026-02-17T21:08:03.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f82a40792d0 0x7f82a407b790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:03.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f82d415d1e0 0x7f82d415bef0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:03.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f82d40c92b0 0x7f82d406b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:03.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 --2- 10.20.193.45:0/3330736980 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f82d40748e0 0x7f82d4073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:03.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 >> 10.20.193.45:0/3330736980 conn(0x7f82d40c9d40 msgr2=0x7f82d41533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:03.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 shutdown_connections 2026-02-17T21:08:03.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 -- 10.20.193.45:0/3330736980 wait complete. 2026-02-17T21:08:03.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:03.963+0000 7f82dad86640 1 librados: shutdown 2026-02-17T21:08:06.965 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:07.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.042+0000 7fe5e193e640 10 monclient: get_monmap_and_config 2026-02-17T21:08:07.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.042+0000 7fe5e193e640 10 monclient: build_initial_monmap 2026-02-17T21:08:07.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.042+0000 7fe5e193e640 10 monclient: monmap: 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:07.043528+0000 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:07.043528+0000 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:07.036 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:07.037 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:07.037 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:07.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 1 Processor -- start 2026-02-17T21:08:07.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 1 -- start start 2026-02-17T21:08:07.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 10 monclient: init 2026-02-17T21:08:07.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:07.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 10 monclient: _add_conns ranks=[2,1,3,0,5,4] 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe5dc155cf0 addr v1:10.20.193.92:6789/0 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe5dc1560d0 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe5dc0c9530 0x7fe5dc0cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 10 monclient(hunting): picked mon.noname-a con 0x7fe5dc0c9530 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5dc06e730 con 0x7fe5dc1560d0 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5dc06ea10 con 0x7fe5dc155cf0 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe5dc06ecf0 con 0x7fe5dc0c9530 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:07.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.043+0000 7fe5e193e640 10 monclient(hunting): authenticate will time out at 1070.673780s 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5db7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe5dc0c9530 0x7fe5dc0cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5daffd640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7fe5dc155cf0 0x7fe5dc076230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:55714/0 (socket says 10.20.193.45:55714) 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5daffd640 1 -- 10.20.193.45:0/1957899744 learned_addr learned my addr 10.20.193.45:0/1957899744 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5db7fe640 10 monclient(hunting): get_auth_request con 0x7fe5dc0c9530 auth_method 0 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.044+0000 7fe5db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:07.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.045+0000 7fe5db7fe640 10 monclient(hunting): handle_auth_done global_id 4629 payload 274 2026-02-17T21:08:07.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.045+0000 7fe5db7fe640 1 -- 10.20.193.45:0/1957899744 >> v1:10.20.193.92:6789/0 conn(0x7fe5dc155cf0 legacy=0x7fe5dc076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:07.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.045+0000 7fe5db7fe640 1 -- 10.20.193.45:0/1957899744 >> v1:10.20.193.86:6789/0 conn(0x7fe5dc1560d0 legacy=0x7fe5dc0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:07.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.045+0000 7fe5db7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:08:07.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.045+0000 7fe5db7fe640 1 monclient: found mon.noname-a 2026-02-17T21:08:07.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.045+0000 7fe5db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:07.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.045+0000 7fe5db7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:07.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.045+0000 7fe5db7fe640 1 -- 10.20.193.45:0/1957899744 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc0c8620 con 0x7fe5dc0c9530 2026-02-17T21:08:07.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.046+0000 7fe5db7fe640 1 --2- 10.20.193.45:0/1957899744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc0c9530 0x7fe5dc0cb0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009d90 tx=0x7fe5cc02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7d478f2bd8f529 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:07.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 1 -- 10.20.193.45:0/1957899744 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc03c070 con 0x7fe5dc0c9530 2026-02-17T21:08:07.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 10 monclient: dump: 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:07.049 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 1 -- 10.20.193.45:0/1957899744 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc037440 con 0x7fe5dc0c9530 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 5 monclient: authenticate success, global_id 4629 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 1 -- 10.20.193.45:0/1957899744 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc037810 con 0x7fe5dc0c9530 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:07.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5d9ffb640 10 monclient: dump: 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:07.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 4 set_mon_vals no callback set 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 10 monclient: shutdown 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 1 -- 10.20.193.45:0/1957899744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc0c9530 msgr2=0x7fe5dc0cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 1 --2- 10.20.193.45:0/1957899744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc0c9530 0x7fe5dc0cb0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009d90 tx=0x7fe5cc02f230 comp rx=0 tx=0).stop 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 1 -- 10.20.193.45:0/1957899744 shutdown_connections 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 1 --2- 10.20.193.45:0/1957899744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc0c9530 0x7fe5dc0cb0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 1 -- 10.20.193.45:0/1957899744 >> 10.20.193.45:0/1957899744 conn(0x7fe5dc0ca5a0 msgr2=0x7fe5dc0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 1 -- 10.20.193.45:0/1957899744 shutdown_connections 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.048+0000 7fe5e193e640 1 -- 10.20.193.45:0/1957899744 wait complete. 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient: build_initial_monmap 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient: monmap: 2026-02-17T21:08:07.052 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 librados: starting msgr at 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 librados: starting objecter 2026-02-17T21:08:07.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 Processor -- start 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 -- start start 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 librados: setting wanted keys 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 librados: calling monclient init 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient: init 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe5dc0c9530 0x7fe5dc149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient(hunting): picked mon.noname-b con 0x7fe5dc0c9530 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc155cf0 0x7fe5dc156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient(hunting): picked mon.noname-a con 0x7fe5dc155cf0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5dc1560d0 0x7fe5dc1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient(hunting): picked mon.noname-c con 0x7fe5dc1560d0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:07.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc1667d0 con 0x7fe5dc155cf0 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc166650 con 0x7fe5dc0c9530 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc166950 con 0x7fe5dc1560d0 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.049+0000 7fe5e193e640 10 monclient(hunting): authenticate will time out at 1070.679833s 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc155cf0 0x7fe5dc156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5db7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5dc1560d0 0x7fe5dc1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5daffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe5dc0c9530 0x7fe5dc149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc155cf0 0x7fe5dc156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:42438/0 (socket says 10.20.193.45:42438) 2026-02-17T21:08:07.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 1 -- 10.20.193.45:0/1291616537 learned_addr learned my addr 10.20.193.45:0/1291616537 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 10 monclient(hunting): get_auth_request con 0x7fe5dc155cf0 auth_method 0 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5daffd640 10 monclient(hunting): get_auth_request con 0x7fe5dc0c9530 auth_method 0 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5daffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5db7fe640 10 monclient(hunting): get_auth_request con 0x7fe5dc1560d0 auth_method 0 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:07.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.050+0000 7fe5daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 10 monclient(hunting): handle_auth_done global_id 4632 payload 824 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 1 -- 10.20.193.45:0/1291616537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5dc1560d0 msgr2=0x7fe5dc1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5dc1560d0 0x7fe5dc1573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 1 -- 10.20.193.45:0/1291616537 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe5dc0c9530 msgr2=0x7fe5dc149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:07.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe5dc0c9530 0x7fe5dc149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 1 monclient: found mon.noname-a 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.051+0000 7fe5da7fc640 1 -- 10.20.193.45:0/1291616537 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc1f43f0 con 0x7fe5dc155cf0 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.053+0000 7fe5da7fc640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc155cf0 0x7fe5dc156e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c4b0 tx=0x7fe5c400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.053+0000 7fe5b3fff640 10 client.?.objecter ms_handle_connect 0x7fe5dc155cf0 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.053+0000 7fe5b3fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 1 -- 10.20.193.45:0/1291616537 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c40052d0 con 0x7fe5dc155cf0 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 10 monclient: dump: 2026-02-17T21:08:07.058 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 10 monclient: _finish_auth 0 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:08:07.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 1 -- 10.20.193.45:0/1291616537 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c4005490 con 0x7fe5dc155cf0 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 1 -- 10.20.193.45:0/1291616537 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4003930 con 0x7fe5dc155cf0 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5b3fff640 10 monclient: dump: 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:07.060 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5d97fa640 4 set_mon_vals no callback set 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5e193e640 5 monclient: authenticate success, global_id 4632 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5e193e640 10 monclient: _renew_subs 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5e193e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc1f46d0 con 0x7fe5dc155cf0 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5e193e640 10 client.4632.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5e193e640 10 monclient: _renew_subs 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5e193e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:07.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc1f4c90 con 0x7fe5dc155cf0 2026-02-17T21:08:07.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.054+0000 7fe5e193e640 1 librados: init done 2026-02-17T21:08:07.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.055+0000 7fe5e193e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:07.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.055+0000 7fe5e193e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:07.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.055+0000 7fe5e193e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:07.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.055+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5dc0744c0 con 0x7fe5dc155cf0 2026-02-17T21:08:07.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.067+0000 7fe5b3fff640 1 -- 10.20.193.45:0/1291616537 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fe5c4003ad0 con 0x7fe5dc155cf0 2026-02-17T21:08:07.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.068+0000 7fe5b3fff640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe5ac079280 0x7fe5ac07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:07.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.068+0000 7fe5daffd640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe5ac079280 0x7fe5ac07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:07.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.068+0000 7fe5daffd640 10 monclient: get_auth_request con 0x7fe5ac079280 auth_method 0 2026-02-17T21:08:07.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.068+0000 7fe5daffd640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe5ac079280 0x7fe5ac07b740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0002770 tx=0x7fe5d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:07.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.068+0000 7fe5b3fff640 10 client.4632.objecter ms_handle_connect 0x7fe5ac079280 2026-02-17T21:08:07.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.070+0000 7fe5b3fff640 1 -- 10.20.193.45:0/1291616537 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fe5c405e320 con 0x7fe5dc155cf0 2026-02-17T21:08:07.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.070+0000 7fe5b3fff640 10 client.4632.objecter ms_dispatch2 0x7fe5dc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:07.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.070+0000 7fe5b3fff640 3 client.4632.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:07.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.070+0000 7fe5b3fff640 3 client.4632.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:07.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.070+0000 7fe5b3fff640 20 client.4632.objecter dump_active .. 0 homeless 2026-02-17T21:08:07.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.173+0000 7fe5b3fff640 1 -- 10.20.193.45:0/1291616537 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe5c40622e0 con 0x7fe5dc155cf0 2026-02-17T21:08:07.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.173+0000 7fe5b3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:07.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.173+0000 7fe5b3fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:07.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.272+0000 7fe5e193e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:07.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.272+0000 7fe5e193e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:07.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.272+0000 7fe5e193e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:07.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.272+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe5dc0741e0 con 0x7fe5dc155cf0 2026-02-17T21:08:07.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.275+0000 7fe5b3fff640 1 -- 10.20.193.45:0/1291616537 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fe5c40665e0 con 0x7fe5dc155cf0 2026-02-17T21:08:07.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.275+0000 7fe5b3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:07.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.275+0000 7fe5b3fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:07.267 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:07.268 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:07.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 10 librados: watch_flush enter 2026-02-17T21:08:07.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 10 librados: watch_flush exit 2026-02-17T21:08:07.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 20 client.4632.objecter shutdown clearing up homeless session... 2026-02-17T21:08:07.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 10 client.4632.objecter successfully canceled tick 2026-02-17T21:08:07.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe5ac079280 msgr2=0x7fe5ac07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe5ac079280 0x7fe5ac07b740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0002770 tx=0x7fe5d0009040 comp rx=0 tx=0).stop 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 10 monclient: shutdown 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc155cf0 msgr2=0x7fe5dc156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc155cf0 0x7fe5dc156e60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400c4b0 tx=0x7fe5c400c980 comp rx=0 tx=0).stop 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 shutdown_connections 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe5ac079280 0x7fe5ac07b740 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5dc1560d0 0x7fe5dc1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe5dc155cf0 0x7fe5dc156e60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 --2- 10.20.193.45:0/1291616537 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe5dc0c9530 0x7fe5dc149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:07.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 >> 10.20.193.45:0/1291616537 conn(0x7fe5dc0ca5a0 msgr2=0x7fe5dc06d950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:07.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 shutdown_connections 2026-02-17T21:08:07.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 -- 10.20.193.45:0/1291616537 wait complete. 2026-02-17T21:08:07.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:07.276+0000 7fe5e193e640 1 librados: shutdown 2026-02-17T21:08:09.937 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:17.150 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:09.940 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:17.153 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:09.948 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:17.161 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:09.965 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:03:17.175 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:09.969 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:03:17.142 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:09.970 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:03:17.180 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:09.973 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:03:17.146 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:09.981 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:03:17.190 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:09.983 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:03:17.156 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:10.279 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:10.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.356+0000 7fcd51501640 10 monclient: get_monmap_and_config 2026-02-17T21:08:10.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.356+0000 7fcd51501640 10 monclient: build_initial_monmap 2026-02-17T21:08:10.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.356+0000 7fcd51501640 10 monclient: monmap: 2026-02-17T21:08:10.349 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:10.349 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:10.349 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:10.357689+0000 2026-02-17T21:08:10.349 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:10.357689+0000 2026-02-17T21:08:10.350 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:10.350 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:10.350 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:10.350 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:10.350 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:10.350 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:10.350 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:10.350 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:10.350 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 1 Processor -- start 2026-02-17T21:08:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 1 -- start start 2026-02-17T21:08:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient: init 2026-02-17T21:08:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient: _add_conns ranks=[5,3,1,4,2,0] 2026-02-17T21:08:10.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fcd4c15d1e0 0x7fcd4c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient(hunting): picked mon.noname-c con 0x7fcd4c15d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fcd4c0748e0 0x7fcd4c0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient(hunting): picked mon.noname-a con 0x7fcd4c0748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fcd4c0c90e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd4c0c9570 con 0x7fcd4c0c90e0 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c0c5860 con 0x7fcd4c0748e0 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4c0c5580 con 0x7fcd4c15d1e0 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.357+0000 7fcd51501640 10 monclient(hunting): authenticate will time out at 1073.987813s 2026-02-17T21:08:10.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4a7fc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fcd4c0748e0 0x7fcd4c0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4affd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fcd4c15d1e0 0x7fcd4c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4b7fe640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fcd4c0c90e0 0x7fcd4c153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:35836/0 (socket says 10.20.193.45:35836) 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4b7fe640 1 -- 10.20.193.45:0/104359360 learned_addr learned my addr 10.20.193.45:0/104359360 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4a7fc640 10 monclient(hunting): get_auth_request con 0x7fcd4c0748e0 auth_method 0 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4affd640 10 monclient(hunting): get_auth_request con 0x7fcd4c15d1e0 auth_method 0 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:10.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.358+0000 7fcd4affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd4a7fc640 10 monclient(hunting): handle_auth_done global_id 4635 payload 274 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd4a7fc640 1 -- 10.20.193.45:0/104359360 >> v2:10.20.193.92:3300/0 conn(0x7fcd4c15d1e0 msgr2=0x7fcd4c15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd4a7fc640 1 --2- 10.20.193.45:0/104359360 >> v2:10.20.193.92:3300/0 conn(0x7fcd4c15d1e0 0x7fcd4c15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd49ffb640 1 -- 10.20.193.45:0/104359360 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789475474 0 0) 0x7fcd4c0c9570 con 0x7fcd4c0c90e0 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd4a7fc640 1 -- 10.20.193.45:0/104359360 >> v1:10.20.193.86:6789/0 conn(0x7fcd4c0c90e0 legacy=0x7fcd4c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd4a7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd4a7fc640 1 monclient: found mon.noname-a 2026-02-17T21:08:10.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd4a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:10.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd4a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:10.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd4a7fc640 1 -- 10.20.193.45:0/104359360 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c0c7de0 con 0x7fcd4c0748e0 2026-02-17T21:08:10.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.359+0000 7fcd49ffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:08:10.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.360+0000 7fcd4a7fc640 1 --2- 10.20.193.45:0/104359360 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 0x7fcd4c0c8ba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd340098a0 tx=0x7fcd3402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5ee1071e9651b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:10.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 1 -- 10.20.193.45:0/104359360 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3403c070 con 0x7fcd4c0748e0 2026-02-17T21:08:10.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:10.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:10.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 10 monclient: dump: 2026-02-17T21:08:10.363 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:10.363 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 10 monclient: _finish_auth 0 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:10.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 1 -- 10.20.193.45:0/104359360 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3402fae0 con 0x7fcd4c0748e0 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 5 monclient: authenticate success, global_id 4635 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 1 -- 10.20.193.45:0/104359360 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd34037440 con 0x7fcd4c0748e0 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 4 set_mon_vals no callback set 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd49ffb640 10 monclient: dump: 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:10.365 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 10 monclient: shutdown 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 1 -- 10.20.193.45:0/104359360 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 msgr2=0x7fcd4c0c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 1 --2- 10.20.193.45:0/104359360 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 0x7fcd4c0c8ba0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcd340098a0 tx=0x7fcd3402ee10 comp rx=0 tx=0).stop 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 1 -- 10.20.193.45:0/104359360 shutdown_connections 2026-02-17T21:08:10.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 1 --2- 10.20.193.45:0/104359360 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 0x7fcd4c0c8ba0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 1 --2- 10.20.193.45:0/104359360 >> v2:10.20.193.92:3300/0 conn(0x7fcd4c15d1e0 0x7fcd4c15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 1 -- 10.20.193.45:0/104359360 >> 10.20.193.45:0/104359360 conn(0x7fcd4c0c9d40 msgr2=0x7fcd4c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 1 -- 10.20.193.45:0/104359360 shutdown_connections 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.362+0000 7fcd51501640 1 -- 10.20.193.45:0/104359360 wait complete. 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.363+0000 7fcd51501640 10 monclient: build_initial_monmap 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.363+0000 7fcd51501640 10 monclient: monmap: 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:10.367 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.363+0000 7fcd51501640 1 librados: starting msgr at 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.363+0000 7fcd51501640 1 librados: starting objecter 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.363+0000 7fcd51501640 1 Processor -- start 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.363+0000 7fcd51501640 1 -- start start 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.363+0000 7fcd51501640 1 librados: setting wanted keys 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.363+0000 7fcd51501640 1 librados: calling monclient init 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.363+0000 7fcd51501640 10 monclient: init 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:08:10.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 0x7fcd4c145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient(hunting): picked mon.noname-a con 0x7fcd4c0748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcd4c0c90e0 0x7fcd4c1f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient(hunting): picked mon.noname-b con 0x7fcd4c0c90e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd4c15d1e0 0x7fcd4c1f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient(hunting): picked mon.noname-c con 0x7fcd4c15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0c8680 con 0x7fcd4c0748e0 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c0c83a0 con 0x7fcd4c0c90e0 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4c074d30 con 0x7fcd4c15d1e0 2026-02-17T21:08:10.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd51501640 10 monclient(hunting): authenticate will time out at 1073.994085s 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 0x7fcd4c145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4a7fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcd4c0c90e0 0x7fcd4c1f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 0x7fcd4c145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:57746/0 (socket says 10.20.193.45:57746) 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 1 -- 10.20.193.45:0/2273843420 learned_addr learned my addr 10.20.193.45:0/2273843420 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 10 monclient(hunting): get_auth_request con 0x7fcd4c0748e0 auth_method 0 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4b7fe640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd4c15d1e0 0x7fcd4c1f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4a7fc640 10 monclient(hunting): get_auth_request con 0x7fcd4c0c90e0 auth_method 0 2026-02-17T21:08:10.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4b7fe640 10 monclient(hunting): get_auth_request con 0x7fcd4c15d1e0 auth_method 0 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:10.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.364+0000 7fcd4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 10 monclient(hunting): handle_auth_done global_id 4638 payload 824 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 1 -- 10.20.193.45:0/2273843420 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd4c15d1e0 msgr2=0x7fcd4c1f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd4c15d1e0 0x7fcd4c1f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 1 -- 10.20.193.45:0/2273843420 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcd4c0c90e0 msgr2=0x7fcd4c1f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcd4c0c90e0 0x7fcd4c1f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 10 monclient: _finish_hunting 0 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 1 monclient: found mon.noname-a 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.366+0000 7fcd4affd640 1 -- 10.20.193.45:0/2273843420 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4c1f43c0 con 0x7fcd4c0748e0 2026-02-17T21:08:10.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.367+0000 7fcd4affd640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 0x7fcd4c145b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000e890 tx=0x7fcd4000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.367+0000 7fcd2b7fe640 10 client.?.objecter ms_handle_connect 0x7fcd4c0748e0 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.367+0000 7fcd2b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 1 -- 10.20.193.45:0/2273843420 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40017070 con 0x7fcd4c0748e0 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 10 monclient: dump: 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:10.373 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 1 -- 10.20.193.45:0/2273843420 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd4000c8e0 con 0x7fcd4c0748e0 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd51501640 5 monclient: authenticate success, global_id 4638 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd51501640 10 monclient: _renew_subs 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd51501640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd4c1f2350 con 0x7fcd4c0748e0 2026-02-17T21:08:10.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 1 -- 10.20.193.45:0/2273843420 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000ccd0 con 0x7fcd4c0748e0 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd2b7fe640 10 monclient: dump: 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:10.375 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd497fa640 4 set_mon_vals no callback set 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd51501640 10 client.4638.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd51501640 10 monclient: _renew_subs 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd51501640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd4c1f2910 con 0x7fcd4c0748e0 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.368+0000 7fcd51501640 1 librados: init done 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.369+0000 7fcd51501640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.369+0000 7fcd51501640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.369+0000 7fcd51501640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:10.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.369+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd4c0c8ba0 con 0x7fcd4c0748e0 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.381+0000 7fcd2b7fe640 1 -- 10.20.193.45:0/2273843420 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fcd40024060 con 0x7fcd4c0748e0 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.382+0000 7fcd2b7fe640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcd18079300 0x7fcd1807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.382+0000 7fcd4a7fc640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcd18079300 0x7fcd1807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.382+0000 7fcd4a7fc640 10 monclient: get_auth_request con 0x7fcd18079300 auth_method 0 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.382+0000 7fcd2b7fe640 10 client.4638.objecter ms_handle_connect 0x7fcd18079300 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.382+0000 7fcd4a7fc640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcd18079300 0x7fcd1807b7c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcd34039000 tx=0x7fcd34033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.383+0000 7fcd2b7fe640 1 -- 10.20.193.45:0/2273843420 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fcd4005e380 con 0x7fcd4c0748e0 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.383+0000 7fcd2b7fe640 10 client.4638.objecter ms_dispatch2 0x7fcd4c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.383+0000 7fcd2b7fe640 3 client.4638.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:10.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.383+0000 7fcd2b7fe640 3 client.4638.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:10.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.383+0000 7fcd2b7fe640 20 client.4638.objecter dump_active .. 0 homeless 2026-02-17T21:08:10.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.489+0000 7fcd2b7fe640 1 -- 10.20.193.45:0/2273843420 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcd40062340 con 0x7fcd4c0748e0 2026-02-17T21:08:10.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.489+0000 7fcd2b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:10.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.489+0000 7fcd2b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:10.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.591+0000 7fcd51501640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:10.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.591+0000 7fcd51501640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:10.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.591+0000 7fcd51501640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:10.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.591+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcd4c0c9b20 con 0x7fcd4c0748e0 2026-02-17T21:08:10.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.597+0000 7fcd2b7fe640 1 -- 10.20.193.45:0/2273843420 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fcd40066640 con 0x7fcd4c0748e0 2026-02-17T21:08:10.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.597+0000 7fcd2b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:10.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.597+0000 7fcd2b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:10.590 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:10.590 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:10.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 10 librados: watch_flush enter 2026-02-17T21:08:10.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 10 librados: watch_flush exit 2026-02-17T21:08:10.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 20 client.4638.objecter shutdown clearing up homeless session... 2026-02-17T21:08:10.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 10 client.4638.objecter successfully canceled tick 2026-02-17T21:08:10.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcd18079300 msgr2=0x7fcd1807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcd18079300 0x7fcd1807b7c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcd34039000 tx=0x7fcd34033000 comp rx=0 tx=0).stop 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 10 monclient: shutdown 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 msgr2=0x7fcd4c145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 0x7fcd4c145b30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000e890 tx=0x7fcd4000ed60 comp rx=0 tx=0).stop 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 shutdown_connections 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcd18079300 0x7fcd1807b7c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd4c15d1e0 0x7fcd4c1f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcd4c0c90e0 0x7fcd4c1f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 --2- 10.20.193.45:0/2273843420 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcd4c0748e0 0x7fcd4c145b30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 >> 10.20.193.45:0/2273843420 conn(0x7fcd4c0c9d40 msgr2=0x7fcd4c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:10.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 shutdown_connections 2026-02-17T21:08:10.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 -- 10.20.193.45:0/2273843420 wait complete. 2026-02-17T21:08:10.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:10.599+0000 7fcd51501640 1 librados: shutdown 2026-02-17T21:08:13.601 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:13.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.681+0000 7f2d8505f640 10 monclient: get_monmap_and_config 2026-02-17T21:08:13.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.681+0000 7f2d8505f640 10 monclient: build_initial_monmap 2026-02-17T21:08:13.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.681+0000 7f2d8505f640 10 monclient: monmap: 2026-02-17T21:08:13.674 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:13.674 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:13.674 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:13.682698+0000 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:13.682698+0000 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:13.675 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 1 Processor -- start 2026-02-17T21:08:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 1 -- start start 2026-02-17T21:08:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 10 monclient: init 2026-02-17T21:08:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:13.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 10 monclient: _add_conns ranks=[5,1,2,0,4,3] 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f2d8015d1e0 0x7f2d8015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 10 monclient(hunting): picked mon.noname-c con 0x7f2d8015d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f2d800748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2d800c92b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d800c5860 con 0x7f2d800748e0 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d800c5580 con 0x7f2d800c92b0 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f2d800c7de0 con 0x7f2d8015d1e0 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.682+0000 7f2d8505f640 10 monclient(hunting): authenticate will time out at 1077.312944s 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.683+0000 7f2d7ed76640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f2d8015d1e0 0x7f2d8015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:13.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.683+0000 7f2d7e575640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f2d800748e0 0x7f2d800c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:35838/0 (socket says 10.20.193.45:35838) 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.683+0000 7f2d7e575640 1 -- 10.20.193.45:0/3795906114 learned_addr learned my addr 10.20.193.45:0/3795906114 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.683+0000 7f2d7ed76640 10 monclient(hunting): get_auth_request con 0x7f2d8015d1e0 auth_method 0 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.683+0000 7f2d7ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.683+0000 7f2d7ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.683+0000 7f2d7ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.684+0000 7f2d7ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.684+0000 7f2d7ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.684+0000 7f2d7ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.685+0000 7f2d7dd74640 1 -- 10.20.193.45:0/3795906114 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223918719 0 0) 0x7f2d800c5860 con 0x7f2d800748e0 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.685+0000 7f2d7dd74640 10 monclient(hunting): _negotiate 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.685+0000 7f2d7dd74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:13.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.685+0000 7f2d7dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.685+0000 7f2d7dd74640 10 monclient(hunting): my global_id is 4696 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.685+0000 7f2d7dd74640 1 -- 10.20.193.45:0/3795906114 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d6c003620 con 0x7f2d800748e0 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.686+0000 7f2d7ed76640 10 monclient(hunting): handle_auth_done global_id 4736 payload 274 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.686+0000 7f2d7ed76640 1 -- 10.20.193.45:0/3795906114 >> v1:10.20.193.92:6789/0 conn(0x7f2d800c92b0 legacy=0x7f2d80153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.686+0000 7f2d7ed76640 1 -- 10.20.193.45:0/3795906114 >> v1:10.20.193.86:6789/0 conn(0x7f2d800748e0 legacy=0x7f2d800c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.686+0000 7f2d7ed76640 10 monclient: _finish_hunting 0 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.686+0000 7f2d7ed76640 1 monclient: found mon.noname-c 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.686+0000 7f2d7ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.686+0000 7f2d7ed76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:08:13.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.686+0000 7f2d7ed76640 1 -- 10.20.193.45:0/3795906114 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d800c80c0 con 0x7f2d8015d1e0 2026-02-17T21:08:13.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.687+0000 7f2d7ed76640 1 --2- 10.20.193.45:0/3795906114 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 0x7f2d8015d5c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2d740098d0 tx=0x7f2d7402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92c1649ce265ce76 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:13.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 1 -- 10.20.193.45:0/3795906114 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7403c070 con 0x7f2d8015d1e0 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 10 monclient: dump: 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:13.687 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 10 monclient: _finish_auth 0 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 10 monclient: _check_auth_tickets 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 1 -- 10.20.193.45:0/3795906114 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7402fba0 con 0x7f2d8015d1e0 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 5 monclient: authenticate success, global_id 4736 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:13.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 1 -- 10.20.193.45:0/3795906114 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74037440 con 0x7f2d8015d1e0 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d7dd74640 10 monclient: dump: 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:13.689 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 4 set_mon_vals no callback set 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 10 monclient: shutdown 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 1 -- 10.20.193.45:0/3795906114 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 msgr2=0x7f2d8015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 1 --2- 10.20.193.45:0/3795906114 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 0x7f2d8015d5c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2d740098d0 tx=0x7f2d7402eed0 comp rx=0 tx=0).stop 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 1 -- 10.20.193.45:0/3795906114 shutdown_connections 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 1 --2- 10.20.193.45:0/3795906114 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 0x7f2d8015d5c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 1 -- 10.20.193.45:0/3795906114 >> 10.20.193.45:0/3795906114 conn(0x7f2d800c9d40 msgr2=0x7f2d800ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 1 -- 10.20.193.45:0/3795906114 shutdown_connections 2026-02-17T21:08:13.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.689+0000 7f2d8505f640 1 -- 10.20.193.45:0/3795906114 wait complete. 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient: build_initial_monmap 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient: monmap: 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:13.691 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 librados: starting msgr at 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 librados: starting objecter 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 Processor -- start 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 -- start start 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 librados: setting wanted keys 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 librados: calling monclient init 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient: init 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2d800748e0 0x7f2d801f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient(hunting): picked mon.noname-b con 0x7f2d800748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2d800c92b0 0x7f2d80154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:13.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient(hunting): picked mon.noname-a con 0x7f2d800c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 0x7f2d801f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient(hunting): picked mon.noname-c con 0x7f2d8015d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d80074d30 con 0x7f2d800c92b0 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f2d800c8680 con 0x7f2d800748e0 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d80153d20 con 0x7f2d8015d1e0 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.690+0000 7f2d8505f640 10 monclient(hunting): authenticate will time out at 1077.320918s 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 0x7f2d801f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:13.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7e575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2d800c92b0 0x7f2d80154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7ed76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2d800748e0 0x7f2d801f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 0x7f2d801f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:43982/0 (socket says 10.20.193.45:43982) 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 1 -- 10.20.193.45:0/52077688 learned_addr learned my addr 10.20.193.45:0/52077688 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 10 monclient(hunting): get_auth_request con 0x7f2d8015d1e0 auth_method 0 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7ed76640 10 monclient(hunting): get_auth_request con 0x7f2d800748e0 auth_method 0 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7ed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7e575640 10 monclient(hunting): get_auth_request con 0x7f2d800c92b0 auth_method 0 2026-02-17T21:08:13.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7e575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7f577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.691+0000 7f2d7ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 10 monclient(hunting): handle_auth_done global_id 4742 payload 824 2026-02-17T21:08:13.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 1 -- 10.20.193.45:0/52077688 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2d800748e0 msgr2=0x7f2d801f77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2d800748e0 0x7f2d801f77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 1 -- 10.20.193.45:0/52077688 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2d800c92b0 msgr2=0x7f2d80154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2d800c92b0 0x7f2d80154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 10 monclient: _finish_hunting 0 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 1 monclient: found mon.noname-c 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.692+0000 7f2d7f577640 1 -- 10.20.193.45:0/52077688 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d801f4650 con 0x7f2d8015d1e0 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.693+0000 7f2d7f577640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 0x7f2d801f3750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000cc50 tx=0x7f2d7000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.693+0000 7f2d5f7fe640 10 client.?.objecter ms_handle_connect 0x7f2d8015d1e0 2026-02-17T21:08:13.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.693+0000 7f2d5f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:13.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.694+0000 7f2d5f7fe640 1 -- 10.20.193.45:0/52077688 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d70003a70 con 0x7f2d8015d1e0 2026-02-17T21:08:13.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.694+0000 7f2d5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:13.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.694+0000 7f2d5f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:08:13.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.694+0000 7f2d5f7fe640 10 monclient: dump: 2026-02-17T21:08:13.698 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:13.698 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.694+0000 7f2d5f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.694+0000 7f2d5f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.694+0000 7f2d5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:13.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 5 monclient: authenticate success, global_id 4742 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 10 monclient: _renew_subs 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d801f6cf0 con 0x7f2d8015d1e0 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 10 client.4742.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 10 monclient: _renew_subs 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d801f4370 con 0x7f2d8015d1e0 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 1 librados: init done 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d8015d5c0 con 0x7f2d8015d1e0 2026-02-17T21:08:13.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d5f7fe640 1 -- 10.20.193.45:0/52077688 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d70003c10 con 0x7f2d8015d1e0 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d5f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d5f7fe640 1 -- 10.20.193.45:0/52077688 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d700050d0 con 0x7f2d8015d1e0 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d5f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d5f7fe640 10 monclient: dump: 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:13.701 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:13.702 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:13.702 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:13.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.695+0000 7f2d7d573640 4 set_mon_vals no callback set 2026-02-17T21:08:13.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.745+0000 7f2d5f7fe640 1 -- 10.20.193.45:0/52077688 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f2d70005270 con 0x7f2d8015d1e0 2026-02-17T21:08:13.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.745+0000 7f2d5f7fe640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d4c079280 0x7f2d4c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:13.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.745+0000 7f2d7ed76640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d4c079280 0x7f2d4c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:13.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.745+0000 7f2d7ed76640 10 monclient: get_auth_request con 0x7f2d4c079280 auth_method 0 2026-02-17T21:08:13.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.746+0000 7f2d5f7fe640 10 client.4742.objecter ms_handle_connect 0x7f2d4c079280 2026-02-17T21:08:13.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.746+0000 7f2d7ed76640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d4c079280 0x7f2d4c07b740 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d74039000 tx=0x7f2d74033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:13.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.787+0000 7f2d5f7fe640 1 -- 10.20.193.45:0/52077688 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f2d70098510 con 0x7f2d8015d1e0 2026-02-17T21:08:13.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.787+0000 7f2d5f7fe640 10 client.4742.objecter ms_dispatch2 0x7f2d80000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:13.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.787+0000 7f2d5f7fe640 3 client.4742.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:13.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.787+0000 7f2d5f7fe640 3 client.4742.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:13.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.787+0000 7f2d5f7fe640 20 client.4742.objecter dump_active .. 0 homeless 2026-02-17T21:08:13.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.813+0000 7f2d5f7fe640 1 -- 10.20.193.45:0/52077688 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2d70062aa0 con 0x7f2d8015d1e0 2026-02-17T21:08:13.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.813+0000 7f2d5f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:13.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.813+0000 7f2d5f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.912+0000 7f2d8505f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:13.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.912+0000 7f2d8505f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.912+0000 7f2d8505f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:13.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.912+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2d800c9b20 con 0x7f2d8015d1e0 2026-02-17T21:08:13.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.914+0000 7f2d5f7fe640 1 -- 10.20.193.45:0/52077688 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f2d70066da0 con 0x7f2d8015d1e0 2026-02-17T21:08:13.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.914+0000 7f2d5f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:13.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.914+0000 7f2d5f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:13.907 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:13.907 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 10 librados: watch_flush enter 2026-02-17T21:08:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 10 librados: watch_flush exit 2026-02-17T21:08:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 20 client.4742.objecter shutdown clearing up homeless session... 2026-02-17T21:08:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 10 client.4742.objecter successfully canceled tick 2026-02-17T21:08:13.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d4c079280 msgr2=0x7f2d4c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d4c079280 0x7f2d4c07b740 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d74039000 tx=0x7f2d74033000 comp rx=0 tx=0).stop 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 10 monclient: shutdown 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 msgr2=0x7f2d801f3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 0x7f2d801f3750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000cc50 tx=0x7f2d7000a430 comp rx=0 tx=0).stop 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 shutdown_connections 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f2d4c079280 0x7f2d4c07b740 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d8015d1e0 0x7f2d801f3750 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f2d800c92b0 0x7f2d80154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 --2- 10.20.193.45:0/52077688 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f2d800748e0 0x7f2d801f77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 >> 10.20.193.45:0/52077688 conn(0x7f2d800c9d40 msgr2=0x7f2d80152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:13.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 shutdown_connections 2026-02-17T21:08:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 -- 10.20.193.45:0/52077688 wait complete. 2026-02-17T21:08:13.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:13.916+0000 7f2d8505f640 1 librados: shutdown 2026-02-17T21:08:16.919 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:16.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.995+0000 7f5a620fc640 10 monclient: get_monmap_and_config 2026-02-17T21:08:16.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.995+0000 7f5a620fc640 10 monclient: build_initial_monmap 2026-02-17T21:08:16.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.995+0000 7f5a620fc640 10 monclient: monmap: 2026-02-17T21:08:16.988 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:16.988 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:16.988 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:16.996542+0000 2026-02-17T21:08:16.988 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:16.996542+0000 2026-02-17T21:08:16.989 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:16.989 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:16.989 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:16.989 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:16.989 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:16.989 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:16.989 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:16.989 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:16.989 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 1 Processor -- start 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 1 -- start start 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient: init 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient: _add_conns ranks=[2,4,5,1,3,0] 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f5a5c1561c0 addr v1:10.20.193.92:6789/0 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5a5c06c890 0x7f5a5c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient(hunting): picked mon.noname-b con 0x7f5a5c06c890 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f5a5c06e110 0x7f5a5c0cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:16.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient(hunting): picked mon.noname-c con 0x7f5a5c06e110 addr v2:10.20.193.92:3300/0 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a5c15ce80 con 0x7f5a5c1561c0 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5a5c06f490 con 0x7f5a5c06c890 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5a5c070010 con 0x7f5a5c06e110 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.996+0000 7f5a620fc640 10 monclient(hunting): authenticate will time out at 1080.626767s 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5a5c06c890 0x7f5a5c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5bfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f5a5c06e110 0x7f5a5c0cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:16.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5a5c06c890 0x7f5a5c0cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:51766/0 (socket says 10.20.193.45:51766) 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 1 -- 10.20.193.45:0/3172547870 learned_addr learned my addr 10.20.193.45:0/3172547870 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 10 monclient(hunting): get_auth_request con 0x7f5a5c06c890 auth_method 0 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5bfff640 10 monclient(hunting): get_auth_request con 0x7f5a5c06e110 auth_method 0 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:16.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.997+0000 7f5a5affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.998+0000 7f5a5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.998+0000 7f5a5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.998+0000 7f5a5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.999+0000 7f5a5affd640 10 monclient(hunting): handle_auth_done global_id 4702 payload 274 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.999+0000 7f5a5affd640 1 -- 10.20.193.45:0/3172547870 >> v2:10.20.193.92:3300/0 conn(0x7f5a5c06e110 msgr2=0x7f5a5c0cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.999+0000 7f5a5affd640 1 --2- 10.20.193.45:0/3172547870 >> v2:10.20.193.92:3300/0 conn(0x7f5a5c06e110 0x7f5a5c0cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.999+0000 7f5a5affd640 1 -- 10.20.193.45:0/3172547870 >> v1:10.20.193.92:6789/0 conn(0x7f5a5c1561c0 legacy=0x7f5a5c0704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.999+0000 7f5a5affd640 10 monclient: _finish_hunting 0 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.999+0000 7f5a5affd640 1 monclient: found mon.noname-b 2026-02-17T21:08:16.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.999+0000 7f5a5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:16.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.999+0000 7f5a5affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:08:16.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:16.999+0000 7f5a5affd640 1 -- 10.20.193.45:0/3172547870 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c06f6e0 con 0x7f5a5c06c890 2026-02-17T21:08:16.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.000+0000 7f5a5affd640 1 --2- 10.20.193.45:0/3172547870 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c06c890 0x7f5a5c0cca30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009970 tx=0x7f5a4c02f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ae963cd95ababb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:17.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 1 -- 10.20.193.45:0/3172547870 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c03c070 con 0x7f5a5c06c890 2026-02-17T21:08:17.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:17.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:08:17.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 10 monclient: dump: 2026-02-17T21:08:17.004 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:17.004 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:17.004 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:17.004 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:17.004 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:17.005 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:17.005 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:17.005 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:17.005 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:17.005 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:17.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:08:17.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:08:17.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:17.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 1 -- 10.20.193.45:0/3172547870 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a4c02fcd0 con 0x7f5a5c06c890 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a620fc640 5 monclient: authenticate success, global_id 4702 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a620fc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 1 -- 10.20.193.45:0/3172547870 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c037660 con 0x7f5a5c06c890 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a5a7fc640 10 monclient: dump: 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:17.006 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a620fc640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.002+0000 7f5a620fc640 4 set_mon_vals no callback set 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 10 monclient: shutdown 2026-02-17T21:08:17.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 -- 10.20.193.45:0/3172547870 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c06c890 msgr2=0x7f5a5c0cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 --2- 10.20.193.45:0/3172547870 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c06c890 0x7f5a5c0cca30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009970 tx=0x7f5a4c02f000 comp rx=0 tx=0).stop 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 -- 10.20.193.45:0/3172547870 shutdown_connections 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 --2- 10.20.193.45:0/3172547870 >> v2:10.20.193.92:3300/0 conn(0x7f5a5c06e110 0x7f5a5c0cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 --2- 10.20.193.45:0/3172547870 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c06c890 0x7f5a5c0cca30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 -- 10.20.193.45:0/3172547870 >> 10.20.193.45:0/3172547870 conn(0x7f5a5c0cbf10 msgr2=0x7f5a5c0cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 -- 10.20.193.45:0/3172547870 shutdown_connections 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 -- 10.20.193.45:0/3172547870 wait complete. 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 10 monclient: build_initial_monmap 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 10 monclient: monmap: 2026-02-17T21:08:17.008 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 librados: starting msgr at 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 librados: starting objecter 2026-02-17T21:08:17.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 Processor -- start 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 -- start start 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 librados: setting wanted keys 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 1 librados: calling monclient init 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.003+0000 7f5a620fc640 10 monclient: init 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a5c06c890 0x7f5a5c1e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient(hunting): picked mon.noname-c con 0x7f5a5c06c890 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5a5c06e110 0x7f5a5c0ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient(hunting): picked mon.noname-a con 0x7f5a5c06e110 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:17.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c1561c0 0x7f5a5c1e7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient(hunting): picked mon.noname-b con 0x7f5a5c1561c0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c06e860 con 0x7f5a5c06e110 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c06fca0 con 0x7f5a5c1561c0 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c15cb00 con 0x7f5a5c06c890 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a620fc640 10 monclient(hunting): authenticate will time out at 1080.634227s 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c1561c0 0x7f5a5c1e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:17.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5b7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a5c06c890 0x7f5a5c1e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5affd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5a5c06e110 0x7f5a5c0ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c1561c0 0x7f5a5c1e7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:51772/0 (socket says 10.20.193.45:51772) 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 1 -- 10.20.193.45:0/384094299 learned_addr learned my addr 10.20.193.45:0/384094299 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 10 monclient(hunting): get_auth_request con 0x7f5a5c1561c0 auth_method 0 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5b7fe640 10 monclient(hunting): get_auth_request con 0x7f5a5c06c890 auth_method 0 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:17.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5affd640 10 monclient(hunting): get_auth_request con 0x7f5a5c06e110 auth_method 0 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.004+0000 7f5a5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.005+0000 7f5a5b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.005+0000 7f5a5b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.005+0000 7f5a5b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:17.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.005+0000 7f5a5affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.005+0000 7f5a5affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.005+0000 7f5a5affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 10 monclient(hunting): handle_auth_done global_id 4705 payload 824 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 1 -- 10.20.193.45:0/384094299 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a5c06c890 msgr2=0x7f5a5c1e9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a5c06c890 0x7f5a5c1e9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 1 -- 10.20.193.45:0/384094299 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5a5c06e110 msgr2=0x7f5a5c0ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5a5c06e110 0x7f5a5c0ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 1 monclient: found mon.noname-b 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:17.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5bfff640 1 -- 10.20.193.45:0/384094299 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c1e8af0 con 0x7f5a5c1561c0 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.006+0000 7f5a5b7fe640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a5c06c890 0x7f5a5c1e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.007+0000 7f5a5bfff640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c1561c0 0x7f5a5c1e7580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000efc0 tx=0x7f5a5000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.007+0000 7f5a37fff640 10 client.?.objecter ms_handle_connect 0x7f5a5c1561c0 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.007+0000 7f5a37fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a37fff640 1 -- 10.20.193.45:0/384094299 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50018020 con 0x7f5a5c1561c0 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a37fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a37fff640 10 monclient: dump: 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:17.015 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a37fff640 10 monclient: _finish_auth 0 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a37fff640 10 monclient: _check_auth_tickets 2026-02-17T21:08:17.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a620fc640 5 monclient: authenticate success, global_id 4705 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a620fc640 10 monclient: _renew_subs 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a620fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a5c1e8d90 con 0x7f5a5c1561c0 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a620fc640 10 client.4705.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a620fc640 10 monclient: _renew_subs 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a620fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a5c1e9350 con 0x7f5a5c1561c0 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.008+0000 7f5a620fc640 1 librados: init done 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a37fff640 1 -- 10.20.193.45:0/384094299 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50014480 con 0x7f5a5c1561c0 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a37fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a37fff640 1 -- 10.20.193.45:0/384094299 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50014830 con 0x7f5a5c1561c0 2026-02-17T21:08:17.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a37fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a37fff640 10 monclient: dump: 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:17.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a59ffb640 4 set_mon_vals no callback set 2026-02-17T21:08:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a620fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a620fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a620fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:17.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.009+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a5c1565a0 con 0x7f5a5c1561c0 2026-02-17T21:08:17.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.021+0000 7f5a37fff640 1 -- 10.20.193.45:0/384094299 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f5a500149d0 con 0x7f5a5c1561c0 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.021+0000 7f5a37fff640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5a2c079280 0x7f5a2c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.021+0000 7f5a5b7fe640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5a2c079280 0x7f5a2c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.021+0000 7f5a5b7fe640 10 monclient: get_auth_request con 0x7f5a2c079280 auth_method 0 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.022+0000 7f5a5b7fe640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5a2c079280 0x7f5a2c07b740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5a48002770 tx=0x7f5a48007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.022+0000 7f5a37fff640 10 client.4705.objecter ms_handle_connect 0x7f5a2c079280 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.023+0000 7f5a37fff640 1 -- 10.20.193.45:0/384094299 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f5a5005f170 con 0x7f5a5c1561c0 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.023+0000 7f5a37fff640 10 client.4705.objecter ms_dispatch2 0x7f5a5c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.023+0000 7f5a37fff640 3 client.4705.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.023+0000 7f5a37fff640 3 client.4705.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:17.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.023+0000 7f5a37fff640 20 client.4705.objecter dump_active .. 0 homeless 2026-02-17T21:08:17.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.125+0000 7f5a37fff640 1 -- 10.20.193.45:0/384094299 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5a50022070 con 0x7f5a5c1561c0 2026-02-17T21:08:17.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.125+0000 7f5a37fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:17.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.125+0000 7f5a37fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:17.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.226+0000 7f5a620fc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:17.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.226+0000 7f5a620fc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:17.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.226+0000 7f5a620fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:17.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.226+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5a5c0cb110 con 0x7f5a5c1561c0 2026-02-17T21:08:17.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.229+0000 7f5a37fff640 1 -- 10.20.193.45:0/384094299 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5a50010040 con 0x7f5a5c1561c0 2026-02-17T21:08:17.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.229+0000 7f5a37fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:17.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.229+0000 7f5a37fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:17.222 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:17.222 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:17.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 10 librados: watch_flush enter 2026-02-17T21:08:17.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 10 librados: watch_flush exit 2026-02-17T21:08:17.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 20 client.4705.objecter shutdown clearing up homeless session... 2026-02-17T21:08:17.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 10 client.4705.objecter successfully canceled tick 2026-02-17T21:08:17.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5a2c079280 msgr2=0x7f5a2c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:17.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5a2c079280 0x7f5a2c07b740 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5a48002770 tx=0x7f5a48007ef0 comp rx=0 tx=0).stop 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 10 monclient: shutdown 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c1561c0 msgr2=0x7f5a5c1e7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c1561c0 0x7f5a5c1e7580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000efc0 tx=0x7f5a5000c490 comp rx=0 tx=0).stop 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 shutdown_connections 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5a2c079280 0x7f5a2c07b740 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5a5c1561c0 0x7f5a5c1e7580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5a5c06e110 0x7f5a5c0ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 --2- 10.20.193.45:0/384094299 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a5c06c890 0x7f5a5c1e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 >> 10.20.193.45:0/384094299 conn(0x7f5a5c0cbf10 msgr2=0x7f5a5c0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:17.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 shutdown_connections 2026-02-17T21:08:17.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 -- 10.20.193.45:0/384094299 wait complete. 2026-02-17T21:08:17.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:17.230+0000 7f5a620fc640 1 librados: shutdown 2026-02-17T21:08:20.233 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:20.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.310+0000 7f4c5865b640 10 monclient: get_monmap_and_config 2026-02-17T21:08:20.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.310+0000 7f4c5865b640 10 monclient: build_initial_monmap 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.310+0000 7f4c5865b640 10 monclient: monmap: 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:20.311179+0000 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:20.311179+0000 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:20.303 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:20.304 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:20.304 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:20.304 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.310+0000 7f4c5865b640 1 Processor -- start 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.310+0000 7f4c5865b640 1 -- start start 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.310+0000 7f4c5865b640 10 monclient: init 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 10 monclient: _add_conns ranks=[3,2,1,5,4,0] 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4c50152620 0x7f4c5015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 10 monclient(hunting): picked mon.noname-a con 0x7f4c50152620 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4c50152a00 addr v1:10.20.193.92:6789/0 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f4c500c94a0 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c500c71a0 con 0x7f4c500c94a0 2026-02-17T21:08:20.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c500c7480 con 0x7f4c50152a00 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f4c500c7760 con 0x7f4c50152620 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c5865b640 10 monclient(hunting): authenticate will time out at 1083.941395s 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c56bd1640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f4c500c94a0 0x7f4c500c5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:60174/0 (socket says 10.20.193.45:60174) 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c56bd1640 1 -- 10.20.193.45:0/3588844339 learned_addr learned my addr 10.20.193.45:0/3588844339 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.311+0000 7f4c563d0640 1 --2- 10.20.193.45:0/3588844339 >> v2:10.20.193.45:3300/0 conn(0x7f4c50152620 0x7f4c5015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.312+0000 7f4c563d0640 10 monclient(hunting): get_auth_request con 0x7f4c50152620 auth_method 0 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.312+0000 7f4c563d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.312+0000 7f4c563d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.312+0000 7f4c563d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:20.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.312+0000 7f4c563d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.312+0000 7f4c563d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.312+0000 7f4c563d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 1 -- 10.20.193.45:0/3588844339 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944794933 0 0) 0x7f4c500c71a0 con 0x7f4c500c94a0 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 10 monclient(hunting): _negotiate 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 10 monclient(hunting): my global_id is 4708 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 1 -- 10.20.193.45:0/3588844339 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c38003620 con 0x7f4c500c94a0 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 1 -- 10.20.193.45:0/3588844339 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187136745 0 0) 0x7f4c500c7480 con 0x7f4c50152a00 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 10 monclient(hunting): _negotiate 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:20.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 10 monclient(hunting): my global_id is 4754 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c553ce640 1 -- 10.20.193.45:0/3588844339 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c500c71a0 con 0x7f4c50152a00 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c563d0640 10 monclient(hunting): handle_auth_done global_id 4647 payload 274 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c563d0640 1 -- 10.20.193.45:0/3588844339 >> v1:10.20.193.92:6789/0 conn(0x7f4c50152a00 legacy=0x7f4c500c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c563d0640 1 -- 10.20.193.45:0/3588844339 >> v1:10.20.193.86:6789/0 conn(0x7f4c500c94a0 legacy=0x7f4c500c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c563d0640 10 monclient: _finish_hunting 0 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c563d0640 1 monclient: found mon.noname-a 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c563d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c563d0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.313+0000 7f4c563d0640 1 -- 10.20.193.45:0/3588844339 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c50159e00 con 0x7f4c50152620 2026-02-17T21:08:20.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.314+0000 7f4c563d0640 1 --2- 10.20.193.45:0/3588844339 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c50152620 0x7f4c5015a8e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098a0 tx=0x7f4c4002ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0022e9e9e8967c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:20.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 1 -- 10.20.193.45:0/3588844339 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4003c070 con 0x7f4c50152620 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 10 monclient: dump: 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:20.317 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 10 monclient: _finish_auth 0 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 10 monclient: _check_auth_tickets 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 1 -- 10.20.193.45:0/3588844339 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4002fb70 con 0x7f4c50152620 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c5865b640 5 monclient: authenticate success, global_id 4647 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c5865b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 1 -- 10.20.193.45:0/3588844339 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40037440 con 0x7f4c50152620 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c5865b640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:20.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c5865b640 4 set_mon_vals no callback set 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.316+0000 7f4c553ce640 10 monclient: dump: 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:20.319 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 10 monclient: shutdown 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 -- 10.20.193.45:0/3588844339 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c50152620 msgr2=0x7f4c5015a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 --2- 10.20.193.45:0/3588844339 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c50152620 0x7f4c5015a8e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4c400098a0 tx=0x7f4c4002ee60 comp rx=0 tx=0).stop 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 -- 10.20.193.45:0/3588844339 shutdown_connections 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 --2- 10.20.193.45:0/3588844339 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c50152620 0x7f4c5015a8e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 -- 10.20.193.45:0/3588844339 >> 10.20.193.45:0/3588844339 conn(0x7f4c500c9d40 msgr2=0x7f4c500ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 -- 10.20.193.45:0/3588844339 shutdown_connections 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 -- 10.20.193.45:0/3588844339 wait complete. 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 10 monclient: build_initial_monmap 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 10 monclient: monmap: 2026-02-17T21:08:20.320 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 librados: starting msgr at 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 librados: starting objecter 2026-02-17T21:08:20.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 Processor -- start 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 -- start start 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 librados: setting wanted keys 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 1 librados: calling monclient init 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.317+0000 7f4c5865b640 10 monclient: init 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c500c94a0 0x7f4c50073750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient(hunting): picked mon.noname-a con 0x7f4c500c94a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c50152620 0x7f4c5006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient(hunting): picked mon.noname-b con 0x7f4c50152620 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c50152a00 0x7f4c5006f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient(hunting): picked mon.noname-c con 0x7f4c50152a00 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:20.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5015ae20 con 0x7f4c500c94a0 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5015a3c0 con 0x7f4c50152620 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5015afa0 con 0x7f4c50152a00 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c5865b640 10 monclient(hunting): authenticate will time out at 1083.948259s 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c500c94a0 0x7f4c50073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c56bd1640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c50152a00 0x7f4c5006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c55bcf640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c50152620 0x7f4c5006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:20.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c500c94a0 0x7f4c50073750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:35448/0 (socket says 10.20.193.45:35448) 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 1 -- 10.20.193.45:0/2170359043 learned_addr learned my addr 10.20.193.45:0/2170359043 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 10 monclient(hunting): get_auth_request con 0x7f4c500c94a0 auth_method 0 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c56bd1640 10 monclient(hunting): get_auth_request con 0x7f4c50152a00 auth_method 0 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c56bd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c56bd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c56bd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c55bcf640 10 monclient(hunting): get_auth_request con 0x7f4c50152620 auth_method 0 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c55bcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c55bcf640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:20.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c55bcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.318+0000 7f4c563d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.319+0000 7f4c56bd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.319+0000 7f4c56bd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.319+0000 7f4c56bd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.319+0000 7f4c55bcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.319+0000 7f4c55bcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.319+0000 7f4c55bcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 10 monclient(hunting): handle_auth_done global_id 4650 payload 824 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 1 -- 10.20.193.45:0/2170359043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c50152a00 msgr2=0x7f4c5006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c50152a00 0x7f4c5006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:20.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 1 -- 10.20.193.45:0/2170359043 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c50152620 msgr2=0x7f4c5006efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c50152620 0x7f4c5006efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 10 monclient: _finish_hunting 0 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 1 monclient: found mon.noname-a 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.320+0000 7f4c563d0640 1 -- 10.20.193.45:0/2170359043 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c501588c0 con 0x7f4c500c94a0 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.321+0000 7f4c563d0640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c500c94a0 0x7f4c50073750 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c40016e30 tx=0x7f4c400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.321+0000 7f4c3effd640 10 client.?.objecter ms_handle_connect 0x7f4c500c94a0 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.321+0000 7f4c3effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 1 -- 10.20.193.45:0/2170359043 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40046020 con 0x7f4c500c94a0 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:20.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 10 monclient: dump: 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 10 monclient: _finish_auth 0 2026-02-17T21:08:20.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 10 monclient: _check_auth_tickets 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 1 -- 10.20.193.45:0/2170359043 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c40042450 con 0x7f4c500c94a0 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 5 monclient: authenticate success, global_id 4650 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 10 monclient: _renew_subs 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5006e210 con 0x7f4c500c94a0 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 1 -- 10.20.193.45:0/2170359043 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c4003c040 con 0x7f4c500c94a0 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c54bcd640 4 set_mon_vals no callback set 2026-02-17T21:08:20.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c3effd640 10 monclient: dump: 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 10 client.4650.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 10 monclient: _renew_subs 2026-02-17T21:08:20.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:20.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5006e7d0 con 0x7f4c500c94a0 2026-02-17T21:08:20.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 1 librados: init done 2026-02-17T21:08:20.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:20.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:20.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:20.330 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.323+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5015a8e0 con 0x7f4c500c94a0 2026-02-17T21:08:20.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.335+0000 7f4c3effd640 1 -- 10.20.193.45:0/2170359043 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4c4004a3b0 con 0x7f4c500c94a0 2026-02-17T21:08:20.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.336+0000 7f4c3effd640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c200792d0 0x7f4c2007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:20.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.336+0000 7f4c55bcf640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c200792d0 0x7f4c2007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:20.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.336+0000 7f4c55bcf640 10 monclient: get_auth_request con 0x7f4c200792d0 auth_method 0 2026-02-17T21:08:20.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.336+0000 7f4c3effd640 10 client.4650.objecter ms_handle_connect 0x7f4c200792d0 2026-02-17T21:08:20.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.336+0000 7f4c55bcf640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c200792d0 0x7f4c2007b790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4c44003fd0 tx=0x7f4c44002a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:20.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.338+0000 7f4c3effd640 1 -- 10.20.193.45:0/2170359043 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f4c40082d50 con 0x7f4c500c94a0 2026-02-17T21:08:20.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.338+0000 7f4c3effd640 10 client.4650.objecter ms_dispatch2 0x7f4c50000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:20.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.338+0000 7f4c3effd640 3 client.4650.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:20.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.338+0000 7f4c3effd640 3 client.4650.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:20.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.338+0000 7f4c3effd640 20 client.4650.objecter dump_active .. 0 homeless 2026-02-17T21:08:20.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.443+0000 7f4c3effd640 1 -- 10.20.193.45:0/2170359043 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4c40050020 con 0x7f4c500c94a0 2026-02-17T21:08:20.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.443+0000 7f4c3effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:20.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.443+0000 7f4c3effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:20.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.542+0000 7f4c5865b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:20.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.542+0000 7f4c5865b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:20.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.542+0000 7f4c5865b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:20.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.542+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4c5014d930 con 0x7f4c500c94a0 2026-02-17T21:08:20.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.546+0000 7f4c3effd640 1 -- 10.20.193.45:0/2170359043 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f4c40086d10 con 0x7f4c500c94a0 2026-02-17T21:08:20.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.546+0000 7f4c3effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:20.538 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.546+0000 7f4c3effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:20.539 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:20.539 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:20.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 10 librados: watch_flush enter 2026-02-17T21:08:20.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 10 librados: watch_flush exit 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 20 client.4650.objecter shutdown clearing up homeless session... 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 10 client.4650.objecter successfully canceled tick 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c200792d0 msgr2=0x7f4c2007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c200792d0 0x7f4c2007b790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4c44003fd0 tx=0x7f4c44002a40 comp rx=0 tx=0).stop 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 10 monclient: shutdown 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c500c94a0 msgr2=0x7f4c50073750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c500c94a0 0x7f4c50073750 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4c40016e30 tx=0x7f4c400047c0 comp rx=0 tx=0).stop 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 shutdown_connections 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c200792d0 0x7f4c2007b790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:20.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4c50152a00 0x7f4c5006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:20.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4c50152620 0x7f4c5006efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:20.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 --2- 10.20.193.45:0/2170359043 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4c500c94a0 0x7f4c50073750 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:20.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 >> 10.20.193.45:0/2170359043 conn(0x7f4c500c9d40 msgr2=0x7f4c5014d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:20.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 shutdown_connections 2026-02-17T21:08:20.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 -- 10.20.193.45:0/2170359043 wait complete. 2026-02-17T21:08:20.542 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:20.547+0000 7f4c5865b640 1 librados: shutdown 2026-02-17T21:08:23.550 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:23.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.625+0000 7fd5822a7640 10 monclient: get_monmap_and_config 2026-02-17T21:08:23.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.625+0000 7fd5822a7640 10 monclient: build_initial_monmap 2026-02-17T21:08:23.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.625+0000 7fd5822a7640 10 monclient: monmap: 2026-02-17T21:08:23.619 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:23.619 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:23.619 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:23.627536+0000 2026-02-17T21:08:23.619 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:23.627536+0000 2026-02-17T21:08:23.620 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:23.620 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:23.620 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:23.620 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:23.620 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:23.620 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:23.620 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:23.620 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:23.620 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 1 Processor -- start 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 1 -- start start 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 10 monclient: init 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 10 monclient: _add_conns ranks=[1,0,4,5,2,3] 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fd57c155e40 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd57c074c90 addr v1:10.20.193.45:6789/0 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fd57c156220 0x7fd57c1666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 10 monclient(hunting): picked mon.noname-b con 0x7fd57c156220 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:23.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57c0734e0 con 0x7fd57c074c90 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57c0737c0 con 0x7fd57c155e40 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fd57c0cd800 con 0x7fd57c156220 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.626+0000 7fd5822a7640 10 monclient(hunting): authenticate will time out at 1087.257856s 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.627+0000 7fd57b7fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fd57c074c90 0x7fd57c0ccb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:32956/0 (socket says 10.20.193.45:32956) 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.627+0000 7fd57b7fe640 1 -- 10.20.193.45:0/2335780561 learned_addr learned my addr 10.20.193.45:0/2335780561 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.627+0000 7fd58081d640 1 --2- 10.20.193.45:0/2335780561 >> v2:10.20.193.86:3300/0 conn(0x7fd57c156220 0x7fd57c1666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.627+0000 7fd58081d640 10 monclient(hunting): get_auth_request con 0x7fd57c156220 auth_method 0 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.627+0000 7fd58081d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.627+0000 7fd58081d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:23.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.627+0000 7fd58081d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.628+0000 7fd58081d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.628+0000 7fd58081d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.628+0000 7fd58081d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.628+0000 7fd57affd640 1 -- 10.20.193.45:0/2335780561 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1619376692 0 0) 0x7fd57c0734e0 con 0x7fd57c074c90 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.628+0000 7fd57affd640 10 monclient(hunting): _negotiate 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.628+0000 7fd57affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.628+0000 7fd57affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.628+0000 7fd57affd640 10 monclient(hunting): my global_id is 4653 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.628+0000 7fd57affd640 1 -- 10.20.193.45:0/2335780561 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd560003620 con 0x7fd57c074c90 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.629+0000 7fd58081d640 10 monclient(hunting): handle_auth_done global_id 4714 payload 274 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.629+0000 7fd58081d640 1 -- 10.20.193.45:0/2335780561 >> v1:10.20.193.86:6789/0 conn(0x7fd57c155e40 legacy=0x7fd57c074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.629+0000 7fd58081d640 1 -- 10.20.193.45:0/2335780561 >> v1:10.20.193.45:6789/0 conn(0x7fd57c074c90 legacy=0x7fd57c0ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:23.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.629+0000 7fd58081d640 10 monclient: _finish_hunting 0 2026-02-17T21:08:23.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.629+0000 7fd58081d640 1 monclient: found mon.noname-b 2026-02-17T21:08:23.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.629+0000 7fd58081d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:23.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.629+0000 7fd58081d640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:08:23.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.629+0000 7fd58081d640 1 -- 10.20.193.45:0/2335780561 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c073aa0 con 0x7fd57c156220 2026-02-17T21:08:23.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.630+0000 7fd58081d640 1 --2- 10.20.193.45:0/2335780561 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c156220 0x7fd57c1666d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd570009d90 tx=0x7fd57002f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3453859a5d836722 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:23.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 1 -- 10.20.193.45:0/2335780561 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57003c070 con 0x7fd57c156220 2026-02-17T21:08:23.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 10 monclient: dump: 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:23.631 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 10 monclient: _finish_auth 0 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 10 monclient: _check_auth_tickets 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd5822a7640 5 monclient: authenticate success, global_id 4714 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 1 -- 10.20.193.45:0/2335780561 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd570037440 con 0x7fd57c156220 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd5822a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 1 -- 10.20.193.45:0/2335780561 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570037810 con 0x7fd57c156220 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd5822a7640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd5822a7640 4 set_mon_vals no callback set 2026-02-17T21:08:23.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.632+0000 7fd57affd640 10 monclient: dump: 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:23.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.633+0000 7fd5822a7640 10 monclient: shutdown 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.633+0000 7fd5822a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.633+0000 7fd5822a7640 1 -- 10.20.193.45:0/2335780561 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c156220 msgr2=0x7fd57c1666d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.633+0000 7fd5822a7640 1 --2- 10.20.193.45:0/2335780561 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c156220 0x7fd57c1666d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd570009d90 tx=0x7fd57002f1e0 comp rx=0 tx=0).stop 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.633+0000 7fd5822a7640 1 -- 10.20.193.45:0/2335780561 shutdown_connections 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.633+0000 7fd5822a7640 1 --2- 10.20.193.45:0/2335780561 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c156220 0x7fd57c1666d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.633+0000 7fd5822a7640 1 -- 10.20.193.45:0/2335780561 >> 10.20.193.45:0/2335780561 conn(0x7fd57c0ce270 msgr2=0x7fd57c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.633+0000 7fd5822a7640 1 -- 10.20.193.45:0/2335780561 shutdown_connections 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.633+0000 7fd5822a7640 1 -- 10.20.193.45:0/2335780561 wait complete. 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient: build_initial_monmap 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient: monmap: 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:23.634 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 librados: starting msgr at 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 librados: starting objecter 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 Processor -- start 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 -- start start 2026-02-17T21:08:23.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 librados: setting wanted keys 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 librados: calling monclient init 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient: init 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c074c90 0x7fd57c157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient(hunting): picked mon.noname-b con 0x7fd57c074c90 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd57c155e40 0x7fd57c0c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient(hunting): picked mon.noname-a con 0x7fd57c155e40 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd57c156220 0x7fd57c1f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient(hunting): picked mon.noname-c con 0x7fd57c156220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c0c4830 con 0x7fd57c155e40 2026-02-17T21:08:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c074060 con 0x7fd57c074c90 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c0c49b0 con 0x7fd57c156220 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.634+0000 7fd5822a7640 10 monclient(hunting): authenticate will time out at 1087.265710s 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57b7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd57c155e40 0x7fd57c0c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c074c90 0x7fd57c157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c074c90 0x7fd57c157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:33486/0 (socket says 10.20.193.45:33486) 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 1 -- 10.20.193.45:0/176229406 learned_addr learned my addr 10.20.193.45:0/176229406 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 10 monclient(hunting): get_auth_request con 0x7fd57c074c90 auth_method 0 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:23.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57b7fe640 10 monclient(hunting): get_auth_request con 0x7fd57c155e40 auth_method 0 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd58081d640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd57c156220 0x7fd57c1f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd57b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd58081d640 10 monclient(hunting): get_auth_request con 0x7fd57c156220 auth_method 0 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd58081d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd58081d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd58081d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd58081d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd58081d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.635+0000 7fd58081d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 10 monclient(hunting): handle_auth_done global_id 4717 payload 824 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 1 -- 10.20.193.45:0/176229406 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd57c156220 msgr2=0x7fd57c1f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd57c156220 0x7fd57c1f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 1 -- 10.20.193.45:0/176229406 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd57c155e40 msgr2=0x7fd57c0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd57c155e40 0x7fd57c0c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:08:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 1 monclient: found mon.noname-b 2026-02-17T21:08:23.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:23.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:08:23.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.636+0000 7fd57bfff640 1 -- 10.20.193.45:0/176229406 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c0c6e40 con 0x7fd57c074c90 2026-02-17T21:08:23.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.637+0000 7fd57bfff640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c074c90 0x7fd57c157d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd56800b570 tx=0x7fd56800ba40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:23.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.637+0000 7fd578ff9640 10 client.?.objecter ms_handle_connect 0x7fd57c074c90 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.637+0000 7fd578ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 1 -- 10.20.193.45:0/176229406 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd568013020 con 0x7fd57c074c90 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 10 monclient: dump: 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:23.642 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 10 monclient: _finish_auth 0 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 1 -- 10.20.193.45:0/176229406 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5680044a0 con 0x7fd57c074c90 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 1 -- 10.20.193.45:0/176229406 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5680029c0 con 0x7fd57c074c90 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:08:23.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd578ff9640 10 monclient: dump: 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd57a7fc640 4 set_mon_vals no callback set 2026-02-17T21:08:23.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd5822a7640 5 monclient: authenticate success, global_id 4717 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd5822a7640 10 monclient: _renew_subs 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd5822a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57c0c7120 con 0x7fd57c074c90 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd5822a7640 10 client.4717.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd5822a7640 10 monclient: _renew_subs 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd5822a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd57c0c76e0 con 0x7fd57c074c90 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.639+0000 7fd5822a7640 1 librados: init done 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.640+0000 7fd5822a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.640+0000 7fd5822a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.640+0000 7fd5822a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:23.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.640+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57c074580 con 0x7fd57c074c90 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.651+0000 7fd578ff9640 1 -- 10.20.193.45:0/176229406 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fd568002b60 con 0x7fd57c074c90 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.651+0000 7fd578ff9640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd54c0792d0 0x7fd54c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.652+0000 7fd57b7fe640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd54c0792d0 0x7fd54c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.652+0000 7fd57b7fe640 10 monclient: get_auth_request con 0x7fd54c0792d0 auth_method 0 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.652+0000 7fd578ff9640 10 client.4717.objecter ms_handle_connect 0x7fd54c0792d0 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.652+0000 7fd57b7fe640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd54c0792d0 0x7fd54c07b790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd56c007b60 tx=0x7fd56c007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.653+0000 7fd578ff9640 1 -- 10.20.193.45:0/176229406 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fd56805e3e0 con 0x7fd57c074c90 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.653+0000 7fd578ff9640 10 client.4717.objecter ms_dispatch2 0x7fd57c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.653+0000 7fd578ff9640 3 client.4717.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.653+0000 7fd578ff9640 3 client.4717.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:23.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.653+0000 7fd578ff9640 20 client.4717.objecter dump_active .. 0 homeless 2026-02-17T21:08:23.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.757+0000 7fd578ff9640 1 -- 10.20.193.45:0/176229406 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd56801d020 con 0x7fd57c074c90 2026-02-17T21:08:23.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.757+0000 7fd578ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:23.751 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.757+0000 7fd578ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:23.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.857+0000 7fd5822a7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:23.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.857+0000 7fd5822a7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:23.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.857+0000 7fd5822a7640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:23.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.857+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd57c0cd360 con 0x7fd57c074c90 2026-02-17T21:08:23.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd578ff9640 1 -- 10.20.193.45:0/176229406 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fd5680623a0 con 0x7fd57c074c90 2026-02-17T21:08:23.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd578ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd578ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:23.854 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:23.854 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 10 librados: watch_flush enter 2026-02-17T21:08:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 10 librados: watch_flush exit 2026-02-17T21:08:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 20 client.4717.objecter shutdown clearing up homeless session... 2026-02-17T21:08:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 10 client.4717.objecter successfully canceled tick 2026-02-17T21:08:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd54c0792d0 msgr2=0x7fd54c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd54c0792d0 0x7fd54c07b790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd56c007b60 tx=0x7fd56c007ab0 comp rx=0 tx=0).stop 2026-02-17T21:08:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 10 monclient: shutdown 2026-02-17T21:08:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c074c90 msgr2=0x7fd57c157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c074c90 0x7fd57c157d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd56800b570 tx=0x7fd56800ba40 comp rx=0 tx=0).stop 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 shutdown_connections 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd54c0792d0 0x7fd54c07b790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd57c156220 0x7fd57c1f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd57c155e40 0x7fd57c0c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 --2- 10.20.193.45:0/176229406 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd57c074c90 0x7fd57c157d40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 >> 10.20.193.45:0/176229406 conn(0x7fd57c0ce270 msgr2=0x7fd57c0cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 shutdown_connections 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 -- 10.20.193.45:0/176229406 wait complete. 2026-02-17T21:08:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:23.861+0000 7fd5822a7640 1 librados: shutdown 2026-02-17T21:08:26.863 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:26.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.940+0000 7fbd73cae640 10 monclient: get_monmap_and_config 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.940+0000 7fbd73cae640 10 monclient: build_initial_monmap 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.940+0000 7fbd73cae640 10 monclient: monmap: 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:26.941328+0000 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:26.941328+0000 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:26.933 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:26.934 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:26.934 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:26.934 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:26.934 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:26.934 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:26.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.940+0000 7fbd73cae640 1 Processor -- start 2026-02-17T21:08:26.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 1 -- start start 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient: init 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient: _add_conns ranks=[5,2,3,4,0,1] 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fbd6c15d1e0 0x7fbd6c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient(hunting): picked mon.noname-c con 0x7fbd6c15d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fbd6c0748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fbd6c0c92b0 0x7fbd6c153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient(hunting): picked mon.noname-a con 0x7fbd6c0c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd6c0c5860 con 0x7fbd6c0748e0 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6c0c5580 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fbd6c0c7de0 con 0x7fbd6c15d1e0 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.941+0000 7fbd73cae640 10 monclient(hunting): authenticate will time out at 1090.571541s 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd71a23640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fbd6c15d1e0 0x7fbd6c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fbd6c0c92b0 0x7fbd6c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fbd6c0c92b0 0x7fbd6c153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:35470/0 (socket says 10.20.193.45:35470) 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 1 -- 10.20.193.45:0/2877191611 learned_addr learned my addr 10.20.193.45:0/2877191611 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 10 monclient(hunting): get_auth_request con 0x7fbd6c0c92b0 auth_method 0 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:26.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd71a23640 10 monclient(hunting): get_auth_request con 0x7fbd6c15d1e0 auth_method 0 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd71a23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd71a23640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd71a23640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd72224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd71a23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd71a23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.942+0000 7fbd71a23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.943+0000 7fbd72224640 10 monclient(hunting): handle_auth_done global_id 4659 payload 274 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.943+0000 7fbd72224640 1 -- 10.20.193.45:0/2877191611 >> v2:10.20.193.92:3300/0 conn(0x7fbd6c15d1e0 msgr2=0x7fbd6c15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.943+0000 7fbd72224640 1 --2- 10.20.193.45:0/2877191611 >> v2:10.20.193.92:3300/0 conn(0x7fbd6c15d1e0 0x7fbd6c15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:26.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.943+0000 7fbd72224640 1 -- 10.20.193.45:0/2877191611 >> v1:10.20.193.92:6789/0 conn(0x7fbd6c0748e0 legacy=0x7fbd6c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:26.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.943+0000 7fbd72224640 10 monclient: _finish_hunting 0 2026-02-17T21:08:26.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.943+0000 7fbd72224640 1 monclient: found mon.noname-a 2026-02-17T21:08:26.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.943+0000 7fbd72224640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:26.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.943+0000 7fbd72224640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:26.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.943+0000 7fbd72224640 1 -- 10.20.193.45:0/2877191611 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c0c80c0 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.944+0000 7fbd72224640 1 --2- 10.20.193.45:0/2877191611 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 0x7fbd6c153610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009e50 tx=0x7fbd6802f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ef3e365c03338 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:26.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 1 -- 10.20.193.45:0/2877191611 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6802fd60 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 10 monclient: dump: 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:26.947 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 10 monclient: _finish_auth 0 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 10 monclient: _check_auth_tickets 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd73cae640 5 monclient: authenticate success, global_id 4659 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 1 -- 10.20.193.45:0/2877191611 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd680373f0 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd73cae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 1 -- 10.20.193.45:0/2877191611 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd680377c0 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd70a21640 10 monclient: dump: 2026-02-17T21:08:26.948 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd73cae640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.946+0000 7fbd73cae640 4 set_mon_vals no callback set 2026-02-17T21:08:26.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 10 monclient: shutdown 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 -- 10.20.193.45:0/2877191611 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 msgr2=0x7fbd6c153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 --2- 10.20.193.45:0/2877191611 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 0x7fbd6c153610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009e50 tx=0x7fbd6802f2a0 comp rx=0 tx=0).stop 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 -- 10.20.193.45:0/2877191611 shutdown_connections 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 --2- 10.20.193.45:0/2877191611 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 0x7fbd6c153610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 --2- 10.20.193.45:0/2877191611 >> v2:10.20.193.92:3300/0 conn(0x7fbd6c15d1e0 0x7fbd6c15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 -- 10.20.193.45:0/2877191611 >> 10.20.193.45:0/2877191611 conn(0x7fbd6c0c9d40 msgr2=0x7fbd6c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 -- 10.20.193.45:0/2877191611 shutdown_connections 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 -- 10.20.193.45:0/2877191611 wait complete. 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 10 monclient: build_initial_monmap 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 10 monclient: monmap: 2026-02-17T21:08:26.950 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 librados: starting msgr at 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 librados: starting objecter 2026-02-17T21:08:26.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 Processor -- start 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 -- start start 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 librados: setting wanted keys 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 1 librados: calling monclient init 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.947+0000 7fbd73cae640 10 monclient: init 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbd6c0748e0 0x7fbd6c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient(hunting): picked mon.noname-c con 0x7fbd6c0748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 0x7fbd6c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient(hunting): picked mon.noname-a con 0x7fbd6c0c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbd6c15d1e0 0x7fbd6c06d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:26.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient(hunting): picked mon.noname-b con 0x7fbd6c15d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c074d30 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c0c8680 con 0x7fbd6c15d1e0 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6c153b50 con 0x7fbd6c0748e0 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd73cae640 10 monclient(hunting): authenticate will time out at 1090.578253s 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71222640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 0x7fbd6c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbd6c0748e0 0x7fbd6c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbd6c0748e0 0x7fbd6c154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:39850/0 (socket says 10.20.193.45:39850) 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 1 -- 10.20.193.45:0/2580543341 learned_addr learned my addr 10.20.193.45:0/2580543341 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:26.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 10 monclient(hunting): get_auth_request con 0x7fbd6c0748e0 auth_method 0 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71222640 10 monclient(hunting): get_auth_request con 0x7fbd6c0c92b0 auth_method 0 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71222640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71222640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd72224640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbd6c15d1e0 0x7fbd6c06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71a23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:26.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71222640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.948+0000 7fbd71222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.949+0000 7fbd72224640 10 monclient(hunting): get_auth_request con 0x7fbd6c15d1e0 auth_method 0 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.949+0000 7fbd72224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.949+0000 7fbd72224640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.949+0000 7fbd72224640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.949+0000 7fbd72224640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.949+0000 7fbd72224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.949+0000 7fbd72224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 10 monclient(hunting): handle_auth_done global_id 4662 payload 824 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 1 -- 10.20.193.45:0/2580543341 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbd6c0748e0 msgr2=0x7fbd6c154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbd6c0748e0 0x7fbd6c154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:26.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 1 -- 10.20.193.45:0/2580543341 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbd6c15d1e0 msgr2=0x7fbd6c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbd6c15d1e0 0x7fbd6c06d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 10 monclient: _finish_hunting 0 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 1 monclient: found mon.noname-a 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.950+0000 7fbd71222640 1 -- 10.20.193.45:0/2580543341 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd6c155920 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.951+0000 7fbd71222640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 0x7fbd6c1552e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000c480 tx=0x7fbd6000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.951+0000 7fbd5a7fc640 10 client.?.objecter ms_handle_connect 0x7fbd6c0c92b0 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.951+0000 7fbd5a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 1 -- 10.20.193.45:0/2580543341 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60017070 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 10 monclient: dump: 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:26.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 1 -- 10.20.193.45:0/2580543341 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd600052d0 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 1 -- 10.20.193.45:0/2580543341 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd600036f0 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5a7fc640 10 monclient: dump: 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:26.958 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd5bfff640 4 set_mon_vals no callback set 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 5 monclient: authenticate success, global_id 4662 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 10 monclient: _renew_subs 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd6c155c00 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 10 client.4662.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:26.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 10 monclient: _renew_subs 2026-02-17T21:08:26.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:26.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd6c1561c0 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 1 librados: init done 2026-02-17T21:08:26.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:26.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:26.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:26.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.953+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd6c153ee0 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.965+0000 7fbd5a7fc640 1 -- 10.20.193.45:0/2580543341 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fbd60003890 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.965+0000 7fbd5a7fc640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbd3c079280 0x7fbd3c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.965+0000 7fbd71a23640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbd3c079280 0x7fbd3c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.965+0000 7fbd71a23640 10 monclient: get_auth_request con 0x7fbd3c079280 auth_method 0 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.966+0000 7fbd5a7fc640 10 client.4662.objecter ms_handle_connect 0x7fbd3c079280 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.966+0000 7fbd71a23640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbd3c079280 0x7fbd3c07b740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009c60 tx=0x7fbd5c009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.967+0000 7fbd5a7fc640 1 -- 10.20.193.45:0/2580543341 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fbd6005d7d0 con 0x7fbd6c0c92b0 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.967+0000 7fbd5a7fc640 10 client.4662.objecter ms_dispatch2 0x7fbd6c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.967+0000 7fbd5a7fc640 3 client.4662.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.967+0000 7fbd5a7fc640 3 client.4662.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:26.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:26.967+0000 7fbd5a7fc640 20 client.4662.objecter dump_active .. 0 homeless 2026-02-17T21:08:27.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.073+0000 7fbd5a7fc640 1 -- 10.20.193.45:0/2580543341 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbd60021020 con 0x7fbd6c0c92b0 2026-02-17T21:08:27.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.073+0000 7fbd5a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:27.065 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.073+0000 7fbd5a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:27.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.175+0000 7fbd73cae640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:27.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.175+0000 7fbd73cae640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:27.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.175+0000 7fbd73cae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:27.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.175+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbd6c1573a0 con 0x7fbd6c0c92b0 2026-02-17T21:08:27.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.177+0000 7fbd5a7fc640 1 -- 10.20.193.45:0/2580543341 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbd60061790 con 0x7fbd6c0c92b0 2026-02-17T21:08:27.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.177+0000 7fbd5a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:27.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.177+0000 7fbd5a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:27.170 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:27.170 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:27.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 10 librados: watch_flush enter 2026-02-17T21:08:27.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 10 librados: watch_flush exit 2026-02-17T21:08:27.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 20 client.4662.objecter shutdown clearing up homeless session... 2026-02-17T21:08:27.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 10 client.4662.objecter successfully canceled tick 2026-02-17T21:08:27.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbd3c079280 msgr2=0x7fbd3c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:27.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbd3c079280 0x7fbd3c07b740 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009c60 tx=0x7fbd5c009290 comp rx=0 tx=0).stop 2026-02-17T21:08:27.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 10 monclient: shutdown 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 msgr2=0x7fbd6c1552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 0x7fbd6c1552e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000c480 tx=0x7fbd6000c950 comp rx=0 tx=0).stop 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 shutdown_connections 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbd3c079280 0x7fbd3c07b740 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbd6c15d1e0 0x7fbd6c06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbd6c0c92b0 0x7fbd6c1552e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 --2- 10.20.193.45:0/2580543341 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbd6c0748e0 0x7fbd6c154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 >> 10.20.193.45:0/2580543341 conn(0x7fbd6c0c9d40 msgr2=0x7fbd6c14df30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 shutdown_connections 2026-02-17T21:08:27.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.178+0000 7fbd73cae640 1 -- 10.20.193.45:0/2580543341 wait complete. 2026-02-17T21:08:27.174 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:27.179+0000 7fbd73cae640 1 librados: shutdown 2026-02-17T21:08:29.968 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:37.181 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:29.970 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:37.183 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:29.978 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:37.191 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:29.997 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:03:37.206 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:29.997 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:03:37.207 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:30.001 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:03:37.174 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:30.002 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:03:37.175 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:30.006 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:03:37.215 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:30.010 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:03:37.183 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:30.180 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:30.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.256+0000 7ff79ceb0640 10 monclient: get_monmap_and_config 2026-02-17T21:08:30.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.256+0000 7ff79ceb0640 10 monclient: build_initial_monmap 2026-02-17T21:08:30.248 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.256+0000 7ff79ceb0640 10 monclient: monmap: 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:30.257067+0000 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:30.257067+0000 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:30.249 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:30.250 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:30.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.256+0000 7ff79ceb0640 1 Processor -- start 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.256+0000 7ff79ceb0640 1 -- start start 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.256+0000 7ff79ceb0640 10 monclient: init 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 10 monclient: _add_conns ranks=[1,3,4,2,5,0] 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff79815d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff7980c92b0 0x7ff79815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 10 monclient(hunting): picked mon.noname-a con 0x7ff7980c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff7980748e0 0x7ff798153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 10 monclient(hunting): picked mon.noname-b con 0x7ff7980748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7980c5860 con 0x7ff79815d1e0 2026-02-17T21:08:30.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7ff7980c5580 con 0x7ff7980c92b0 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff7980c7de0 con 0x7ff7980748e0 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff79ceb0640 10 monclient(hunting): authenticate will time out at 1093.887301s 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff795d74640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff7980c92b0 0x7ff79815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.257+0000 7ff796d76640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff7980748e0 0x7ff798153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff795d74640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff7980c92b0 0x7ff79815d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:54296/0 (socket says 10.20.193.45:54296) 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff795d74640 1 -- 10.20.193.45:0/724404263 learned_addr learned my addr 10.20.193.45:0/724404263 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff795d74640 10 monclient(hunting): get_auth_request con 0x7ff7980c92b0 auth_method 0 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff795d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff795d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:30.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff795d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff796d76640 10 monclient(hunting): get_auth_request con 0x7ff7980748e0 auth_method 0 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff796d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff796d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff796d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff795d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff795d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff795d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff796d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff796d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.258+0000 7ff796d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.259+0000 7ff795d74640 10 monclient(hunting): handle_auth_done global_id 4665 payload 274 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.259+0000 7ff795d74640 1 -- 10.20.193.45:0/724404263 >> v2:10.20.193.86:3300/0 conn(0x7ff7980748e0 msgr2=0x7ff798153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:30.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.259+0000 7ff795d74640 1 --2- 10.20.193.45:0/724404263 >> v2:10.20.193.86:3300/0 conn(0x7ff7980748e0 0x7ff798153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.259+0000 7ff795d74640 1 -- 10.20.193.45:0/724404263 >> v1:10.20.193.86:6789/0 conn(0x7ff79815d1e0 legacy=0x7ff7980c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:30.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.259+0000 7ff795d74640 10 monclient: _finish_hunting 0 2026-02-17T21:08:30.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.259+0000 7ff795d74640 1 monclient: found mon.noname-a 2026-02-17T21:08:30.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.259+0000 7ff795d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:30.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.259+0000 7ff795d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:30.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.259+0000 7ff795d74640 1 -- 10.20.193.45:0/724404263 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7980c80c0 con 0x7ff7980c92b0 2026-02-17T21:08:30.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.260+0000 7ff795d74640 1 --2- 10.20.193.45:0/724404263 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff7980c92b0 0x7ff79815d5c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff780009970 tx=0x7ff78002eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcc0b5ca6cd98d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:30.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 1 -- 10.20.193.45:0/724404263 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78003c070 con 0x7ff7980c92b0 2026-02-17T21:08:30.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:30.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:30.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 10 monclient: dump: 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 10 monclient: _finish_auth 0 2026-02-17T21:08:30.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 10 monclient: _check_auth_tickets 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 1 -- 10.20.193.45:0/724404263 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff78002fb20 con 0x7ff7980c92b0 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff79ceb0640 5 monclient: authenticate success, global_id 4665 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 1 -- 10.20.193.45:0/724404263 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780037440 con 0x7ff7980c92b0 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff795573640 10 monclient: dump: 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:30.264 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff79ceb0640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.262+0000 7ff79ceb0640 4 set_mon_vals no callback set 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 10 monclient: shutdown 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 -- 10.20.193.45:0/724404263 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff7980c92b0 msgr2=0x7ff79815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:30.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 --2- 10.20.193.45:0/724404263 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff7980c92b0 0x7ff79815d5c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff780009970 tx=0x7ff78002eef0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 -- 10.20.193.45:0/724404263 shutdown_connections 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 --2- 10.20.193.45:0/724404263 >> v2:10.20.193.86:3300/0 conn(0x7ff7980748e0 0x7ff798153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 --2- 10.20.193.45:0/724404263 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff7980c92b0 0x7ff79815d5c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 -- 10.20.193.45:0/724404263 >> 10.20.193.45:0/724404263 conn(0x7ff7980c9d40 msgr2=0x7ff7980ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 -- 10.20.193.45:0/724404263 shutdown_connections 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 -- 10.20.193.45:0/724404263 wait complete. 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 10 monclient: build_initial_monmap 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 10 monclient: monmap: 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:30.266 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 librados: starting msgr at 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 librados: starting objecter 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 Processor -- start 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 -- start start 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 librados: setting wanted keys 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 1 librados: calling monclient init 2026-02-17T21:08:30.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.263+0000 7ff79ceb0640 10 monclient: init 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff7980748e0 0x7ff7981e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient(hunting): picked mon.noname-b con 0x7ff7980748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff7980c92b0 0x7ff79806e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient(hunting): picked mon.noname-c con 0x7ff7980c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff79815d1e0 0x7ff79806e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient(hunting): picked mon.noname-a con 0x7ff79815d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff798074d30 con 0x7ff79815d1e0 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff7980c8680 con 0x7ff7980748e0 2026-02-17T21:08:30.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff798153b50 con 0x7ff7980c92b0 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff79ceb0640 10 monclient(hunting): authenticate will time out at 1093.894380s 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff796d76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff79815d1e0 0x7ff79806e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff796d76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff79815d1e0 0x7ff79806e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:54310/0 (socket says 10.20.193.45:54310) 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff796d76640 1 -- 10.20.193.45:0/231217119 learned_addr learned my addr 10.20.193.45:0/231217119 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff796d76640 10 monclient(hunting): get_auth_request con 0x7ff79815d1e0 auth_method 0 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff796d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff796d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff796d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff795d74640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff7980c92b0 0x7ff79806e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:30.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.264+0000 7ff796575640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff7980748e0 0x7ff7981e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff795d74640 10 monclient(hunting): get_auth_request con 0x7ff7980c92b0 auth_method 0 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff795d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff795d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff795d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796575640 10 monclient(hunting): get_auth_request con 0x7ff7980748e0 auth_method 0 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff795d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:30.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff795d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff795d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.265+0000 7ff796575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 10 monclient(hunting): handle_auth_done global_id 4668 payload 824 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 1 -- 10.20.193.45:0/231217119 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff7980c92b0 msgr2=0x7ff79806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff7980c92b0 0x7ff79806e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 1 -- 10.20.193.45:0/231217119 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff7980748e0 msgr2=0x7ff7981e64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff7980748e0 0x7ff7981e64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 10 monclient: _finish_hunting 0 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 1 monclient: found mon.noname-a 2026-02-17T21:08:30.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.266+0000 7ff796d76640 1 -- 10.20.193.45:0/231217119 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7981e5170 con 0x7ff79815d1e0 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.267+0000 7ff796d76640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff79815d1e0 0x7ff79806e5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff78800efc0 tx=0x7ff78800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.267+0000 7ff77effd640 10 client.?.objecter ms_handle_connect 0x7ff79815d1e0 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.267+0000 7ff77effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 1 -- 10.20.193.45:0/231217119 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788018020 con 0x7ff79815d1e0 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 10 monclient: dump: 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:30.272 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 10 monclient: _finish_auth 0 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 10 monclient: _check_auth_tickets 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:30.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 1 -- 10.20.193.45:0/231217119 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff788014480 con 0x7ff79815d1e0 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 5 monclient: authenticate success, global_id 4668 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 10 monclient: _renew_subs 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7981e5450 con 0x7ff79815d1e0 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 1 -- 10.20.193.45:0/231217119 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff788014870 con 0x7ff79815d1e0 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff794d72640 4 set_mon_vals no callback set 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff77effd640 10 monclient: dump: 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:30.274 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 10 client.4668.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 10 monclient: _renew_subs 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7981e5a10 con 0x7ff79815d1e0 2026-02-17T21:08:30.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 1 librados: init done 2026-02-17T21:08:30.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:30.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:30.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:30.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.269+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7980c6320 con 0x7ff79815d1e0 2026-02-17T21:08:30.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.281+0000 7ff77effd640 1 -- 10.20.193.45:0/231217119 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff788014a10 con 0x7ff79815d1e0 2026-02-17T21:08:30.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.282+0000 7ff77effd640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff7640792d0 0x7ff76407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:30.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.282+0000 7ff796575640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff7640792d0 0x7ff76407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:30.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.282+0000 7ff796575640 10 monclient: get_auth_request con 0x7ff7640792d0 auth_method 0 2026-02-17T21:08:30.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.282+0000 7ff77effd640 10 client.4668.objecter ms_handle_connect 0x7ff7640792d0 2026-02-17T21:08:30.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.282+0000 7ff796575640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff7640792d0 0x7ff76407b790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff78c004680 tx=0x7ff78c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:30.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.283+0000 7ff77effd640 1 -- 10.20.193.45:0/231217119 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ff78805f200 con 0x7ff79815d1e0 2026-02-17T21:08:30.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.283+0000 7ff77effd640 10 client.4668.objecter ms_dispatch2 0x7ff798000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:30.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.283+0000 7ff77effd640 3 client.4668.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:30.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.283+0000 7ff77effd640 3 client.4668.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:30.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.283+0000 7ff77effd640 20 client.4668.objecter dump_active .. 0 homeless 2026-02-17T21:08:30.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.391+0000 7ff77effd640 1 -- 10.20.193.45:0/231217119 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff7980c6320 con 0x7ff79815d1e0 2026-02-17T21:08:30.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.391+0000 7ff77effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:30.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.391+0000 7ff77effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:30.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.494+0000 7ff79ceb0640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:30.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.494+0000 7ff79ceb0640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:30.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.494+0000 7ff79ceb0640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:30.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.494+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff798153f30 con 0x7ff79815d1e0 2026-02-17T21:08:30.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.497+0000 7ff77effd640 1 -- 10.20.193.45:0/231217119 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff788022070 con 0x7ff79815d1e0 2026-02-17T21:08:30.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.497+0000 7ff77effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:30.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.497+0000 7ff77effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:30.490 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:30.490 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:30.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 10 librados: watch_flush enter 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 10 librados: watch_flush exit 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 20 client.4668.objecter shutdown clearing up homeless session... 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 10 client.4668.objecter successfully canceled tick 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff7640792d0 msgr2=0x7ff76407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff7640792d0 0x7ff76407b790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff78c004680 tx=0x7ff78c009190 comp rx=0 tx=0).stop 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 10 monclient: shutdown 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff79815d1e0 msgr2=0x7ff79806e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff79815d1e0 0x7ff79806e5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff78800efc0 tx=0x7ff78800c490 comp rx=0 tx=0).stop 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 shutdown_connections 2026-02-17T21:08:30.492 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff7640792d0 0x7ff76407b790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff79815d1e0 0x7ff79806e5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff7980c92b0 0x7ff79806e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 --2- 10.20.193.45:0/231217119 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff7980748e0 0x7ff7981e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:30.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 >> 10.20.193.45:0/231217119 conn(0x7ff7980c9d40 msgr2=0x7ff7980ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:30.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 shutdown_connections 2026-02-17T21:08:30.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 -- 10.20.193.45:0/231217119 wait complete. 2026-02-17T21:08:30.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:30.498+0000 7ff79ceb0640 1 librados: shutdown 2026-02-17T21:08:33.501 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:33.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.578+0000 7f53a0432640 10 monclient: get_monmap_and_config 2026-02-17T21:08:33.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.578+0000 7f53a0432640 10 monclient: build_initial_monmap 2026-02-17T21:08:33.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.578+0000 7f53a0432640 10 monclient: monmap: 2026-02-17T21:08:33.571 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:33.571 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:33.579828+0000 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:33.579828+0000 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:33.572 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:33.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.579+0000 7f53a0432640 1 Processor -- start 2026-02-17T21:08:33.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.579+0000 7f53a0432640 1 -- start start 2026-02-17T21:08:33.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.579+0000 7f53a0432640 10 monclient: init 2026-02-17T21:08:33.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.579+0000 7f53a0432640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:33.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 10 monclient: _add_conns ranks=[5,3,2,4,0,1] 2026-02-17T21:08:33.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f539815d1e0 0x7f539815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:33.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 10 monclient(hunting): picked mon.noname-c con 0x7f539815d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:08:33.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f53980748e0 0x7f53980c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:33.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 10 monclient(hunting): picked mon.noname-a con 0x7f53980748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f53980c90e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53980c9570 con 0x7f53980c90e0 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f53980c5860 con 0x7f53980748e0 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f53980c5580 con 0x7f539815d1e0 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f53a0432640 10 monclient(hunting): authenticate will time out at 1097.210052s 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f539d9a6640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f53980748e0 0x7f53980c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f539d9a6640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f53980748e0 0x7f53980c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:54318/0 (socket says 10.20.193.45:54318) 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f539d9a6640 1 -- 10.20.193.45:0/573675072 learned_addr learned my addr 10.20.193.45:0/573675072 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:33.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f539d9a6640 10 monclient(hunting): get_auth_request con 0x7f53980748e0 auth_method 0 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f539d9a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f539d9a6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f539d9a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.580+0000 7f539e1a7640 1 --2- 10.20.193.45:0/573675072 >> v2:10.20.193.92:3300/0 conn(0x7f539815d1e0 0x7f539815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539e1a7640 10 monclient(hunting): get_auth_request con 0x7f539815d1e0 auth_method 0 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539e1a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539e1a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539e1a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:33.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539e1a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539e1a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539e1a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 10 monclient(hunting): handle_auth_done global_id 4671 payload 274 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 1 -- 10.20.193.45:0/573675072 >> v2:10.20.193.92:3300/0 conn(0x7f539815d1e0 msgr2=0x7f539815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 1 --2- 10.20.193.45:0/573675072 >> v2:10.20.193.92:3300/0 conn(0x7f539815d1e0 0x7f539815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 1 -- 10.20.193.45:0/573675072 >> v1:10.20.193.92:6789/0 conn(0x7f53980c90e0 legacy=0x7f5398153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 10 monclient: _finish_hunting 0 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 1 monclient: found mon.noname-a 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.581+0000 7f539d9a6640 1 -- 10.20.193.45:0/573675072 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53980c7de0 con 0x7f53980748e0 2026-02-17T21:08:33.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.582+0000 7f539d9a6640 1 --2- 10.20.193.45:0/573675072 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980748e0 0x7f53980c8ba0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f538c009970 tx=0x7f538c02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2103a3b06806e04 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:33.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 1 -- 10.20.193.45:0/573675072 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c03c070 con 0x7f53980748e0 2026-02-17T21:08:33.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:33.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 10 monclient: dump: 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:33.587 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 10 monclient: _finish_auth 0 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 10 monclient: _check_auth_tickets 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 1 -- 10.20.193.45:0/573675072 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538c02fbc0 con 0x7f53980748e0 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 1 -- 10.20.193.45:0/573675072 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c037440 con 0x7f53980748e0 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f53a0432640 5 monclient: authenticate success, global_id 4671 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f53a0432640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f53a0432640 4 set_mon_vals no callback set 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:33.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.584+0000 7f539d1a5640 10 monclient: dump: 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:33.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 10 monclient: shutdown 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 -- 10.20.193.45:0/573675072 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980748e0 msgr2=0x7f53980c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 --2- 10.20.193.45:0/573675072 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980748e0 0x7f53980c8ba0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f538c009970 tx=0x7f538c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 -- 10.20.193.45:0/573675072 shutdown_connections 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 --2- 10.20.193.45:0/573675072 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980748e0 0x7f53980c8ba0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 --2- 10.20.193.45:0/573675072 >> v2:10.20.193.92:3300/0 conn(0x7f539815d1e0 0x7f539815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 -- 10.20.193.45:0/573675072 >> 10.20.193.45:0/573675072 conn(0x7f53980c9d40 msgr2=0x7f53980ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 -- 10.20.193.45:0/573675072 shutdown_connections 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 -- 10.20.193.45:0/573675072 wait complete. 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 10 monclient: build_initial_monmap 2026-02-17T21:08:33.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 10 monclient: monmap: 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 librados: starting msgr at 2026-02-17T21:08:33.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.585+0000 7f53a0432640 1 librados: starting objecter 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 Processor -- start 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 -- start start 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 librados: setting wanted keys 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 librados: calling monclient init 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient: init 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f53980748e0 0x7f53981e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient(hunting): picked mon.noname-b con 0x7f53980748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980c90e0 0x7f53981e8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient(hunting): picked mon.noname-a con 0x7f53980c90e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:33.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f539815d1e0 0x7f539806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient(hunting): picked mon.noname-c con 0x7f539815d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f53980c8680 con 0x7f53980c90e0 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f53980c83a0 con 0x7f53980748e0 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5398074d30 con 0x7f539815d1e0 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f53a0432640 10 monclient(hunting): authenticate will time out at 1097.216474s 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f539d9a6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980c90e0 0x7f53981e8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f539d9a6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980c90e0 0x7f53981e8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:54324/0 (socket says 10.20.193.45:54324) 2026-02-17T21:08:33.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f539d9a6640 1 -- 10.20.193.45:0/3894184551 learned_addr learned my addr 10.20.193.45:0/3894184551 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f539d9a6640 10 monclient(hunting): get_auth_request con 0x7f53980c90e0 auth_method 0 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f539d9a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f539d9a6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f539d9a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f539e9a8640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f539815d1e0 0x7f539806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.586+0000 7f539e1a7640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f53980748e0 0x7f53981e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e9a8640 10 monclient(hunting): get_auth_request con 0x7f539815d1e0 auth_method 0 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e9a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e9a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e9a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e1a7640 10 monclient(hunting): get_auth_request con 0x7f53980748e0 auth_method 0 2026-02-17T21:08:33.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e1a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e1a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e1a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539d9a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539d9a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539d9a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e9a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e9a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e9a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e1a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e1a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.587+0000 7f539e1a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:33.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 10 monclient(hunting): handle_auth_done global_id 4674 payload 824 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 1 -- 10.20.193.45:0/3894184551 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f539815d1e0 msgr2=0x7f539806da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f539815d1e0 0x7f539806da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 1 -- 10.20.193.45:0/3894184551 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f53980748e0 msgr2=0x7f53981e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f53980748e0 0x7f53981e78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 10 monclient: _finish_hunting 0 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 1 monclient: found mon.noname-a 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.588+0000 7f539d9a6640 1 -- 10.20.193.45:0/3894184551 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53981e5a60 con 0x7f53980c90e0 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.589+0000 7f539d9a6640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980c90e0 0x7f53981e8810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f538c02f4a0 tx=0x7f538c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.589+0000 7f537effd640 10 client.?.objecter ms_handle_connect 0x7f53980c90e0 2026-02-17T21:08:33.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.589+0000 7f537effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 1 -- 10.20.193.45:0/3894184551 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c03c040 con 0x7f53980c90e0 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 10 monclient: dump: 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:33.597 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 10 monclient: _finish_auth 0 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 10 monclient: _check_auth_tickets 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 1 -- 10.20.193.45:0/3894184551 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538c042410 con 0x7f53980c90e0 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 5 monclient: authenticate success, global_id 4674 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 10 monclient: _renew_subs 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53981e5d40 con 0x7f53980c90e0 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:33.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 1 -- 10.20.193.45:0/3894184551 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c0427e0 con 0x7f53980c90e0 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f537effd640 10 monclient: dump: 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:33.599 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f539c9a4640 4 set_mon_vals no callback set 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 10 client.4674.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 10 monclient: _renew_subs 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539806d210 con 0x7f53980c90e0 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 1 librados: init done 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:33.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.591+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53980c8ba0 con 0x7f53980c90e0 2026-02-17T21:08:33.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.603+0000 7f537effd640 1 -- 10.20.193.45:0/3894184551 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f538c042980 con 0x7f53980c90e0 2026-02-17T21:08:33.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.603+0000 7f537effd640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f53680792b0 0x7f536807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:33.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.603+0000 7f539e1a7640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f53680792b0 0x7f536807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:33.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.603+0000 7f539e1a7640 10 monclient: get_auth_request con 0x7f53680792b0 auth_method 0 2026-02-17T21:08:33.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.604+0000 7f539e1a7640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f53680792b0 0x7f536807b770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5388009ba0 tx=0x7f5388009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:33.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.604+0000 7f537effd640 10 client.4674.objecter ms_handle_connect 0x7f53680792b0 2026-02-17T21:08:33.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.605+0000 7f537effd640 1 -- 10.20.193.45:0/3894184551 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f538c083a20 con 0x7f53980c90e0 2026-02-17T21:08:33.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.605+0000 7f537effd640 10 client.4674.objecter ms_dispatch2 0x7f5398000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:33.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.605+0000 7f537effd640 3 client.4674.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:33.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.605+0000 7f537effd640 3 client.4674.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:33.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.605+0000 7f537effd640 20 client.4674.objecter dump_active .. 0 homeless 2026-02-17T21:08:33.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.709+0000 7f537effd640 1 -- 10.20.193.45:0/3894184551 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f538c0879e0 con 0x7f53980c90e0 2026-02-17T21:08:33.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.709+0000 7f537effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:33.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.709+0000 7f537effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:33.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.810+0000 7f53a0432640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:33.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.810+0000 7f53a0432640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:33.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.810+0000 7f53a0432640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:33.802 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.810+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f53980c9b20 con 0x7f53980c90e0 2026-02-17T21:08:33.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.812+0000 7f537effd640 1 -- 10.20.193.45:0/3894184551 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f538c08bce0 con 0x7f53980c90e0 2026-02-17T21:08:33.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.812+0000 7f537effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:33.804 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.812+0000 7f537effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:33.804 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:33.804 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 10 librados: watch_flush enter 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 10 librados: watch_flush exit 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 20 client.4674.objecter shutdown clearing up homeless session... 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 10 client.4674.objecter successfully canceled tick 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f53680792b0 msgr2=0x7f536807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f53680792b0 0x7f536807b770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5388009ba0 tx=0x7f5388009290 comp rx=0 tx=0).stop 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 10 monclient: shutdown 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980c90e0 msgr2=0x7f53981e8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980c90e0 0x7f53981e8810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f538c02f4a0 tx=0x7f538c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 shutdown_connections 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f53680792b0 0x7f536807b770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f539815d1e0 0x7f539806da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f53980c90e0 0x7f53981e8810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 --2- 10.20.193.45:0/3894184551 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f53980748e0 0x7f53981e78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:33.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 >> 10.20.193.45:0/3894184551 conn(0x7f53980c9d40 msgr2=0x7f539814de90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:33.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 shutdown_connections 2026-02-17T21:08:33.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 -- 10.20.193.45:0/3894184551 wait complete. 2026-02-17T21:08:33.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:33.814+0000 7f53a0432640 1 librados: shutdown 2026-02-17T21:08:36.816 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:36.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.895+0000 7fea44334640 10 monclient: get_monmap_and_config 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.895+0000 7fea44334640 10 monclient: build_initial_monmap 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.895+0000 7fea44334640 10 monclient: monmap: 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:36.896053+0000 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:36.896053+0000 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:36.888 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:36.889 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:36.889 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:36.889 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:36.889 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:36.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.895+0000 7fea44334640 1 Processor -- start 2026-02-17T21:08:36.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.895+0000 7fea44334640 1 -- start start 2026-02-17T21:08:36.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.895+0000 7fea44334640 10 monclient: init 2026-02-17T21:08:36.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:36.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 10 monclient: _add_conns ranks=[4,3,1,0,2,5] 2026-02-17T21:08:36.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fea3c152620 0x7fea3c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:36.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 10 monclient(hunting): picked mon.noname-b con 0x7fea3c152620 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fea3c152a00 0x7fea3c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 10 monclient(hunting): picked mon.noname-a con 0x7fea3c152a00 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fea3c0c8d90 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea3c0c71a0 con 0x7fea3c0c8d90 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fea3c0c7760 con 0x7fea3c152a00 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fea3c0c7480 con 0x7fea3c152620 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea44334640 10 monclient(hunting): authenticate will time out at 1100.526254s 2026-02-17T21:08:36.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea418a8640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fea3c152a00 0x7fea3c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea420a9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fea3c152620 0x7fea3c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea418a8640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fea3c152a00 0x7fea3c15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:54338/0 (socket says 10.20.193.45:54338) 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea418a8640 1 -- 10.20.193.45:0/2662461294 learned_addr learned my addr 10.20.193.45:0/2662461294 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea418a8640 10 monclient(hunting): get_auth_request con 0x7fea3c152a00 auth_method 0 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea418a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea418a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea418a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea420a9640 10 monclient(hunting): get_auth_request con 0x7fea3c152620 auth_method 0 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea420a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea420a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.896+0000 7fea420a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:36.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea420a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea420a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea420a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 10 monclient(hunting): handle_auth_done global_id 4677 payload 274 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 1 -- 10.20.193.45:0/2662461294 >> v2:10.20.193.86:3300/0 conn(0x7fea3c152620 msgr2=0x7fea3c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 1 --2- 10.20.193.45:0/2662461294 >> v2:10.20.193.86:3300/0 conn(0x7fea3c152620 0x7fea3c15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 1 -- 10.20.193.45:0/2662461294 >> v1:10.20.193.86:6789/0 conn(0x7fea3c0c8d90 legacy=0x7fea3c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 10 monclient: _finish_hunting 0 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 1 monclient: found mon.noname-a 2026-02-17T21:08:36.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:36.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:36.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.897+0000 7fea418a8640 1 -- 10.20.193.45:0/2662461294 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3c159e00 con 0x7fea3c152a00 2026-02-17T21:08:36.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.898+0000 7fea418a8640 1 --2- 10.20.193.45:0/2662461294 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fea3c152a00 0x7fea3c15ae20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea3c1563b0 tx=0x7fea3002ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d948bd95082826e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:36.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 1 -- 10.20.193.45:0/2662461294 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3003c070 con 0x7fea3c152a00 2026-02-17T21:08:36.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 10 monclient: dump: 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:36.903 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 10 monclient: _finish_auth 0 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 10 monclient: _check_auth_tickets 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 1 -- 10.20.193.45:0/2662461294 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3002fb00 con 0x7fea3c152a00 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 5 monclient: authenticate success, global_id 4677 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 1 -- 10.20.193.45:0/2662461294 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30037440 con 0x7fea3c152a00 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 4 set_mon_vals no callback set 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:36.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea410a7640 10 monclient: dump: 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 10 monclient: shutdown 2026-02-17T21:08:36.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 1 -- 10.20.193.45:0/2662461294 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fea3c152a00 msgr2=0x7fea3c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 1 --2- 10.20.193.45:0/2662461294 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fea3c152a00 0x7fea3c15ae20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea3c1563b0 tx=0x7fea3002ee90 comp rx=0 tx=0).stop 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 1 -- 10.20.193.45:0/2662461294 shutdown_connections 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 1 --2- 10.20.193.45:0/2662461294 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fea3c152a00 0x7fea3c15ae20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 1 --2- 10.20.193.45:0/2662461294 >> v2:10.20.193.86:3300/0 conn(0x7fea3c152620 0x7fea3c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.900+0000 7fea44334640 1 -- 10.20.193.45:0/2662461294 >> 10.20.193.45:0/2662461294 conn(0x7fea3c0c9d40 msgr2=0x7fea3c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 1 -- 10.20.193.45:0/2662461294 shutdown_connections 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 1 -- 10.20.193.45:0/2662461294 wait complete. 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 10 monclient: build_initial_monmap 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 10 monclient: monmap: 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:36.906 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 1 librados: starting msgr at 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 1 librados: starting objecter 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 1 Processor -- start 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 1 -- start start 2026-02-17T21:08:36.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 1 librados: setting wanted keys 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 1 librados: calling monclient init 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.901+0000 7fea44334640 10 monclient: init 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fea3c0c8d90 0x7fea3c140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient(hunting): picked mon.noname-b con 0x7fea3c0c8d90 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fea3c152620 0x7fea3c156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient(hunting): picked mon.noname-c con 0x7fea3c152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fea3c152a00 0x7fea3c157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient(hunting): picked mon.noname-a con 0x7fea3c152a00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:36.908 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c0c5c90 con 0x7fea3c152a00 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c15a3c0 con 0x7fea3c0c8d90 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c0c5e10 con 0x7fea3c152620 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea44334640 10 monclient(hunting): authenticate will time out at 1100.532262s 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fea3c0c8d90 0x7fea3c140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea428aa640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fea3c152a00 0x7fea3c157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fea3c0c8d90 0x7fea3c140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:33470/0 (socket says 10.20.193.45:33470) 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea418a8640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fea3c152620 0x7fea3c156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 1 -- 10.20.193.45:0/2805044378 learned_addr learned my addr 10.20.193.45:0/2805044378 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 10 monclient(hunting): get_auth_request con 0x7fea3c0c8d90 auth_method 0 2026-02-17T21:08:36.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea428aa640 10 monclient(hunting): get_auth_request con 0x7fea3c152a00 auth_method 0 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea428aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea428aa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea428aa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea418a8640 10 monclient(hunting): get_auth_request con 0x7fea3c152620 auth_method 0 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea418a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea418a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea418a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:36.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea420a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea428aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea428aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.902+0000 7fea428aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.903+0000 7fea418a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.903+0000 7fea418a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.903+0000 7fea418a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 10 monclient(hunting): handle_auth_done global_id 4735 payload 824 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 1 -- 10.20.193.45:0/2805044378 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fea3c152620 msgr2=0x7fea3c156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fea3c152620 0x7fea3c156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 1 -- 10.20.193.45:0/2805044378 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fea3c152a00 msgr2=0x7fea3c157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fea3c152a00 0x7fea3c157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 10 monclient: _finish_hunting 0 2026-02-17T21:08:36.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 1 monclient: found mon.noname-b 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.904+0000 7fea420a9640 1 -- 10.20.193.45:0/2805044378 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3c1f88b0 con 0x7fea3c0c8d90 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.905+0000 7fea420a9640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fea3c0c8d90 0x7fea3c140fd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00ebe0 tx=0x7fea2c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.905+0000 7fea22ffd640 10 client.?.objecter ms_handle_connect 0x7fea3c0c8d90 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.905+0000 7fea22ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.906+0000 7fea22ffd640 1 -- 10.20.193.45:0/2805044378 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c017070 con 0x7fea3c0c8d90 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.906+0000 7fea22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.906+0000 7fea22ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.906+0000 7fea22ffd640 10 monclient: dump: 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:36.912 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.906+0000 7fea22ffd640 10 monclient: _finish_auth 0 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.906+0000 7fea22ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.906+0000 7fea22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.906+0000 7fea22ffd640 1 -- 10.20.193.45:0/2805044378 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea2c00cc40 con 0x7fea3c0c8d90 2026-02-17T21:08:36.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.906+0000 7fea22ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea22ffd640 1 -- 10.20.193.45:0/2805044378 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c013470 con 0x7fea3c0c8d90 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea22ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea408a6640 4 set_mon_vals no callback set 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea22ffd640 10 monclient: dump: 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:36.914 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 5 monclient: authenticate success, global_id 4735 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 10 monclient: _renew_subs 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea3c1f8b90 con 0x7fea3c0c8d90 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 10 client.4735.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 10 monclient: _renew_subs 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea3c1f9150 con 0x7fea3c0c8d90 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 1 librados: init done 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:36.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:36.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:36.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:36.907+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea3c0c9170 con 0x7fea3c0c8d90 2026-02-17T21:08:37.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.011+0000 7fea22ffd640 1 -- 10.20.193.45:0/2805044378 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fea2c013610 con 0x7fea3c0c8d90 2026-02-17T21:08:37.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.012+0000 7fea22ffd640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fea0c0792d0 0x7fea0c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:37.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.012+0000 7fea418a8640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fea0c0792d0 0x7fea0c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:37.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.012+0000 7fea418a8640 10 monclient: get_auth_request con 0x7fea0c0792d0 auth_method 0 2026-02-17T21:08:37.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.012+0000 7fea22ffd640 10 client.4735.objecter ms_handle_connect 0x7fea0c0792d0 2026-02-17T21:08:37.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.012+0000 7fea418a8640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fea0c0792d0 0x7fea0c07b790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea3c072110 tx=0x7fea30033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:37.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.013+0000 7fea22ffd640 1 -- 10.20.193.45:0/2805044378 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fea2c05e890 con 0x7fea3c0c8d90 2026-02-17T21:08:37.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.013+0000 7fea22ffd640 10 client.4735.objecter ms_dispatch2 0x7fea3c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:37.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.013+0000 7fea22ffd640 3 client.4735.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:37.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.013+0000 7fea22ffd640 3 client.4735.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:37.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.013+0000 7fea22ffd640 20 client.4735.objecter dump_active .. 0 homeless 2026-02-17T21:08:37.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.019+0000 7fea22ffd640 1 -- 10.20.193.45:0/2805044378 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fea2c062850 con 0x7fea3c0c8d90 2026-02-17T21:08:37.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.019+0000 7fea22ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:37.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.019+0000 7fea22ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:37.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.119+0000 7fea44334640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:37.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.119+0000 7fea44334640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:37.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.119+0000 7fea44334640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:08:37.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.119+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fea3c0ca640 con 0x7fea3c0c8d90 2026-02-17T21:08:37.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.121+0000 7fea22ffd640 1 -- 10.20.193.45:0/2805044378 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fea2c066b50 con 0x7fea3c0c8d90 2026-02-17T21:08:37.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.121+0000 7fea22ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:37.113 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.121+0000 7fea22ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:37.114 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:37.114 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:37.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 10 librados: watch_flush enter 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 10 librados: watch_flush exit 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 20 client.4735.objecter shutdown clearing up homeless session... 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 10 client.4735.objecter successfully canceled tick 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fea0c0792d0 msgr2=0x7fea0c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fea0c0792d0 0x7fea0c07b790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea3c072110 tx=0x7fea30033000 comp rx=0 tx=0).stop 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 10 monclient: shutdown 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fea3c0c8d90 msgr2=0x7fea3c140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fea3c0c8d90 0x7fea3c140fd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00ebe0 tx=0x7fea2c00c520 comp rx=0 tx=0).stop 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 shutdown_connections 2026-02-17T21:08:37.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fea0c0792d0 0x7fea0c07b790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:37.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fea3c152a00 0x7fea3c157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:37.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fea3c152620 0x7fea3c156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:37.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 --2- 10.20.193.45:0/2805044378 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fea3c0c8d90 0x7fea3c140fd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:37.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 >> 10.20.193.45:0/2805044378 conn(0x7fea3c0c9d40 msgr2=0x7fea3c14ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:37.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 shutdown_connections 2026-02-17T21:08:37.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 -- 10.20.193.45:0/2805044378 wait complete. 2026-02-17T21:08:37.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:37.122+0000 7fea44334640 1 librados: shutdown 2026-02-17T21:08:40.125 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:40.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.202+0000 7fedab9d6640 10 monclient: get_monmap_and_config 2026-02-17T21:08:40.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.202+0000 7fedab9d6640 10 monclient: build_initial_monmap 2026-02-17T21:08:40.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.202+0000 7fedab9d6640 10 monclient: monmap: 2026-02-17T21:08:40.195 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:40.195 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:40.195 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:40.202952+0000 2026-02-17T21:08:40.195 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:40.202952+0000 2026-02-17T21:08:40.195 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:40.195 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:40.195 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:40.196 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:40.196 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:40.196 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:40.196 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:40.196 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:40.196 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:40.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.202+0000 7fedab9d6640 1 Processor -- start 2026-02-17T21:08:40.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.202+0000 7fedab9d6640 1 -- start start 2026-02-17T21:08:40.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.202+0000 7fedab9d6640 10 monclient: init 2026-02-17T21:08:40.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:40.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 10 monclient: _add_conns ranks=[2,3,1,0,4,5] 2026-02-17T21:08:40.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7feda415d1e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7feda40c92b0 0x7feda415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 10 monclient(hunting): picked mon.noname-a con 0x7feda40c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7feda40748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda40c5860 con 0x7feda40748e0 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda40c5580 con 0x7feda415d1e0 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7feda40c7de0 con 0x7feda40c92b0 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7fedab9d6640 10 monclient(hunting): authenticate will time out at 1103.833111s 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7feda974b640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7feda415d1e0 0x7feda40c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:52240/0 (socket says 10.20.193.45:52240) 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7feda974b640 1 -- 10.20.193.45:0/135050261 learned_addr learned my addr 10.20.193.45:0/135050261 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:08:40.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7feda8f4a640 1 --2- 10.20.193.45:0/135050261 >> v2:10.20.193.45:3300/0 conn(0x7feda40c92b0 0x7feda415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7feda8f4a640 10 monclient(hunting): get_auth_request con 0x7feda40c92b0 auth_method 0 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7feda8f4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7feda8f4a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.203+0000 7feda8f4a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.204+0000 7feda8f4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.204+0000 7feda8f4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.204+0000 7feda8f4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.204+0000 7fed93fff640 1 -- 10.20.193.45:0/135050261 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319705110 0 0) 0x7feda40c5860 con 0x7feda40748e0 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.204+0000 7fed93fff640 10 monclient(hunting): _negotiate 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.204+0000 7fed93fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.204+0000 7fed93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:40.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.204+0000 7fed93fff640 10 monclient(hunting): my global_id is 4738 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.204+0000 7fed93fff640 1 -- 10.20.193.45:0/135050261 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed8c003620 con 0x7feda40748e0 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7fed93fff640 1 -- 10.20.193.45:0/135050261 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671103036 0 0) 0x7feda40c5580 con 0x7feda415d1e0 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7fed93fff640 10 monclient(hunting): _negotiate 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7fed93fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7fed93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7fed93fff640 10 monclient(hunting): my global_id is 4787 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7fed93fff640 1 -- 10.20.193.45:0/135050261 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda40c5860 con 0x7feda415d1e0 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7feda8f4a640 10 monclient(hunting): handle_auth_done global_id 4683 payload 274 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7feda8f4a640 1 -- 10.20.193.45:0/135050261 >> v1:10.20.193.92:6789/0 conn(0x7feda415d1e0 legacy=0x7feda40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7feda8f4a640 1 -- 10.20.193.45:0/135050261 >> v1:10.20.193.86:6789/0 conn(0x7feda40748e0 legacy=0x7feda4153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7feda8f4a640 10 monclient: _finish_hunting 0 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7feda8f4a640 1 monclient: found mon.noname-a 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7feda8f4a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:40.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7feda8f4a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:40.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.205+0000 7feda8f4a640 1 -- 10.20.193.45:0/135050261 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda40c80c0 con 0x7feda40c92b0 2026-02-17T21:08:40.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.206+0000 7feda8f4a640 1 --2- 10.20.193.45:0/135050261 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda40c92b0 0x7feda415d5c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fed980098d0 tx=0x7fed9802eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916f05b3da0522c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:40.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 1 -- 10.20.193.45:0/135050261 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9803c070 con 0x7feda40c92b0 2026-02-17T21:08:40.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:40.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:40.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 10 monclient: dump: 2026-02-17T21:08:40.209 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:40.209 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:40.209 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 10 monclient: _finish_auth 0 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 10 monclient: _check_auth_tickets 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 1 -- 10.20.193.45:0/135050261 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed9802fba0 con 0x7feda40c92b0 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:40.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 1 -- 10.20.193.45:0/135050261 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98037440 con 0x7feda40c92b0 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fedab9d6640 5 monclient: authenticate success, global_id 4683 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fedab9d6640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fedab9d6640 4 set_mon_vals no callback set 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.207+0000 7fed93fff640 10 monclient: dump: 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:40.211 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 10 monclient: shutdown 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 -- 10.20.193.45:0/135050261 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda40c92b0 msgr2=0x7feda415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 --2- 10.20.193.45:0/135050261 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda40c92b0 0x7feda415d5c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fed980098d0 tx=0x7fed9802eed0 comp rx=0 tx=0).stop 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 -- 10.20.193.45:0/135050261 shutdown_connections 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 --2- 10.20.193.45:0/135050261 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda40c92b0 0x7feda415d5c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 -- 10.20.193.45:0/135050261 >> 10.20.193.45:0/135050261 conn(0x7feda40c9d40 msgr2=0x7feda40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 -- 10.20.193.45:0/135050261 shutdown_connections 2026-02-17T21:08:40.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 -- 10.20.193.45:0/135050261 wait complete. 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 10 monclient: build_initial_monmap 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 10 monclient: monmap: 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:40.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 librados: starting msgr at 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 librados: starting objecter 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.208+0000 7fedab9d6640 1 Processor -- start 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 1 -- start start 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 1 librados: setting wanted keys 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 1 librados: calling monclient init 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient: init 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7feda40748e0 0x7feda40ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient(hunting): picked mon.noname-b con 0x7feda40748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feda40c92b0 0x7feda4140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient(hunting): picked mon.noname-c con 0x7feda40c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:40.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda415d1e0 0x7feda4145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient(hunting): picked mon.noname-a con 0x7feda415d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7feda4074d30 con 0x7feda415d1e0 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7feda40c8680 con 0x7feda40748e0 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7feda4153d20 con 0x7feda40c92b0 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7fedab9d6640 10 monclient(hunting): authenticate will time out at 1103.839483s 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda9f4c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda415d1e0 0x7feda4145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda8f4a640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feda40c92b0 0x7feda4140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda974b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7feda40748e0 0x7feda40ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:40.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda974b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7feda40748e0 0x7feda40ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:58334/0 (socket says 10.20.193.45:58334) 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda974b640 1 -- 10.20.193.45:0/852451846 learned_addr learned my addr 10.20.193.45:0/852451846 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda974b640 10 monclient(hunting): get_auth_request con 0x7feda40748e0 auth_method 0 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda974b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda974b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda974b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda9f4c640 10 monclient(hunting): get_auth_request con 0x7feda415d1e0 auth_method 0 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda9f4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda9f4c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda9f4c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda8f4a640 10 monclient(hunting): get_auth_request con 0x7feda40c92b0 auth_method 0 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda8f4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:40.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda8f4a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.209+0000 7feda8f4a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.210+0000 7feda974b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.210+0000 7feda974b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.210+0000 7feda974b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.210+0000 7feda9f4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.210+0000 7feda9f4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.210+0000 7feda9f4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.210+0000 7feda8f4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.210+0000 7feda8f4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.210+0000 7feda8f4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 10 monclient(hunting): handle_auth_done global_id 4686 payload 824 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 1 -- 10.20.193.45:0/852451846 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feda40c92b0 msgr2=0x7feda4140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:40.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feda40c92b0 0x7feda4140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 1 -- 10.20.193.45:0/852451846 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7feda40748e0 msgr2=0x7feda40ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7feda40748e0 0x7feda40ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 10 monclient: _finish_hunting 0 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 1 monclient: found mon.noname-a 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.211+0000 7feda9f4c640 1 -- 10.20.193.45:0/852451846 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda4145220 con 0x7feda415d1e0 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.212+0000 7feda9f4c640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda415d1e0 0x7feda4145d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feda000cbf0 tx=0x7feda000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.212+0000 7fed91ffb640 10 client.?.objecter ms_handle_connect 0x7feda415d1e0 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.212+0000 7fed91ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 1 -- 10.20.193.45:0/852451846 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda000ce10 con 0x7feda415d1e0 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:40.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 10 monclient: dump: 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 10 monclient: _finish_auth 0 2026-02-17T21:08:40.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 1 -- 10.20.193.45:0/852451846 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda0003a70 con 0x7feda415d1e0 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 1 -- 10.20.193.45:0/852451846 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0003e60 con 0x7feda415d1e0 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed937fe640 4 set_mon_vals no callback set 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fed91ffb640 10 monclient: dump: 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:40.220 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fedab9d6640 5 monclient: authenticate success, global_id 4686 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fedab9d6640 10 monclient: _renew_subs 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fedab9d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:40.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda40cbc90 con 0x7feda415d1e0 2026-02-17T21:08:40.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fedab9d6640 10 client.4686.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:40.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fedab9d6640 10 monclient: _renew_subs 2026-02-17T21:08:40.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fedab9d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:40.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda40cc250 con 0x7feda415d1e0 2026-02-17T21:08:40.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.214+0000 7fedab9d6640 1 librados: init done 2026-02-17T21:08:40.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.215+0000 7fedab9d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:40.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.215+0000 7fedab9d6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:40.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.215+0000 7fedab9d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:40.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.215+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda415d5c0 con 0x7feda415d1e0 2026-02-17T21:08:40.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.323+0000 7fed91ffb640 1 -- 10.20.193.45:0/852451846 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7feda00050d0 con 0x7feda415d1e0 2026-02-17T21:08:40.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.324+0000 7fed91ffb640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fed740792b0 0x7fed7407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:40.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.324+0000 7feda974b640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fed740792b0 0x7fed7407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:40.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.324+0000 7feda974b640 10 monclient: get_auth_request con 0x7fed740792b0 auth_method 0 2026-02-17T21:08:40.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.324+0000 7fed91ffb640 10 client.4686.objecter ms_handle_connect 0x7fed740792b0 2026-02-17T21:08:40.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.324+0000 7feda974b640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fed740792b0 0x7fed7407b770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fed94005980 tx=0x7fed94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:40.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.332+0000 7fed91ffb640 1 -- 10.20.193.45:0/852451846 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7feda005e9d0 con 0x7feda415d1e0 2026-02-17T21:08:40.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.332+0000 7fed91ffb640 10 client.4686.objecter ms_dispatch2 0x7feda4000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:40.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.332+0000 7fed91ffb640 3 client.4686.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:40.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.332+0000 7fed91ffb640 3 client.4686.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:40.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.332+0000 7fed91ffb640 20 client.4686.objecter dump_active .. 0 homeless 2026-02-17T21:08:40.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.332+0000 7fed91ffb640 1 -- 10.20.193.45:0/852451846 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feda0062990 con 0x7feda415d1e0 2026-02-17T21:08:40.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.332+0000 7fed91ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:40.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.332+0000 7fed91ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:40.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.431+0000 7fedab9d6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:40.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.431+0000 7fedab9d6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:40.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.431+0000 7fedab9d6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:40.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.431+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feda41573a0 con 0x7feda415d1e0 2026-02-17T21:08:40.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.434+0000 7fed91ffb640 1 -- 10.20.193.45:0/852451846 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7feda0067e20 con 0x7feda415d1e0 2026-02-17T21:08:40.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.434+0000 7fed91ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:40.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.434+0000 7fed91ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:40.427 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:40.428 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:40.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 10 librados: watch_flush enter 2026-02-17T21:08:40.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 10 librados: watch_flush exit 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 20 client.4686.objecter shutdown clearing up homeless session... 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 10 client.4686.objecter successfully canceled tick 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fed740792b0 msgr2=0x7fed7407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fed740792b0 0x7fed7407b770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fed94005980 tx=0x7fed94009040 comp rx=0 tx=0).stop 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 10 monclient: shutdown 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda415d1e0 msgr2=0x7feda4145d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda415d1e0 0x7feda4145d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feda000cbf0 tx=0x7feda000a430 comp rx=0 tx=0).stop 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 shutdown_connections 2026-02-17T21:08:40.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fed740792b0 0x7fed7407b770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:40.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7feda415d1e0 0x7feda4145d90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:40.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feda40c92b0 0x7feda4140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:40.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 --2- 10.20.193.45:0/852451846 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7feda40748e0 0x7feda40ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:40.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 >> 10.20.193.45:0/852451846 conn(0x7feda40c9d40 msgr2=0x7feda414db20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:40.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 shutdown_connections 2026-02-17T21:08:40.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 -- 10.20.193.45:0/852451846 wait complete. 2026-02-17T21:08:40.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:40.436+0000 7fedab9d6640 1 librados: shutdown 2026-02-17T21:08:43.437 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:43.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.516+0000 7f50c7bd5640 10 monclient: get_monmap_and_config 2026-02-17T21:08:43.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.516+0000 7f50c7bd5640 10 monclient: build_initial_monmap 2026-02-17T21:08:43.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.516+0000 7f50c7bd5640 10 monclient: monmap: 2026-02-17T21:08:43.509 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:43.509 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:43.509 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:43.517173+0000 2026-02-17T21:08:43.509 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:43.517173+0000 2026-02-17T21:08:43.509 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.516+0000 7f50c7bd5640 1 Processor -- start 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.516+0000 7f50c7bd5640 1 -- start start 2026-02-17T21:08:43.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.516+0000 7f50c7bd5640 10 monclient: init 2026-02-17T21:08:43.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:43.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 10 monclient: _add_conns ranks=[5,0,4,3,1,2] 2026-02-17T21:08:43.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f50c015d1e0 0x7f50c015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:43.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 10 monclient(hunting): picked mon.noname-c con 0x7f50c015d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:08:43.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f50c00748e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:08:43.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f50c00c92b0 0x7f50c0153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:43.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 10 monclient(hunting): picked mon.noname-b con 0x7f50c00c92b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:43.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c00c5860 con 0x7f50c00748e0 2026-02-17T21:08:43.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f50c00c5580 con 0x7f50c00c92b0 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f50c00c7de0 con 0x7f50c015d1e0 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c7bd5640 10 monclient(hunting): authenticate will time out at 1107.147326s 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c5149640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f50c00748e0 0x7f50c00c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:46258/0 (socket says 10.20.193.45:46258) 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c5149640 1 -- 10.20.193.45:0/3897575409 learned_addr learned my addr 10.20.193.45:0/3897575409 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c594a640 1 --2- 10.20.193.45:0/3897575409 >> v2:10.20.193.92:3300/0 conn(0x7f50c015d1e0 0x7f50c015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c614b640 1 --2- 10.20.193.45:0/3897575409 >> v2:10.20.193.86:3300/0 conn(0x7f50c00c92b0 0x7f50c0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c594a640 10 monclient(hunting): get_auth_request con 0x7f50c015d1e0 auth_method 0 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c594a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:43.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c594a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c594a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c614b640 10 monclient(hunting): get_auth_request con 0x7f50c00c92b0 auth_method 0 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c614b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c614b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.517+0000 7f50c614b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.518+0000 7f50c594a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.518+0000 7f50c594a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.518+0000 7f50c594a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.518+0000 7f50c614b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.518+0000 7f50c614b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.518+0000 7f50c614b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:43.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c4948640 1 -- 10.20.193.45:0/3897575409 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2217131470 0 0) 0x7f50c00c5860 con 0x7f50c00748e0 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c4948640 10 monclient(hunting): _negotiate 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c4948640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c4948640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c4948640 10 monclient(hunting): my global_id is 4689 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c4948640 1 -- 10.20.193.45:0/3897575409 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50a8003620 con 0x7f50c00748e0 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c614b640 10 monclient(hunting): handle_auth_done global_id 4744 payload 274 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c614b640 1 -- 10.20.193.45:0/3897575409 >> v2:10.20.193.92:3300/0 conn(0x7f50c015d1e0 msgr2=0x7f50c015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c614b640 1 --2- 10.20.193.45:0/3897575409 >> v2:10.20.193.92:3300/0 conn(0x7f50c015d1e0 0x7f50c015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c614b640 1 -- 10.20.193.45:0/3897575409 >> v1:10.20.193.45:6789/0 conn(0x7f50c00748e0 legacy=0x7f50c00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c614b640 10 monclient: _finish_hunting 0 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c614b640 1 monclient: found mon.noname-b 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c614b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:43.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c614b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.519+0000 7f50c614b640 1 -- 10.20.193.45:0/3897575409 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c00c80c0 con 0x7f50c00c92b0 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.520+0000 7f50c614b640 1 --2- 10.20.193.45:0/3897575409 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00c92b0 0x7f50c0153610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009d90 tx=0x7f50bc02f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a086626bab38276c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.521+0000 7f50c4948640 1 -- 10.20.193.45:0/3897575409 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc03c070 con 0x7f50c00c92b0 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.521+0000 7f50c4948640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.521+0000 7f50c4948640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.521+0000 7f50c4948640 10 monclient: dump: 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:43.518 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:43.519 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:43.519 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:43.519 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:43.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.521+0000 7f50c4948640 10 monclient: _finish_auth 0 2026-02-17T21:08:43.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.521+0000 7f50c4948640 10 monclient: _check_auth_tickets 2026-02-17T21:08:43.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.521+0000 7f50c4948640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:43.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.521+0000 7f50c7bd5640 5 monclient: authenticate success, global_id 4744 2026-02-17T21:08:43.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.521+0000 7f50c7bd5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:43.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c4948640 1 -- 10.20.193.45:0/3897575409 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc037440 con 0x7f50c00c92b0 2026-02-17T21:08:43.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c4948640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:43.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c4948640 1 -- 10.20.193.45:0/3897575409 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0377f0 con 0x7f50c00c92b0 2026-02-17T21:08:43.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c4948640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:43.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c4948640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c4948640 10 monclient: dump: 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:43.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 4 set_mon_vals no callback set 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 10 monclient: shutdown 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 1 -- 10.20.193.45:0/3897575409 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00c92b0 msgr2=0x7f50c0153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 1 --2- 10.20.193.45:0/3897575409 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00c92b0 0x7f50c0153610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009d90 tx=0x7f50bc02f1e0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 1 -- 10.20.193.45:0/3897575409 shutdown_connections 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 1 --2- 10.20.193.45:0/3897575409 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00c92b0 0x7f50c0153610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 1 --2- 10.20.193.45:0/3897575409 >> v2:10.20.193.92:3300/0 conn(0x7f50c015d1e0 0x7f50c015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 1 -- 10.20.193.45:0/3897575409 >> 10.20.193.45:0/3897575409 conn(0x7f50c00c9d40 msgr2=0x7f50c00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 1 -- 10.20.193.45:0/3897575409 shutdown_connections 2026-02-17T21:08:43.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.522+0000 7f50c7bd5640 1 -- 10.20.193.45:0/3897575409 wait complete. 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient: build_initial_monmap 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient: monmap: 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:43.528 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 librados: starting msgr at 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 librados: starting objecter 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 Processor -- start 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 -- start start 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 librados: setting wanted keys 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 librados: calling monclient init 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient: init 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00748e0 0x7f50c01f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient(hunting): picked mon.noname-b con 0x7f50c00748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f50c00c92b0 0x7f50c01f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient(hunting): picked mon.noname-c con 0x7f50c00c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:43.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f50c015d1e0 0x7f50c0152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient(hunting): picked mon.noname-a con 0x7f50c015d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0074d30 con 0x7f50c015d1e0 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00c8680 con 0x7f50c00748e0 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0153b50 con 0x7f50c00c92b0 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.523+0000 7f50c7bd5640 10 monclient(hunting): authenticate will time out at 1107.153732s 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00748e0 0x7f50c01f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c614b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f50c015d1e0 0x7f50c0152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c5149640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f50c00c92b0 0x7f50c01f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:43.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00748e0 0x7f50c01f2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:58358/0 (socket says 10.20.193.45:58358) 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 1 -- 10.20.193.45:0/2421216093 learned_addr learned my addr 10.20.193.45:0/2421216093 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 10 monclient(hunting): get_auth_request con 0x7f50c00748e0 auth_method 0 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c614b640 10 monclient(hunting): get_auth_request con 0x7f50c015d1e0 auth_method 0 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c614b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c614b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c614b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c5149640 10 monclient(hunting): get_auth_request con 0x7f50c00c92b0 auth_method 0 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c5149640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:43.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c5149640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c5149640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c594a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c614b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c614b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c614b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c5149640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c5149640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.524+0000 7f50c5149640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 10 monclient(hunting): handle_auth_done global_id 4692 payload 824 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 1 -- 10.20.193.45:0/2421216093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f50c00c92b0 msgr2=0x7f50c01f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:43.532 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f50c00c92b0 0x7f50c01f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 1 -- 10.20.193.45:0/2421216093 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00748e0 msgr2=0x7f50c01f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00748e0 0x7f50c01f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 10 monclient: _finish_hunting 0 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 1 monclient: found mon.noname-a 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.525+0000 7f50c614b640 1 -- 10.20.193.45:0/2421216093 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c01f2f60 con 0x7f50c015d1e0 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.527+0000 7f50c614b640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f50c015d1e0 0x7f50c0152a10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f50c00c6500 tx=0x7f50bc004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.527+0000 7f50ae7fc640 10 client.?.objecter ms_handle_connect 0x7f50c015d1e0 2026-02-17T21:08:43.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.527+0000 7f50ae7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 1 -- 10.20.193.45:0/2421216093 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc03c050 con 0x7f50c015d1e0 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 10 monclient: dump: 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:43.534 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 10 monclient: _finish_auth 0 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 1 -- 10.20.193.45:0/2421216093 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc03d040 con 0x7f50c015d1e0 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 1 -- 10.20.193.45:0/2421216093 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc009450 con 0x7f50c015d1e0 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50ae7fc640 10 monclient: dump: 2026-02-17T21:08:43.535 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50affff640 4 set_mon_vals no callback set 2026-02-17T21:08:43.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50c7bd5640 5 monclient: authenticate success, global_id 4692 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50c7bd5640 10 monclient: _renew_subs 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50c7bd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.528+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c0155bc0 con 0x7f50c015d1e0 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.529+0000 7f50c7bd5640 10 client.4692.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.529+0000 7f50c7bd5640 10 monclient: _renew_subs 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.529+0000 7f50c7bd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.529+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c0156180 con 0x7f50c015d1e0 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.529+0000 7f50c7bd5640 1 librados: init done 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.529+0000 7f50c7bd5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.529+0000 7f50c7bd5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.529+0000 7f50c7bd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:43.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.529+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c00c6870 con 0x7f50c015d1e0 2026-02-17T21:08:43.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.540+0000 7f50ae7fc640 1 -- 10.20.193.45:0/2421216093 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f50bc004040 con 0x7f50c015d1e0 2026-02-17T21:08:43.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.541+0000 7f50ae7fc640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50900792d0 0x7f509007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:43.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.541+0000 7f50c594a640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50900792d0 0x7f509007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:43.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.541+0000 7f50c594a640 10 monclient: get_auth_request con 0x7f50900792d0 auth_method 0 2026-02-17T21:08:43.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.541+0000 7f50c594a640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50900792d0 0x7f509007b790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009c60 tx=0x7f50b0009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:43.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.541+0000 7f50ae7fc640 10 client.4692.objecter ms_handle_connect 0x7f50900792d0 2026-02-17T21:08:43.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.543+0000 7f50ae7fc640 1 -- 10.20.193.45:0/2421216093 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f50bc037db0 con 0x7f50c015d1e0 2026-02-17T21:08:43.539 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.543+0000 7f50ae7fc640 10 client.4692.objecter ms_dispatch2 0x7f50c0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:43.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.543+0000 7f50ae7fc640 3 client.4692.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:43.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.543+0000 7f50ae7fc640 3 client.4692.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:43.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.543+0000 7f50ae7fc640 20 client.4692.objecter dump_active .. 0 homeless 2026-02-17T21:08:43.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.646+0000 7f50ae7fc640 1 -- 10.20.193.45:0/2421216093 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f50c00c6870 con 0x7f50c015d1e0 2026-02-17T21:08:43.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.646+0000 7f50ae7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:43.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.646+0000 7f50ae7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:43.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.746+0000 7f50c7bd5640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:43.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.746+0000 7f50c7bd5640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:43.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.746+0000 7f50c7bd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:43.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.746+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f50c0153f30 con 0x7f50c015d1e0 2026-02-17T21:08:43.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.748+0000 7f50ae7fc640 1 -- 10.20.193.45:0/2421216093 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f50bc087e20 con 0x7f50c015d1e0 2026-02-17T21:08:43.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.748+0000 7f50ae7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:43.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.748+0000 7f50ae7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:43.741 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:43.741 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:43.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 10 librados: watch_flush enter 2026-02-17T21:08:43.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 10 librados: watch_flush exit 2026-02-17T21:08:43.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 20 client.4692.objecter shutdown clearing up homeless session... 2026-02-17T21:08:43.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 10 client.4692.objecter successfully canceled tick 2026-02-17T21:08:43.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50900792d0 msgr2=0x7f509007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:43.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50900792d0 0x7f509007b790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009c60 tx=0x7f50b0009290 comp rx=0 tx=0).stop 2026-02-17T21:08:43.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 10 monclient: shutdown 2026-02-17T21:08:43.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f50c015d1e0 msgr2=0x7f50c0152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f50c015d1e0 0x7f50c0152a10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f50c00c6500 tx=0x7f50bc004b40 comp rx=0 tx=0).stop 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 shutdown_connections 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50900792d0 0x7f509007b790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f50c015d1e0 0x7f50c0152a10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f50c00c92b0 0x7f50c01f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 --2- 10.20.193.45:0/2421216093 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f50c00748e0 0x7f50c01f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 >> 10.20.193.45:0/2421216093 conn(0x7f50c00c9d40 msgr2=0x7f50c01533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 shutdown_connections 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 -- 10.20.193.45:0/2421216093 wait complete. 2026-02-17T21:08:43.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:43.750+0000 7f50c7bd5640 1 librados: shutdown 2026-02-17T21:08:46.752 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.828+0000 7f25d38a9640 10 monclient: get_monmap_and_config 2026-02-17T21:08:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.828+0000 7f25d38a9640 10 monclient: build_initial_monmap 2026-02-17T21:08:46.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.828+0000 7f25d38a9640 10 monclient: monmap: 2026-02-17T21:08:46.821 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:46.821 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:46.821 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:46.829331+0000 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:46.829331+0000 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.828+0000 7f25d38a9640 1 Processor -- start 2026-02-17T21:08:46.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.828+0000 7f25d38a9640 1 -- start start 2026-02-17T21:08:46.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.828+0000 7f25d38a9640 10 monclient: init 2026-02-17T21:08:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 10 monclient: _add_conns ranks=[3,2,4,1,0,5] 2026-02-17T21:08:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f25cc15d1e0 0x7f25cc15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 10 monclient(hunting): picked mon.noname-a con 0x7f25cc15d1e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f25cc0748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:08:46.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f25cc0c92b0 0x7f25cc153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 10 monclient(hunting): picked mon.noname-b con 0x7f25cc0c92b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25cc0c5860 con 0x7f25cc0748e0 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc0c5580 con 0x7f25cc15d1e0 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc0c7de0 con 0x7f25cc0c92b0 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d38a9640 10 monclient(hunting): authenticate will time out at 1110.459523s 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d0e1d640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f25cc0748e0 0x7f25cc0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:52254/0 (socket says 10.20.193.45:52254) 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d0e1d640 1 -- 10.20.193.45:0/2486901999 learned_addr learned my addr 10.20.193.45:0/2486901999 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:08:46.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.829+0000 7f25d1e1f640 1 --2- 10.20.193.45:0/2486901999 >> v2:10.20.193.86:3300/0 conn(0x7f25cc0c92b0 0x7f25cc153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.830+0000 7f25d1e1f640 10 monclient(hunting): get_auth_request con 0x7f25cc0c92b0 auth_method 0 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.830+0000 7f25d1e1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.830+0000 7f25d1e1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.830+0000 7f25d1e1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.830+0000 7f25d1e1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.830+0000 7f25d1e1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.830+0000 7f25d1e1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.830+0000 7f25d161e640 1 --2- 10.20.193.45:0/2486901999 >> v2:10.20.193.45:3300/0 conn(0x7f25cc15d1e0 0x7f25cc15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d161e640 10 monclient(hunting): get_auth_request con 0x7f25cc15d1e0 auth_method 0 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d161e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d161e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:46.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d161e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25bbfff640 1 -- 10.20.193.45:0/2486901999 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 628123894 0 0) 0x7f25cc0c5860 con 0x7f25cc0748e0 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25bbfff640 10 monclient(hunting): _negotiate 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25bbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25bbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25bbfff640 10 monclient(hunting): my global_id is 4799 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25bbfff640 1 -- 10.20.193.45:0/2486901999 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25b4003620 con 0x7f25cc0748e0 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d161e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d161e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d161e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d1e1f640 10 monclient(hunting): handle_auth_done global_id 4750 payload 274 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d1e1f640 1 -- 10.20.193.45:0/2486901999 >> v2:10.20.193.45:3300/0 conn(0x7f25cc15d1e0 msgr2=0x7f25cc15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d1e1f640 1 --2- 10.20.193.45:0/2486901999 >> v2:10.20.193.45:3300/0 conn(0x7f25cc15d1e0 0x7f25cc15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:46.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d1e1f640 1 -- 10.20.193.45:0/2486901999 >> v1:10.20.193.92:6789/0 conn(0x7f25cc0748e0 legacy=0x7f25cc0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d1e1f640 10 monclient: _finish_hunting 0 2026-02-17T21:08:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d1e1f640 1 monclient: found mon.noname-b 2026-02-17T21:08:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d1e1f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d1e1f640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:08:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.831+0000 7f25d1e1f640 1 -- 10.20.193.45:0/2486901999 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc0c80c0 con 0x7f25cc0c92b0 2026-02-17T21:08:46.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.832+0000 7f25d1e1f640 1 --2- 10.20.193.45:0/2486901999 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25cc0c92b0 0x7f25cc153610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009d90 tx=0x7f25c802f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=706e7b8489263d5f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 1 -- 10.20.193.45:0/2486901999 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c803c070 con 0x7f25cc0c92b0 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 10 monclient: dump: 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:46.837 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 10 monclient: _finish_auth 0 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 10 monclient: _check_auth_tickets 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25d38a9640 5 monclient: authenticate success, global_id 4750 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25d38a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 1 -- 10.20.193.45:0/2486901999 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c8037440 con 0x7f25cc0c92b0 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 1 -- 10.20.193.45:0/2486901999 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80377f0 con 0x7f25cc0c92b0 2026-02-17T21:08:46.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25d38a9640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25d38a9640 4 set_mon_vals no callback set 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.834+0000 7f25bbfff640 10 monclient: dump: 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:46.839 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 10 monclient: shutdown 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 -- 10.20.193.45:0/2486901999 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25cc0c92b0 msgr2=0x7f25cc153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 --2- 10.20.193.45:0/2486901999 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25cc0c92b0 0x7f25cc153610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f25c8009d90 tx=0x7f25c802f1e0 comp rx=0 tx=0).stop 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 -- 10.20.193.45:0/2486901999 shutdown_connections 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 --2- 10.20.193.45:0/2486901999 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25cc0c92b0 0x7f25cc153610 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 --2- 10.20.193.45:0/2486901999 >> v2:10.20.193.45:3300/0 conn(0x7f25cc15d1e0 0x7f25cc15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 -- 10.20.193.45:0/2486901999 >> 10.20.193.45:0/2486901999 conn(0x7f25cc0c9d40 msgr2=0x7f25cc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 -- 10.20.193.45:0/2486901999 shutdown_connections 2026-02-17T21:08:46.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 -- 10.20.193.45:0/2486901999 wait complete. 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 10 monclient: build_initial_monmap 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 10 monclient: monmap: 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:46.841 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 librados: starting msgr at 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 librados: starting objecter 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 Processor -- start 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 -- start start 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 librados: setting wanted keys 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 1 librados: calling monclient init 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.835+0000 7f25d38a9640 10 monclient: init 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25cc0748e0 0x7f25cc1f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient(hunting): picked mon.noname-a con 0x7f25cc0748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25cc0c92b0 0x7f25cc1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:46.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient(hunting): picked mon.noname-c con 0x7f25cc0c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25cc15d1e0 0x7f25cc0740d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient(hunting): picked mon.noname-b con 0x7f25cc15d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc074d30 con 0x7f25cc0748e0 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc0c8680 con 0x7f25cc15d1e0 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc153b50 con 0x7f25cc0c92b0 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d38a9640 10 monclient(hunting): authenticate will time out at 1110.466265s 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25cc0748e0 0x7f25cc1f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:46.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d1e1f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25cc15d1e0 0x7f25cc0740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25cc0748e0 0x7f25cc1f4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:35910/0 (socket says 10.20.193.45:35910) 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d0e1d640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25cc0c92b0 0x7f25cc1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 1 -- 10.20.193.45:0/3529158933 learned_addr learned my addr 10.20.193.45:0/3529158933 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 10 monclient(hunting): get_auth_request con 0x7f25cc0748e0 auth_method 0 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d1e1f640 10 monclient(hunting): get_auth_request con 0x7f25cc15d1e0 auth_method 0 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d1e1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d1e1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d1e1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:46.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d0e1d640 10 monclient(hunting): get_auth_request con 0x7f25cc0c92b0 auth_method 0 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d0e1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d0e1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d0e1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d161e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d1e1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d1e1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.836+0000 7f25d1e1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.837+0000 7f25d0e1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.837+0000 7f25d0e1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.837+0000 7f25d0e1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 10 monclient(hunting): handle_auth_done global_id 4698 payload 824 2026-02-17T21:08:46.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 1 -- 10.20.193.45:0/3529158933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25cc0c92b0 msgr2=0x7f25cc1454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25cc0c92b0 0x7f25cc1454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 1 -- 10.20.193.45:0/3529158933 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25cc15d1e0 msgr2=0x7f25cc0740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25cc15d1e0 0x7f25cc0740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 10 monclient: _finish_hunting 0 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 1 monclient: found mon.noname-a 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.838+0000 7f25d161e640 1 -- 10.20.193.45:0/3529158933 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc145a00 con 0x7f25cc0748e0 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.839+0000 7f25d161e640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25cc0748e0 0x7f25cc1f4260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00e8c0 tx=0x7f25bc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.839+0000 7f25b9ffb640 10 client.?.objecter ms_handle_connect 0x7f25cc0748e0 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.839+0000 7f25b9ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.840+0000 7f25b9ffb640 1 -- 10.20.193.45:0/3529158933 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc017070 con 0x7f25cc0748e0 2026-02-17T21:08:46.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.840+0000 7f25b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 10 monclient: dump: 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:46.847 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 1 -- 10.20.193.45:0/3529158933 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25bc00c940 con 0x7f25cc0748e0 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 5 monclient: authenticate success, global_id 4698 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 1 -- 10.20.193.45:0/3529158933 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00cd30 con 0x7f25cc0748e0 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25bb7fe640 4 set_mon_vals no callback set 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25b9ffb640 10 monclient: dump: 2026-02-17T21:08:46.848 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 10 monclient: _renew_subs 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25cc1f53f0 con 0x7f25cc0748e0 2026-02-17T21:08:46.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 10 client.4698.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 10 monclient: _renew_subs 2026-02-17T21:08:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25cc1f59b0 con 0x7f25cc0748e0 2026-02-17T21:08:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 1 librados: init done 2026-02-17T21:08:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:46.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.841+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25cc0698c0 con 0x7f25cc0748e0 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.852+0000 7f25b9ffb640 1 -- 10.20.193.45:0/3529158933 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f25bc024060 con 0x7f25cc0748e0 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.853+0000 7f25b9ffb640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f259c0792b0 0x7f259c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.853+0000 7f25d0e1d640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f259c0792b0 0x7f259c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.853+0000 7f25d0e1d640 10 monclient: get_auth_request con 0x7f259c0792b0 auth_method 0 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.853+0000 7f25d0e1d640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f259c0792b0 0x7f259c07b770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007b60 tx=0x7f25c0007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.853+0000 7f25b9ffb640 10 client.4698.objecter ms_handle_connect 0x7f259c0792b0 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.854+0000 7f25b9ffb640 1 -- 10.20.193.45:0/3529158933 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f25bc05e470 con 0x7f25cc0748e0 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.854+0000 7f25b9ffb640 10 client.4698.objecter ms_dispatch2 0x7f25cc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.854+0000 7f25b9ffb640 3 client.4698.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:46.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.854+0000 7f25b9ffb640 3 client.4698.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:46.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.854+0000 7f25b9ffb640 20 client.4698.objecter dump_active .. 0 homeless 2026-02-17T21:08:46.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.958+0000 7f25b9ffb640 1 -- 10.20.193.45:0/3529158933 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f25cc0698c0 con 0x7f25cc0748e0 2026-02-17T21:08:46.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.958+0000 7f25b9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:46.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:46.958+0000 7f25b9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:47.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.064+0000 7f25d38a9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:47.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.064+0000 7f25d38a9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:47.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.064+0000 7f25d38a9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:47.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.064+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f25cc153f30 con 0x7f25cc0748e0 2026-02-17T21:08:47.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.066+0000 7f25b9ffb640 1 -- 10.20.193.45:0/3529158933 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f25bc062430 con 0x7f25cc0748e0 2026-02-17T21:08:47.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.066+0000 7f25b9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:47.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.066+0000 7f25b9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:47.059 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:47.059 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:47.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 10 librados: watch_flush enter 2026-02-17T21:08:47.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 10 librados: watch_flush exit 2026-02-17T21:08:47.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 20 client.4698.objecter shutdown clearing up homeless session... 2026-02-17T21:08:47.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 10 client.4698.objecter successfully canceled tick 2026-02-17T21:08:47.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f259c0792b0 msgr2=0x7f259c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:47.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f259c0792b0 0x7f259c07b770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f25c0007b60 tx=0x7f25c0007ab0 comp rx=0 tx=0).stop 2026-02-17T21:08:47.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 10 monclient: shutdown 2026-02-17T21:08:47.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25cc0748e0 msgr2=0x7f25cc1f4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25cc0748e0 0x7f25cc1f4260 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00e8c0 tx=0x7f25bc00ed90 comp rx=0 tx=0).stop 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 shutdown_connections 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f259c0792b0 0x7f259c07b770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25cc15d1e0 0x7f25cc0740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25cc0c92b0 0x7f25cc1454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 --2- 10.20.193.45:0/3529158933 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25cc0748e0 0x7f25cc1f4260 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 >> 10.20.193.45:0/3529158933 conn(0x7f25cc0c9d40 msgr2=0x7f25cc152450 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 shutdown_connections 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 -- 10.20.193.45:0/3529158933 wait complete. 2026-02-17T21:08:47.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:47.067+0000 7f25d38a9640 1 librados: shutdown 2026-02-17T21:08:50.047 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:57.260 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:50.048 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:57.261 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:50.056 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:03:57.269 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:50.070 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:50.075 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:03:57.248 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:50.076 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:03:57.250 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:50.077 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:03:57.286 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:50.079 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:03:57.288 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:50.086 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:03:57.260 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:50.089 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:03:57.299 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:08:50.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.145+0000 7f175e888640 10 monclient: get_monmap_and_config 2026-02-17T21:08:50.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.145+0000 7f175e888640 10 monclient: build_initial_monmap 2026-02-17T21:08:50.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.145+0000 7f175e888640 10 monclient: monmap: 2026-02-17T21:08:50.139 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:50.139 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:50.139 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:50.147580+0000 2026-02-17T21:08:50.139 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:50.147580+0000 2026-02-17T21:08:50.139 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:50.140 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:50.140 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:50.140 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:50.140 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:50.140 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:50.140 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:50.140 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:50.140 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:50.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 1 Processor -- start 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 1 -- start start 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient: init 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient: _add_conns ranks=[5,3,4,2,1,0] 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f1758152620 0x7f175815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient(hunting): picked mon.noname-c con 0x7f1758152620 addr v2:10.20.193.92:3300/0 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f1758152a00 0x7f175815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient(hunting): picked mon.noname-a con 0x7f1758152a00 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f17580c8d90 0x7f17580c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient(hunting): picked mon.noname-b con 0x7f17580c8d90 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:50.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f17580c7760 con 0x7f1758152a00 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f17580c71a0 con 0x7f17580c8d90 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f17580c7480 con 0x7f1758152620 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.146+0000 7f175e888640 10 monclient(hunting): authenticate will time out at 1113.777828s 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f1758152a00 0x7f175815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f1757fff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f1758152620 0x7f175815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f175cdfe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f17580c8d90 0x7f17580c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f1758152a00 0x7f175815ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:49122/0 (socket says 10.20.193.45:49122) 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 1 -- 10.20.193.45:0/3169168402 learned_addr learned my addr 10.20.193.45:0/3169168402 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:50.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 10 monclient(hunting): get_auth_request con 0x7f1758152a00 auth_method 0 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f17577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f1757fff640 10 monclient(hunting): get_auth_request con 0x7f1758152620 auth_method 0 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f1757fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f1757fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.148+0000 7f1757fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f175cdfe640 10 monclient(hunting): get_auth_request con 0x7f17580c8d90 auth_method 0 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f175cdfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:50.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f175cdfe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f175cdfe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 10 monclient(hunting): handle_auth_done global_id 4701 payload 274 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 1 -- 10.20.193.45:0/3169168402 >> v2:10.20.193.92:3300/0 conn(0x7f1758152620 msgr2=0x7f175815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 1 --2- 10.20.193.45:0/3169168402 >> v2:10.20.193.92:3300/0 conn(0x7f1758152620 0x7f175815a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 1 -- 10.20.193.45:0/3169168402 >> v2:10.20.193.86:3300/0 conn(0x7f17580c8d90 msgr2=0x7f17580c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 1 --2- 10.20.193.45:0/3169168402 >> v2:10.20.193.86:3300/0 conn(0x7f17580c8d90 0x7f17580c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 10 monclient: _finish_hunting 0 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 1 monclient: found mon.noname-a 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.149+0000 7f17577fe640 1 -- 10.20.193.45:0/3169168402 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1758159e00 con 0x7f1758152a00 2026-02-17T21:08:50.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.150+0000 7f17577fe640 1 --2- 10.20.193.45:0/3169168402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 0x7f175815ae20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1758072110 tx=0x7f174802ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2132cb92972178 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:50.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.151+0000 7f1756ffd640 1 -- 10.20.193.45:0/3169168402 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174803c070 con 0x7f1758152a00 2026-02-17T21:08:50.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.151+0000 7f1756ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:50.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.151+0000 7f1756ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:50.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.151+0000 7f1756ffd640 10 monclient: dump: 2026-02-17T21:08:50.154 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:50.154 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:50.154 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:50.154 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.151+0000 7f1756ffd640 10 monclient: _finish_auth 0 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.151+0000 7f1756ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.151+0000 7f1756ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.151+0000 7f175e888640 5 monclient: authenticate success, global_id 4701 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.151+0000 7f175e888640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:08:50.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f1756ffd640 1 -- 10.20.193.45:0/3169168402 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174802fb50 con 0x7f1758152a00 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f1756ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f1756ffd640 1 -- 10.20.193.45:0/3169168402 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748037440 con 0x7f1758152a00 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f1756ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f1756ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f1756ffd640 10 monclient: dump: 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:50.156 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f175e888640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f175e888640 4 set_mon_vals no callback set 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f175e888640 10 monclient: shutdown 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f175e888640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f175e888640 1 -- 10.20.193.45:0/3169168402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 msgr2=0x7f175815ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.152+0000 7f175e888640 1 --2- 10.20.193.45:0/3169168402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 0x7f175815ae20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1758072110 tx=0x7f174802ee90 comp rx=0 tx=0).stop 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 -- 10.20.193.45:0/3169168402 shutdown_connections 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 --2- 10.20.193.45:0/3169168402 >> v2:10.20.193.86:3300/0 conn(0x7f17580c8d90 0x7f17580c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 --2- 10.20.193.45:0/3169168402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 0x7f175815ae20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 --2- 10.20.193.45:0/3169168402 >> v2:10.20.193.92:3300/0 conn(0x7f1758152620 0x7f175815a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 -- 10.20.193.45:0/3169168402 >> 10.20.193.45:0/3169168402 conn(0x7f17580c9d40 msgr2=0x7f17580ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 -- 10.20.193.45:0/3169168402 shutdown_connections 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 -- 10.20.193.45:0/3169168402 wait complete. 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 10 monclient: build_initial_monmap 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 10 monclient: monmap: 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:50.158 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 librados: starting msgr at 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 librados: starting objecter 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 Processor -- start 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 -- start start 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 librados: setting wanted keys 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 1 librados: calling monclient init 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.153+0000 7f175e888640 10 monclient: init 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:08:50.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17580c8d90 0x7f1758143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient(hunting): picked mon.noname-c con 0x7f17580c8d90 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1758152620 0x7f17581f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient(hunting): picked mon.noname-b con 0x7f1758152620 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 0x7f17581f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient(hunting): picked mon.noname-a con 0x7f1758152a00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f17580c96b0 con 0x7f1758152a00 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f175815a3c0 con 0x7f1758152620 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f175815bdd0 con 0x7f17580c8d90 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:50.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175e888640 10 monclient(hunting): authenticate will time out at 1113.785214s 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 0x7f17581f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 0x7f17581f6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:49138/0 (socket says 10.20.193.45:49138) 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 1 -- 10.20.193.45:0/73598770 learned_addr learned my addr 10.20.193.45:0/73598770 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 10 monclient(hunting): get_auth_request con 0x7f1758152a00 auth_method 0 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.154+0000 7f175cdfe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.155+0000 7f1757fff640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17580c8d90 0x7f1758143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:50.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.155+0000 7f17577fe640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1758152620 0x7f17581f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.155+0000 7f1757fff640 10 monclient(hunting): get_auth_request con 0x7f17580c8d90 auth_method 0 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.155+0000 7f1757fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.155+0000 7f1757fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.155+0000 7f1757fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f17577fe640 10 monclient(hunting): get_auth_request con 0x7f1758152620 auth_method 0 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f17577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f17577fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f17577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 10 monclient(hunting): handle_auth_done global_id 4704 payload 824 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 1 -- 10.20.193.45:0/73598770 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17580c8d90 msgr2=0x7f1758143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17580c8d90 0x7f1758143da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 1 -- 10.20.193.45:0/73598770 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1758152620 msgr2=0x7f17581f61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:50.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1758152620 0x7f17581f61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 10 monclient: _finish_hunting 0 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 1 monclient: found mon.noname-a 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.156+0000 7f175cdfe640 1 -- 10.20.193.45:0/73598770 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17581f5150 con 0x7f1758152a00 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.157+0000 7f175cdfe640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 0x7f17581f6730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f174c007e70 tx=0x7f174c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.157+0000 7f1754ff9640 10 client.?.objecter ms_handle_connect 0x7f1758152a00 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.157+0000 7f1754ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 1 -- 10.20.193.45:0/73598770 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c00eea0 con 0x7f1758152a00 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 10 monclient: dump: 2026-02-17T21:08:50.163 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 10 monclient: _finish_auth 0 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:50.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 5 monclient: authenticate success, global_id 4704 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 1 -- 10.20.193.45:0/73598770 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f174c019070 con 0x7f1758152a00 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 1 -- 10.20.193.45:0/73598770 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c014880 con 0x7f1758152a00 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f17567fc640 4 set_mon_vals no callback set 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f1754ff9640 10 monclient: dump: 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:50.165 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 10 monclient: _renew_subs 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17581f5430 con 0x7f1758152a00 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 10 client.4704.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 10 monclient: _renew_subs 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17581f59f0 con 0x7f1758152a00 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 1 librados: init done 2026-02-17T21:08:50.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:50.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:50.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:50.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.159+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17580c9170 con 0x7f1758152a00 2026-02-17T21:08:50.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.172+0000 7f1754ff9640 1 -- 10.20.193.45:0/73598770 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f174c014a20 con 0x7f1758152a00 2026-02-17T21:08:50.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.172+0000 7f1754ff9640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1728079280 0x7f172807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:50.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.172+0000 7f1757fff640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1728079280 0x7f172807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:50.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.172+0000 7f1757fff640 10 monclient: get_auth_request con 0x7f1728079280 auth_method 0 2026-02-17T21:08:50.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.172+0000 7f1757fff640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1728079280 0x7f172807b740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1744003840 tx=0x7f1744008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:50.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.172+0000 7f1754ff9640 10 client.4704.objecter ms_handle_connect 0x7f1728079280 2026-02-17T21:08:50.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.175+0000 7f1754ff9640 1 -- 10.20.193.45:0/73598770 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f174c05f4b0 con 0x7f1758152a00 2026-02-17T21:08:50.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.175+0000 7f1754ff9640 10 client.4704.objecter ms_dispatch2 0x7f1758000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:50.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.175+0000 7f1754ff9640 3 client.4704.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:50.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.175+0000 7f1754ff9640 3 client.4704.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:50.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.176+0000 7f1754ff9640 20 client.4704.objecter dump_active .. 0 homeless 2026-02-17T21:08:50.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.281+0000 7f1754ff9640 1 -- 10.20.193.45:0/73598770 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f174c063b70 con 0x7f1758152a00 2026-02-17T21:08:50.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.281+0000 7f1754ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:50.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.281+0000 7f1754ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:50.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.379+0000 7f175e888640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:50.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.379+0000 7f175e888640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:50.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.379+0000 7f175e888640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:50.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.379+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f17580ca420 con 0x7f1758152a00 2026-02-17T21:08:50.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.381+0000 7f1754ff9640 1 -- 10.20.193.45:0/73598770 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f174c063470 con 0x7f1758152a00 2026-02-17T21:08:50.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.381+0000 7f1754ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:50.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.381+0000 7f1754ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:50.375 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:50.376 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:50.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 10 librados: watch_flush enter 2026-02-17T21:08:50.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 10 librados: watch_flush exit 2026-02-17T21:08:50.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 20 client.4704.objecter shutdown clearing up homeless session... 2026-02-17T21:08:50.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 10 client.4704.objecter successfully canceled tick 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1728079280 msgr2=0x7f172807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1728079280 0x7f172807b740 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1744003840 tx=0x7f1744008040 comp rx=0 tx=0).stop 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 10 monclient: shutdown 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 msgr2=0x7f17581f6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 0x7f17581f6730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f174c007e70 tx=0x7f174c00e4b0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 shutdown_connections 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1728079280 0x7f172807b740 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1758152a00 0x7f17581f6730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1758152620 0x7f17581f61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 --2- 10.20.193.45:0/73598770 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17580c8d90 0x7f1758143da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:50.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 >> 10.20.193.45:0/73598770 conn(0x7f17580c9d40 msgr2=0x7f175815c160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:50.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.382+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 shutdown_connections 2026-02-17T21:08:50.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.383+0000 7f175e888640 1 -- 10.20.193.45:0/73598770 wait complete. 2026-02-17T21:08:50.379 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:50.383+0000 7f175e888640 1 librados: shutdown 2026-02-17T21:08:53.385 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:53.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.462+0000 7fa789896640 10 monclient: get_monmap_and_config 2026-02-17T21:08:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.462+0000 7fa789896640 10 monclient: build_initial_monmap 2026-02-17T21:08:53.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.462+0000 7fa789896640 10 monclient: monmap: 2026-02-17T21:08:53.455 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:53.455 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:53.455 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:53.463229+0000 2026-02-17T21:08:53.455 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:53.463229+0000 2026-02-17T21:08:53.455 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:53.455 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:53.455 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:53.456 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:53.456 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:53.456 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:53.456 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:53.456 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:53.456 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.462+0000 7fa789896640 1 Processor -- start 2026-02-17T21:08:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.462+0000 7fa789896640 1 -- start start 2026-02-17T21:08:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.462+0000 7fa789896640 10 monclient: init 2026-02-17T21:08:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 10 monclient: _add_conns ranks=[3,1,4,5,2,0] 2026-02-17T21:08:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fa784152620 0x7fa78415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:53.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 10 monclient(hunting): picked mon.noname-a con 0x7fa784152620 addr v2:10.20.193.45:3300/0 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa784152a00 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa7840c94a0 0x7fa78415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 10 monclient(hunting): picked mon.noname-b con 0x7fa7840c94a0 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7840c71a0 con 0x7fa784152a00 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fa7840c7760 con 0x7fa784152620 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa7840c7480 con 0x7fa7840c94a0 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa789896640 10 monclient(hunting): authenticate will time out at 1117.093440s 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.463+0000 7fa782ffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fa784152620 0x7fa78415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:53.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa7837fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa7840c94a0 0x7fa78415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa782ffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fa784152620 0x7fa78415a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:49152/0 (socket says 10.20.193.45:49152) 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa782ffd640 1 -- 10.20.193.45:0/3639164334 learned_addr learned my addr 10.20.193.45:0/3639164334 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa782ffd640 10 monclient(hunting): get_auth_request con 0x7fa784152620 auth_method 0 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa782ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa782ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa782ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa7837fe640 10 monclient(hunting): get_auth_request con 0x7fa7840c94a0 auth_method 0 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa7837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa7837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa7837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa782ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:53.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa782ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa782ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa7837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa7837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.464+0000 7fa7837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.465+0000 7fa782ffd640 10 monclient(hunting): handle_auth_done global_id 4707 payload 274 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.465+0000 7fa782ffd640 1 -- 10.20.193.45:0/3639164334 >> v2:10.20.193.86:3300/0 conn(0x7fa7840c94a0 msgr2=0x7fa78415ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.465+0000 7fa782ffd640 1 --2- 10.20.193.45:0/3639164334 >> v2:10.20.193.86:3300/0 conn(0x7fa7840c94a0 0x7fa78415ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.465+0000 7fa782ffd640 1 -- 10.20.193.45:0/3639164334 >> v1:10.20.193.86:6789/0 conn(0x7fa784152a00 legacy=0x7fa7840c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.465+0000 7fa782ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.465+0000 7fa782ffd640 1 monclient: found mon.noname-a 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.465+0000 7fa782ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.465+0000 7fa782ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:53.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.465+0000 7fa782ffd640 1 -- 10.20.193.45:0/3639164334 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa784159e00 con 0x7fa784152620 2026-02-17T21:08:53.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.466+0000 7fa782ffd640 1 --2- 10.20.193.45:0/3639164334 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa784152620 0x7fa78415a8e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa784076d30 tx=0x7fa77802eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e171a40451cb2e8a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 1 -- 10.20.193.45:0/3639164334 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77803c070 con 0x7fa784152620 2026-02-17T21:08:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:53.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 10 monclient: dump: 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:53.470 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 10 monclient: _finish_auth 0 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 1 -- 10.20.193.45:0/3639164334 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77802fb20 con 0x7fa784152620 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa781ffb640 1 -- 10.20.193.45:0/3639164334 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778037440 con 0x7fa784152620 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.467+0000 7fa789896640 5 monclient: authenticate success, global_id 4707 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 4 set_mon_vals no callback set 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa781ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa781ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa781ffb640 10 monclient: dump: 2026-02-17T21:08:53.471 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 10 monclient: shutdown 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:53.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 1 -- 10.20.193.45:0/3639164334 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa784152620 msgr2=0x7fa78415a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 1 --2- 10.20.193.45:0/3639164334 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa784152620 0x7fa78415a8e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa784076d30 tx=0x7fa77802eeb0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 1 -- 10.20.193.45:0/3639164334 shutdown_connections 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 1 --2- 10.20.193.45:0/3639164334 >> v2:10.20.193.86:3300/0 conn(0x7fa7840c94a0 0x7fa78415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 1 --2- 10.20.193.45:0/3639164334 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa784152620 0x7fa78415a8e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 1 -- 10.20.193.45:0/3639164334 >> 10.20.193.45:0/3639164334 conn(0x7fa7840c9d40 msgr2=0x7fa7840ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 1 -- 10.20.193.45:0/3639164334 shutdown_connections 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 1 -- 10.20.193.45:0/3639164334 wait complete. 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 10 monclient: build_initial_monmap 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.468+0000 7fa789896640 10 monclient: monmap: 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:53.473 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 librados: starting msgr at 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 librados: starting objecter 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 Processor -- start 2026-02-17T21:08:53.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 -- start start 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 librados: setting wanted keys 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 librados: calling monclient init 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient: init 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa7840c94a0 0x7fa7841f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient(hunting): picked mon.noname-a con 0x7fa7840c94a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa784152620 0x7fa7841571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient(hunting): picked mon.noname-b con 0x7fa784152620 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa784152a00 0x7fa7841530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient(hunting): picked mon.noname-c con 0x7fa784152a00 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:53.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa7840c5c90 con 0x7fa7840c94a0 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa78415a3c0 con 0x7fa784152620 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa7840c5e10 con 0x7fa784152a00 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa789896640 10 monclient(hunting): authenticate will time out at 1117.099554s 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa782ffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa7840c94a0 0x7fa7841f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.469+0000 7fa7827fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa784152620 0x7fa7841571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7837fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa784152a00 0x7fa7841530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa782ffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa7840c94a0 0x7fa7841f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:49164/0 (socket says 10.20.193.45:49164) 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa782ffd640 1 -- 10.20.193.45:0/1768466234 learned_addr learned my addr 10.20.193.45:0/1768466234 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:53.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa782ffd640 10 monclient(hunting): get_auth_request con 0x7fa7840c94a0 auth_method 0 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa782ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa782ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa782ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7827fc640 10 monclient(hunting): get_auth_request con 0x7fa784152620 auth_method 0 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7827fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7827fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7837fe640 10 monclient(hunting): get_auth_request con 0x7fa784152a00 auth_method 0 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:53.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa782ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa782ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa782ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7827fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7827fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7827fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.470+0000 7fa7837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 10 monclient(hunting): handle_auth_done global_id 4710 payload 824 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 1 -- 10.20.193.45:0/1768466234 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa784152a00 msgr2=0x7fa7841530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa784152a00 0x7fa7841530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 1 -- 10.20.193.45:0/1768466234 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa784152620 msgr2=0x7fa7841571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa784152620 0x7fa7841571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 1 monclient: found mon.noname-a 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.471+0000 7fa782ffd640 1 -- 10.20.193.45:0/1768466234 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa784156750 con 0x7fa7840c94a0 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.472+0000 7fa782ffd640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa7840c94a0 0x7fa7841f36c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa778009a40 tx=0x7fa7780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.472+0000 7fa75bfff640 10 client.?.objecter ms_handle_connect 0x7fa7840c94a0 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.472+0000 7fa75bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 1 -- 10.20.193.45:0/1768466234 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77803c040 con 0x7fa7840c94a0 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:08:53.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 10 monclient: dump: 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 10 monclient: _finish_auth 0 2026-02-17T21:08:53.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 1 -- 10.20.193.45:0/1768466234 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa778042410 con 0x7fa7840c94a0 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa789896640 5 monclient: authenticate success, global_id 4710 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa789896640 10 monclient: _renew_subs 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa789896640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7841f3c00 con 0x7fa7840c94a0 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 1 -- 10.20.193.45:0/1768466234 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778042800 con 0x7fa7840c94a0 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa7817fa640 4 set_mon_vals no callback set 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa75bfff640 10 monclient: dump: 2026-02-17T21:08:53.481 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa789896640 10 client.4710.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa789896640 10 monclient: _renew_subs 2026-02-17T21:08:53.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa789896640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7841f41b0 con 0x7fa7840c94a0 2026-02-17T21:08:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.474+0000 7fa789896640 1 librados: init done 2026-02-17T21:08:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.475+0000 7fa789896640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.475+0000 7fa789896640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.475+0000 7fa789896640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:53.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.475+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7840c8d90 con 0x7fa7840c94a0 2026-02-17T21:08:53.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.486+0000 7fa75bfff640 1 -- 10.20.193.45:0/1768466234 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fa7780429a0 con 0x7fa7840c94a0 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.487+0000 7fa75bfff640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7540792d0 0x7fa75407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.487+0000 7fa7827fc640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7540792d0 0x7fa75407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.487+0000 7fa7827fc640 10 monclient: get_auth_request con 0x7fa7540792d0 auth_method 0 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.487+0000 7fa75bfff640 10 client.4710.objecter ms_handle_connect 0x7fa7540792d0 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.487+0000 7fa7827fc640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7540792d0 0x7fa75407b790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7841478b0 tx=0x7fa76c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.489+0000 7fa75bfff640 1 -- 10.20.193.45:0/1768466234 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fa778083b40 con 0x7fa7840c94a0 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.489+0000 7fa75bfff640 10 client.4710.objecter ms_dispatch2 0x7fa784000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.489+0000 7fa75bfff640 3 client.4710.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.489+0000 7fa75bfff640 3 client.4710.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:53.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.489+0000 7fa75bfff640 20 client.4710.objecter dump_active .. 0 homeless 2026-02-17T21:08:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.593+0000 7fa75bfff640 1 -- 10.20.193.45:0/1768466234 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa778087b00 con 0x7fa7840c94a0 2026-02-17T21:08:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.593+0000 7fa75bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:53.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.593+0000 7fa75bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.691+0000 7fa789896640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.691+0000 7fa789896640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.691+0000 7fa789896640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:08:53.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.691+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa78414cc80 con 0x7fa7840c94a0 2026-02-17T21:08:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.693+0000 7fa75bfff640 1 -- 10.20.193.45:0/1768466234 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fa77808be00 con 0x7fa7840c94a0 2026-02-17T21:08:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.693+0000 7fa75bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:53.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.693+0000 7fa75bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:53.686 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:53.686 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 10 librados: watch_flush enter 2026-02-17T21:08:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 10 librados: watch_flush exit 2026-02-17T21:08:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 20 client.4710.objecter shutdown clearing up homeless session... 2026-02-17T21:08:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 10 client.4710.objecter successfully canceled tick 2026-02-17T21:08:53.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7540792d0 msgr2=0x7fa75407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7540792d0 0x7fa75407b790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7841478b0 tx=0x7fa76c009190 comp rx=0 tx=0).stop 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 10 monclient: shutdown 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa7840c94a0 msgr2=0x7fa7841f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa7840c94a0 0x7fa7841f36c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa778009a40 tx=0x7fa7780047c0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 shutdown_connections 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa7540792d0 0x7fa75407b790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa784152a00 0x7fa7841530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa784152620 0x7fa7841571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 --2- 10.20.193.45:0/1768466234 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa7840c94a0 0x7fa7841f36c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 >> 10.20.193.45:0/1768466234 conn(0x7fa7840c9d40 msgr2=0x7fa78414cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:53.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 shutdown_connections 2026-02-17T21:08:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 -- 10.20.193.45:0/1768466234 wait complete. 2026-02-17T21:08:53.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:53.694+0000 7fa789896640 1 librados: shutdown 2026-02-17T21:08:56.696 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:08:56.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.772+0000 7fbc177a9640 10 monclient: get_monmap_and_config 2026-02-17T21:08:56.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.772+0000 7fbc177a9640 10 monclient: build_initial_monmap 2026-02-17T21:08:56.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.772+0000 7fbc177a9640 10 monclient: monmap: 2026-02-17T21:08:56.765 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:56.765 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:56.765 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:08:56.773459+0000 2026-02-17T21:08:56.765 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:08:56.773459+0000 2026-02-17T21:08:56.765 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:56.765 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:56.766 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:08:56.766 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:08:56.766 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:08:56.766 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:08:56.766 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:08:56.766 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:08:56.766 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:56.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 1 Processor -- start 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 1 -- start start 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient: init 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient: _add_conns ranks=[4,5,1,3,2,0] 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fbc10155e40 0x7fbc10074580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient(hunting): picked mon.noname-b con 0x7fbc10155e40 addr v2:10.20.193.86:3300/0 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fbc10156220 0x7fbc10074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient(hunting): picked mon.noname-c con 0x7fbc10156220 addr v2:10.20.193.92:3300/0 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbc100ccb80 addr v1:10.20.193.86:6789/0 2026-02-17T21:08:56.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc100734e0 con 0x7fbc100ccb80 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fbc100cd800 con 0x7fbc10155e40 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fbc100737c0 con 0x7fbc10156220 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.773+0000 7fbc177a9640 10 monclient(hunting): authenticate will time out at 1120.403698s 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fbc10156220 0x7fbc10074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc1551e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fbc10155e40 0x7fbc10074580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fbc10156220 0x7fbc10074ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:54348/0 (socket says 10.20.193.45:54348) 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 1 -- 10.20.193.45:0/956115942 learned_addr learned my addr 10.20.193.45:0/956115942 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 10 monclient(hunting): get_auth_request con 0x7fbc10156220 auth_method 0 2026-02-17T21:08:56.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc1551e640 10 monclient(hunting): get_auth_request con 0x7fbc10155e40 auth_method 0 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc1551e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc1551e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc1551e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc14d1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc1551e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc1551e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.774+0000 7fbc1551e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:56.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.775+0000 7fbc14d1d640 10 monclient(hunting): handle_auth_done global_id 4814 payload 274 2026-02-17T21:08:56.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.775+0000 7fbc14d1d640 1 -- 10.20.193.45:0/956115942 >> v2:10.20.193.86:3300/0 conn(0x7fbc10155e40 msgr2=0x7fbc10074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:56.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.775+0000 7fbc14d1d640 1 --2- 10.20.193.45:0/956115942 >> v2:10.20.193.86:3300/0 conn(0x7fbc10155e40 0x7fbc10074580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.775+0000 7fbc14d1d640 1 -- 10.20.193.45:0/956115942 >> v1:10.20.193.86:6789/0 conn(0x7fbc100ccb80 legacy=0x7fbc100ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:08:56.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.775+0000 7fbc14d1d640 10 monclient: _finish_hunting 0 2026-02-17T21:08:56.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.775+0000 7fbc14d1d640 1 monclient: found mon.noname-c 2026-02-17T21:08:56.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.775+0000 7fbc14d1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:56.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.775+0000 7fbc14d1d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:08:56.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.775+0000 7fbc14d1d640 1 -- 10.20.193.45:0/956115942 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc10073aa0 con 0x7fbc10156220 2026-02-17T21:08:56.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.776+0000 7fbc14d1d640 1 --2- 10.20.193.45:0/956115942 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc10156220 0x7fbc10074ac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc1008f5a0 tx=0x7fbc0402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cadb4308d6ecd5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:56.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 1 -- 10.20.193.45:0/956115942 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0403c070 con 0x7fbc10156220 2026-02-17T21:08:56.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:56.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:08:56.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 10 monclient: dump: 2026-02-17T21:08:56.779 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:56.779 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:56.779 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 10 monclient: _finish_auth 0 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 10 monclient: _check_auth_tickets 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 1 -- 10.20.193.45:0/956115942 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0402fb40 con 0x7fbc10156220 2026-02-17T21:08:56.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 1 -- 10.20.193.45:0/956115942 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc04037440 con 0x7fbc10156220 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 5 monclient: authenticate success, global_id 4814 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 10 monclient: get_monmap_and_config success 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 4 set_mon_vals no callback set 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbbfffff640 10 monclient: dump: 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:56.781 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 10 monclient: shutdown 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 1 -- 10.20.193.45:0/956115942 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc10156220 msgr2=0x7fbc10074ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 1 --2- 10.20.193.45:0/956115942 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc10156220 0x7fbc10074ac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc1008f5a0 tx=0x7fbc0402eed0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 1 -- 10.20.193.45:0/956115942 shutdown_connections 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 1 --2- 10.20.193.45:0/956115942 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc10156220 0x7fbc10074ac0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 1 --2- 10.20.193.45:0/956115942 >> v2:10.20.193.86:3300/0 conn(0x7fbc10155e40 0x7fbc10074580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 1 -- 10.20.193.45:0/956115942 >> 10.20.193.45:0/956115942 conn(0x7fbc100ce270 msgr2=0x7fbc100ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 1 -- 10.20.193.45:0/956115942 shutdown_connections 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.778+0000 7fbc177a9640 1 -- 10.20.193.45:0/956115942 wait complete. 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient: build_initial_monmap 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient: monmap: 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:08:56.783 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 librados: starting msgr at 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 librados: starting objecter 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 Processor -- start 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 -- start start 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 librados: setting wanted keys 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 librados: calling monclient init 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient: init 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient: _reopen_session rank -1 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc100ccb80 0x7fbc10151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:56.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient(hunting): picked mon.noname-c con 0x7fbc100ccb80 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbc10155e40 0x7fbc101478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient(hunting): picked mon.noname-b con 0x7fbc10155e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbc10156220 0x7fbc101f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient(hunting): picked mon.noname-a con 0x7fbc10156220 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc100c4830 con 0x7fbc10156220 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10074060 con 0x7fbc10155e40 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc100c49b0 con 0x7fbc100ccb80 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient(hunting): _renew_subs 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.779+0000 7fbc177a9640 10 monclient(hunting): authenticate will time out at 1120.409794s 2026-02-17T21:08:56.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc100ccb80 0x7fbc10151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc14d1d640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbc10155e40 0x7fbc101478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc100ccb80 0x7fbc10151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:54364/0 (socket says 10.20.193.45:54364) 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 1 -- 10.20.193.45:0/3449572771 learned_addr learned my addr 10.20.193.45:0/3449572771 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 10 monclient(hunting): get_auth_request con 0x7fbc100ccb80 auth_method 0 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc15d1f640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbc10156220 0x7fbc101f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc14d1d640 10 monclient(hunting): get_auth_request con 0x7fbc10155e40 auth_method 0 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc14d1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc14d1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:56.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc14d1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc15d1f640 10 monclient(hunting): get_auth_request con 0x7fbc10156220 auth_method 0 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc15d1f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc15d1f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc15d1f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc1551e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc14d1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc14d1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc14d1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc15d1f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc15d1f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:08:56.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.780+0000 7fbc15d1f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 10 monclient(hunting): handle_auth_done global_id 4817 payload 824 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 1 -- 10.20.193.45:0/3449572771 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbc10155e40 msgr2=0x7fbc101478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbc10155e40 0x7fbc101478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 1 -- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbc10156220 msgr2=0x7fbc101f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbc10156220 0x7fbc101f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 10 monclient: _finish_hunting 0 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 1 monclient: found mon.noname-c 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.781+0000 7fbc1551e640 1 -- 10.20.193.45:0/3449572771 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc101f72f0 con 0x7fbc100ccb80 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.782+0000 7fbc1551e640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc100ccb80 0x7fbc10151aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000ec10 tx=0x7fbc0000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.782+0000 7fbbfdffb640 10 client.?.objecter ms_handle_connect 0x7fbc100ccb80 2026-02-17T21:08:56.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.782+0000 7fbbfdffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbbfdffb640 1 -- 10.20.193.45:0/3449572771 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00017070 con 0x7fbc100ccb80 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbbfdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbbfdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbbfdffb640 10 monclient: dump: 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:56.789 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbbfdffb640 10 monclient: _finish_auth 0 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbbfdffb640 10 monclient: _check_auth_tickets 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbbfdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbc177a9640 5 monclient: authenticate success, global_id 4817 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbc177a9640 10 monclient: _renew_subs 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbc177a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc101f75b0 con 0x7fbc100ccb80 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbc177a9640 10 client.4817.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbc177a9640 10 monclient: _renew_subs 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbc177a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc101f7b70 con 0x7fbc100ccb80 2026-02-17T21:08:56.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.783+0000 7fbc177a9640 1 librados: init done 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbc177a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbc177a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbc177a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc100698c0 con 0x7fbc100ccb80 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbbfdffb640 1 -- 10.20.193.45:0/3449572771 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0000cc40 con 0x7fbc100ccb80 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbbfdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbbff7fe640 4 set_mon_vals no callback set 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbbfdffb640 1 -- 10.20.193.45:0/3449572771 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00021060 con 0x7fbc100ccb80 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbbfdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbbfdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.784+0000 7fbbfdffb640 10 monclient: dump: 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:08:56.791 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:08:56.792 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:56.792 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:08:56.792 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:08:56.792 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:08:56.792 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:08:56.792 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:08:56.792 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:08:56.792 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:08:56.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.890+0000 7fbbfdffb640 1 -- 10.20.193.45:0/3449572771 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fbc00024060 con 0x7fbc100ccb80 2026-02-17T21:08:56.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.890+0000 7fbbfdffb640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbbe00792b0 0x7fbbe007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:08:56.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.890+0000 7fbc14d1d640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbbe00792b0 0x7fbbe007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:08:56.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.890+0000 7fbc14d1d640 10 monclient: get_auth_request con 0x7fbbe00792b0 auth_method 0 2026-02-17T21:08:56.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.891+0000 7fbbfdffb640 10 client.4817.objecter ms_handle_connect 0x7fbbe00792b0 2026-02-17T21:08:56.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.891+0000 7fbc14d1d640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbbe00792b0 0x7fbbe007b770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbc1008f310 tx=0x7fbc04033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:08:56.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.892+0000 7fbbfdffb640 1 -- 10.20.193.45:0/3449572771 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fbc00097fb0 con 0x7fbc100ccb80 2026-02-17T21:08:56.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.892+0000 7fbbfdffb640 10 client.4817.objecter ms_dispatch2 0x7fbc10000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:08:56.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.892+0000 7fbbfdffb640 3 client.4817.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:08:56.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.892+0000 7fbbfdffb640 3 client.4817.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:08:56.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.892+0000 7fbbfdffb640 20 client.4817.objecter dump_active .. 0 homeless 2026-02-17T21:08:56.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.898+0000 7fbbfdffb640 1 -- 10.20.193.45:0/3449572771 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbc100698c0 con 0x7fbc100ccb80 2026-02-17T21:08:56.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.898+0000 7fbbfdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:08:56.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.898+0000 7fbbfdffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:08:56.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.996+0000 7fbc177a9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:08:56.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.996+0000 7fbc177a9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:56.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.996+0000 7fbc177a9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:08:56.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.996+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbc100ccfa0 con 0x7fbc100ccb80 2026-02-17T21:08:56.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.999+0000 7fbbfdffb640 1 -- 10.20.193.45:0/3449572771 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fbc00062540 con 0x7fbc100ccb80 2026-02-17T21:08:56.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.999+0000 7fbbfdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:08:56.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:56.999+0000 7fbbfdffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:08:56.992 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:08:56.992 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:08:56.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 10 librados: watch_flush enter 2026-02-17T21:08:56.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 10 librados: watch_flush exit 2026-02-17T21:08:56.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 20 client.4817.objecter shutdown clearing up homeless session... 2026-02-17T21:08:56.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 10 client.4817.objecter successfully canceled tick 2026-02-17T21:08:56.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbbe00792b0 msgr2=0x7fbbe007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:56.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbbe00792b0 0x7fbbe007b770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbc1008f310 tx=0x7fbc04033000 comp rx=0 tx=0).stop 2026-02-17T21:08:56.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 10 monclient: shutdown 2026-02-17T21:08:56.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:08:56.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc100ccb80 msgr2=0x7fbc10151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc100ccb80 0x7fbc10151aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000ec10 tx=0x7fbc0000c520 comp rx=0 tx=0).stop 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 shutdown_connections 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbbe00792b0 0x7fbbe007b770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbc10156220 0x7fbc101f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbc10155e40 0x7fbc101478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 --2- 10.20.193.45:0/3449572771 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbc100ccb80 0x7fbc10151aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 >> 10.20.193.45:0/3449572771 conn(0x7fbc100ce270 msgr2=0x7fbc100ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 shutdown_connections 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 -- 10.20.193.45:0/3449572771 wait complete. 2026-02-17T21:08:56.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:08:57.000+0000 7fbc177a9640 1 librados: shutdown 2026-02-17T21:09:00.002 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:00.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.079+0000 7effa7236640 10 monclient: get_monmap_and_config 2026-02-17T21:09:00.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.079+0000 7effa7236640 10 monclient: build_initial_monmap 2026-02-17T21:09:00.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.079+0000 7effa7236640 10 monclient: monmap: 2026-02-17T21:09:00.072 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:00.080546+0000 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:00.080546+0000 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:00.073 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:00.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 1 Processor -- start 2026-02-17T21:09:00.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 1 -- start start 2026-02-17T21:09:00.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 10 monclient: init 2026-02-17T21:09:00.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 10 monclient: _add_conns ranks=[0,4,2,5,1,3] 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7effa015d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7effa00c92b0 0x7effa015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 10 monclient(hunting): picked mon.noname-b con 0x7effa00c92b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7effa00748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa00c5860 con 0x7effa015d1e0 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa00c5580 con 0x7effa00748e0 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7effa00c7de0 con 0x7effa00c92b0 2026-02-17T21:09:00.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.080+0000 7effa7236640 10 monclient(hunting): authenticate will time out at 1123.710668s 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7effa4fab640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7effa015d1e0 0x7effa00c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:50580/0 (socket says 10.20.193.45:50580) 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7effa4fab640 1 -- 10.20.193.45:0/4264679453 learned_addr learned my addr 10.20.193.45:0/4264679453 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7eff97fff640 1 --2- 10.20.193.45:0/4264679453 >> v2:10.20.193.86:3300/0 conn(0x7effa00c92b0 0x7effa015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7eff97fff640 10 monclient(hunting): get_auth_request con 0x7effa00c92b0 auth_method 0 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7eff97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7eff97fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7eff97fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7eff97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7eff97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:00.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.081+0000 7eff97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 1 -- 10.20.193.45:0/4264679453 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544985706 0 0) 0x7effa00c5580 con 0x7effa00748e0 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 10 monclient(hunting): _negotiate 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 10 monclient(hunting): my global_id is 4820 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 1 -- 10.20.193.45:0/4264679453 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff8c003620 con 0x7effa00748e0 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 1 -- 10.20.193.45:0/4264679453 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858882607 0 0) 0x7effa00c5860 con 0x7effa015d1e0 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 10 monclient(hunting): _negotiate 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 10 monclient(hunting): my global_id is 4716 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff977fe640 1 -- 10.20.193.45:0/4264679453 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa00c5580 con 0x7effa015d1e0 2026-02-17T21:09:00.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff97fff640 10 monclient(hunting): handle_auth_done global_id 4774 payload 274 2026-02-17T21:09:00.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff97fff640 1 -- 10.20.193.45:0/4264679453 >> v1:10.20.193.92:6789/0 conn(0x7effa00748e0 legacy=0x7effa0153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:00.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff97fff640 1 -- 10.20.193.45:0/4264679453 >> v1:10.20.193.45:6789/0 conn(0x7effa015d1e0 legacy=0x7effa00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:00.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff97fff640 10 monclient: _finish_hunting 0 2026-02-17T21:09:00.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff97fff640 1 monclient: found mon.noname-b 2026-02-17T21:09:00.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff97fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:00.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff97fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:00.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.082+0000 7eff97fff640 1 -- 10.20.193.45:0/4264679453 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa00c80c0 con 0x7effa00c92b0 2026-02-17T21:09:00.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.083+0000 7eff97fff640 1 --2- 10.20.193.45:0/4264679453 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa00c92b0 0x7effa015d5c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff880098d0 tx=0x7eff8802eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e390c1dedb34883 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:00.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 1 -- 10.20.193.45:0/4264679453 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8803c070 con 0x7effa00c92b0 2026-02-17T21:09:00.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:00.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 10 monclient: dump: 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:00.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 10 monclient: _finish_auth 0 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 10 monclient: _check_auth_tickets 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 1 -- 10.20.193.45:0/4264679453 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8802fba0 con 0x7effa00c92b0 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 1 -- 10.20.193.45:0/4264679453 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff88037440 con 0x7effa00c92b0 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7eff977fe640 10 monclient: dump: 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:00.088 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 5 monclient: authenticate success, global_id 4774 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 4 set_mon_vals no callback set 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 10 monclient: shutdown 2026-02-17T21:09:00.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 1 -- 10.20.193.45:0/4264679453 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa00c92b0 msgr2=0x7effa015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 1 --2- 10.20.193.45:0/4264679453 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa00c92b0 0x7effa015d5c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff880098d0 tx=0x7eff8802eed0 comp rx=0 tx=0).stop 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 1 -- 10.20.193.45:0/4264679453 shutdown_connections 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 1 --2- 10.20.193.45:0/4264679453 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa00c92b0 0x7effa015d5c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 1 -- 10.20.193.45:0/4264679453 >> 10.20.193.45:0/4264679453 conn(0x7effa00c9d40 msgr2=0x7effa00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 1 -- 10.20.193.45:0/4264679453 shutdown_connections 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.085+0000 7effa7236640 1 -- 10.20.193.45:0/4264679453 wait complete. 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient: build_initial_monmap 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient: monmap: 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:00.090 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 librados: starting msgr at 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 librados: starting objecter 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 Processor -- start 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 -- start start 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 librados: setting wanted keys 2026-02-17T21:09:00.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 librados: calling monclient init 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient: init 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7effa00748e0 0x7effa01f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient(hunting): picked mon.noname-a con 0x7effa00748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effa00c92b0 0x7effa013f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient(hunting): picked mon.noname-c con 0x7effa00c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa015d1e0 0x7effa0072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient(hunting): picked mon.noname-b con 0x7effa015d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7effa0074d30 con 0x7effa00748e0 2026-02-17T21:09:00.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7effa00c8680 con 0x7effa015d1e0 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7effa0153d20 con 0x7effa00c92b0 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.086+0000 7effa7236640 10 monclient(hunting): authenticate will time out at 1123.716862s 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa015d1e0 0x7effa0072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7eff97fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effa00c92b0 0x7effa013f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa4fab640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7effa00748e0 0x7effa01f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa015d1e0 0x7effa0072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:39562/0 (socket says 10.20.193.45:39562) 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 1 -- 10.20.193.45:0/1784439779 learned_addr learned my addr 10.20.193.45:0/1784439779 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 10 monclient(hunting): get_auth_request con 0x7effa015d1e0 auth_method 0 2026-02-17T21:09:00.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7eff97fff640 10 monclient(hunting): get_auth_request con 0x7effa00c92b0 auth_method 0 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7eff97fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7eff97fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7eff97fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa4fab640 10 monclient(hunting): get_auth_request con 0x7effa00748e0 auth_method 0 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa4fab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa4fab640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa4fab640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:00.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa57ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7eff97fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7eff97fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7eff97fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa4fab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa4fab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.087+0000 7effa4fab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 10 monclient(hunting): handle_auth_done global_id 4777 payload 824 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 1 -- 10.20.193.45:0/1784439779 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effa00c92b0 msgr2=0x7effa013f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effa00c92b0 0x7effa013f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 1 -- 10.20.193.45:0/1784439779 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7effa00748e0 msgr2=0x7effa01f7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7effa00748e0 0x7effa01f7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:00.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 10 monclient: _finish_hunting 0 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 1 monclient: found mon.noname-b 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.088+0000 7effa57ac640 1 -- 10.20.193.45:0/1784439779 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa00cb980 con 0x7effa015d1e0 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.089+0000 7effa57ac640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa015d1e0 0x7effa0072490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00cc30 tx=0x7eff9c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.089+0000 7eff957fa640 10 client.?.objecter ms_handle_connect 0x7effa015d1e0 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.089+0000 7eff957fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 1 -- 10.20.193.45:0/1784439779 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00ce50 con 0x7effa015d1e0 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 10 monclient: dump: 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:00.096 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 10 monclient: _finish_auth 0 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 10 monclient: _check_auth_tickets 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:00.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 1 -- 10.20.193.45:0/1784439779 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c003a70 con 0x7effa015d1e0 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 1 -- 10.20.193.45:0/1784439779 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c003e40 con 0x7effa015d1e0 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff957fa640 10 monclient: dump: 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:00.098 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 5 monclient: authenticate success, global_id 4777 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7eff96ffd640 4 set_mon_vals no callback set 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 10 monclient: _renew_subs 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa013f550 con 0x7effa015d1e0 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 10 client.4777.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 10 monclient: _renew_subs 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa01f45f0 con 0x7effa015d1e0 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 1 librados: init done 2026-02-17T21:09:00.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:00.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:00.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:00.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.091+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa015d5c0 con 0x7effa015d1e0 2026-02-17T21:09:00.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.195+0000 7eff957fa640 1 -- 10.20.193.45:0/1784439779 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7eff9c0050d0 con 0x7effa015d1e0 2026-02-17T21:09:00.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.196+0000 7eff957fa640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7eff700794a0 0x7eff7007b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:00.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.196+0000 7effa4fab640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7eff700794a0 0x7eff7007b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:00.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.196+0000 7effa4fab640 10 monclient: get_auth_request con 0x7eff700794a0 auth_method 0 2026-02-17T21:09:00.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.196+0000 7effa4fab640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7eff700794a0 0x7eff7007b960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7eff90005980 tx=0x7eff90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:00.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.196+0000 7eff957fa640 10 client.4777.objecter ms_handle_connect 0x7eff700794a0 2026-02-17T21:09:00.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.197+0000 7eff957fa640 1 -- 10.20.193.45:0/1784439779 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7eff9c05ea80 con 0x7effa015d1e0 2026-02-17T21:09:00.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.197+0000 7eff957fa640 10 client.4777.objecter ms_dispatch2 0x7effa0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:00.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.197+0000 7eff957fa640 3 client.4777.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:00.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.197+0000 7eff957fa640 3 client.4777.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:00.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.197+0000 7eff957fa640 20 client.4777.objecter dump_active .. 0 homeless 2026-02-17T21:09:00.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.203+0000 7eff957fa640 1 -- 10.20.193.45:0/1784439779 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7eff9c062a40 con 0x7effa015d1e0 2026-02-17T21:09:00.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.203+0000 7eff957fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:00.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.203+0000 7eff957fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:00.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.304+0000 7effa7236640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:00.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.304+0000 7effa7236640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:00.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.304+0000 7effa7236640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:00.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.304+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7effa00c49b0 con 0x7effa015d1e0 2026-02-17T21:09:00.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.307+0000 7eff957fa640 1 -- 10.20.193.45:0/1784439779 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7eff9c066d40 con 0x7effa015d1e0 2026-02-17T21:09:00.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.307+0000 7eff957fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:00.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.307+0000 7eff957fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:00.299 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:00.299 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:00.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 10 librados: watch_flush enter 2026-02-17T21:09:00.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 10 librados: watch_flush exit 2026-02-17T21:09:00.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 20 client.4777.objecter shutdown clearing up homeless session... 2026-02-17T21:09:00.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 10 client.4777.objecter successfully canceled tick 2026-02-17T21:09:00.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7eff700794a0 msgr2=0x7eff7007b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:00.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7eff700794a0 0x7eff7007b960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7eff90005980 tx=0x7eff90009040 comp rx=0 tx=0).stop 2026-02-17T21:09:00.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 10 monclient: shutdown 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa015d1e0 msgr2=0x7effa0072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa015d1e0 0x7effa0072490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00cc30 tx=0x7eff9c00a430 comp rx=0 tx=0).stop 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 shutdown_connections 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7eff700794a0 0x7eff7007b960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7effa015d1e0 0x7effa0072490 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effa00c92b0 0x7effa013f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 --2- 10.20.193.45:0/1784439779 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7effa00748e0 0x7effa01f7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 >> 10.20.193.45:0/1784439779 conn(0x7effa00c9d40 msgr2=0x7effa0149360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 shutdown_connections 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 -- 10.20.193.45:0/1784439779 wait complete. 2026-02-17T21:09:00.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:00.308+0000 7effa7236640 1 librados: shutdown 2026-02-17T21:09:03.310 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:03.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.384+0000 7f40f285b640 10 monclient: get_monmap_and_config 2026-02-17T21:09:03.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.384+0000 7f40f285b640 10 monclient: build_initial_monmap 2026-02-17T21:09:03.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.384+0000 7f40f285b640 10 monclient: monmap: 2026-02-17T21:09:03.377 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:03.377 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:03.377 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:03.385329+0000 2026-02-17T21:09:03.377 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:03.385329+0000 2026-02-17T21:09:03.377 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:03.377 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:03.377 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:03.378 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:03.378 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:03.378 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:03.378 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:03.378 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:03.378 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:03.381 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.384+0000 7f40f285b640 1 Processor -- start 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 1 -- start start 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient: init 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient: _add_conns ranks=[5,1,3,2,0,4] 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f40ec15d1e0 0x7f40ec15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient(hunting): picked mon.noname-c con 0x7f40ec15d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f40ec0748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f40ec0c92b0 0x7f40ec153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient(hunting): picked mon.noname-a con 0x7f40ec0c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:03.382 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40ec0c5860 con 0x7f40ec0748e0 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f40ec0c5580 con 0x7f40ec0c92b0 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f40ec0c7de0 con 0x7f40ec15d1e0 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f285b640 10 monclient(hunting): authenticate will time out at 1127.015553s 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40f0dd1640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f40ec0c92b0 0x7f40ec153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40eb7fe640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f40ec0748e0 0x7f40ec0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:60552/0 (socket says 10.20.193.45:60552) 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40eb7fe640 1 -- 10.20.193.45:0/2350813262 learned_addr learned my addr 10.20.193.45:0/2350813262 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.385+0000 7f40ebfff640 1 --2- 10.20.193.45:0/2350813262 >> v2:10.20.193.92:3300/0 conn(0x7f40ec15d1e0 0x7f40ec15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:03.383 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40ebfff640 10 monclient(hunting): get_auth_request con 0x7f40ec15d1e0 auth_method 0 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40f0dd1640 10 monclient(hunting): get_auth_request con 0x7f40ec0c92b0 auth_method 0 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40f0dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40f0dd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40f0dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40f0dd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40f0dd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:03.384 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.386+0000 7f40f0dd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40eaffd640 1 -- 10.20.193.45:0/2350813262 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780584283 0 0) 0x7f40ec0c5860 con 0x7f40ec0748e0 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40eaffd640 10 monclient(hunting): _negotiate 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40eaffd640 10 monclient(hunting): my global_id is 4780 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40eaffd640 1 -- 10.20.193.45:0/2350813262 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40d0003620 con 0x7f40ec0748e0 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40ebfff640 10 monclient(hunting): handle_auth_done global_id 4826 payload 274 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40ebfff640 1 -- 10.20.193.45:0/2350813262 >> v2:10.20.193.45:3300/0 conn(0x7f40ec0c92b0 msgr2=0x7f40ec153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40ebfff640 1 --2- 10.20.193.45:0/2350813262 >> v2:10.20.193.45:3300/0 conn(0x7f40ec0c92b0 0x7f40ec153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40ebfff640 1 -- 10.20.193.45:0/2350813262 >> v1:10.20.193.86:6789/0 conn(0x7f40ec0748e0 legacy=0x7f40ec0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40ebfff640 10 monclient: _finish_hunting 0 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40ebfff640 1 monclient: found mon.noname-c 2026-02-17T21:09:03.385 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:03.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40ebfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:03.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.387+0000 7f40ebfff640 1 -- 10.20.193.45:0/2350813262 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec0c80c0 con 0x7f40ec15d1e0 2026-02-17T21:09:03.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.388+0000 7f40ebfff640 1 --2- 10.20.193.45:0/2350813262 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec15d1e0 0x7f40ec15d5c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f40d80098a0 tx=0x7f40d802ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b5d56b66c60d8c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:03.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 1 -- 10.20.193.45:0/2350813262 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d803c070 con 0x7f40ec15d1e0 2026-02-17T21:09:03.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:03.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 10 monclient: dump: 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:03.393 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 10 monclient: _finish_auth 0 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 5 monclient: authenticate success, global_id 4826 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 1 -- 10.20.193.45:0/2350813262 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d802fae0 con 0x7f40ec15d1e0 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 1 -- 10.20.193.45:0/2350813262 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8037440 con 0x7f40ec15d1e0 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 4 set_mon_vals no callback set 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:03.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40eaffd640 10 monclient: dump: 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 10 monclient: shutdown 2026-02-17T21:09:03.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 1 -- 10.20.193.45:0/2350813262 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec15d1e0 msgr2=0x7f40ec15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 1 --2- 10.20.193.45:0/2350813262 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec15d1e0 0x7f40ec15d5c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f40d80098a0 tx=0x7f40d802ee10 comp rx=0 tx=0).stop 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 1 -- 10.20.193.45:0/2350813262 shutdown_connections 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 1 --2- 10.20.193.45:0/2350813262 >> v2:10.20.193.45:3300/0 conn(0x7f40ec0c92b0 0x7f40ec153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 1 --2- 10.20.193.45:0/2350813262 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec15d1e0 0x7f40ec15d5c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 1 -- 10.20.193.45:0/2350813262 >> 10.20.193.45:0/2350813262 conn(0x7f40ec0c9d40 msgr2=0x7f40ec0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 1 -- 10.20.193.45:0/2350813262 shutdown_connections 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.390+0000 7f40f285b640 1 -- 10.20.193.45:0/2350813262 wait complete. 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient: build_initial_monmap 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient: monmap: 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:03.396 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 librados: starting msgr at 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 librados: starting objecter 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 Processor -- start 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 -- start start 2026-02-17T21:09:03.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 librados: setting wanted keys 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 librados: calling monclient init 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient: init 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec0748e0 0x7f40ec1f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient(hunting): picked mon.noname-c con 0x7f40ec0748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40ec0c92b0 0x7f40ec13f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient(hunting): picked mon.noname-b con 0x7f40ec0c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40ec15d1e0 0x7f40ec0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient(hunting): picked mon.noname-a con 0x7f40ec15d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec074d30 con 0x7f40ec15d1e0 2026-02-17T21:09:03.398 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec0c8680 con 0x7f40ec0c92b0 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec153b50 con 0x7f40ec0748e0 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.391+0000 7f40f285b640 10 monclient(hunting): authenticate will time out at 1127.021961s 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40f0dd1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40ec15d1e0 0x7f40ec0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec0748e0 0x7f40ec1f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40eb7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40ec0c92b0 0x7f40ec13f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec0748e0 0x7f40ec1f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:33258/0 (socket says 10.20.193.45:33258) 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 1 -- 10.20.193.45:0/4170861040 learned_addr learned my addr 10.20.193.45:0/4170861040 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 10 monclient(hunting): get_auth_request con 0x7f40ec0748e0 auth_method 0 2026-02-17T21:09:03.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40eb7fe640 10 monclient(hunting): get_auth_request con 0x7f40ec0c92b0 auth_method 0 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40f0dd1640 10 monclient(hunting): get_auth_request con 0x7f40ec15d1e0 auth_method 0 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40f0dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40f0dd1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40f0dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:03.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40f0dd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40f0dd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.392+0000 7f40f0dd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 10 monclient(hunting): handle_auth_done global_id 4829 payload 824 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 1 -- 10.20.193.45:0/4170861040 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40ec0c92b0 msgr2=0x7f40ec13f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40ec0c92b0 0x7f40ec13f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 1 -- 10.20.193.45:0/4170861040 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40ec15d1e0 msgr2=0x7f40ec0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40ec15d1e0 0x7f40ec0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 10 monclient: _finish_hunting 0 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 1 monclient: found mon.noname-c 2026-02-17T21:09:03.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.393+0000 7f40ebfff640 1 -- 10.20.193.45:0/4170861040 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec1f3470 con 0x7f40ec0748e0 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.394+0000 7f40ebfff640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec0748e0 0x7f40ec1f2d30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f40d802f340 tx=0x7f40d80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.394+0000 7f40e8ff9640 10 client.?.objecter ms_handle_connect 0x7f40ec0748e0 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.394+0000 7f40e8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 1 -- 10.20.193.45:0/4170861040 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8046020 con 0x7f40ec0748e0 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 10 monclient: dump: 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:03.402 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 10 monclient: _finish_auth 0 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 1 -- 10.20.193.45:0/4170861040 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d8042430 con 0x7f40ec0748e0 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40f285b640 5 monclient: authenticate success, global_id 4829 2026-02-17T21:09:03.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40f285b640 10 monclient: _renew_subs 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40f285b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ec1f3750 con 0x7f40ec0748e0 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 1 -- 10.20.193.45:0/4170861040 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d803c040 con 0x7f40ec0748e0 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40ea7fc640 4 set_mon_vals no callback set 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40e8ff9640 10 monclient: dump: 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:03.404 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40f285b640 10 client.4829.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40f285b640 10 monclient: _renew_subs 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40f285b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ec1f3d10 con 0x7f40ec0748e0 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.396+0000 7f40f285b640 1 librados: init done 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.397+0000 7f40f285b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.397+0000 7f40f285b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:03.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.397+0000 7f40f285b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:03.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.397+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ec153f30 con 0x7f40ec0748e0 2026-02-17T21:09:03.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.407+0000 7f40e8ff9640 1 -- 10.20.193.45:0/4170861040 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f40d8053070 con 0x7f40ec0748e0 2026-02-17T21:09:03.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.408+0000 7f40e8ff9640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f40bc0792d0 0x7f40bc07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:03.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.408+0000 7f40eb7fe640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f40bc0792d0 0x7f40bc07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:03.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.408+0000 7f40eb7fe640 10 monclient: get_auth_request con 0x7f40bc0792d0 auth_method 0 2026-02-17T21:09:03.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.408+0000 7f40eb7fe640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f40bc0792d0 0x7f40bc07b790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007b60 tx=0x7f40dc007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:03.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.408+0000 7f40e8ff9640 10 client.4829.objecter ms_handle_connect 0x7f40bc0792d0 2026-02-17T21:09:03.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.409+0000 7f40e8ff9640 1 -- 10.20.193.45:0/4170861040 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f40d80838a0 con 0x7f40ec0748e0 2026-02-17T21:09:03.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.409+0000 7f40e8ff9640 10 client.4829.objecter ms_dispatch2 0x7f40ec000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:03.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.409+0000 7f40e8ff9640 3 client.4829.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:03.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.409+0000 7f40e8ff9640 3 client.4829.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:03.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.409+0000 7f40e8ff9640 20 client.4829.objecter dump_active .. 0 homeless 2026-02-17T21:09:03.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.508+0000 7f40e8ff9640 1 -- 10.20.193.45:0/4170861040 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f40d8050020 con 0x7f40ec0748e0 2026-02-17T21:09:03.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.508+0000 7f40e8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:03.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.508+0000 7f40e8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:03.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.610+0000 7f40f285b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:03.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.610+0000 7f40f285b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:03.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.610+0000 7f40f285b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:03.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.610+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f40ec140650 con 0x7f40ec0748e0 2026-02-17T21:09:03.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.612+0000 7f40e8ff9640 1 -- 10.20.193.45:0/4170861040 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f40d8087860 con 0x7f40ec0748e0 2026-02-17T21:09:03.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.612+0000 7f40e8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:03.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.612+0000 7f40e8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:03.605 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:03.605 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 10 librados: watch_flush enter 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 10 librados: watch_flush exit 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 20 client.4829.objecter shutdown clearing up homeless session... 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 10 client.4829.objecter successfully canceled tick 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f40bc0792d0 msgr2=0x7f40bc07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f40bc0792d0 0x7f40bc07b790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f40dc007b60 tx=0x7f40dc007ab0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 10 monclient: shutdown 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec0748e0 msgr2=0x7f40ec1f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:03.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec0748e0 0x7f40ec1f2d30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f40d802f340 tx=0x7f40d80047c0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 shutdown_connections 2026-02-17T21:09:03.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f40bc0792d0 0x7f40bc07b790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40ec15d1e0 0x7f40ec0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40ec0c92b0 0x7f40ec13f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 --2- 10.20.193.45:0/4170861040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40ec0748e0 0x7f40ec1f2d30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:03.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 >> 10.20.193.45:0/4170861040 conn(0x7f40ec0c9d40 msgr2=0x7f40ec14dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:03.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 shutdown_connections 2026-02-17T21:09:03.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.613+0000 7f40f285b640 1 -- 10.20.193.45:0/4170861040 wait complete. 2026-02-17T21:09:03.608 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:03.614+0000 7f40f285b640 1 librados: shutdown 2026-02-17T21:09:06.616 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:06.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.694+0000 7f5902bf7640 10 monclient: get_monmap_and_config 2026-02-17T21:09:06.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.694+0000 7f5902bf7640 10 monclient: build_initial_monmap 2026-02-17T21:09:06.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.694+0000 7f5902bf7640 10 monclient: monmap: 2026-02-17T21:09:06.686 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:06.694873+0000 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:06.694873+0000 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:06.687 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:06.688 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:06.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.694+0000 7f5902bf7640 1 Processor -- start 2026-02-17T21:09:06.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.694+0000 7f5902bf7640 1 -- start start 2026-02-17T21:09:06.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.694+0000 7f5902bf7640 10 monclient: init 2026-02-17T21:09:06.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:06.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 10 monclient: _add_conns ranks=[4,1,3,2,0,5] 2026-02-17T21:09:06.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f58fc152620 0x7f58fc15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:06.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 10 monclient(hunting): picked mon.noname-b con 0x7f58fc152620 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:06.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f58fc152a00 addr v1:10.20.193.86:6789/0 2026-02-17T21:09:06.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f58fc0c94a0 0x7f58fc15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 10 monclient(hunting): picked mon.noname-a con 0x7f58fc0c94a0 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58fc0c71a0 con 0x7f58fc152a00 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f58fc0c7760 con 0x7f58fc0c94a0 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f58fc0c7480 con 0x7f58fc152620 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f5902bf7640 10 monclient(hunting): authenticate will time out at 1130.325116s 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f590096c640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f58fc152620 0x7f58fc15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f590096c640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f58fc152620 0x7f58fc15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:39578/0 (socket says 10.20.193.45:39578) 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f590096c640 1 -- 10.20.193.45:0/2606524787 learned_addr learned my addr 10.20.193.45:0/2606524787 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:06.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f590096c640 10 monclient(hunting): get_auth_request con 0x7f58fc152620 auth_method 0 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f590096c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f590096c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.695+0000 7f590096c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590116d640 1 --2- 10.20.193.45:0/2606524787 >> v2:10.20.193.45:3300/0 conn(0x7f58fc0c94a0 0x7f58fc15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590096c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590096c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590096c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590116d640 10 monclient(hunting): get_auth_request con 0x7f58fc0c94a0 auth_method 0 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590116d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590116d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590116d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590116d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:06.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590116d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.696+0000 7f590116d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.697+0000 7f590096c640 10 monclient(hunting): handle_auth_done global_id 4786 payload 274 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.697+0000 7f590096c640 1 -- 10.20.193.45:0/2606524787 >> v2:10.20.193.45:3300/0 conn(0x7f58fc0c94a0 msgr2=0x7f58fc15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.697+0000 7f590096c640 1 --2- 10.20.193.45:0/2606524787 >> v2:10.20.193.45:3300/0 conn(0x7f58fc0c94a0 0x7f58fc15ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.697+0000 7f590096c640 1 -- 10.20.193.45:0/2606524787 >> v1:10.20.193.86:6789/0 conn(0x7f58fc152a00 legacy=0x7f58fc0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.697+0000 7f590096c640 10 monclient: _finish_hunting 0 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.697+0000 7f590096c640 1 monclient: found mon.noname-b 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.697+0000 7f590096c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.697+0000 7f590096c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:06.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.697+0000 7f590096c640 1 -- 10.20.193.45:0/2606524787 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc159e00 con 0x7f58fc152620 2026-02-17T21:09:06.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.699+0000 7f590096c640 1 --2- 10.20.193.45:0/2606524787 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 0x7f58fc15a8e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f58fc072110 tx=0x7f58ec02eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e630af5173e434b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:06.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.700+0000 7f58f37fe640 1 -- 10.20.193.45:0/2606524787 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec03c070 con 0x7f58fc152620 2026-02-17T21:09:06.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.700+0000 7f58f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:06.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:06.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 10 monclient: dump: 2026-02-17T21:09:06.701 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:06.701 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:06.701 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:06.701 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 10 monclient: _finish_auth 0 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 1 -- 10.20.193.45:0/2606524787 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec02fb20 con 0x7f58fc152620 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 5 monclient: authenticate success, global_id 4786 2026-02-17T21:09:06.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 1 -- 10.20.193.45:0/2606524787 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec037440 con 0x7f58fc152620 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 4 set_mon_vals no callback set 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f58f37fe640 10 monclient: dump: 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:06.703 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 10 monclient: shutdown 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 1 -- 10.20.193.45:0/2606524787 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 msgr2=0x7f58fc15a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 1 --2- 10.20.193.45:0/2606524787 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 0x7f58fc15a8e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f58fc072110 tx=0x7f58ec02eeb0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 1 -- 10.20.193.45:0/2606524787 shutdown_connections 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 1 --2- 10.20.193.45:0/2606524787 >> v2:10.20.193.45:3300/0 conn(0x7f58fc0c94a0 0x7f58fc15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 1 --2- 10.20.193.45:0/2606524787 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 0x7f58fc15a8e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 1 -- 10.20.193.45:0/2606524787 >> 10.20.193.45:0/2606524787 conn(0x7f58fc0c9d40 msgr2=0x7f58fc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:06.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 1 -- 10.20.193.45:0/2606524787 shutdown_connections 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 1 -- 10.20.193.45:0/2606524787 wait complete. 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 10 monclient: build_initial_monmap 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.701+0000 7f5902bf7640 10 monclient: monmap: 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:06.705 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 librados: starting msgr at 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 librados: starting objecter 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 Processor -- start 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 -- start start 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 librados: setting wanted keys 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 librados: calling monclient init 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient: init 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58fc0c94a0 0x7f58fc158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient(hunting): picked mon.noname-c con 0x7f58fc0c94a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:06.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 0x7f58fc06b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient(hunting): picked mon.noname-b con 0x7f58fc152620 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58fc152a00 0x7f58fc155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient(hunting): picked mon.noname-a con 0x7f58fc152a00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc0c7c40 con 0x7f58fc152a00 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc15a3c0 con 0x7f58fc152620 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58fc0c7dc0 con 0x7f58fc0c94a0 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f5902bf7640 10 monclient(hunting): authenticate will time out at 1130.332567s 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f590116d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58fc152a00 0x7f58fc155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:06.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f58f3fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 0x7f58fc06b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.702+0000 7f590096c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58fc0c94a0 0x7f58fc158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590116d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58fc152a00 0x7f58fc155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:43598/0 (socket says 10.20.193.45:43598) 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590116d640 1 -- 10.20.193.45:0/4202289264 learned_addr learned my addr 10.20.193.45:0/4202289264 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590116d640 10 monclient(hunting): get_auth_request con 0x7f58fc152a00 auth_method 0 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f58f3fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 0x7f58fc06b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:39582/0 (socket says 10.20.193.45:39582) 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590116d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590116d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590116d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f58f3fff640 10 monclient(hunting): get_auth_request con 0x7f58fc152620 auth_method 0 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f58f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f58f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:06.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f58f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590096c640 10 monclient(hunting): get_auth_request con 0x7f58fc0c94a0 auth_method 0 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590096c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590096c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590096c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590116d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590116d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590116d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f58f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f58f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f58f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590096c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590096c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:06.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.703+0000 7f590096c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 10 monclient(hunting): handle_auth_done global_id 4731 payload 824 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 1 -- 10.20.193.45:0/4202289264 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58fc0c94a0 msgr2=0x7f58fc158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58fc0c94a0 0x7f58fc158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 1 -- 10.20.193.45:0/4202289264 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 msgr2=0x7f58fc06b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 0x7f58fc06b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 10 monclient: _finish_hunting 0 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 1 monclient: found mon.noname-a 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.704+0000 7f590116d640 1 -- 10.20.193.45:0/4202289264 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58fc1f4840 con 0x7f58fc152a00 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.705+0000 7f590116d640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58fc152a00 0x7f58fc155910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f58f800efc0 tx=0x7f58f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:06.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.705+0000 7f58f17fa640 10 client.?.objecter ms_handle_connect 0x7f58fc152a00 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.705+0000 7f58f17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 1 -- 10.20.193.45:0/4202289264 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8018020 con 0x7f58fc152a00 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 10 monclient: dump: 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:06.711 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 10 monclient: _finish_auth 0 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 10 monclient: _check_auth_tickets 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 1 -- 10.20.193.45:0/4202289264 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f8014480 con 0x7f58fc152a00 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f5902bf7640 5 monclient: authenticate success, global_id 4731 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 1 -- 10.20.193.45:0/4202289264 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8014870 con 0x7f58fc152a00 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f17fa640 10 monclient: dump: 2026-02-17T21:09:06.712 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f58f2ffd640 4 set_mon_vals no callback set 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f5902bf7640 10 monclient: _renew_subs 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f5902bf7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:06.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58fc1f39e0 con 0x7f58fc152a00 2026-02-17T21:09:06.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f5902bf7640 10 client.4731.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:06.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f5902bf7640 10 monclient: _renew_subs 2026-02-17T21:09:06.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f5902bf7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:06.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58fc1f3fa0 con 0x7f58fc152a00 2026-02-17T21:09:06.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.707+0000 7f5902bf7640 1 librados: init done 2026-02-17T21:09:06.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.708+0000 7f5902bf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:06.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.708+0000 7f5902bf7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:06.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.708+0000 7f5902bf7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:06.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.708+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58fc15a8e0 con 0x7f58fc152a00 2026-02-17T21:09:06.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.719+0000 7f58f17fa640 1 -- 10.20.193.45:0/4202289264 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f58f8014a10 con 0x7f58fc152a00 2026-02-17T21:09:06.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.720+0000 7f58f17fa640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f58cc079300 0x7f58cc07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:06.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.720+0000 7f590096c640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f58cc079300 0x7f58cc07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:06.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.720+0000 7f590096c640 10 monclient: get_auth_request con 0x7f58cc079300 auth_method 0 2026-02-17T21:09:06.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.720+0000 7f590096c640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f58cc079300 0x7f58cc07b7c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58fc1563b0 tx=0x7f58ec033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:06.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.720+0000 7f58f17fa640 10 client.4731.objecter ms_handle_connect 0x7f58cc079300 2026-02-17T21:09:06.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.722+0000 7f58f17fa640 1 -- 10.20.193.45:0/4202289264 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f58f805f190 con 0x7f58fc152a00 2026-02-17T21:09:06.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.722+0000 7f58f17fa640 10 client.4731.objecter ms_dispatch2 0x7f58fc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:06.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.722+0000 7f58f17fa640 3 client.4731.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:06.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.722+0000 7f58f17fa640 3 client.4731.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:06.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.722+0000 7f58f17fa640 20 client.4731.objecter dump_active .. 0 homeless 2026-02-17T21:09:06.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.826+0000 7f58f17fa640 1 -- 10.20.193.45:0/4202289264 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f58f8022070 con 0x7f58fc152a00 2026-02-17T21:09:06.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.826+0000 7f58f17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:06.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.826+0000 7f58f17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:06.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.927+0000 7f5902bf7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:06.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.927+0000 7f5902bf7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:06.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.927+0000 7f5902bf7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:06.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.927+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f58fc153160 con 0x7f58fc152a00 2026-02-17T21:09:06.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.929+0000 7f58f17fa640 1 -- 10.20.193.45:0/4202289264 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f58fc153160 con 0x7f58fc152a00 2026-02-17T21:09:06.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.929+0000 7f58f17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:06.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.929+0000 7f58f17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:06.922 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:06.922 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:06.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 10 librados: watch_flush enter 2026-02-17T21:09:06.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 10 librados: watch_flush exit 2026-02-17T21:09:06.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 20 client.4731.objecter shutdown clearing up homeless session... 2026-02-17T21:09:06.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 10 client.4731.objecter successfully canceled tick 2026-02-17T21:09:06.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f58cc079300 msgr2=0x7f58cc07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:06.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f58cc079300 0x7f58cc07b7c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58fc1563b0 tx=0x7f58ec033000 comp rx=0 tx=0).stop 2026-02-17T21:09:06.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 10 monclient: shutdown 2026-02-17T21:09:06.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58fc152a00 msgr2=0x7f58fc155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58fc152a00 0x7f58fc155910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f58f800efc0 tx=0x7f58f800c490 comp rx=0 tx=0).stop 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 shutdown_connections 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f58cc079300 0x7f58cc07b7c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f58fc152a00 0x7f58fc155910 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f58fc152620 0x7f58fc06b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 --2- 10.20.193.45:0/4202289264 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58fc0c94a0 0x7f58fc158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 >> 10.20.193.45:0/4202289264 conn(0x7f58fc0c9d40 msgr2=0x7f58fc0c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 shutdown_connections 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.930+0000 7f5902bf7640 1 -- 10.20.193.45:0/4202289264 wait complete. 2026-02-17T21:09:06.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:06.931+0000 7f5902bf7640 1 librados: shutdown 2026-02-17T21:09:09.933 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:10.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.009+0000 7fc87e653640 10 monclient: get_monmap_and_config 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.009+0000 7fc87e653640 10 monclient: build_initial_monmap 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.009+0000 7fc87e653640 10 monclient: monmap: 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:10.010188+0000 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:10.010188+0000 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:10.002 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:10.003 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:10.003 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:10.003 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:10.003 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:10.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.009+0000 7fc87e653640 1 Processor -- start 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.009+0000 7fc87e653640 1 -- start start 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.009+0000 7fc87e653640 10 monclient: init 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 10 monclient: _add_conns ranks=[4,0,1,5,3,2] 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc87815d1e0 0x7fc87815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 10 monclient(hunting): picked mon.noname-b con 0x7fc87815d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc8780748e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc8780c92b0 addr v1:10.20.193.86:6789/0 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8780c5860 con 0x7fc8780748e0 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8780c5580 con 0x7fc8780c92b0 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:10.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc8780c7de0 con 0x7fc87815d1e0 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc87e653640 10 monclient(hunting): authenticate will time out at 1133.640307s 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.010+0000 7fc877fff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc87815d1e0 0x7fc87815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.011+0000 7fc877fff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc87815d1e0 0x7fc87815d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:45078/0 (socket says 10.20.193.45:45078) 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.011+0000 7fc877fff640 1 -- 10.20.193.45:0/1048951796 learned_addr learned my addr 10.20.193.45:0/1048951796 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.011+0000 7fc877fff640 10 monclient(hunting): get_auth_request con 0x7fc87815d1e0 auth_method 0 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.011+0000 7fc877fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.011+0000 7fc877fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.011+0000 7fc877fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.011+0000 7fc877fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.011+0000 7fc877fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:10.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.011+0000 7fc877fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:10.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.012+0000 7fc877fff640 10 monclient(hunting): handle_auth_done global_id 4792 payload 274 2026-02-17T21:09:10.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.012+0000 7fc877fff640 1 -- 10.20.193.45:0/1048951796 >> v1:10.20.193.86:6789/0 conn(0x7fc8780c92b0 legacy=0x7fc878153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:10.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.012+0000 7fc877fff640 1 -- 10.20.193.45:0/1048951796 >> v1:10.20.193.45:6789/0 conn(0x7fc8780748e0 legacy=0x7fc8780c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:10.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.012+0000 7fc877fff640 10 monclient: _finish_hunting 0 2026-02-17T21:09:10.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.012+0000 7fc877fff640 1 monclient: found mon.noname-b 2026-02-17T21:09:10.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.012+0000 7fc877fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:10.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.012+0000 7fc877fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:10.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.012+0000 7fc877fff640 1 -- 10.20.193.45:0/1048951796 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8780c80c0 con 0x7fc87815d1e0 2026-02-17T21:09:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.014+0000 7fc877fff640 1 --2- 10.20.193.45:0/1048951796 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 0x7fc87815d5c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8640099a0 tx=0x7fc86402ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=811c42d0485e101a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 1 -- 10.20.193.45:0/1048951796 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86403c070 con 0x7fc87815d1e0 2026-02-17T21:09:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:10.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 10 monclient: dump: 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 10 monclient: _finish_auth 0 2026-02-17T21:09:10.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 1 -- 10.20.193.45:0/1048951796 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86402fb80 con 0x7fc87815d1e0 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 5 monclient: authenticate success, global_id 4792 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 4 set_mon_vals no callback set 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 1 -- 10.20.193.45:0/1048951796 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc864037440 con 0x7fc87815d1e0 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc876ffd640 10 monclient: dump: 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:10.014 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 10 monclient: shutdown 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 1 -- 10.20.193.45:0/1048951796 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 msgr2=0x7fc87815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 1 --2- 10.20.193.45:0/1048951796 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 0x7fc87815d5c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc8640099a0 tx=0x7fc86402ef50 comp rx=0 tx=0).stop 2026-02-17T21:09:10.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 1 -- 10.20.193.45:0/1048951796 shutdown_connections 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 1 --2- 10.20.193.45:0/1048951796 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 0x7fc87815d5c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 1 -- 10.20.193.45:0/1048951796 >> 10.20.193.45:0/1048951796 conn(0x7fc8780c9d40 msgr2=0x7fc8780ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 1 -- 10.20.193.45:0/1048951796 shutdown_connections 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.016+0000 7fc87e653640 1 -- 10.20.193.45:0/1048951796 wait complete. 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.017+0000 7fc87e653640 10 monclient: build_initial_monmap 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.017+0000 7fc87e653640 10 monclient: monmap: 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:10.016 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.017+0000 7fc87e653640 1 librados: starting msgr at 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.017+0000 7fc87e653640 1 librados: starting objecter 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.017+0000 7fc87e653640 1 Processor -- start 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.017+0000 7fc87e653640 1 -- start start 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.017+0000 7fc87e653640 1 librados: setting wanted keys 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.017+0000 7fc87e653640 1 librados: calling monclient init 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.017+0000 7fc87e653640 10 monclient: init 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:09:10.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc8780748e0 0x7fc878144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient(hunting): picked mon.noname-a con 0x7fc8780748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8780c92b0 0x7fc878072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient(hunting): picked mon.noname-c con 0x7fc8780c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 0x7fc8781f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient(hunting): picked mon.noname-b con 0x7fc87815d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc878074d30 con 0x7fc8780748e0 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc8780c8680 con 0x7fc87815d1e0 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc878153d20 con 0x7fc8780c92b0 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:10.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87e653640 10 monclient(hunting): authenticate will time out at 1133.648163s 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc877fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc8780748e0 0x7fc878144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87cbc9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 0x7fc8781f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc877fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc8780748e0 0x7fc878144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:50938/0 (socket says 10.20.193.45:50938) 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc877fff640 1 -- 10.20.193.45:0/536885587 learned_addr learned my addr 10.20.193.45:0/536885587 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc877fff640 10 monclient(hunting): get_auth_request con 0x7fc8780748e0 auth_method 0 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc877fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc877fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc877fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87cbc9640 10 monclient(hunting): get_auth_request con 0x7fc87815d1e0 auth_method 0 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87cbc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87cbc9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:10.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.018+0000 7fc87cbc9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc877fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc877fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc877fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc87cbc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc87cbc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc87cbc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc8777fe640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8780c92b0 0x7fc878072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc8777fe640 10 monclient(hunting): get_auth_request con 0x7fc8780c92b0 auth_method 0 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc8777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc8777fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:10.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.019+0000 7fc8777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:10.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc8777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:10.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc8777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:10.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc8777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:10.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 10 monclient(hunting): handle_auth_done global_id 4795 payload 824 2026-02-17T21:09:10.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 1 -- 10.20.193.45:0/536885587 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8780c92b0 msgr2=0x7fc878072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:10.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8780c92b0 0x7fc878072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 1 -- 10.20.193.45:0/536885587 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc8780748e0 msgr2=0x7fc878144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc8780748e0 0x7fc878144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 10 monclient: _finish_hunting 0 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 1 monclient: found mon.noname-b 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.020+0000 7fc87cbc9640 1 -- 10.20.193.45:0/536885587 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc878145240 con 0x7fc87815d1e0 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.021+0000 7fc87cbc9640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 0x7fc8781f3040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00cb10 tx=0x7fc86c00a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.021+0000 7fc874ff9640 10 client.?.objecter ms_handle_connect 0x7fc87815d1e0 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.021+0000 7fc874ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc874ff9640 1 -- 10.20.193.45:0/536885587 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c016020 con 0x7fc87815d1e0 2026-02-17T21:09:10.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc874ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc874ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc874ff9640 10 monclient: dump: 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:10.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc874ff9640 10 monclient: _finish_auth 0 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc874ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc874ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc87e653640 5 monclient: authenticate success, global_id 4795 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc87e653640 10 monclient: _renew_subs 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc87e653640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc878145520 con 0x7fc87815d1e0 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc87e653640 10 client.4795.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc87e653640 10 monclient: _renew_subs 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc87e653640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc878145ae0 con 0x7fc87815d1e0 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.022+0000 7fc87e653640 1 librados: init done 2026-02-17T21:09:10.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc87e653640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc87e653640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc87e653640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87815d5c0 con 0x7fc87815d1e0 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc874ff9640 1 -- 10.20.193.45:0/536885587 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86c00acb0 con 0x7fc87815d1e0 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc874ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc874ff9640 1 -- 10.20.193.45:0/536885587 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00ae60 con 0x7fc87815d1e0 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc874ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc874ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc8767fc640 4 set_mon_vals no callback set 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.023+0000 7fc874ff9640 10 monclient: dump: 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:10.027 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:10.028 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:10.028 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:10.028 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:10.028 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:10.028 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:10.028 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:10.028 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:10.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.133+0000 7fc874ff9640 1 -- 10.20.193.45:0/536885587 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc86c012420 con 0x7fc87815d1e0 2026-02-17T21:09:10.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.133+0000 7fc874ff9640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc848079280 0x7fc84807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:10.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.133+0000 7fc877fff640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc848079280 0x7fc84807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:10.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.133+0000 7fc877fff640 10 monclient: get_auth_request con 0x7fc848079280 auth_method 0 2026-02-17T21:09:10.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.133+0000 7fc874ff9640 10 client.4795.objecter ms_handle_connect 0x7fc848079280 2026-02-17T21:09:10.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.133+0000 7fc877fff640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc848079280 0x7fc84807b740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc86402ef90 tx=0x7fc864033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:10.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.135+0000 7fc874ff9640 1 -- 10.20.193.45:0/536885587 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fc86c098720 con 0x7fc87815d1e0 2026-02-17T21:09:10.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.135+0000 7fc874ff9640 10 client.4795.objecter ms_dispatch2 0x7fc878000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:10.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.135+0000 7fc874ff9640 3 client.4795.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:10.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.135+0000 7fc874ff9640 3 client.4795.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:10.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.135+0000 7fc874ff9640 20 client.4795.objecter dump_active .. 0 homeless 2026-02-17T21:09:10.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.142+0000 7fc874ff9640 1 -- 10.20.193.45:0/536885587 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc86c020020 con 0x7fc87815d1e0 2026-02-17T21:09:10.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.142+0000 7fc874ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:10.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.142+0000 7fc874ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:10.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.242+0000 7fc87e653640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:10.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.242+0000 7fc87e653640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:10.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.242+0000 7fc87e653640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:10.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.242+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc878149a10 con 0x7fc87815d1e0 2026-02-17T21:09:10.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.246+0000 7fc874ff9640 1 -- 10.20.193.45:0/536885587 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc86c062ba0 con 0x7fc87815d1e0 2026-02-17T21:09:10.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.246+0000 7fc874ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:10.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.246+0000 7fc874ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:10.239 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:10.239 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:10.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 10 librados: watch_flush enter 2026-02-17T21:09:10.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 10 librados: watch_flush exit 2026-02-17T21:09:10.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 20 client.4795.objecter shutdown clearing up homeless session... 2026-02-17T21:09:10.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 10 client.4795.objecter successfully canceled tick 2026-02-17T21:09:10.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc848079280 msgr2=0x7fc84807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:10.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc848079280 0x7fc84807b740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc86402ef90 tx=0x7fc864033000 comp rx=0 tx=0).stop 2026-02-17T21:09:10.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 10 monclient: shutdown 2026-02-17T21:09:10.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 msgr2=0x7fc8781f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 0x7fc8781f3040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00cb10 tx=0x7fc86c00a060 comp rx=0 tx=0).stop 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 shutdown_connections 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc848079280 0x7fc84807b740 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc87815d1e0 0x7fc8781f3040 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8780c92b0 0x7fc878072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 --2- 10.20.193.45:0/536885587 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc8780748e0 0x7fc878144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 >> 10.20.193.45:0/536885587 conn(0x7fc8780c9d40 msgr2=0x7fc8781533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 shutdown_connections 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 -- 10.20.193.45:0/536885587 wait complete. 2026-02-17T21:09:10.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:10.247+0000 7fc87e653640 1 librados: shutdown 2026-02-17T21:09:13.250 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.327+0000 7f6b739fe640 10 monclient: get_monmap_and_config 2026-02-17T21:09:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.327+0000 7f6b739fe640 10 monclient: build_initial_monmap 2026-02-17T21:09:13.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.327+0000 7f6b739fe640 10 monclient: monmap: 2026-02-17T21:09:13.320 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:13.320 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:13.320 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:13.328178+0000 2026-02-17T21:09:13.320 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:13.328178+0000 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.327+0000 7f6b739fe640 1 Processor -- start 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.327+0000 7f6b739fe640 1 -- start start 2026-02-17T21:09:13.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.327+0000 7f6b739fe640 10 monclient: init 2026-02-17T21:09:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 10 monclient: _add_conns ranks=[4,3,0,2,5,1] 2026-02-17T21:09:13.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f6b6c152620 0x7f6b6c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 10 monclient(hunting): picked mon.noname-b con 0x7f6b6c152620 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f6b6c152a00 0x7f6b6c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 10 monclient(hunting): picked mon.noname-a con 0x7f6b6c152a00 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6b6c0c8d90 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6c0c71a0 con 0x7f6b6c0c8d90 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f6b6c0c7760 con 0x7f6b6c152a00 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f6b6c0c7480 con 0x7f6b6c152620 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:13.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b739fe640 10 monclient(hunting): authenticate will time out at 1136.958292s 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b70f72640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f6b6c152a00 0x7f6b6c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.328+0000 7f6b71773640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f6b6c152620 0x7f6b6c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b71773640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f6b6c152620 0x7f6b6c15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:45088/0 (socket says 10.20.193.45:45088) 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b71773640 1 -- 10.20.193.45:0/2190582744 learned_addr learned my addr 10.20.193.45:0/2190582744 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b71773640 10 monclient(hunting): get_auth_request con 0x7f6b6c152620 auth_method 0 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b71773640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b71773640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b71773640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b70f72640 10 monclient(hunting): get_auth_request con 0x7f6b6c152a00 auth_method 0 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b70f72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b70f72640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:13.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b70f72640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b70f72640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b70f72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b70f72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b71773640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b71773640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.329+0000 7f6b71773640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.330+0000 7f6b70f72640 10 monclient(hunting): handle_auth_done global_id 4737 payload 274 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.330+0000 7f6b70f72640 1 -- 10.20.193.45:0/2190582744 >> v2:10.20.193.86:3300/0 conn(0x7f6b6c152620 msgr2=0x7f6b6c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.330+0000 7f6b70f72640 1 --2- 10.20.193.45:0/2190582744 >> v2:10.20.193.86:3300/0 conn(0x7f6b6c152620 0x7f6b6c15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.330+0000 7f6b70f72640 1 -- 10.20.193.45:0/2190582744 >> v1:10.20.193.45:6789/0 conn(0x7f6b6c0c8d90 legacy=0x7f6b6c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.330+0000 7f6b70f72640 10 monclient: _finish_hunting 0 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.330+0000 7f6b70f72640 1 monclient: found mon.noname-a 2026-02-17T21:09:13.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.330+0000 7f6b70f72640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.330+0000 7f6b70f72640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:09:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.330+0000 7f6b70f72640 1 -- 10.20.193.45:0/2190582744 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c159e00 con 0x7f6b6c152a00 2026-02-17T21:09:13.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.331+0000 7f6b70f72640 1 --2- 10.20.193.45:0/2190582744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b6c152a00 0x7f6b6c15ae20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c1563b0 tx=0x7f6b6002ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e2ac4413ae4555 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:13.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 1 -- 10.20.193.45:0/2190582744 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6003c070 con 0x7f6b6c152a00 2026-02-17T21:09:13.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:13.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:09:13.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 10 monclient: dump: 2026-02-17T21:09:13.334 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:13.334 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 10 monclient: _finish_auth 0 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:09:13.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 1 -- 10.20.193.45:0/2190582744 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6002fa50 con 0x7f6b6c152a00 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b739fe640 5 monclient: authenticate success, global_id 4737 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b739fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 1 -- 10.20.193.45:0/2190582744 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6002fe20 con 0x7f6b6c152a00 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b739fe640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b739fe640 4 set_mon_vals no callback set 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.333+0000 7f6b5bfff640 10 monclient: dump: 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:13.336 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 10 monclient: shutdown 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 -- 10.20.193.45:0/2190582744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b6c152a00 msgr2=0x7f6b6c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:13.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 --2- 10.20.193.45:0/2190582744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b6c152a00 0x7f6b6c15ae20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c1563b0 tx=0x7f6b6002ede0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 -- 10.20.193.45:0/2190582744 shutdown_connections 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 --2- 10.20.193.45:0/2190582744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b6c152a00 0x7f6b6c15ae20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 --2- 10.20.193.45:0/2190582744 >> v2:10.20.193.86:3300/0 conn(0x7f6b6c152620 0x7f6b6c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 -- 10.20.193.45:0/2190582744 >> 10.20.193.45:0/2190582744 conn(0x7f6b6c0c9d40 msgr2=0x7f6b6c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 -- 10.20.193.45:0/2190582744 shutdown_connections 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 -- 10.20.193.45:0/2190582744 wait complete. 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 10 monclient: build_initial_monmap 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 10 monclient: monmap: 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:13.338 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 librados: starting msgr at 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.334+0000 7f6b739fe640 1 librados: starting objecter 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 Processor -- start 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 -- start start 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 librados: setting wanted keys 2026-02-17T21:09:13.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 librados: calling monclient init 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient: init 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b6c0c8d90 0x7f6b6c0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient(hunting): picked mon.noname-a con 0x7f6b6c0c8d90 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6b6c152620 0x7f6b6c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient(hunting): picked mon.noname-c con 0x7f6b6c152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b6c152a00 0x7f6b6c1f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient(hunting): picked mon.noname-b con 0x7f6b6c152a00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c0c7c40 con 0x7f6b6c0c8d90 2026-02-17T21:09:13.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c15a3c0 con 0x7f6b6c152a00 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c0c7dc0 con 0x7f6b6c152620 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b739fe640 10 monclient(hunting): authenticate will time out at 1136.965496s 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b71773640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b6c0c8d90 0x7f6b6c0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b71f74640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b6c152a00 0x7f6b6c1f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b71f74640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b6c152a00 0x7f6b6c1f3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:45090/0 (socket says 10.20.193.45:45090) 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b71f74640 1 -- 10.20.193.45:0/1114429701 learned_addr learned my addr 10.20.193.45:0/1114429701 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b71f74640 10 monclient(hunting): get_auth_request con 0x7f6b6c152a00 auth_method 0 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b71f74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:13.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b71f74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.335+0000 7f6b71f74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b70f72640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6b6c152620 0x7f6b6c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71773640 10 monclient(hunting): get_auth_request con 0x7f6b6c0c8d90 auth_method 0 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71773640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71773640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71773640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71f74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71f74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71f74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b70f72640 10 monclient(hunting): get_auth_request con 0x7f6b6c152620 auth_method 0 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b70f72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:13.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b70f72640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b70f72640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71773640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71773640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b71773640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b70f72640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b70f72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.336+0000 7f6b70f72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 10 monclient(hunting): handle_auth_done global_id 4801 payload 824 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 1 -- 10.20.193.45:0/1114429701 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6b6c152620 msgr2=0x7f6b6c157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6b6c152620 0x7f6b6c157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 1 -- 10.20.193.45:0/1114429701 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b6c0c8d90 msgr2=0x7f6b6c0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:13.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b6c0c8d90 0x7f6b6c0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 10 monclient: _finish_hunting 0 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 1 monclient: found mon.noname-b 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.337+0000 7f6b71f74640 1 -- 10.20.193.45:0/1114429701 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c0cbff0 con 0x7f6b6c152a00 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.338+0000 7f6b71f74640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b6c152a00 0x7f6b6c1f3a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800b9c0 tx=0x7f6b6800be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.338+0000 7f6b59ffb640 10 client.?.objecter ms_handle_connect 0x7f6b6c152a00 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.338+0000 7f6b59ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 1 -- 10.20.193.45:0/1114429701 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68006e60 con 0x7f6b6c152a00 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 10 monclient: dump: 2026-02-17T21:09:13.344 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 10 monclient: _finish_auth 0 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:09:13.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 1 -- 10.20.193.45:0/1114429701 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b68010070 con 0x7f6b6c152a00 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b739fe640 5 monclient: authenticate success, global_id 4801 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b739fe640 10 monclient: _renew_subs 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b739fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c0cc2c0 con 0x7f6b6c152a00 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 1 -- 10.20.193.45:0/1114429701 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6800c970 con 0x7f6b6c152a00 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b5b7fe640 4 set_mon_vals no callback set 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b59ffb640 10 monclient: dump: 2026-02-17T21:09:13.346 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b739fe640 10 client.4801.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b739fe640 10 monclient: _renew_subs 2026-02-17T21:09:13.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b739fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:13.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6c0cc880 con 0x7f6b6c152a00 2026-02-17T21:09:13.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.340+0000 7f6b739fe640 1 librados: init done 2026-02-17T21:09:13.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.341+0000 7f6b739fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:13.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.341+0000 7f6b739fe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:13.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.341+0000 7f6b739fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:13.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.341+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6c0c9170 con 0x7f6b6c152a00 2026-02-17T21:09:13.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.448+0000 7f6b59ffb640 1 -- 10.20.193.45:0/1114429701 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f6b6800cb10 con 0x7f6b6c152a00 2026-02-17T21:09:13.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.449+0000 7f6b59ffb640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b3c0792b0 0x7f6b3c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:13.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.449+0000 7f6b71773640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b3c0792b0 0x7f6b3c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:13.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.449+0000 7f6b71773640 10 monclient: get_auth_request con 0x7f6b3c0792b0 auth_method 0 2026-02-17T21:09:13.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.449+0000 7f6b71773640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b3c0792b0 0x7f6b3c07b770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c006dc0 tx=0x7f6b5c009340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:13.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.449+0000 7f6b59ffb640 10 client.4801.objecter ms_handle_connect 0x7f6b3c0792b0 2026-02-17T21:09:13.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.450+0000 7f6b59ffb640 1 -- 10.20.193.45:0/1114429701 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f6b6805dd30 con 0x7f6b6c152a00 2026-02-17T21:09:13.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.450+0000 7f6b59ffb640 10 client.4801.objecter ms_dispatch2 0x7f6b6c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:13.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.450+0000 7f6b59ffb640 3 client.4801.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:13.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.450+0000 7f6b59ffb640 3 client.4801.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:13.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.450+0000 7f6b59ffb640 20 client.4801.objecter dump_active .. 0 homeless 2026-02-17T21:09:13.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.457+0000 7f6b59ffb640 1 -- 10.20.193.45:0/1114429701 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6b68061cf0 con 0x7f6b6c152a00 2026-02-17T21:09:13.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.457+0000 7f6b59ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:13.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.457+0000 7f6b59ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:13.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.555+0000 7f6b739fe640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:13.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.555+0000 7f6b739fe640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:13.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.555+0000 7f6b739fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:13.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.555+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6b6c147ef0 con 0x7f6b6c152a00 2026-02-17T21:09:13.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b59ffb640 1 -- 10.20.193.45:0/1114429701 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f6b68065ff0 con 0x7f6b6c152a00 2026-02-17T21:09:13.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b59ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:13.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b59ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:13.551 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:13.551 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:13.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 10 librados: watch_flush enter 2026-02-17T21:09:13.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 10 librados: watch_flush exit 2026-02-17T21:09:13.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 20 client.4801.objecter shutdown clearing up homeless session... 2026-02-17T21:09:13.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 10 client.4801.objecter successfully canceled tick 2026-02-17T21:09:13.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b3c0792b0 msgr2=0x7f6b3c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b3c0792b0 0x7f6b3c07b770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c006dc0 tx=0x7f6b5c009340 comp rx=0 tx=0).stop 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 10 monclient: shutdown 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b6c152a00 msgr2=0x7f6b6c1f3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b6c152a00 0x7f6b6c1f3a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800b9c0 tx=0x7f6b6800be90 comp rx=0 tx=0).stop 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 shutdown_connections 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6b3c0792b0 0x7f6b3c07b770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6b6c152a00 0x7f6b6c1f3a70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6b6c152620 0x7f6b6c157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.558+0000 7f6b739fe640 1 --2- 10.20.193.45:0/1114429701 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6b6c0c8d90 0x7f6b6c0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:13.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.559+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 >> 10.20.193.45:0/1114429701 conn(0x7f6b6c0c9d40 msgr2=0x7f6b6c144340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:13.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.559+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 shutdown_connections 2026-02-17T21:09:13.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.559+0000 7f6b739fe640 1 -- 10.20.193.45:0/1114429701 wait complete. 2026-02-17T21:09:13.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:13.559+0000 7f6b739fe640 1 librados: shutdown 2026-02-17T21:09:16.561 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:16.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.638+0000 7f3cd67a7640 10 monclient: get_monmap_and_config 2026-02-17T21:09:16.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.638+0000 7f3cd67a7640 10 monclient: build_initial_monmap 2026-02-17T21:09:16.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.638+0000 7f3cd67a7640 10 monclient: monmap: 2026-02-17T21:09:16.632 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:16.632 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:16.640302+0000 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:16.640302+0000 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:16.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.638+0000 7f3cd67a7640 1 Processor -- start 2026-02-17T21:09:16.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.638+0000 7f3cd67a7640 1 -- start start 2026-02-17T21:09:16.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.638+0000 7f3cd67a7640 10 monclient: init 2026-02-17T21:09:16.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:16.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 10 monclient: _add_conns ranks=[4,1,5,3,0,2] 2026-02-17T21:09:16.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3cd015d1e0 0x7f3cd015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:16.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 10 monclient(hunting): picked mon.noname-b con 0x7f3cd015d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:16.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3cd00748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3cd00c92b0 0x7f3cd0153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 10 monclient(hunting): picked mon.noname-c con 0x7f3cd00c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd00c5860 con 0x7f3cd00748e0 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd00c5580 con 0x7f3cd015d1e0 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd00c7de0 con 0x7f3cd00c92b0 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd67a7640 10 monclient(hunting): authenticate will time out at 1140.270439s 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3cd4d1d640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3cd00c92b0 0x7f3cd0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.639+0000 7f3ccffff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3cd015d1e0 0x7f3cd015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:16.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3cd4d1d640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3cd00c92b0 0x7f3cd0153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:58004/0 (socket says 10.20.193.45:58004) 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3cd4d1d640 1 -- 10.20.193.45:0/3334009953 learned_addr learned my addr 10.20.193.45:0/3334009953 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3cd4d1d640 10 monclient(hunting): get_auth_request con 0x7f3cd00c92b0 auth_method 0 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3cd4d1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3cd4d1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3cd4d1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3ccffff640 10 monclient(hunting): get_auth_request con 0x7f3cd015d1e0 auth_method 0 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3ccffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3ccffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3ccffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3cd4d1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3cd4d1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3cd4d1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3ccffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:16.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3ccffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.640+0000 7f3ccffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.641+0000 7f3cd4d1d640 10 monclient(hunting): handle_auth_done global_id 4841 payload 274 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.641+0000 7f3cd4d1d640 1 -- 10.20.193.45:0/3334009953 >> v2:10.20.193.86:3300/0 conn(0x7f3cd015d1e0 msgr2=0x7f3cd015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.641+0000 7f3cd4d1d640 1 --2- 10.20.193.45:0/3334009953 >> v2:10.20.193.86:3300/0 conn(0x7f3cd015d1e0 0x7f3cd015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.641+0000 7f3cd4d1d640 1 -- 10.20.193.45:0/3334009953 >> v1:10.20.193.86:6789/0 conn(0x7f3cd00748e0 legacy=0x7f3cd00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.641+0000 7f3cd4d1d640 10 monclient: _finish_hunting 0 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.641+0000 7f3cd4d1d640 1 monclient: found mon.noname-c 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.641+0000 7f3cd4d1d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.641+0000 7f3cd4d1d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.641+0000 7f3cd4d1d640 1 -- 10.20.193.45:0/3334009953 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00c80c0 con 0x7f3cd00c92b0 2026-02-17T21:09:16.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.642+0000 7f3cd4d1d640 1 --2- 10.20.193.45:0/3334009953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 0x7f3cd0153610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009e50 tx=0x7f3cc402f2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b1fea8e4c7e709 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 1 -- 10.20.193.45:0/3334009953 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc402fcc0 con 0x7f3cd00c92b0 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 10 monclient: dump: 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:16.646 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 10 monclient: _finish_auth 0 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 10 monclient: _check_auth_tickets 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 1 -- 10.20.193.45:0/3334009953 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc40373f0 con 0x7f3cd00c92b0 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 5 monclient: authenticate success, global_id 4841 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:16.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 1 -- 10.20.193.45:0/3334009953 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc402fe60 con 0x7f3cd00c92b0 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cceffd640 10 monclient: dump: 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:16.648 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 4 set_mon_vals no callback set 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 10 monclient: shutdown 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 1 -- 10.20.193.45:0/3334009953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 msgr2=0x7f3cd0153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 1 --2- 10.20.193.45:0/3334009953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 0x7f3cd0153610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4009e50 tx=0x7f3cc402f2a0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 1 -- 10.20.193.45:0/3334009953 shutdown_connections 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 1 --2- 10.20.193.45:0/3334009953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 0x7f3cd0153610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 1 --2- 10.20.193.45:0/3334009953 >> v2:10.20.193.86:3300/0 conn(0x7f3cd015d1e0 0x7f3cd015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 1 -- 10.20.193.45:0/3334009953 >> 10.20.193.45:0/3334009953 conn(0x7f3cd00c9d40 msgr2=0x7f3cd00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 1 -- 10.20.193.45:0/3334009953 shutdown_connections 2026-02-17T21:09:16.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.644+0000 7f3cd67a7640 1 -- 10.20.193.45:0/3334009953 wait complete. 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.645+0000 7f3cd67a7640 10 monclient: build_initial_monmap 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.645+0000 7f3cd67a7640 10 monclient: monmap: 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:16.650 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.645+0000 7f3cd67a7640 1 librados: starting msgr at 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.645+0000 7f3cd67a7640 1 librados: starting objecter 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.645+0000 7f3cd67a7640 1 Processor -- start 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.645+0000 7f3cd67a7640 1 -- start start 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.645+0000 7f3cd67a7640 1 librados: setting wanted keys 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.645+0000 7f3cd67a7640 1 librados: calling monclient init 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.645+0000 7f3cd67a7640 10 monclient: init 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3cd00748e0 0x7f3cd01f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient(hunting): picked mon.noname-b con 0x7f3cd00748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 0x7f3cd006f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:16.651 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient(hunting): picked mon.noname-c con 0x7f3cd00c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3cd015d1e0 0x7f3cd01f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient(hunting): picked mon.noname-a con 0x7f3cd015d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd0074d30 con 0x7f3cd015d1e0 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00c8680 con 0x7f3cd00748e0 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd0153b50 con 0x7f3cd00c92b0 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd67a7640 10 monclient(hunting): authenticate will time out at 1140.277174s 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccf7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 0x7f3cd006f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:16.652 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd4d1d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3cd015d1e0 0x7f3cd01f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccffff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3cd00748e0 0x7f3cd01f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccf7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 0x7f3cd006f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:58014/0 (socket says 10.20.193.45:58014) 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccf7fe640 1 -- 10.20.193.45:0/2634537112 learned_addr learned my addr 10.20.193.45:0/2634537112 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccf7fe640 10 monclient(hunting): get_auth_request con 0x7f3cd00c92b0 auth_method 0 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccffff640 10 monclient(hunting): get_auth_request con 0x7f3cd00748e0 auth_method 0 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3ccffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:16.653 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd4d1d640 10 monclient(hunting): get_auth_request con 0x7f3cd015d1e0 auth_method 0 2026-02-17T21:09:16.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd4d1d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:16.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd4d1d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:16.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.646+0000 7f3cd4d1d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:16.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.647+0000 7f3ccf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:16.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.647+0000 7f3ccf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:16.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.647+0000 7f3ccf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:16.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.647+0000 7f3ccffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:16.654 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.647+0000 7f3ccffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:16.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.647+0000 7f3ccffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:16.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.647+0000 7f3cd4d1d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:16.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.647+0000 7f3cd4d1d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:16.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.647+0000 7f3cd4d1d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:16.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 10 monclient(hunting): handle_auth_done global_id 4844 payload 824 2026-02-17T21:09:16.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 1 -- 10.20.193.45:0/2634537112 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3cd00748e0 msgr2=0x7f3cd01f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:16.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3cd00748e0 0x7f3cd01f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 1 -- 10.20.193.45:0/2634537112 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3cd015d1e0 msgr2=0x7f3cd01f2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:16.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3cd015d1e0 0x7f3cd01f2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 1 monclient: found mon.noname-c 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.648+0000 7f3ccf7fe640 1 -- 10.20.193.45:0/2634537112 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd01551a0 con 0x7f3cd00c92b0 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.649+0000 7f3ccf7fe640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 0x7f3cd006f6c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000b570 tx=0x7f3cc000ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.649+0000 7f3cccff9640 10 client.?.objecter ms_handle_connect 0x7f3cd00c92b0 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.649+0000 7f3cccff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cccff9640 1 -- 10.20.193.45:0/2634537112 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0013020 con 0x7f3cd00c92b0 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cccff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cccff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:16.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cccff9640 10 monclient: dump: 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cccff9640 10 monclient: _finish_auth 0 2026-02-17T21:09:16.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cccff9640 10 monclient: _check_auth_tickets 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cd67a7640 5 monclient: authenticate success, global_id 4844 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cd67a7640 10 monclient: _renew_subs 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cd67a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd0073580 con 0x7f3cd00c92b0 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cd67a7640 10 client.4844.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cd67a7640 10 monclient: _renew_subs 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cd67a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.650+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd0073b40 con 0x7f3cd00c92b0 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cd67a7640 1 librados: init done 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cccff9640 1 -- 10.20.193.45:0/2634537112 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc0004480 con 0x7f3cd00c92b0 2026-02-17T21:09:16.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cccff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cccff9640 1 -- 10.20.193.45:0/2634537112 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0002980 con 0x7f3cd00c92b0 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cccff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cccff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cce7fc640 4 set_mon_vals no callback set 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cccff9640 10 monclient: dump: 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:16.659 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:16.660 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:16.660 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:16.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cd67a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:16.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cd67a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:16.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cd67a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:16.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.651+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd015dbb0 con 0x7f3cd00c92b0 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.663+0000 7f3cccff9640 1 -- 10.20.193.45:0/2634537112 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f3cc0002b20 con 0x7f3cd00c92b0 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.663+0000 7f3cccff9640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ca0079280 0x7f3ca007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.663+0000 7f3ccffff640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ca0079280 0x7f3ca007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.663+0000 7f3ccffff640 10 monclient: get_auth_request con 0x7f3ca0079280 auth_method 0 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.663+0000 7f3ccffff640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ca0079280 0x7f3ca007b740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009ba0 tx=0x7f3cbc009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.663+0000 7f3cccff9640 10 client.4844.objecter ms_handle_connect 0x7f3ca0079280 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.665+0000 7f3cccff9640 1 -- 10.20.193.45:0/2634537112 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f3cc0097dd0 con 0x7f3cd00c92b0 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.665+0000 7f3cccff9640 10 client.4844.objecter ms_dispatch2 0x7f3cd0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.665+0000 7f3cccff9640 3 client.4844.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.665+0000 7f3cccff9640 3 client.4844.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:16.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.665+0000 7f3cccff9640 20 client.4844.objecter dump_active .. 0 homeless 2026-02-17T21:09:16.759 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.767+0000 7f3cccff9640 1 -- 10.20.193.45:0/2634537112 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3cd015dbb0 con 0x7f3cd00c92b0 2026-02-17T21:09:16.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.767+0000 7f3cccff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:16.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.767+0000 7f3cccff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:16.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.866+0000 7f3cd67a7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:16.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.866+0000 7f3cd67a7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:16.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.866+0000 7f3cd67a7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:16.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.866+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3cd0153ee0 con 0x7f3cd00c92b0 2026-02-17T21:09:16.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.869+0000 7f3cccff9640 1 -- 10.20.193.45:0/2634537112 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f3cc001d020 con 0x7f3cd00c92b0 2026-02-17T21:09:16.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.869+0000 7f3cccff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:16.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.869+0000 7f3cccff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:16.863 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:16.863 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:16.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 10 librados: watch_flush enter 2026-02-17T21:09:16.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 10 librados: watch_flush exit 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 20 client.4844.objecter shutdown clearing up homeless session... 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 10 client.4844.objecter successfully canceled tick 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ca0079280 msgr2=0x7f3ca007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ca0079280 0x7f3ca007b740 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009ba0 tx=0x7f3cbc009290 comp rx=0 tx=0).stop 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 10 monclient: shutdown 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 msgr2=0x7f3cd006f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 0x7f3cd006f6c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3cc000b570 tx=0x7f3cc000ba40 comp rx=0 tx=0).stop 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 shutdown_connections 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ca0079280 0x7f3ca007b740 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3cd015d1e0 0x7f3cd01f2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3cd00c92b0 0x7f3cd006f6c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 --2- 10.20.193.45:0/2634537112 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3cd00748e0 0x7f3cd01f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:16.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 >> 10.20.193.45:0/2634537112 conn(0x7f3cd00c9d40 msgr2=0x7f3cd01533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:16.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 shutdown_connections 2026-02-17T21:09:16.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 -- 10.20.193.45:0/2634537112 wait complete. 2026-02-17T21:09:16.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:16.870+0000 7f3cd67a7640 1 librados: shutdown 2026-02-17T21:09:19.874 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:19.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.952+0000 7f17a7ada640 10 monclient: get_monmap_and_config 2026-02-17T21:09:19.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.952+0000 7f17a7ada640 10 monclient: build_initial_monmap 2026-02-17T21:09:19.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.952+0000 7f17a7ada640 10 monclient: monmap: 2026-02-17T21:09:19.945 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:19.945 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:19.945 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:19.953608+0000 2026-02-17T21:09:19.945 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:19.953608+0000 2026-02-17T21:09:19.946 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:19.946 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:19.946 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:19.946 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:19.946 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:19.946 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:19.946 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:19.946 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:19.946 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:19.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 1 Processor -- start 2026-02-17T21:09:19.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 1 -- start start 2026-02-17T21:09:19.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient: init 2026-02-17T21:09:19.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:19.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient: _add_conns ranks=[4,0,3,5,1,2] 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f17a015d1e0 0x7f17a015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient(hunting): picked mon.noname-b con 0x7f17a015d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f17a00748e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f17a00c92b0 0x7f17a0153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient(hunting): picked mon.noname-a con 0x7f17a00c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a00c5860 con 0x7f17a00748e0 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f17a00c5580 con 0x7f17a00c92b0 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f17a00c7de0 con 0x7f17a015d1e0 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:19.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.953+0000 7f17a7ada640 10 monclient(hunting): authenticate will time out at 1143.583757s 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f17a00c92b0 0x7f17a0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a584f640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f17a015d1e0 0x7f17a015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f17a00c92b0 0x7f17a0153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:50094/0 (socket says 10.20.193.45:50094) 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 1 -- 10.20.193.45:0/2358327701 learned_addr learned my addr 10.20.193.45:0/2358327701 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 10 monclient(hunting): get_auth_request con 0x7f17a00c92b0 auth_method 0 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a584f640 10 monclient(hunting): get_auth_request con 0x7f17a015d1e0 auth_method 0 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a584f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a584f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a584f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:19.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a6050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a584f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a584f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.954+0000 7f17a584f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.955+0000 7f17a6050640 10 monclient(hunting): handle_auth_done global_id 4746 payload 274 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.955+0000 7f17a6050640 1 -- 10.20.193.45:0/2358327701 >> v2:10.20.193.86:3300/0 conn(0x7f17a015d1e0 msgr2=0x7f17a015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.955+0000 7f17a6050640 1 --2- 10.20.193.45:0/2358327701 >> v2:10.20.193.86:3300/0 conn(0x7f17a015d1e0 0x7f17a015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.955+0000 7f17a6050640 1 -- 10.20.193.45:0/2358327701 >> v1:10.20.193.45:6789/0 conn(0x7f17a00748e0 legacy=0x7f17a00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.955+0000 7f17a6050640 10 monclient: _finish_hunting 0 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.955+0000 7f17a6050640 1 monclient: found mon.noname-a 2026-02-17T21:09:19.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.955+0000 7f17a6050640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:19.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.955+0000 7f17a6050640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:09:19.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.955+0000 7f17a6050640 1 -- 10.20.193.45:0/2358327701 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a00c80c0 con 0x7f17a00c92b0 2026-02-17T21:09:19.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.956+0000 7f17a6050640 1 --2- 10.20.193.45:0/2358327701 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a00c92b0 0x7f17a0153610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f179c009e50 tx=0x7f179c02f2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bebc3cfb7656f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:19.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 1 -- 10.20.193.45:0/2358327701 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c02fcc0 con 0x7f17a00c92b0 2026-02-17T21:09:19.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:19.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 10 monclient: dump: 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:19.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 10 monclient: _finish_auth 0 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 10 monclient: _check_auth_tickets 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 1 -- 10.20.193.45:0/2358327701 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c0373f0 con 0x7f17a00c92b0 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a7ada640 5 monclient: authenticate success, global_id 4746 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a7ada640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 1 -- 10.20.193.45:0/2358327701 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c02fe60 con 0x7f17a00c92b0 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a484d640 10 monclient: dump: 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:19.959 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a7ada640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.958+0000 7f17a7ada640 4 set_mon_vals no callback set 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 10 monclient: shutdown 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:19.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 -- 10.20.193.45:0/2358327701 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a00c92b0 msgr2=0x7f17a0153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 --2- 10.20.193.45:0/2358327701 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a00c92b0 0x7f17a0153610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f179c009e50 tx=0x7f179c02f2a0 comp rx=0 tx=0).stop 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 -- 10.20.193.45:0/2358327701 shutdown_connections 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 --2- 10.20.193.45:0/2358327701 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a00c92b0 0x7f17a0153610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 --2- 10.20.193.45:0/2358327701 >> v2:10.20.193.86:3300/0 conn(0x7f17a015d1e0 0x7f17a015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 -- 10.20.193.45:0/2358327701 >> 10.20.193.45:0/2358327701 conn(0x7f17a00c9d40 msgr2=0x7f17a00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 -- 10.20.193.45:0/2358327701 shutdown_connections 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 -- 10.20.193.45:0/2358327701 wait complete. 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 10 monclient: build_initial_monmap 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 10 monclient: monmap: 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:19.961 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 librados: starting msgr at 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 librados: starting objecter 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 Processor -- start 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 -- start start 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 librados: setting wanted keys 2026-02-17T21:09:19.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 1 librados: calling monclient init 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.959+0000 7f17a7ada640 10 monclient: init 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f17a00748e0 0x7f17a006e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient(hunting): picked mon.noname-b con 0x7f17a00748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17a00c92b0 0x7f17a01f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient(hunting): picked mon.noname-c con 0x7f17a00c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a015d1e0 0x7f17a01f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient(hunting): picked mon.noname-a con 0x7f17a015d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f17a0074d30 con 0x7f17a015d1e0 2026-02-17T21:09:19.963 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f17a00c8680 con 0x7f17a00748e0 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f17a0153b50 con 0x7f17a00c92b0 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a7ada640 10 monclient(hunting): authenticate will time out at 1143.590349s 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a6050640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a015d1e0 0x7f17a01f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a584f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f17a00748e0 0x7f17a006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a6050640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a015d1e0 0x7f17a01f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:50110/0 (socket says 10.20.193.45:50110) 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a504e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17a00c92b0 0x7f17a01f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a6050640 1 -- 10.20.193.45:0/142463488 learned_addr learned my addr 10.20.193.45:0/142463488 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a6050640 10 monclient(hunting): get_auth_request con 0x7f17a015d1e0 auth_method 0 2026-02-17T21:09:19.964 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a6050640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a6050640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a6050640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a584f640 10 monclient(hunting): get_auth_request con 0x7f17a00748e0 auth_method 0 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a584f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a584f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a584f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a504e640 10 monclient(hunting): get_auth_request con 0x7f17a00c92b0 auth_method 0 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a504e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a504e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.960+0000 7f17a504e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.961+0000 7f17a6050640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.961+0000 7f17a6050640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.961+0000 7f17a6050640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:19.965 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.961+0000 7f17a504e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.961+0000 7f17a504e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.961+0000 7f17a504e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.961+0000 7f17a584f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.961+0000 7f17a584f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.961+0000 7f17a584f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 10 monclient(hunting): handle_auth_done global_id 4749 payload 824 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 1 -- 10.20.193.45:0/142463488 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17a00c92b0 msgr2=0x7f17a01f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17a00c92b0 0x7f17a01f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 1 -- 10.20.193.45:0/142463488 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f17a00748e0 msgr2=0x7f17a006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f17a00748e0 0x7f17a006e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 10 monclient: _finish_hunting 0 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 1 monclient: found mon.noname-a 2026-02-17T21:09:19.966 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:19.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:09:19.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.962+0000 7f17a6050640 1 -- 10.20.193.45:0/142463488 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a01f4df0 con 0x7f17a015d1e0 2026-02-17T21:09:19.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.963+0000 7f17a6050640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a015d1e0 0x7f17a01f5dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f179c039040 tx=0x7f179c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:19.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.963+0000 7f178e7fc640 10 client.?.objecter ms_handle_connect 0x7f17a015d1e0 2026-02-17T21:09:19.967 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.963+0000 7f178e7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 1 -- 10.20.193.45:0/142463488 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c046020 con 0x7f17a015d1e0 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 10 monclient: dump: 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:19.969 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 1 -- 10.20.193.45:0/142463488 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c041450 con 0x7f17a015d1e0 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 1 -- 10.20.193.45:0/142463488 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c009510 con 0x7f17a015d1e0 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:09:19.970 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178e7fc640 10 monclient: dump: 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f178ffff640 4 set_mon_vals no callback set 2026-02-17T21:09:19.971 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 5 monclient: authenticate success, global_id 4749 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 10 monclient: _renew_subs 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17a014cf20 con 0x7f17a015d1e0 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 10 client.4749.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 10 monclient: _renew_subs 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17a014cc40 con 0x7f17a015d1e0 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 1 librados: init done 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:19.972 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.966+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17a014e4c0 con 0x7f17a015d1e0 2026-02-17T21:09:19.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.978+0000 7f178e7fc640 1 -- 10.20.193.45:0/142463488 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f179c041860 con 0x7f17a015d1e0 2026-02-17T21:09:19.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.979+0000 7f178e7fc640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f17700792b0 0x7f177007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:19.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.979+0000 7f17a584f640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f17700792b0 0x7f177007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:19.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.979+0000 7f17a584f640 10 monclient: get_auth_request con 0x7f17700792b0 auth_method 0 2026-02-17T21:09:19.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.979+0000 7f17a584f640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f17700792b0 0x7f177007b770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1790009ba0 tx=0x7f1790009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:19.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.979+0000 7f178e7fc640 10 client.4749.objecter ms_handle_connect 0x7f17700792b0 2026-02-17T21:09:19.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.981+0000 7f178e7fc640 1 -- 10.20.193.45:0/142463488 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f179c083ca0 con 0x7f17a015d1e0 2026-02-17T21:09:19.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.981+0000 7f178e7fc640 10 client.4749.objecter ms_dispatch2 0x7f17a0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:19.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.981+0000 7f178e7fc640 3 client.4749.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:19.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.981+0000 7f178e7fc640 3 client.4749.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:19.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:19.981+0000 7f178e7fc640 20 client.4749.objecter dump_active .. 0 homeless 2026-02-17T21:09:20.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.091+0000 7f178e7fc640 1 -- 10.20.193.45:0/142463488 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f17a014e4c0 con 0x7f17a015d1e0 2026-02-17T21:09:20.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.091+0000 7f178e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:20.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.091+0000 7f178e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:20.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.192+0000 7f17a7ada640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:20.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.192+0000 7f17a7ada640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:20.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.192+0000 7f17a7ada640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:20.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.192+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f17a015e0c0 con 0x7f17a015d1e0 2026-02-17T21:09:20.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.195+0000 7f178e7fc640 1 -- 10.20.193.45:0/142463488 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f17a015e0c0 con 0x7f17a015d1e0 2026-02-17T21:09:20.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.195+0000 7f178e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:20.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.195+0000 7f178e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:20.187 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:20.188 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:20.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 10 librados: watch_flush enter 2026-02-17T21:09:20.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 10 librados: watch_flush exit 2026-02-17T21:09:20.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 20 client.4749.objecter shutdown clearing up homeless session... 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 10 client.4749.objecter successfully canceled tick 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f17700792b0 msgr2=0x7f177007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f17700792b0 0x7f177007b770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1790009ba0 tx=0x7f1790009290 comp rx=0 tx=0).stop 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 10 monclient: shutdown 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a015d1e0 msgr2=0x7f17a01f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a015d1e0 0x7f17a01f5dd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f179c039040 tx=0x7f179c004b40 comp rx=0 tx=0).stop 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 shutdown_connections 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f17700792b0 0x7f177007b770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f17a015d1e0 0x7f17a01f5dd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:20.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f17a00c92b0 0x7f17a01f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 --2- 10.20.193.45:0/142463488 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f17a00748e0 0x7f17a006e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 >> 10.20.193.45:0/142463488 conn(0x7f17a00c9d40 msgr2=0x7f17a01533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 shutdown_connections 2026-02-17T21:09:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 -- 10.20.193.45:0/142463488 wait complete. 2026-02-17T21:09:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:20.196+0000 7f17a7ada640 1 librados: shutdown 2026-02-17T21:09:23.198 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:23.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 10 monclient: get_monmap_and_config 2026-02-17T21:09:23.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 10 monclient: build_initial_monmap 2026-02-17T21:09:23.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 10 monclient: monmap: 2026-02-17T21:09:23.267 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:23.267 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:23.267 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:23.274896+0000 2026-02-17T21:09:23.267 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:23.274896+0000 2026-02-17T21:09:23.267 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:23.267 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:23.267 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:23.268 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:23.268 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:23.268 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:23.268 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:23.268 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:23.268 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:23.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 1 Processor -- start 2026-02-17T21:09:23.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 1 -- start start 2026-02-17T21:09:23.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 10 monclient: init 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 10 monclient: _add_conns ranks=[4,5,1,3,2,0] 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff01415d1e0 0x7ff01415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 10 monclient(hunting): picked mon.noname-b con 0x7ff01415d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff0140748e0 0x7ff0140c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.274+0000 7ff0190bd640 10 monclient(hunting): picked mon.noname-c con 0x7ff0140748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.275+0000 7ff0190bd640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff0140c90e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.275+0000 7ff0190bd640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0140c9570 con 0x7ff0140c90e0 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.275+0000 7ff0190bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:23.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.275+0000 7ff0190bd640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff0140c5860 con 0x7ff01415d1e0 2026-02-17T21:09:23.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.275+0000 7ff0190bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:23.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.275+0000 7ff0190bd640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff0140c5580 con 0x7ff0140748e0 2026-02-17T21:09:23.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.275+0000 7ff0190bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:23.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.275+0000 7ff0190bd640 10 monclient(hunting): authenticate will time out at 1146.905020s 2026-02-17T21:09:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff0140748e0 0x7ff0140c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff0140748e0 0x7ff0140c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:42320/0 (socket says 10.20.193.45:42320) 2026-02-17T21:09:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 1 -- 10.20.193.45:0/3861642117 learned_addr learned my addr 10.20.193.45:0/3861642117 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 10 monclient(hunting): get_auth_request con 0x7ff0140748e0 auth_method 0 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012d76640 1 --2- 10.20.193.45:0/3861642117 >> v2:10.20.193.86:3300/0 conn(0x7ff01415d1e0 0x7ff01415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012d76640 10 monclient(hunting): get_auth_request con 0x7ff01415d1e0 auth_method 0 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.300+0000 7ff012d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:23.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:23.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:23.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012575640 10 monclient(hunting): handle_auth_done global_id 4850 payload 274 2026-02-17T21:09:23.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012575640 1 -- 10.20.193.45:0/3861642117 >> v2:10.20.193.86:3300/0 conn(0x7ff01415d1e0 msgr2=0x7ff01415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:23.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012575640 1 --2- 10.20.193.45:0/3861642117 >> v2:10.20.193.86:3300/0 conn(0x7ff01415d1e0 0x7ff01415d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012575640 1 -- 10.20.193.45:0/3861642117 >> v1:10.20.193.86:6789/0 conn(0x7ff0140c90e0 legacy=0x7ff014153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:23.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012575640 10 monclient: _finish_hunting 0 2026-02-17T21:09:23.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012575640 1 monclient: found mon.noname-c 2026-02-17T21:09:23.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:23.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:23.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.301+0000 7ff012575640 1 -- 10.20.193.45:0/3861642117 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0140c7de0 con 0x7ff0140748e0 2026-02-17T21:09:23.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.302+0000 7ff012575640 1 --2- 10.20.193.45:0/3861642117 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 0x7ff0140c8ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feffc009970 tx=0x7feffc02eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f97a31a124bbcf39 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:23.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 1 -- 10.20.193.45:0/3861642117 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc03c070 con 0x7ff0140748e0 2026-02-17T21:09:23.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 10 monclient: dump: 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:23.302 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 10 monclient: _finish_auth 0 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 10 monclient: _check_auth_tickets 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 1 -- 10.20.193.45:0/3861642117 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc02fb20 con 0x7ff0140748e0 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 1 -- 10.20.193.45:0/3861642117 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc037440 con 0x7ff0140748e0 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff011d74640 10 monclient: dump: 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:23.303 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 5 monclient: authenticate success, global_id 4850 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 4 set_mon_vals no callback set 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 10 monclient: shutdown 2026-02-17T21:09:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 1 -- 10.20.193.45:0/3861642117 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 msgr2=0x7ff0140c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 1 --2- 10.20.193.45:0/3861642117 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 0x7ff0140c8ba0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feffc009970 tx=0x7feffc02eef0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 1 -- 10.20.193.45:0/3861642117 shutdown_connections 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 1 --2- 10.20.193.45:0/3861642117 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 0x7ff0140c8ba0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 1 --2- 10.20.193.45:0/3861642117 >> v2:10.20.193.86:3300/0 conn(0x7ff01415d1e0 0x7ff01415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 1 -- 10.20.193.45:0/3861642117 >> 10.20.193.45:0/3861642117 conn(0x7ff0140c9d40 msgr2=0x7ff0140ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 1 -- 10.20.193.45:0/3861642117 shutdown_connections 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.304+0000 7ff0190bd640 1 -- 10.20.193.45:0/3861642117 wait complete. 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 10 monclient: build_initial_monmap 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 10 monclient: monmap: 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:23.305 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 1 librados: starting msgr at 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 1 librados: starting objecter 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 1 Processor -- start 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 1 -- start start 2026-02-17T21:09:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 1 librados: setting wanted keys 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 1 librados: calling monclient init 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 10 monclient: init 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.305+0000 7ff0190bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 0x7ff0141f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 10 monclient(hunting): picked mon.noname-c con 0x7ff0140748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0140c90e0 0x7ff0141f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 10 monclient(hunting): picked mon.noname-b con 0x7ff0140c90e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff01415d1e0 0x7ff0141439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 10 monclient(hunting): picked mon.noname-a con 0x7ff01415d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff0140c8680 con 0x7ff01415d1e0 2026-02-17T21:09:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0140c83a0 con 0x7ff0140c90e0 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff014074d30 con 0x7ff0140748e0 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff0190bd640 10 monclient(hunting): authenticate will time out at 1146.936049s 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0140c90e0 0x7ff0141f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012d76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 0x7ff0141f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff013577640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff01415d1e0 0x7ff0141439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0140c90e0 0x7ff0141f2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:56586/0 (socket says 10.20.193.45:56586) 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 1 -- 10.20.193.45:0/1992886395 learned_addr learned my addr 10.20.193.45:0/1992886395 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 10 monclient(hunting): get_auth_request con 0x7ff0140c90e0 auth_method 0 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012d76640 10 monclient(hunting): get_auth_request con 0x7ff0140748e0 auth_method 0 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff013577640 10 monclient(hunting): get_auth_request con 0x7ff01415d1e0 auth_method 0 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff013577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff013577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff013577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff012d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff013577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff013577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.306+0000 7ff013577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 10 monclient(hunting): handle_auth_done global_id 4853 payload 824 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 1 -- 10.20.193.45:0/1992886395 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0140c90e0 msgr2=0x7ff0141f2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0140c90e0 0x7ff0141f2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 1 -- 10.20.193.45:0/1992886395 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff01415d1e0 msgr2=0x7ff0141439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff01415d1e0 0x7ff0141439c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 10 monclient: _finish_hunting 0 2026-02-17T21:09:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 1 monclient: found mon.noname-c 2026-02-17T21:09:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.308+0000 7ff012d76640 1 -- 10.20.193.45:0/1992886395 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff014144860 con 0x7ff0140748e0 2026-02-17T21:09:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.309+0000 7ff012d76640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 0x7ff0141f2a70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff00800e8a0 tx=0x7ff00800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.309+0000 7feff37fe640 10 client.?.objecter ms_handle_connect 0x7ff0140748e0 2026-02-17T21:09:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.309+0000 7feff37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:23.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 1 -- 10.20.193.45:0/1992886395 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff008017070 con 0x7ff0140748e0 2026-02-17T21:09:23.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:23.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:23.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 10 monclient: dump: 2026-02-17T21:09:23.313 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:23.313 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 10 monclient: _finish_auth 0 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 1 -- 10.20.193.45:0/1992886395 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00800c940 con 0x7ff0140748e0 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 1 -- 10.20.193.45:0/1992886395 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00800cd10 con 0x7ff0140748e0 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff0190bd640 5 monclient: authenticate success, global_id 4853 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff011573640 4 set_mon_vals no callback set 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff0190bd640 10 monclient: _renew_subs 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff0190bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0141e5d70 con 0x7ff0140748e0 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7feff37fe640 10 monclient: dump: 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:23.315 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff0190bd640 10 client.4853.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff0190bd640 10 monclient: _renew_subs 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff0190bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0141e6330 con 0x7ff0140748e0 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.310+0000 7ff0190bd640 1 librados: init done 2026-02-17T21:09:23.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.311+0000 7ff0190bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.311+0000 7ff0190bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.311+0000 7ff0190bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.311+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0140c8ba0 con 0x7ff0140748e0 2026-02-17T21:09:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.322+0000 7feff37fe640 1 -- 10.20.193.45:0/1992886395 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff008013470 con 0x7ff0140748e0 2026-02-17T21:09:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.322+0000 7feff37fe640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fefe00792d0 0x7fefe007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.322+0000 7ff012575640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fefe00792d0 0x7fefe007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.322+0000 7ff012575640 10 monclient: get_auth_request con 0x7fefe00792d0 auth_method 0 2026-02-17T21:09:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.322+0000 7feff37fe640 10 client.4853.objecter ms_handle_connect 0x7fefe00792d0 2026-02-17T21:09:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.322+0000 7ff012575640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fefe00792d0 0x7fefe007b790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feffc0091b0 tx=0x7feffc033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.324+0000 7feff37fe640 1 -- 10.20.193.45:0/1992886395 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ff00805e720 con 0x7ff0140748e0 2026-02-17T21:09:23.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.324+0000 7feff37fe640 10 client.4853.objecter ms_dispatch2 0x7ff014000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:23.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.324+0000 7feff37fe640 3 client.4853.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:23.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.324+0000 7feff37fe640 3 client.4853.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:23.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.324+0000 7feff37fe640 20 client.4853.objecter dump_active .. 0 homeless 2026-02-17T21:09:23.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.425+0000 7feff37fe640 1 -- 10.20.193.45:0/1992886395 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff0080626e0 con 0x7ff0140748e0 2026-02-17T21:09:23.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.425+0000 7feff37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:23.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.425+0000 7feff37fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:23.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.531+0000 7ff0190bd640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:23.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.531+0000 7ff0190bd640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:23.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.531+0000 7ff0190bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:23.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.531+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff0140c9b20 con 0x7ff0140748e0 2026-02-17T21:09:23.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.534+0000 7feff37fe640 1 -- 10.20.193.45:0/1992886395 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff0080669e0 con 0x7ff0140748e0 2026-02-17T21:09:23.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.534+0000 7feff37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:23.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.534+0000 7feff37fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:23.527 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:23.527 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:23.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 10 librados: watch_flush enter 2026-02-17T21:09:23.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 10 librados: watch_flush exit 2026-02-17T21:09:23.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 20 client.4853.objecter shutdown clearing up homeless session... 2026-02-17T21:09:23.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 10 client.4853.objecter successfully canceled tick 2026-02-17T21:09:23.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fefe00792d0 msgr2=0x7fefe007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fefe00792d0 0x7fefe007b790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feffc0091b0 tx=0x7feffc033000 comp rx=0 tx=0).stop 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 10 monclient: shutdown 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 msgr2=0x7ff0141f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.535+0000 7ff0190bd640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 0x7ff0141f2a70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff00800e8a0 tx=0x7ff00800ed70 comp rx=0 tx=0).stop 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.536+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 shutdown_connections 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.536+0000 7ff0190bd640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fefe00792d0 0x7fefe007b790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.536+0000 7ff0190bd640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff01415d1e0 0x7ff0141439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.536+0000 7ff0190bd640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0140c90e0 0x7ff0141f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.536+0000 7ff0190bd640 1 --2- 10.20.193.45:0/1992886395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff0140748e0 0x7ff0141f2a70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.536+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 >> 10.20.193.45:0/1992886395 conn(0x7ff0140c9d40 msgr2=0x7ff01414ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:23.530 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.536+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 shutdown_connections 2026-02-17T21:09:23.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.536+0000 7ff0190bd640 1 -- 10.20.193.45:0/1992886395 wait complete. 2026-02-17T21:09:23.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:23.536+0000 7ff0190bd640 1 librados: shutdown 2026-02-17T21:09:26.539 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:26.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.620+0000 7f883ac36640 10 monclient: get_monmap_and_config 2026-02-17T21:09:26.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.620+0000 7f883ac36640 10 monclient: build_initial_monmap 2026-02-17T21:09:26.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.620+0000 7f883ac36640 10 monclient: monmap: 2026-02-17T21:09:26.613 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:26.613 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:26.613 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:26.621155+0000 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:26.621155+0000 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.620+0000 7f883ac36640 1 Processor -- start 2026-02-17T21:09:26.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.620+0000 7f883ac36640 1 -- start start 2026-02-17T21:09:26.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.620+0000 7f883ac36640 10 monclient: init 2026-02-17T21:09:26.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:26.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 10 monclient: _add_conns ranks=[2,0,5,1,3,4] 2026-02-17T21:09:26.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f883415d1e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:09:26.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f88340c92b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:26.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f8834153d20 0x7f883415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:26.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 10 monclient(hunting): picked mon.noname-c con 0x7f8834153d20 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:26.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88340c5860 con 0x7f88340c92b0 2026-02-17T21:09:26.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88340c5580 con 0x7f883415d1e0 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f88340c7de0 con 0x7f8834153d20 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f883ac36640 10 monclient(hunting): authenticate will time out at 1150.251281s 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f88391ac640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f8834153d20 0x7f883415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f88389ab640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f883415d1e0 0x7f88340c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:46908/0 (socket says 10.20.193.45:46908) 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.621+0000 7f88389ab640 1 -- 10.20.193.45:0/1833311094 learned_addr learned my addr 10.20.193.45:0/1833311094 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.622+0000 7f88391ac640 10 monclient(hunting): get_auth_request con 0x7f8834153d20 auth_method 0 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.622+0000 7f88391ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.622+0000 7f88391ac640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.622+0000 7f88391ac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:26.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.622+0000 7f88391ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.622+0000 7f88391ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.622+0000 7f88391ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.623+0000 7f88391ac640 10 monclient(hunting): handle_auth_done global_id 4856 payload 274 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.623+0000 7f88391ac640 1 -- 10.20.193.45:0/1833311094 >> v1:10.20.193.92:6789/0 conn(0x7f883415d1e0 legacy=0x7f88340c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.623+0000 7f88391ac640 1 -- 10.20.193.45:0/1833311094 >> v1:10.20.193.45:6789/0 conn(0x7f88340c92b0 legacy=0x7f8834153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.623+0000 7f88391ac640 10 monclient: _finish_hunting 0 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.623+0000 7f88391ac640 1 monclient: found mon.noname-c 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.623+0000 7f88391ac640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.623+0000 7f88391ac640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:26.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.623+0000 7f88391ac640 1 -- 10.20.193.45:0/1833311094 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88340c80c0 con 0x7f8834153d20 2026-02-17T21:09:26.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.625+0000 7f88391ac640 1 --2- 10.20.193.45:0/1833311094 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8834153d20 0x7f883415d5c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8830009dc0 tx=0x7f883002f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4267b649444356d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:26.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 1 -- 10.20.193.45:0/1833311094 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883003c070 con 0x7f8834153d20 2026-02-17T21:09:26.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:26.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:26.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 10 monclient: dump: 2026-02-17T21:09:26.625 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:09:26.626 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 1 -- 10.20.193.45:0/1833311094 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8830037440 con 0x7f8834153d20 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 1 -- 10.20.193.45:0/1833311094 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830037810 con 0x7f8834153d20 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 5 monclient: authenticate success, global_id 4856 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 4 set_mon_vals no callback set 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f882b7fe640 10 monclient: dump: 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:26.627 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 10 monclient: shutdown 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 1 -- 10.20.193.45:0/1833311094 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8834153d20 msgr2=0x7f883415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 1 --2- 10.20.193.45:0/1833311094 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8834153d20 0x7f883415d5c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8830009dc0 tx=0x7f883002f230 comp rx=0 tx=0).stop 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 1 -- 10.20.193.45:0/1833311094 shutdown_connections 2026-02-17T21:09:26.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 1 --2- 10.20.193.45:0/1833311094 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8834153d20 0x7f883415d5c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 1 -- 10.20.193.45:0/1833311094 >> 10.20.193.45:0/1833311094 conn(0x7f88340c9d40 msgr2=0x7f88340ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 1 -- 10.20.193.45:0/1833311094 shutdown_connections 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.628+0000 7f883ac36640 1 -- 10.20.193.45:0/1833311094 wait complete. 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient: build_initial_monmap 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient: monmap: 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:26.629 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 librados: starting msgr at 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 librados: starting objecter 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 Processor -- start 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 -- start start 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 librados: setting wanted keys 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 librados: calling monclient init 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient: init 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88340c92b0 0x7f88341f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:26.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient(hunting): picked mon.noname-a con 0x7f88340c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8834153d20 0x7f88341f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient(hunting): picked mon.noname-b con 0x7f8834153d20 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f883415d1e0 0x7f883415bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient(hunting): picked mon.noname-c con 0x7f883415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f88340748e0 con 0x7f88340c92b0 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f88340c8680 con 0x7f8834153d20 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8834074a60 con 0x7f883415d1e0 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.629+0000 7f883ac36640 10 monclient(hunting): authenticate will time out at 1150.259941s 2026-02-17T21:09:26.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88389ab640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88340c92b0 0x7f88341f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f883415d1e0 0x7f883415bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f883415d1e0 0x7f883415bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:42336/0 (socket says 10.20.193.45:42336) 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 1 -- 10.20.193.45:0/1141428405 learned_addr learned my addr 10.20.193.45:0/1141428405 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 10 monclient(hunting): get_auth_request con 0x7f883415d1e0 auth_method 0 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f882bfff640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8834153d20 0x7f88341f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88389ab640 10 monclient(hunting): get_auth_request con 0x7f88340c92b0 auth_method 0 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88389ab640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:26.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88389ab640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88389ab640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88391ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f882bfff640 10 monclient(hunting): get_auth_request con 0x7f8834153d20 auth_method 0 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f882bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f882bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f882bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88389ab640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88389ab640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.630+0000 7f88389ab640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f882bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:26.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f882bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f882bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 10 monclient(hunting): handle_auth_done global_id 4862 payload 824 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 1 -- 10.20.193.45:0/1141428405 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8834153d20 msgr2=0x7f88341f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8834153d20 0x7f88341f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 1 -- 10.20.193.45:0/1141428405 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88340c92b0 msgr2=0x7f88341f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88340c92b0 0x7f88341f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 10 monclient: _finish_hunting 0 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 1 monclient: found mon.noname-c 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.631+0000 7f88391ac640 1 -- 10.20.193.45:0/1141428405 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88341f3de0 con 0x7f883415d1e0 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.633+0000 7f88391ac640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f883415d1e0 0x7f883415bdc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f883003a040 tx=0x7f8830004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:26.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.633+0000 7f88297fa640 10 client.?.objecter ms_handle_connect 0x7f883415d1e0 2026-02-17T21:09:26.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.633+0000 7f88297fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:26.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 1 -- 10.20.193.45:0/1141428405 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830047020 con 0x7f883415d1e0 2026-02-17T21:09:26.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:26.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:26.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 10 monclient: dump: 2026-02-17T21:09:26.637 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:26.637 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:26.637 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:26.637 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:26.637 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 10 monclient: _finish_auth 0 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 10 monclient: _check_auth_tickets 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 1 -- 10.20.193.45:0/1141428405 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88300358f0 con 0x7f883415d1e0 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f883ac36640 5 monclient: authenticate success, global_id 4862 2026-02-17T21:09:26.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f883ac36640 10 monclient: _renew_subs 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f883ac36640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88341f7810 con 0x7f883415d1e0 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 1 -- 10.20.193.45:0/1141428405 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883003c040 con 0x7f883415d1e0 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f88297fa640 10 monclient: dump: 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:26.639 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.634+0000 7f882affd640 4 set_mon_vals no callback set 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.635+0000 7f883ac36640 10 client.4862.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.635+0000 7f883ac36640 10 monclient: _renew_subs 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.635+0000 7f883ac36640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.635+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88341f7dd0 con 0x7f883415d1e0 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.635+0000 7f883ac36640 1 librados: init done 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.635+0000 7f883ac36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.635+0000 7f883ac36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:26.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.635+0000 7f883ac36640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:26.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.635+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88340698c0 con 0x7f883415d1e0 2026-02-17T21:09:26.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.743+0000 7f88297fa640 1 -- 10.20.193.45:0/1141428405 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f8830035ce0 con 0x7f883415d1e0 2026-02-17T21:09:26.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.743+0000 7f88297fa640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f88040792b0 0x7f880407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:26.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.743+0000 7f88389ab640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f88040792b0 0x7f880407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:26.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.743+0000 7f88389ab640 10 monclient: get_auth_request con 0x7f88040792b0 auth_method 0 2026-02-17T21:09:26.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.743+0000 7f88389ab640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f88040792b0 0x7f880407b770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8824002770 tx=0x7f8824009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:26.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.743+0000 7f88297fa640 10 client.4862.objecter ms_handle_connect 0x7f88040792b0 2026-02-17T21:09:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.745+0000 7f88297fa640 1 -- 10.20.193.45:0/1141428405 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f8830084570 con 0x7f883415d1e0 2026-02-17T21:09:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.745+0000 7f88297fa640 10 client.4862.objecter ms_dispatch2 0x7f8834000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.745+0000 7f88297fa640 3 client.4862.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.745+0000 7f88297fa640 3 client.4862.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.745+0000 7f88297fa640 20 client.4862.objecter dump_active .. 0 homeless 2026-02-17T21:09:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.751+0000 7f88297fa640 1 -- 10.20.193.45:0/1141428405 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f88340698c0 con 0x7f883415d1e0 2026-02-17T21:09:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.751+0000 7f88297fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.751+0000 7f88297fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:26.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.850+0000 7f883ac36640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:26.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.850+0000 7f883ac36640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:26.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.850+0000 7f883ac36640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:26.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.850+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f883414e2e0 con 0x7f883415d1e0 2026-02-17T21:09:26.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.852+0000 7f88297fa640 1 -- 10.20.193.45:0/1141428405 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f883414e2e0 con 0x7f883415d1e0 2026-02-17T21:09:26.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.852+0000 7f88297fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:26.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.852+0000 7f88297fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:26.845 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:26.845 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 10 librados: watch_flush enter 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 10 librados: watch_flush exit 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 20 client.4862.objecter shutdown clearing up homeless session... 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 10 client.4862.objecter successfully canceled tick 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f88040792b0 msgr2=0x7f880407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f88040792b0 0x7f880407b770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8824002770 tx=0x7f8824009040 comp rx=0 tx=0).stop 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 10 monclient: shutdown 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f883415d1e0 msgr2=0x7f883415bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f883415d1e0 0x7f883415bdc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f883003a040 tx=0x7f8830004b40 comp rx=0 tx=0).stop 2026-02-17T21:09:26.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 shutdown_connections 2026-02-17T21:09:26.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f88040792b0 0x7f880407b770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:26.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f883415d1e0 0x7f883415bdc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:26.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8834153d20 0x7f88341f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:26.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 --2- 10.20.193.45:0/1141428405 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f88340c92b0 0x7f88341f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:26.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 >> 10.20.193.45:0/1141428405 conn(0x7f88340c9d40 msgr2=0x7f88340ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:26.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 shutdown_connections 2026-02-17T21:09:26.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 -- 10.20.193.45:0/1141428405 wait complete. 2026-02-17T21:09:26.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:26.853+0000 7f883ac36640 1 librados: shutdown 2026-02-17T21:09:29.855 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:29.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.930+0000 7fb19ec1b640 10 monclient: get_monmap_and_config 2026-02-17T21:09:29.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.930+0000 7fb19ec1b640 10 monclient: build_initial_monmap 2026-02-17T21:09:29.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.930+0000 7fb19ec1b640 10 monclient: monmap: 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:29.931388+0000 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:29.931388+0000 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:29.924 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:29.925 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:29.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.930+0000 7fb19ec1b640 1 Processor -- start 2026-02-17T21:09:29.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.930+0000 7fb19ec1b640 1 -- start start 2026-02-17T21:09:29.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.930+0000 7fb19ec1b640 10 monclient: init 2026-02-17T21:09:29.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:29.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 10 monclient: _add_conns ranks=[0,3,4,5,1,2] 2026-02-17T21:09:29.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb19815d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:29.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fb1980c92b0 0x7fb19815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 10 monclient(hunting): picked mon.noname-a con 0x7fb1980c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fb1980748e0 0x7fb198153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 10 monclient(hunting): picked mon.noname-b con 0x7fb1980748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1980c5860 con 0x7fb19815d1e0 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fb1980c5580 con 0x7fb1980c92b0 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fb1980c7de0 con 0x7fb1980748e0 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:29.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.931+0000 7fb19ec1b640 10 monclient(hunting): authenticate will time out at 1153.561502s 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb18ffff640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fb1980c92b0 0x7fb19815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19d191640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fb1980748e0 0x7fb198153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19c990640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fb19815d1e0 0x7fb1980c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:42106/0 (socket says 10.20.193.45:42106) 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19c990640 1 -- 10.20.193.45:0/4059654202 learned_addr learned my addr 10.20.193.45:0/4059654202 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19d191640 10 monclient(hunting): get_auth_request con 0x7fb1980748e0 auth_method 0 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19d191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19d191640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19d191640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb18ffff640 10 monclient(hunting): get_auth_request con 0x7fb1980c92b0 auth_method 0 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb18ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb18ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:29.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb18ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19d191640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19d191640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.932+0000 7fb19d191640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.933+0000 7fb18ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.933+0000 7fb18ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.933+0000 7fb18ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.934+0000 7fb19d191640 10 monclient(hunting): handle_auth_done global_id 4825 payload 274 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.934+0000 7fb19d191640 1 -- 10.20.193.45:0/4059654202 >> v2:10.20.193.45:3300/0 conn(0x7fb1980c92b0 msgr2=0x7fb19815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.934+0000 7fb19d191640 1 --2- 10.20.193.45:0/4059654202 >> v2:10.20.193.45:3300/0 conn(0x7fb1980c92b0 0x7fb19815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.934+0000 7fb19d191640 1 -- 10.20.193.45:0/4059654202 >> v1:10.20.193.45:6789/0 conn(0x7fb19815d1e0 legacy=0x7fb1980c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.934+0000 7fb19d191640 10 monclient: _finish_hunting 0 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.934+0000 7fb19d191640 1 monclient: found mon.noname-b 2026-02-17T21:09:29.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.934+0000 7fb19d191640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:29.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.934+0000 7fb19d191640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:29.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.934+0000 7fb19d191640 1 -- 10.20.193.45:0/4059654202 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1980c80c0 con 0x7fb1980748e0 2026-02-17T21:09:29.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.935+0000 7fb19d191640 1 --2- 10.20.193.45:0/4059654202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb1980748e0 0x7fb198153610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb194009d90 tx=0x7fb19402f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82198057a80e30c9 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:29.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 1 -- 10.20.193.45:0/4059654202 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19403c070 con 0x7fb1980748e0 2026-02-17T21:09:29.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:29.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:29.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 10 monclient: dump: 2026-02-17T21:09:29.940 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:29.940 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:29.940 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:29.940 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:29.941 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:29.941 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:29.941 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:29.941 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:29.941 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:29.941 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:09:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:09:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 1 -- 10.20.193.45:0/4059654202 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194037440 con 0x7fb1980748e0 2026-02-17T21:09:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 5 monclient: authenticate success, global_id 4825 2026-02-17T21:09:29.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 1 -- 10.20.193.45:0/4059654202 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194037810 con 0x7fb1980748e0 2026-02-17T21:09:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 4 set_mon_vals no callback set 2026-02-17T21:09:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:29.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:29.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb18f7fe640 10 monclient: dump: 2026-02-17T21:09:29.944 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:29.944 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:29.944 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:29.944 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:29.944 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:29.945 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:29.945 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:29.945 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:29.945 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:29.945 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:29.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 10 monclient: shutdown 2026-02-17T21:09:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4059654202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb1980748e0 msgr2=0x7fb198153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 1 --2- 10.20.193.45:0/4059654202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb1980748e0 0x7fb198153610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb194009d90 tx=0x7fb19402f1e0 comp rx=0 tx=0).stop 2026-02-17T21:09:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4059654202 shutdown_connections 2026-02-17T21:09:29.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 1 --2- 10.20.193.45:0/4059654202 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb1980748e0 0x7fb198153610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 1 --2- 10.20.193.45:0/4059654202 >> v2:10.20.193.45:3300/0 conn(0x7fb1980c92b0 0x7fb19815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4059654202 >> 10.20.193.45:0/4059654202 conn(0x7fb1980c9d40 msgr2=0x7fb1980ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4059654202 shutdown_connections 2026-02-17T21:09:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.937+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4059654202 wait complete. 2026-02-17T21:09:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient: build_initial_monmap 2026-02-17T21:09:29.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient: monmap: 2026-02-17T21:09:29.948 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:29.948 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:29.948 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:29.948 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:29.948 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:29.949 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:29.949 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:29.949 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:29.949 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:29.949 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:29.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 librados: starting msgr at 2026-02-17T21:09:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 librados: starting objecter 2026-02-17T21:09:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 Processor -- start 2026-02-17T21:09:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 -- start start 2026-02-17T21:09:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 librados: setting wanted keys 2026-02-17T21:09:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 librados: calling monclient init 2026-02-17T21:09:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient: init 2026-02-17T21:09:29.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:09:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb1980748e0 0x7fb19806b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient(hunting): picked mon.noname-a con 0x7fb1980748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1980c92b0 0x7fb198140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient(hunting): picked mon.noname-c con 0x7fb1980c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:29.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb19815d1e0 0x7fb1981f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:29.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient(hunting): picked mon.noname-b con 0x7fb19815d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:29.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:29.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb198074d30 con 0x7fb1980748e0 2026-02-17T21:09:29.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:29.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb1980c8680 con 0x7fb19815d1e0 2026-02-17T21:09:29.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb198153b50 con 0x7fb1980c92b0 2026-02-17T21:09:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.938+0000 7fb19ec1b640 10 monclient(hunting): authenticate will time out at 1153.568904s 2026-02-17T21:09:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb18ffff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1980c92b0 0x7fb198140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb19815d1e0 0x7fb1981f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19c990640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb1980748e0 0x7fb19806b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:29.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb19815d1e0 0x7fb1981f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:39588/0 (socket says 10.20.193.45:39588) 2026-02-17T21:09:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 1 -- 10.20.193.45:0/4117102906 learned_addr learned my addr 10.20.193.45:0/4117102906 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 10 monclient(hunting): get_auth_request con 0x7fb19815d1e0 auth_method 0 2026-02-17T21:09:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb18ffff640 10 monclient(hunting): get_auth_request con 0x7fb1980c92b0 auth_method 0 2026-02-17T21:09:29.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb18ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:29.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb18ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:29.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb18ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:29.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19c990640 10 monclient(hunting): get_auth_request con 0x7fb1980748e0 auth_method 0 2026-02-17T21:09:29.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19c990640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:29.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19c990640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:29.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19c990640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:29.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:29.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:29.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19d191640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:29.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb18ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:29.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb18ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:29.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb18ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:29.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19c990640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:29.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19c990640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:29.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.939+0000 7fb19c990640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:29.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 10 monclient(hunting): handle_auth_done global_id 4828 payload 824 2026-02-17T21:09:29.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 1 -- 10.20.193.45:0/4117102906 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1980c92b0 msgr2=0x7fb198140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:29.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1980c92b0 0x7fb198140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:29.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 1 -- 10.20.193.45:0/4117102906 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb1980748e0 msgr2=0x7fb19806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:29.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb1980748e0 0x7fb19806b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:29.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 10 monclient: _finish_hunting 0 2026-02-17T21:09:29.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 1 monclient: found mon.noname-b 2026-02-17T21:09:29.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.941+0000 7fb19d191640 1 -- 10.20.193.45:0/4117102906 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1981f5e80 con 0x7fb19815d1e0 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.942+0000 7fb19d191640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb19815d1e0 0x7fb1981f4fb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb194009d90 tx=0x7fb194004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.942+0000 7fb18d7fa640 10 client.?.objecter ms_handle_connect 0x7fb19815d1e0 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.942+0000 7fb18d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 1 -- 10.20.193.45:0/4117102906 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19403c050 con 0x7fb19815d1e0 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 10 monclient: dump: 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:29.958 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 10 monclient: _finish_auth 0 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb19ec1b640 5 monclient: authenticate success, global_id 4828 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb19ec1b640 10 monclient: _renew_subs 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb19ec1b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1981f2910 con 0x7fb19815d1e0 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb19ec1b640 10 client.4828.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb19ec1b640 10 monclient: _renew_subs 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb19ec1b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:29.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1981f1b50 con 0x7fb19815d1e0 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb19ec1b640 1 librados: init done 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 1 -- 10.20.193.45:0/4117102906 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194048070 con 0x7fb19815d1e0 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 1 -- 10.20.193.45:0/4117102906 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194035a50 con 0x7fb19815d1e0 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18d7fa640 10 monclient: dump: 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.943+0000 7fb18effd640 4 set_mon_vals no callback set 2026-02-17T21:09:29.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.944+0000 7fb19ec1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:29.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.944+0000 7fb19ec1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:29.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.944+0000 7fb19ec1b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:29.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.944+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb198153f30 con 0x7fb19815d1e0 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.955+0000 7fb18d7fa640 1 -- 10.20.193.45:0/4117102906 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb194035bf0 con 0x7fb19815d1e0 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.955+0000 7fb18d7fa640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb168079280 0x7fb16807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.955+0000 7fb19c990640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb168079280 0x7fb16807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.955+0000 7fb19c990640 10 monclient: get_auth_request con 0x7fb168079280 auth_method 0 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.956+0000 7fb18d7fa640 10 client.4828.objecter ms_handle_connect 0x7fb168079280 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.956+0000 7fb19c990640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb168079280 0x7fb16807b740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb188002770 tx=0x7fb188009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.957+0000 7fb18d7fa640 1 -- 10.20.193.45:0/4117102906 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fb1940be2d0 con 0x7fb19815d1e0 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.957+0000 7fb18d7fa640 10 client.4828.objecter ms_dispatch2 0x7fb198000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.957+0000 7fb18d7fa640 3 client.4828.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.957+0000 7fb18d7fa640 3 client.4828.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:29.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:29.957+0000 7fb18d7fa640 20 client.4828.objecter dump_active .. 0 homeless 2026-02-17T21:09:30.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.059+0000 7fb18d7fa640 1 -- 10.20.193.45:0/4117102906 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb194088920 con 0x7fb19815d1e0 2026-02-17T21:09:30.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.059+0000 7fb18d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:30.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.059+0000 7fb18d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:30.107 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:37.320 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:30.134 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:04:37.344 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:30.135 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:37.348 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:30.136 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:04:37.309 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:30.136 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:04:37.346 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:30.138 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:04:37.311 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:30.148 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:04:37.358 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:30.148 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:37.362 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:30.149 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:04:37.322 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:30.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.164+0000 7fb19ec1b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:30.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.164+0000 7fb19ec1b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:30.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.164+0000 7fb19ec1b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:30.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.164+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb1980c9b20 con 0x7fb19815d1e0 2026-02-17T21:09:30.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.168+0000 7fb18d7fa640 1 -- 10.20.193.45:0/4117102906 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb19408cc20 con 0x7fb19815d1e0 2026-02-17T21:09:30.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.168+0000 7fb18d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:30.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.168+0000 7fb18d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:30.162 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:30.162 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:30.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 10 librados: watch_flush enter 2026-02-17T21:09:30.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 10 librados: watch_flush exit 2026-02-17T21:09:30.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 20 client.4828.objecter shutdown clearing up homeless session... 2026-02-17T21:09:30.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 10 client.4828.objecter successfully canceled tick 2026-02-17T21:09:30.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb168079280 msgr2=0x7fb16807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:30.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb168079280 0x7fb16807b740 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb188002770 tx=0x7fb188009040 comp rx=0 tx=0).stop 2026-02-17T21:09:30.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 10 monclient: shutdown 2026-02-17T21:09:30.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:30.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb19815d1e0 msgr2=0x7fb1981f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:30.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb19815d1e0 0x7fb1981f4fb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb194009d90 tx=0x7fb194004b40 comp rx=0 tx=0).stop 2026-02-17T21:09:30.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 shutdown_connections 2026-02-17T21:09:30.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb168079280 0x7fb16807b740 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:30.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb19815d1e0 0x7fb1981f4fb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:30.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1980c92b0 0x7fb198140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:30.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 --2- 10.20.193.45:0/4117102906 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb1980748e0 0x7fb19806b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:30.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 >> 10.20.193.45:0/4117102906 conn(0x7fb1980c9d40 msgr2=0x7fb198149520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:30.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 shutdown_connections 2026-02-17T21:09:30.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.170+0000 7fb19ec1b640 1 -- 10.20.193.45:0/4117102906 wait complete. 2026-02-17T21:09:30.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:30.171+0000 7fb19ec1b640 1 librados: shutdown 2026-02-17T21:09:33.174 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:33.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.251+0000 7f580325b640 10 monclient: get_monmap_and_config 2026-02-17T21:09:33.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.251+0000 7f580325b640 10 monclient: build_initial_monmap 2026-02-17T21:09:33.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.251+0000 7f580325b640 10 monclient: monmap: 2026-02-17T21:09:33.244 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:33.244 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:33.252640+0000 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:33.252640+0000 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:33.245 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 1 Processor -- start 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 1 -- start start 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 10 monclient: init 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 10 monclient: _add_conns ranks=[4,2,0,3,1,5] 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f57fc15d1e0 0x7f57fc15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 10 monclient(hunting): picked mon.noname-b con 0x7f57fc15d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f57fc0748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f57fc0c92b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:33.249 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57fc0c5860 con 0x7f57fc0c92b0 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57fc0c5580 con 0x7f57fc0748e0 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f57fc0c7de0 con 0x7f57fc15d1e0 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.252+0000 7f580325b640 10 monclient(hunting): authenticate will time out at 1156.882879s 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.253+0000 7f57f3fff640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f57fc0748e0 0x7f57fc0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:33844/0 (socket says 10.20.193.45:33844) 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.253+0000 7f57f3fff640 1 -- 10.20.193.45:0/316503373 learned_addr learned my addr 10.20.193.45:0/316503373 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.253+0000 7f5800fd0640 1 --2- 10.20.193.45:0/316503373 >> v2:10.20.193.86:3300/0 conn(0x7f57fc15d1e0 0x7f57fc15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.253+0000 7f5800fd0640 10 monclient(hunting): get_auth_request con 0x7f57fc15d1e0 auth_method 0 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.253+0000 7f5800fd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:33.250 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.253+0000 7f5800fd0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.253+0000 7f5800fd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f5800fd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f5800fd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f5800fd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 1 -- 10.20.193.45:0/316503373 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1938561859 0 0) 0x7f57fc0c5860 con 0x7f57fc0c92b0 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 10 monclient(hunting): _negotiate 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 10 monclient(hunting): my global_id is 4767 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 1 -- 10.20.193.45:0/316503373 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57e8003620 con 0x7f57fc0c92b0 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 1 -- 10.20.193.45:0/316503373 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144731127 0 0) 0x7f57fc0c5580 con 0x7f57fc0748e0 2026-02-17T21:09:33.251 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 10 monclient(hunting): _negotiate 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 10 monclient(hunting): my global_id is 4868 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.254+0000 7f57f37fe640 1 -- 10.20.193.45:0/316503373 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57fc0c5860 con 0x7f57fc0748e0 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.255+0000 7f5800fd0640 10 monclient(hunting): handle_auth_done global_id 4831 payload 274 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.255+0000 7f5800fd0640 1 -- 10.20.193.45:0/316503373 >> v1:10.20.193.92:6789/0 conn(0x7f57fc0748e0 legacy=0x7f57fc0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.255+0000 7f5800fd0640 1 -- 10.20.193.45:0/316503373 >> v1:10.20.193.45:6789/0 conn(0x7f57fc0c92b0 legacy=0x7f57fc153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.255+0000 7f5800fd0640 10 monclient: _finish_hunting 0 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.255+0000 7f5800fd0640 1 monclient: found mon.noname-b 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.255+0000 7f5800fd0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.255+0000 7f5800fd0640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.255+0000 7f5800fd0640 1 -- 10.20.193.45:0/316503373 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc0c80c0 con 0x7f57fc15d1e0 2026-02-17T21:09:33.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.256+0000 7f5800fd0640 1 --2- 10.20.193.45:0/316503373 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc15d1e0 0x7f57fc15d5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0098d0 tx=0x7f57ec02eed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf669a6874af80f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:33.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f57f37fe640 1 -- 10.20.193.45:0/316503373 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec03c070 con 0x7f57fc15d1e0 2026-02-17T21:09:33.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f57f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f57f37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f57f37fe640 10 monclient: dump: 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:33.258 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f57f37fe640 10 monclient: _finish_auth 0 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f57f37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f57f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f57f37fe640 1 -- 10.20.193.45:0/316503373 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ec02fba0 con 0x7f57fc15d1e0 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f580325b640 5 monclient: authenticate success, global_id 4831 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.258+0000 7f580325b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f57f37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f57f37fe640 1 -- 10.20.193.45:0/316503373 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec037440 con 0x7f57fc15d1e0 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 4 set_mon_vals no callback set 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f57f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:33.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f57f37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f57f37fe640 10 monclient: dump: 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 10 monclient: shutdown 2026-02-17T21:09:33.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 1 -- 10.20.193.45:0/316503373 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc15d1e0 msgr2=0x7f57fc15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 1 --2- 10.20.193.45:0/316503373 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc15d1e0 0x7f57fc15d5c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0098d0 tx=0x7f57ec02eed0 comp rx=0 tx=0).stop 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 1 -- 10.20.193.45:0/316503373 shutdown_connections 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 1 --2- 10.20.193.45:0/316503373 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc15d1e0 0x7f57fc15d5c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 1 -- 10.20.193.45:0/316503373 >> 10.20.193.45:0/316503373 conn(0x7f57fc0c9d40 msgr2=0x7f57fc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 1 -- 10.20.193.45:0/316503373 shutdown_connections 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 1 -- 10.20.193.45:0/316503373 wait complete. 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 10 monclient: build_initial_monmap 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.259+0000 7f580325b640 10 monclient: monmap: 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:33.261 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 librados: starting msgr at 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 librados: starting objecter 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 Processor -- start 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 -- start start 2026-02-17T21:09:33.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 librados: setting wanted keys 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 librados: calling monclient init 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient: init 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f57fc0748e0 0x7f57fc1f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient(hunting): picked mon.noname-a con 0x7f57fc0748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc0c92b0 0x7f57fc072990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient(hunting): picked mon.noname-b con 0x7f57fc0c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57fc15d1e0 0x7f57fc145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient(hunting): picked mon.noname-c con 0x7f57fc15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc074d30 con 0x7f57fc0748e0 2026-02-17T21:09:33.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc0c8680 con 0x7f57fc0c92b0 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc153d20 con 0x7f57fc15d1e0 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f580325b640 10 monclient(hunting): authenticate will time out at 1156.890666s 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f5800fd0640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f57fc0748e0 0x7f57fc1f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.260+0000 7f57f3fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc0c92b0 0x7f57fc072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f58017d1640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57fc15d1e0 0x7f57fc145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f57f3fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc0c92b0 0x7f57fc072990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:39604/0 (socket says 10.20.193.45:39604) 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f57f3fff640 1 -- 10.20.193.45:0/2954667902 learned_addr learned my addr 10.20.193.45:0/2954667902 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f57f3fff640 10 monclient(hunting): get_auth_request con 0x7f57fc0c92b0 auth_method 0 2026-02-17T21:09:33.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f57f3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f57f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f57f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f5800fd0640 10 monclient(hunting): get_auth_request con 0x7f57fc0748e0 auth_method 0 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f5800fd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f5800fd0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f5800fd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f58017d1640 10 monclient(hunting): get_auth_request con 0x7f57fc15d1e0 auth_method 0 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f58017d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f58017d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f58017d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f57f3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:33.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f57f3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f57f3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f5800fd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f5800fd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f5800fd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f58017d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f58017d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.261+0000 7f58017d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 10 monclient(hunting): handle_auth_done global_id 4834 payload 824 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 1 -- 10.20.193.45:0/2954667902 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57fc15d1e0 msgr2=0x7f57fc145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57fc15d1e0 0x7f57fc145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 1 -- 10.20.193.45:0/2954667902 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f57fc0748e0 msgr2=0x7f57fc1f76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:33.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f57fc0748e0 0x7f57fc1f76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:33.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:09:33.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 1 monclient: found mon.noname-b 2026-02-17T21:09:33.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:33.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:33.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.262+0000 7f57f3fff640 1 -- 10.20.193.45:0/2954667902 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc073340 con 0x7f57fc0c92b0 2026-02-17T21:09:33.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.263+0000 7f57f3fff640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc0c92b0 0x7f57fc072990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57e400c790 tx=0x7f57e400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:33.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.263+0000 7f57f17fa640 10 client.?.objecter ms_handle_connect 0x7f57fc0c92b0 2026-02-17T21:09:33.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.263+0000 7f57f17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:33.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 1 -- 10.20.193.45:0/2954667902 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4017070 con 0x7f57fc0c92b0 2026-02-17T21:09:33.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:33.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:33.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 10 monclient: dump: 2026-02-17T21:09:33.269 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:33.269 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:33.269 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 10 monclient: _finish_auth 0 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 10 monclient: _check_auth_tickets 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:33.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f580325b640 5 monclient: authenticate success, global_id 4834 2026-02-17T21:09:33.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 1 -- 10.20.193.45:0/2954667902 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e4005bb0 con 0x7f57fc0c92b0 2026-02-17T21:09:33.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:33.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 1 -- 10.20.193.45:0/2954667902 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4007070 con 0x7f57fc0c92b0 2026-02-17T21:09:33.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f580325b640 10 monclient: _renew_subs 2026-02-17T21:09:33.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f580325b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:33.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57fc073620 con 0x7f57fc0c92b0 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f2ffd640 4 set_mon_vals no callback set 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f57f17fa640 10 monclient: dump: 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:33.272 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:33.273 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:33.273 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:33.273 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:33.273 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:33.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f580325b640 10 client.4834.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:33.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f580325b640 10 monclient: _renew_subs 2026-02-17T21:09:33.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f580325b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:33.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57fc073be0 con 0x7f57fc0c92b0 2026-02-17T21:09:33.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.265+0000 7f580325b640 1 librados: init done 2026-02-17T21:09:33.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.266+0000 7f580325b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:33.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.266+0000 7f580325b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:33.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.266+0000 7f580325b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:33.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.266+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57fc15d5c0 con 0x7f57fc0c92b0 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.277+0000 7f57f17fa640 1 -- 10.20.193.45:0/2954667902 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f57e4007210 con 0x7f57fc0c92b0 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.278+0000 7f57f17fa640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57cc079280 0x7f57cc07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.278+0000 7f5800fd0640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57cc079280 0x7f57cc07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.278+0000 7f5800fd0640 10 monclient: get_auth_request con 0x7f57cc079280 auth_method 0 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.278+0000 7f57f17fa640 10 client.4834.objecter ms_handle_connect 0x7f57cc079280 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.278+0000 7f5800fd0640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57cc079280 0x7f57cc07b740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f57ec039000 tx=0x7f57ec033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.279+0000 7f57f17fa640 1 -- 10.20.193.45:0/2954667902 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f57e405d860 con 0x7f57fc0c92b0 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.279+0000 7f57f17fa640 10 client.4834.objecter ms_dispatch2 0x7f57fc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.279+0000 7f57f17fa640 3 client.4834.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:33.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.279+0000 7f57f17fa640 3 client.4834.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:33.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.280+0000 7f57f17fa640 20 client.4834.objecter dump_active .. 0 homeless 2026-02-17T21:09:33.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.382+0000 7f57f17fa640 1 -- 10.20.193.45:0/2954667902 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f57e4021020 con 0x7f57fc0c92b0 2026-02-17T21:09:33.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.382+0000 7f57f17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:33.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.382+0000 7f57f17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:33.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.484+0000 7f580325b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:33.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.484+0000 7f580325b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:33.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.484+0000 7f580325b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:33.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.484+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f57fc0c9b20 con 0x7f57fc0c92b0 2026-02-17T21:09:33.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.487+0000 7f57f17fa640 1 -- 10.20.193.45:0/2954667902 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f57e4061820 con 0x7f57fc0c92b0 2026-02-17T21:09:33.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.487+0000 7f57f17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:33.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.487+0000 7f57f17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:33.480 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:33.480 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 10 librados: watch_flush enter 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 10 librados: watch_flush exit 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 20 client.4834.objecter shutdown clearing up homeless session... 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 10 client.4834.objecter successfully canceled tick 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57cc079280 msgr2=0x7f57cc07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57cc079280 0x7f57cc07b740 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f57ec039000 tx=0x7f57ec033000 comp rx=0 tx=0).stop 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 10 monclient: shutdown 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc0c92b0 msgr2=0x7f57fc072990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc0c92b0 0x7f57fc072990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f57e400c790 tx=0x7f57e400cc60 comp rx=0 tx=0).stop 2026-02-17T21:09:33.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 shutdown_connections 2026-02-17T21:09:33.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f57cc079280 0x7f57cc07b740 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:33.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f57fc15d1e0 0x7f57fc145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:33.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f57fc0c92b0 0x7f57fc072990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:33.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 --2- 10.20.193.45:0/2954667902 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f57fc0748e0 0x7f57fc1f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:33.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 >> 10.20.193.45:0/2954667902 conn(0x7f57fc0c9d40 msgr2=0x7f57fc0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:33.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 shutdown_connections 2026-02-17T21:09:33.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 -- 10.20.193.45:0/2954667902 wait complete. 2026-02-17T21:09:33.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:33.488+0000 7f580325b640 1 librados: shutdown 2026-02-17T21:09:36.490 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:36.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.569+0000 7f7b95415640 10 monclient: get_monmap_and_config 2026-02-17T21:09:36.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.569+0000 7f7b95415640 10 monclient: build_initial_monmap 2026-02-17T21:09:36.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.569+0000 7f7b95415640 10 monclient: monmap: 2026-02-17T21:09:36.566 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:36.566 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:36.566 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:36.570689+0000 2026-02-17T21:09:36.566 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:36.570689+0000 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 1 Processor -- start 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 1 -- start start 2026-02-17T21:09:36.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient: init 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient: _add_conns ranks=[1,3,5,0,4,2] 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f7b9015d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f7b900c92b0 0x7f7b9015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient(hunting): picked mon.noname-a con 0x7f7b900c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f7b900748e0 0x7f7b90153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient(hunting): picked mon.noname-c con 0x7f7b900748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b900c5860 con 0x7f7b9015d1e0 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f7b900c5580 con 0x7f7b900c92b0 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:36.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f7b900c7de0 con 0x7f7b900748e0 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.570+0000 7f7b95415640 10 monclient(hunting): authenticate will time out at 1160.200799s 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8effd640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f7b9015d1e0 0x7f7b900c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:60212/0 (socket says 10.20.193.45:60212) 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8effd640 1 -- 10.20.193.45:0/1786134191 learned_addr learned my addr 10.20.193.45:0/1786134191 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8f7fe640 1 --2- 10.20.193.45:0/1786134191 >> v2:10.20.193.92:3300/0 conn(0x7f7b900748e0 0x7f7b90153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8e7fc640 1 --2- 10.20.193.45:0/1786134191 >> v2:10.20.193.45:3300/0 conn(0x7f7b900c92b0 0x7f7b9015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f7b900748e0 auth_method 0 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8e7fc640 10 monclient(hunting): get_auth_request con 0x7f7b900c92b0 auth_method 0 2026-02-17T21:09:36.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.571+0000 7f7b8e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.572+0000 7f7b8f7fe640 10 monclient(hunting): handle_auth_done global_id 4874 payload 274 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.572+0000 7f7b8f7fe640 1 -- 10.20.193.45:0/1786134191 >> v2:10.20.193.45:3300/0 conn(0x7f7b900c92b0 msgr2=0x7f7b9015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.572+0000 7f7b8f7fe640 1 --2- 10.20.193.45:0/1786134191 >> v2:10.20.193.45:3300/0 conn(0x7f7b900c92b0 0x7f7b9015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.572+0000 7f7b8f7fe640 1 -- 10.20.193.45:0/1786134191 >> v1:10.20.193.86:6789/0 conn(0x7f7b9015d1e0 legacy=0x7f7b900c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:36.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.572+0000 7f7b8f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:09:36.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.572+0000 7f7b8f7fe640 1 monclient: found mon.noname-c 2026-02-17T21:09:36.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.572+0000 7f7b8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:36.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.572+0000 7f7b8f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:36.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.572+0000 7f7b8f7fe640 1 -- 10.20.193.45:0/1786134191 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b900c80c0 con 0x7f7b900748e0 2026-02-17T21:09:36.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.573+0000 7f7b8f7fe640 1 --2- 10.20.193.45:0/1786134191 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900748e0 0x7f7b90153610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009d90 tx=0x7f7b8002f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc4b4e1776bd67a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:36.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 1 -- 10.20.193.45:0/1786134191 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8003c070 con 0x7f7b900748e0 2026-02-17T21:09:36.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:36.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:36.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 10 monclient: dump: 2026-02-17T21:09:36.578 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:36.578 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:36.578 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:36.578 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:36.578 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 10 monclient: _finish_auth 0 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 1 -- 10.20.193.45:0/1786134191 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b80037440 con 0x7f7b900748e0 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 5 monclient: authenticate success, global_id 4874 2026-02-17T21:09:36.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 1 -- 10.20.193.45:0/1786134191 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80037810 con 0x7f7b900748e0 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b8dffb640 10 monclient: dump: 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:36.580 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 4 set_mon_vals no callback set 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 10 monclient: shutdown 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 1 -- 10.20.193.45:0/1786134191 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900748e0 msgr2=0x7f7b90153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 1 --2- 10.20.193.45:0/1786134191 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900748e0 0x7f7b90153610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009d90 tx=0x7f7b8002f1e0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 1 -- 10.20.193.45:0/1786134191 shutdown_connections 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 1 --2- 10.20.193.45:0/1786134191 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900748e0 0x7f7b90153610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 1 --2- 10.20.193.45:0/1786134191 >> v2:10.20.193.45:3300/0 conn(0x7f7b900c92b0 0x7f7b9015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 1 -- 10.20.193.45:0/1786134191 >> 10.20.193.45:0/1786134191 conn(0x7f7b900c9d40 msgr2=0x7f7b900ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:36.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 1 -- 10.20.193.45:0/1786134191 shutdown_connections 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.575+0000 7f7b95415640 1 -- 10.20.193.45:0/1786134191 wait complete. 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient: build_initial_monmap 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient: monmap: 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:36.582 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 librados: starting msgr at 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 librados: starting objecter 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 Processor -- start 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 -- start start 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 librados: setting wanted keys 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 librados: calling monclient init 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient: init 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b900748e0 0x7f7b901f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient(hunting): picked mon.noname-a con 0x7f7b900748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:36.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900c92b0 0x7f7b90072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient(hunting): picked mon.noname-c con 0x7f7b900c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b9015d1e0 0x7f7b90073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient(hunting): picked mon.noname-b con 0x7f7b9015d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7b90074d30 con 0x7f7b900748e0 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7b900c8680 con 0x7f7b9015d1e0 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7b90153b50 con 0x7f7b900c92b0 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.576+0000 7f7b95415640 10 monclient(hunting): authenticate will time out at 1160.206984s 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8effd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b900748e0 0x7f7b901f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:36.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900c92b0 0x7f7b90072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8f7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b9015d1e0 0x7f7b90073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900c92b0 0x7f7b90072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:59940/0 (socket says 10.20.193.45:59940) 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 1 -- 10.20.193.45:0/1159727479 learned_addr learned my addr 10.20.193.45:0/1159727479 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 10 monclient(hunting): get_auth_request con 0x7f7b900c92b0 auth_method 0 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8effd640 10 monclient(hunting): get_auth_request con 0x7f7b900748e0 auth_method 0 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:36.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8f7fe640 10 monclient(hunting): get_auth_request con 0x7f7b9015d1e0 auth_method 0 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.577+0000 7f7b8effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:36.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 10 monclient(hunting): handle_auth_done global_id 4877 payload 824 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 1 -- 10.20.193.45:0/1159727479 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b9015d1e0 msgr2=0x7f7b90073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b9015d1e0 0x7f7b90073cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 1 -- 10.20.193.45:0/1159727479 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b900748e0 msgr2=0x7f7b901f7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b900748e0 0x7f7b901f7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 1 monclient: found mon.noname-c 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.578+0000 7f7b8e7fc640 1 -- 10.20.193.45:0/1159727479 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b90072e90 con 0x7f7b900c92b0 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.579+0000 7f7b8e7fc640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900c92b0 0x7f7b90072490 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800ec10 tx=0x7f7b7800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.579+0000 7f7b6f7fe640 10 client.?.objecter ms_handle_connect 0x7f7b900c92b0 2026-02-17T21:09:36.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.579+0000 7f7b6f7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 1 -- 10.20.193.45:0/1159727479 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78017070 con 0x7f7b900c92b0 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 10 monclient: dump: 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:36.588 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 1 -- 10.20.193.45:0/1159727479 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7800cc40 con 0x7f7b900c92b0 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b95415640 5 monclient: authenticate success, global_id 4877 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b95415640 10 monclient: _renew_subs 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b95415640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b90073170 con 0x7f7b900c92b0 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 1 -- 10.20.193.45:0/1159727479 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78013470 con 0x7f7b900c92b0 2026-02-17T21:09:36.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b6f7fe640 10 monclient: dump: 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:36.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b8d7fa640 4 set_mon_vals no callback set 2026-02-17T21:09:36.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b95415640 10 client.4877.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:36.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b95415640 10 monclient: _renew_subs 2026-02-17T21:09:36.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b95415640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:36.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b901e53a0 con 0x7f7b900c92b0 2026-02-17T21:09:36.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.581+0000 7f7b95415640 1 librados: init done 2026-02-17T21:09:36.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.582+0000 7f7b95415640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:36.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.582+0000 7f7b95415640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:36.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.582+0000 7f7b95415640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:36.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.582+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b90153f30 con 0x7f7b900c92b0 2026-02-17T21:09:36.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.593+0000 7f7b6f7fe640 1 -- 10.20.193.45:0/1159727479 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f7b78013630 con 0x7f7b900c92b0 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.594+0000 7f7b6f7fe640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b5c079280 0x7f7b5c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.594+0000 7f7b8effd640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b5c079280 0x7f7b5c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.594+0000 7f7b8effd640 10 monclient: get_auth_request con 0x7f7b5c079280 auth_method 0 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.594+0000 7f7b8effd640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b5c079280 0x7f7b5c07b740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7b84002770 tx=0x7f7b84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.594+0000 7f7b6f7fe640 10 client.4877.objecter ms_handle_connect 0x7f7b5c079280 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.595+0000 7f7b6f7fe640 1 -- 10.20.193.45:0/1159727479 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f7b7805e8e0 con 0x7f7b900c92b0 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.595+0000 7f7b6f7fe640 10 client.4877.objecter ms_dispatch2 0x7f7b90000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.595+0000 7f7b6f7fe640 3 client.4877.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.595+0000 7f7b6f7fe640 3 client.4877.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:36.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.595+0000 7f7b6f7fe640 20 client.4877.objecter dump_active .. 0 homeless 2026-02-17T21:09:36.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.695+0000 7f7b6f7fe640 1 -- 10.20.193.45:0/1159727479 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7b780628a0 con 0x7f7b900c92b0 2026-02-17T21:09:36.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.695+0000 7f7b6f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:36.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.695+0000 7f7b6f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:36.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.793+0000 7f7b95415640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:36.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.793+0000 7f7b95415640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:36.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.793+0000 7f7b95415640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:36.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.793+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b901573a0 con 0x7f7b900c92b0 2026-02-17T21:09:36.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.795+0000 7f7b6f7fe640 1 -- 10.20.193.45:0/1159727479 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f7b78066ba0 con 0x7f7b900c92b0 2026-02-17T21:09:36.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.795+0000 7f7b6f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:36.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.795+0000 7f7b6f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:36.788 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:36.789 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:36.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 10 librados: watch_flush enter 2026-02-17T21:09:36.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 10 librados: watch_flush exit 2026-02-17T21:09:36.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 20 client.4877.objecter shutdown clearing up homeless session... 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 10 client.4877.objecter successfully canceled tick 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b5c079280 msgr2=0x7f7b5c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b5c079280 0x7f7b5c07b740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7b84002770 tx=0x7f7b84009040 comp rx=0 tx=0).stop 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 10 monclient: shutdown 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900c92b0 msgr2=0x7f7b90072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900c92b0 0x7f7b90072490 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800ec10 tx=0x7f7b7800c520 comp rx=0 tx=0).stop 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 shutdown_connections 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7b5c079280 0x7f7b5c07b740 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7b9015d1e0 0x7f7b90073cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b900c92b0 0x7f7b90072490 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 --2- 10.20.193.45:0/1159727479 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7b900748e0 0x7f7b901f7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:36.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 >> 10.20.193.45:0/1159727479 conn(0x7f7b900c9d40 msgr2=0x7f7b90152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:36.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 shutdown_connections 2026-02-17T21:09:36.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 -- 10.20.193.45:0/1159727479 wait complete. 2026-02-17T21:09:36.792 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:36.797+0000 7f7b95415640 1 librados: shutdown 2026-02-17T21:09:39.800 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:39.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.875+0000 7f0beb8d6640 10 monclient: get_monmap_and_config 2026-02-17T21:09:39.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.875+0000 7f0beb8d6640 10 monclient: build_initial_monmap 2026-02-17T21:09:39.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.875+0000 7f0beb8d6640 10 monclient: monmap: 2026-02-17T21:09:39.869 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:39.869 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:39.877553+0000 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:39.877553+0000 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:39.870 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:39.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 1 Processor -- start 2026-02-17T21:09:39.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 1 -- start start 2026-02-17T21:09:39.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 10 monclient: init 2026-02-17T21:09:39.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:39.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 10 monclient: _add_conns ranks=[3,2,1,5,0,4] 2026-02-17T21:09:39.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0be40c3e40 0x7f0be406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:39.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 10 monclient(hunting): picked mon.noname-a con 0x7f0be40c3e40 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:39.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0be40c92a0 addr v1:10.20.193.92:6789/0 2026-02-17T21:09:39.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0be415f8e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0be40c96f0 con 0x7f0be415f8e0 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0be40c7c40 con 0x7f0be40c92a0 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0be40c8e10 con 0x7f0be40c3e40 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.876+0000 7f0beb8d6640 10 monclient(hunting): authenticate will time out at 1163.507774s 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be8e4a640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f0be40c92a0 0x7f0be415f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:46526/0 (socket says 10.20.193.45:46526) 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be8e4a640 1 -- 10.20.193.45:0/4003630191 learned_addr learned my addr 10.20.193.45:0/4003630191 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be964b640 1 --2- 10.20.193.45:0/4003630191 >> v2:10.20.193.45:3300/0 conn(0x7f0be40c3e40 0x7f0be406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be964b640 10 monclient(hunting): get_auth_request con 0x7f0be40c3e40 auth_method 0 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be964b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be964b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:39.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be964b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be964b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be964b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.877+0000 7f0be964b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 1 -- 10.20.193.45:0/4003630191 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3618077821 0 0) 0x7f0be40c7c40 con 0x7f0be40c92a0 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 10 monclient(hunting): _negotiate 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 10 monclient(hunting): my global_id is 4880 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 1 -- 10.20.193.45:0/4003630191 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bcc003620 con 0x7f0be40c92a0 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 1 -- 10.20.193.45:0/4003630191 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237270339 0 0) 0x7f0be40c96f0 con 0x7f0be415f8e0 2026-02-17T21:09:39.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 10 monclient(hunting): _negotiate 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 10 monclient(hunting): my global_id is 4843 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0bd3fff640 1 -- 10.20.193.45:0/4003630191 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0be40c7c40 con 0x7f0be415f8e0 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0be964b640 10 monclient(hunting): handle_auth_done global_id 4779 payload 274 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0be964b640 1 -- 10.20.193.45:0/4003630191 >> v1:10.20.193.92:6789/0 conn(0x7f0be40c92a0 legacy=0x7f0be415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0be964b640 1 -- 10.20.193.45:0/4003630191 >> v1:10.20.193.86:6789/0 conn(0x7f0be415f8e0 legacy=0x7f0be4073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0be964b640 10 monclient: _finish_hunting 0 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0be964b640 1 monclient: found mon.noname-a 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0be964b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0be964b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.878+0000 7f0be964b640 1 -- 10.20.193.45:0/4003630191 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be40c7f20 con 0x7f0be40c3e40 2026-02-17T21:09:39.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.879+0000 7f0be964b640 1 --2- 10.20.193.45:0/4003630191 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c3e40 0x7f0be406d170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0be40c8f90 tx=0x7f0bd402ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ebb31b00caf700 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:39.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 1 -- 10.20.193.45:0/4003630191 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd403c070 con 0x7f0be40c3e40 2026-02-17T21:09:39.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:39.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:09:39.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 10 monclient: dump: 2026-02-17T21:09:39.884 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:39.884 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:39.884 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 10 monclient: _finish_auth 0 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 10 monclient: _check_auth_tickets 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:39.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 1 -- 10.20.193.45:0/4003630191 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd402fb70 con 0x7f0be40c3e40 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 1 -- 10.20.193.45:0/4003630191 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4037440 con 0x7f0be40c3e40 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0beb8d6640 5 monclient: authenticate success, global_id 4779 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0beb8d6640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0beb8d6640 4 set_mon_vals no callback set 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.881+0000 7f0bd3fff640 10 monclient: dump: 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:39.886 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 10 monclient: shutdown 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 1 -- 10.20.193.45:0/4003630191 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c3e40 msgr2=0x7f0be406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 1 --2- 10.20.193.45:0/4003630191 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c3e40 0x7f0be406d170 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0be40c8f90 tx=0x7f0bd402ee60 comp rx=0 tx=0).stop 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 1 -- 10.20.193.45:0/4003630191 shutdown_connections 2026-02-17T21:09:39.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 1 --2- 10.20.193.45:0/4003630191 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c3e40 0x7f0be406d170 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 1 -- 10.20.193.45:0/4003630191 >> 10.20.193.45:0/4003630191 conn(0x7f0be40c9d40 msgr2=0x7f0be40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 1 -- 10.20.193.45:0/4003630191 shutdown_connections 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 1 -- 10.20.193.45:0/4003630191 wait complete. 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 10 monclient: build_initial_monmap 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 10 monclient: monmap: 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:39.888 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.882+0000 7f0beb8d6640 1 librados: starting msgr at 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 librados: starting objecter 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 Processor -- start 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 -- start start 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 librados: setting wanted keys 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 librados: calling monclient init 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient: init 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:39.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0be40c3e40 0x7f0be4159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient(hunting): picked mon.noname-c con 0x7f0be40c3e40 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c92a0 0x7f0be40cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient(hunting): picked mon.noname-a con 0x7f0be40c92a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0be415f8e0 0x7f0be41f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient(hunting): picked mon.noname-b con 0x7f0be415f8e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0be40c87c0 con 0x7f0be40c92a0 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0be40c84e0 con 0x7f0be415f8e0 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0be40c8aa0 con 0x7f0be40c3e40 2026-02-17T21:09:39.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0beb8d6640 10 monclient(hunting): authenticate will time out at 1163.514515s 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be8e4a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c92a0 0x7f0be40cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be9e4c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0be415f8e0 0x7f0be41f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be964b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0be40c3e40 0x7f0be4159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be8e4a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c92a0 0x7f0be40cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:33900/0 (socket says 10.20.193.45:33900) 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be8e4a640 1 -- 10.20.193.45:0/2380826818 learned_addr learned my addr 10.20.193.45:0/2380826818 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be8e4a640 10 monclient(hunting): get_auth_request con 0x7f0be40c92a0 auth_method 0 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be8e4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be8e4a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be8e4a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:39.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be9e4c640 10 monclient(hunting): get_auth_request con 0x7f0be415f8e0 auth_method 0 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be9e4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be9e4c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be9e4c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be964b640 10 monclient(hunting): get_auth_request con 0x7f0be40c3e40 auth_method 0 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be964b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be964b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.883+0000 7f0be964b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.884+0000 7f0be8e4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.884+0000 7f0be8e4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.884+0000 7f0be8e4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.884+0000 7f0be9e4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:39.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.884+0000 7f0be9e4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.884+0000 7f0be9e4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.884+0000 7f0be964b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.884+0000 7f0be964b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.884+0000 7f0be964b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 10 monclient(hunting): handle_auth_done global_id 4846 payload 824 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 1 -- 10.20.193.45:0/2380826818 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0be40c3e40 msgr2=0x7f0be4159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0be40c3e40 0x7f0be4159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 1 -- 10.20.193.45:0/2380826818 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c92a0 msgr2=0x7f0be40cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c92a0 0x7f0be40cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 10 monclient: _finish_hunting 0 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 1 monclient: found mon.noname-b 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:39.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.885+0000 7f0be9e4c640 1 -- 10.20.193.45:0/2380826818 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be415a1f0 con 0x7f0be415f8e0 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.886+0000 7f0be9e4c640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0be415f8e0 0x7f0be41f4e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0be000cbc0 tx=0x7f0be000a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.886+0000 7f0bd1ffb640 10 client.?.objecter ms_handle_connect 0x7f0be415f8e0 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.886+0000 7f0bd1ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0bd1ffb640 1 -- 10.20.193.45:0/2380826818 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be000acf0 con 0x7f0be415f8e0 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0bd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0bd1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0bd1ffb640 10 monclient: dump: 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:39.894 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0bd1ffb640 10 monclient: _finish_auth 0 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0bd1ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0bd1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0beb8d6640 5 monclient: authenticate success, global_id 4846 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0beb8d6640 10 monclient: _renew_subs 2026-02-17T21:09:39.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0beb8d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be415a4d0 con 0x7f0be415f8e0 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0beb8d6640 10 client.4846.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0beb8d6640 10 monclient: _renew_subs 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0beb8d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be415aa90 con 0x7f0be415f8e0 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.887+0000 7f0beb8d6640 1 librados: init done 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0bd1ffb640 1 -- 10.20.193.45:0/2380826818 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be0003c80 con 0x7f0be415f8e0 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0bd1ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0bd1ffb640 1 -- 10.20.193.45:0/2380826818 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be00052d0 con 0x7f0be415f8e0 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0bd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0bd1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:39.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0bd37fe640 4 set_mon_vals no callback set 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0bd1ffb640 10 monclient: dump: 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:39.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0beb8d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:39.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0beb8d6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:39.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0beb8d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:39.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.888+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be40698c0 con 0x7f0be415f8e0 2026-02-17T21:09:39.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.995+0000 7f0bd1ffb640 1 -- 10.20.193.45:0/2380826818 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f0be0005470 con 0x7f0be415f8e0 2026-02-17T21:09:39.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.996+0000 7f0bd1ffb640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0bb4079280 0x7f0bb407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:39.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.996+0000 7f0be964b640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0bb4079280 0x7f0bb407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:39.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.996+0000 7f0be964b640 10 monclient: get_auth_request con 0x7f0bb4079280 auth_method 0 2026-02-17T21:09:39.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.996+0000 7f0be964b640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0bb4079280 0x7f0bb407b740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4039000 tx=0x7f0bd4033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:39.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.996+0000 7f0bd1ffb640 10 client.4846.objecter ms_handle_connect 0x7f0bb4079280 2026-02-17T21:09:39.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.998+0000 7f0bd1ffb640 1 -- 10.20.193.45:0/2380826818 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f0be0098780 con 0x7f0be415f8e0 2026-02-17T21:09:39.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.998+0000 7f0bd1ffb640 10 client.4846.objecter ms_dispatch2 0x7f0be4000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:39.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.998+0000 7f0bd1ffb640 3 client.4846.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:39.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.998+0000 7f0bd1ffb640 3 client.4846.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:39.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:39.998+0000 7f0bd1ffb640 20 client.4846.objecter dump_active .. 0 homeless 2026-02-17T21:09:39.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.004+0000 7f0bd1ffb640 1 -- 10.20.193.45:0/2380826818 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0be40698c0 con 0x7f0be415f8e0 2026-02-17T21:09:39.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.004+0000 7f0bd1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:39.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.004+0000 7f0bd1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:40.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.102+0000 7f0beb8d6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:40.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.102+0000 7f0beb8d6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:40.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.102+0000 7f0beb8d6640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:40.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.102+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0be406d1d0 con 0x7f0be415f8e0 2026-02-17T21:09:40.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0bd1ffb640 1 -- 10.20.193.45:0/2380826818 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0be0062c00 con 0x7f0be415f8e0 2026-02-17T21:09:40.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0bd1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:40.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0bd1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:40.099 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:40.099 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 10 librados: watch_flush enter 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 10 librados: watch_flush exit 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 20 client.4846.objecter shutdown clearing up homeless session... 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 10 client.4846.objecter successfully canceled tick 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0bb4079280 msgr2=0x7f0bb407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0bb4079280 0x7f0bb407b740 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4039000 tx=0x7f0bd4033000 comp rx=0 tx=0).stop 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 10 monclient: shutdown 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0be415f8e0 msgr2=0x7f0be41f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0be415f8e0 0x7f0be41f4e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0be000cbc0 tx=0x7f0be000a430 comp rx=0 tx=0).stop 2026-02-17T21:09:40.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 shutdown_connections 2026-02-17T21:09:40.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0bb4079280 0x7f0bb407b740 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:40.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0be415f8e0 0x7f0be41f4e00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:40.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0be40c92a0 0x7f0be40cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:40.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 --2- 10.20.193.45:0/2380826818 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0be40c3e40 0x7f0be4159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:40.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 >> 10.20.193.45:0/2380826818 conn(0x7f0be40c9d40 msgr2=0x7f0be4073320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:40.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 shutdown_connections 2026-02-17T21:09:40.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 -- 10.20.193.45:0/2380826818 wait complete. 2026-02-17T21:09:40.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:40.106+0000 7f0beb8d6640 1 librados: shutdown 2026-02-17T21:09:43.110 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:43.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.186+0000 7f0ca2fb2640 10 monclient: get_monmap_and_config 2026-02-17T21:09:43.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.186+0000 7f0ca2fb2640 10 monclient: build_initial_monmap 2026-02-17T21:09:43.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.186+0000 7f0ca2fb2640 10 monclient: monmap: 2026-02-17T21:09:43.197 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:43.197 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:43.197 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:43.188091+0000 2026-02-17T21:09:43.197 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:43.188091+0000 2026-02-17T21:09:43.197 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.186+0000 7f0ca2fb2640 1 Processor -- start 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.186+0000 7f0ca2fb2640 1 -- start start 2026-02-17T21:09:43.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.186+0000 7f0ca2fb2640 10 monclient: init 2026-02-17T21:09:43.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:43.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 10 monclient: _add_conns ranks=[5,3,1,0,4,2] 2026-02-17T21:09:43.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0c9c15d1e0 0x7f0c9c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:43.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 10 monclient(hunting): picked mon.noname-c con 0x7f0c9c15d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:43.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f0c9c0748e0 0x7f0c9c0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:43.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 10 monclient(hunting): picked mon.noname-a con 0x7f0c9c0748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:43.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f0c9c0c90e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:09:43.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9c0c9570 con 0x7f0c9c0c90e0 2026-02-17T21:09:43.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:43.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0c9c0c5860 con 0x7f0c9c0748e0 2026-02-17T21:09:43.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:43.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0c9c0c5580 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:43.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca2fb2640 10 monclient(hunting): authenticate will time out at 1166.818295s 2026-02-17T21:09:43.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca0d27640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f0c9c15d1e0 0x7f0c9c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:43.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca1528640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f0c9c0c90e0 0x7f0c9c153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:45072/0 (socket says 10.20.193.45:45072) 2026-02-17T21:09:43.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca1528640 1 -- 10.20.193.45:0/602818785 learned_addr learned my addr 10.20.193.45:0/602818785 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:43.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0c93fff640 1 --2- 10.20.193.45:0/602818785 >> v2:10.20.193.45:3300/0 conn(0x7f0c9c0748e0 0x7f0c9c0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:43.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca0d27640 10 monclient(hunting): get_auth_request con 0x7f0c9c15d1e0 auth_method 0 2026-02-17T21:09:43.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca0d27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:43.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca0d27640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:43.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0ca0d27640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:43.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0c93fff640 10 monclient(hunting): get_auth_request con 0x7f0c9c0748e0 auth_method 0 2026-02-17T21:09:43.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0c93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:43.202 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0c93fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:43.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.187+0000 7f0c93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:43.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:43.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:43.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:43.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0c93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:43.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0c93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0c93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 10 monclient(hunting): handle_auth_done global_id 4886 payload 274 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 1 -- 10.20.193.45:0/602818785 >> v2:10.20.193.45:3300/0 conn(0x7f0c9c0748e0 msgr2=0x7f0c9c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 1 --2- 10.20.193.45:0/602818785 >> v2:10.20.193.45:3300/0 conn(0x7f0c9c0748e0 0x7f0c9c0c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 1 -- 10.20.193.45:0/602818785 >> v1:10.20.193.86:6789/0 conn(0x7f0c9c0c90e0 legacy=0x7f0c9c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 10 monclient: _finish_hunting 0 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 1 monclient: found mon.noname-c 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.188+0000 7f0ca0d27640 1 -- 10.20.193.45:0/602818785 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c0c7de0 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.190+0000 7f0ca0d27640 1 --2- 10.20.193.45:0/602818785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 0x7f0c9c15d5c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0098a0 tx=0x7f0c8c02ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=317b95760b354c2a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:43.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 1 -- 10.20.193.45:0/602818785 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c03c070 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 10 monclient: dump: 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:43.205 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 10 monclient: _finish_auth 0 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 10 monclient: _check_auth_tickets 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0ca2fb2640 5 monclient: authenticate success, global_id 4886 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0ca2fb2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 1 -- 10.20.193.45:0/602818785 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c02fae0 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 1 -- 10.20.193.45:0/602818785 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c037440 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0ca2fb2640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:43.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0ca2fb2640 4 set_mon_vals no callback set 2026-02-17T21:09:43.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:43.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:43.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0c937fe640 10 monclient: dump: 2026-02-17T21:09:43.207 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:43.207 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:43.207 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:43.207 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:43.208 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:43.208 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:43.208 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:43.208 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:43.208 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:43.208 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:43.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0ca2fb2640 10 monclient: shutdown 2026-02-17T21:09:43.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0ca2fb2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:43.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/602818785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 msgr2=0x7f0c9c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:43.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.191+0000 7f0ca2fb2640 1 --2- 10.20.193.45:0/602818785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 0x7f0c9c15d5c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0098a0 tx=0x7f0c8c02ee10 comp rx=0 tx=0).stop 2026-02-17T21:09:43.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/602818785 shutdown_connections 2026-02-17T21:09:43.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 --2- 10.20.193.45:0/602818785 >> v2:10.20.193.45:3300/0 conn(0x7f0c9c0748e0 0x7f0c9c0c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:43.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 --2- 10.20.193.45:0/602818785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 0x7f0c9c15d5c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:43.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/602818785 >> 10.20.193.45:0/602818785 conn(0x7f0c9c0c9d40 msgr2=0x7f0c9c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:43.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/602818785 shutdown_connections 2026-02-17T21:09:43.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/602818785 wait complete. 2026-02-17T21:09:43.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 10 monclient: build_initial_monmap 2026-02-17T21:09:43.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 10 monclient: monmap: 2026-02-17T21:09:43.211 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:43.211 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:43.211 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:43.211 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:43.211 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:43.211 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:43.212 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:43.212 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:43.212 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:43.212 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:43.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 librados: starting msgr at 2026-02-17T21:09:43.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 librados: starting objecter 2026-02-17T21:09:43.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 Processor -- start 2026-02-17T21:09:43.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 -- start start 2026-02-17T21:09:43.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 librados: setting wanted keys 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 1 librados: calling monclient init 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.192+0000 7f0ca2fb2640 10 monclient: init 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0c9c0748e0 0x7f0c9c06ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient(hunting): picked mon.noname-b con 0x7f0c9c0748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0c9c0c90e0 0x7f0c9c15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient(hunting): picked mon.noname-a con 0x7f0c9c0c90e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 0x7f0c9c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient(hunting): picked mon.noname-c con 0x7f0c9c15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:43.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c0c8680 con 0x7f0c9c0c90e0 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c0c83a0 con 0x7f0c9c0748e0 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c074d30 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca2fb2640 10 monclient(hunting): authenticate will time out at 1166.824273s 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 0x7f0c9c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0c93fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0c9c0c90e0 0x7f0c9c15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca0d27640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0c9c0748e0 0x7f0c9c06ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 0x7f0c9c0cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36982/0 (socket says 10.20.193.45:36982) 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 1 -- 10.20.193.45:0/997926125 learned_addr learned my addr 10.20.193.45:0/997926125 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:43.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 10 monclient(hunting): get_auth_request con 0x7f0c9c15d1e0 auth_method 0 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca0d27640 10 monclient(hunting): get_auth_request con 0x7f0c9c0748e0 auth_method 0 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca0d27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca0d27640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca0d27640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0c93fff640 10 monclient(hunting): get_auth_request con 0x7f0c9c0c90e0 auth_method 0 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0c93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0c93fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0c93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:43.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca1528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca0d27640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca0d27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0ca0d27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0c93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.193+0000 7f0c93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.194+0000 7f0c93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 10 monclient(hunting): handle_auth_done global_id 4889 payload 824 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 1 -- 10.20.193.45:0/997926125 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0c9c0748e0 msgr2=0x7f0c9c06ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0c9c0748e0 0x7f0c9c06ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 1 -- 10.20.193.45:0/997926125 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0c9c0c90e0 msgr2=0x7f0c9c15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0c9c0c90e0 0x7f0c9c15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 10 monclient: _finish_hunting 0 2026-02-17T21:09:43.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 1 monclient: found mon.noname-c 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.195+0000 7f0ca1528640 1 -- 10.20.193.45:0/997926125 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c1ee200 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.196+0000 7f0ca1528640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 0x7f0c9c0cc360 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800cbc0 tx=0x7f0c9800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.196+0000 7f0c917fa640 10 client.?.objecter ms_handle_connect 0x7f0c9c15d1e0 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.196+0000 7f0c917fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 1 -- 10.20.193.45:0/997926125 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98017070 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 10 monclient: dump: 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:43.217 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 10 monclient: _finish_auth 0 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 10 monclient: _check_auth_tickets 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 5 monclient: authenticate success, global_id 4889 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 10 monclient: _renew_subs 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9c1f3b00 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.218 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 10 client.4889.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 10 monclient: _renew_subs 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9c1f3da0 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 1 librados: init done 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 1 -- 10.20.193.45:0/997926125 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9800ad50 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 1 -- 10.20.193.45:0/997926125 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9801c640 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c917fa640 10 monclient: dump: 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:43.219 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:43.220 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:43.220 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:43.220 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:43.220 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:43.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0c92ffd640 4 set_mon_vals no callback set 2026-02-17T21:09:43.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.197+0000 7f0ca2fb2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:43.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.198+0000 7f0ca2fb2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:43.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.198+0000 7f0ca2fb2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:43.220 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.198+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c9c0c8ba0 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.209+0000 7f0c917fa640 1 -- 10.20.193.45:0/997926125 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f0c9801c7e0 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.209+0000 7f0c917fa640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0c6c0792b0 0x7f0c6c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:43.221 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.210+0000 7f0ca0d27640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0c6c0792b0 0x7f0c6c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:43.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.210+0000 7f0ca0d27640 10 monclient: get_auth_request con 0x7f0c6c0792b0 auth_method 0 2026-02-17T21:09:43.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.210+0000 7f0ca0d27640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0c6c0792b0 0x7f0c6c07b770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c039000 tx=0x7f0c8c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:43.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.210+0000 7f0c917fa640 10 client.4889.objecter ms_handle_connect 0x7f0c6c0792b0 2026-02-17T21:09:43.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.211+0000 7f0c917fa640 1 -- 10.20.193.45:0/997926125 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f0c98097fb0 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.211+0000 7f0c917fa640 10 client.4889.objecter ms_dispatch2 0x7f0c9c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:43.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.211+0000 7f0c917fa640 3 client.4889.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:43.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.211+0000 7f0c917fa640 3 client.4889.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:43.222 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.211+0000 7f0c917fa640 20 client.4889.objecter dump_active .. 0 homeless 2026-02-17T21:09:43.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.313+0000 7f0c917fa640 1 -- 10.20.193.45:0/997926125 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0c98022070 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.313+0000 7f0c917fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:43.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.313+0000 7f0c917fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:43.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.411+0000 7f0ca2fb2640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:43.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.411+0000 7f0ca2fb2640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:43.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.411+0000 7f0ca2fb2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:43.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.411+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0c9c15e080 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.414+0000 7f0c917fa640 1 -- 10.20.193.45:0/997926125 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f0c980623a0 con 0x7f0c9c15d1e0 2026-02-17T21:09:43.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.414+0000 7f0c917fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:43.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.414+0000 7f0c917fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:43.407 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:43.407 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:43.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 10 librados: watch_flush enter 2026-02-17T21:09:43.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 10 librados: watch_flush exit 2026-02-17T21:09:43.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 20 client.4889.objecter shutdown clearing up homeless session... 2026-02-17T21:09:43.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 10 client.4889.objecter successfully canceled tick 2026-02-17T21:09:43.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0c6c0792b0 msgr2=0x7f0c6c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:43.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0c6c0792b0 0x7f0c6c07b770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c039000 tx=0x7f0c8c033000 comp rx=0 tx=0).stop 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 10 monclient: shutdown 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 msgr2=0x7f0c9c0cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 0x7f0c9c0cc360 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800cbc0 tx=0x7f0c9800a430 comp rx=0 tx=0).stop 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 shutdown_connections 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f0c6c0792b0 0x7f0c6c07b770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0c9c15d1e0 0x7f0c9c0cc360 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f0c9c0c90e0 0x7f0c9c15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 --2- 10.20.193.45:0/997926125 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f0c9c0748e0 0x7f0c9c06ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:43.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 >> 10.20.193.45:0/997926125 conn(0x7f0c9c0c9d40 msgr2=0x7f0c9c149470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:43.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 shutdown_connections 2026-02-17T21:09:43.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 -- 10.20.193.45:0/997926125 wait complete. 2026-02-17T21:09:43.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:43.415+0000 7f0ca2fb2640 1 librados: shutdown 2026-02-17T21:09:46.419 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:46.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.496+0000 7fb96a32c640 10 monclient: get_monmap_and_config 2026-02-17T21:09:46.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.496+0000 7fb96a32c640 10 monclient: build_initial_monmap 2026-02-17T21:09:46.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.496+0000 7fb96a32c640 10 monclient: monmap: 2026-02-17T21:09:46.489 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:46.489 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:46.489 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:46.497604+0000 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:46.497604+0000 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:46.490 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:46.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 1 Processor -- start 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 1 -- start start 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 10 monclient: init 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 10 monclient: _add_conns ranks=[0,5,2,4,1,3] 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb96415d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fb9640c92b0 0x7fb96415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 10 monclient(hunting): picked mon.noname-c con 0x7fb9640c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb9640748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9640c5860 con 0x7fb96415d1e0 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9640c5580 con 0x7fb9640748e0 2026-02-17T21:09:46.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fb9640c7de0 con 0x7fb9640c92b0 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.497+0000 7fb96a32c640 10 monclient(hunting): authenticate will time out at 1170.127931s 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.498+0000 7fb963fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fb96415d1e0 0x7fb9640c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:40146/0 (socket says 10.20.193.45:40146) 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.498+0000 7fb963fff640 1 -- 10.20.193.45:0/2421788418 learned_addr learned my addr 10.20.193.45:0/2421788418 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.498+0000 7fb9637fe640 1 --2- 10.20.193.45:0/2421788418 >> v2:10.20.193.92:3300/0 conn(0x7fb9640c92b0 0x7fb96415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.498+0000 7fb9637fe640 10 monclient(hunting): get_auth_request con 0x7fb9640c92b0 auth_method 0 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.498+0000 7fb9637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.498+0000 7fb9637fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.498+0000 7fb9637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.499+0000 7fb9637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:46.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.499+0000 7fb9637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.499+0000 7fb9637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.499+0000 7fb962ffd640 1 -- 10.20.193.45:0/2421788418 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895826085 0 0) 0x7fb9640c5860 con 0x7fb96415d1e0 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.499+0000 7fb962ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.499+0000 7fb962ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.499+0000 7fb962ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.499+0000 7fb962ffd640 10 monclient(hunting): my global_id is 4791 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.499+0000 7fb962ffd640 1 -- 10.20.193.45:0/2421788418 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb948003620 con 0x7fb96415d1e0 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.500+0000 7fb9637fe640 10 monclient(hunting): handle_auth_done global_id 4892 payload 274 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.500+0000 7fb9637fe640 1 -- 10.20.193.45:0/2421788418 >> v1:10.20.193.92:6789/0 conn(0x7fb9640748e0 legacy=0x7fb964153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.500+0000 7fb9637fe640 1 -- 10.20.193.45:0/2421788418 >> v1:10.20.193.45:6789/0 conn(0x7fb96415d1e0 legacy=0x7fb9640c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.500+0000 7fb9637fe640 10 monclient: _finish_hunting 0 2026-02-17T21:09:46.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.500+0000 7fb9637fe640 1 monclient: found mon.noname-c 2026-02-17T21:09:46.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.500+0000 7fb9637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:46.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.500+0000 7fb9637fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:46.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.500+0000 7fb9637fe640 1 -- 10.20.193.45:0/2421788418 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9640c80c0 con 0x7fb9640c92b0 2026-02-17T21:09:46.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.502+0000 7fb9637fe640 1 --2- 10.20.193.45:0/2421788418 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb9640c92b0 0x7fb96415d5c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9540098d0 tx=0x7fb95402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c056905064e1fce7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 1 -- 10.20.193.45:0/2421788418 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95403c070 con 0x7fb9640c92b0 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 10 monclient: dump: 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:46.504 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 10 monclient: _finish_auth 0 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 1 -- 10.20.193.45:0/2421788418 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95402fba0 con 0x7fb9640c92b0 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 1 -- 10.20.193.45:0/2421788418 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954037440 con 0x7fb9640c92b0 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:46.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb962ffd640 10 monclient: dump: 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb96a32c640 5 monclient: authenticate success, global_id 4892 2026-02-17T21:09:46.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb96a32c640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.503+0000 7fb96a32c640 4 set_mon_vals no callback set 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 10 monclient: shutdown 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 1 -- 10.20.193.45:0/2421788418 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb9640c92b0 msgr2=0x7fb96415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 1 --2- 10.20.193.45:0/2421788418 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb9640c92b0 0x7fb96415d5c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9540098d0 tx=0x7fb95402eed0 comp rx=0 tx=0).stop 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 1 -- 10.20.193.45:0/2421788418 shutdown_connections 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 1 --2- 10.20.193.45:0/2421788418 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb9640c92b0 0x7fb96415d5c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 1 -- 10.20.193.45:0/2421788418 >> 10.20.193.45:0/2421788418 conn(0x7fb9640c9d40 msgr2=0x7fb9640ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 1 -- 10.20.193.45:0/2421788418 shutdown_connections 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 1 -- 10.20.193.45:0/2421788418 wait complete. 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 10 monclient: build_initial_monmap 2026-02-17T21:09:46.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.504+0000 7fb96a32c640 10 monclient: monmap: 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 librados: starting msgr at 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 librados: starting objecter 2026-02-17T21:09:46.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 Processor -- start 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 -- start start 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 librados: setting wanted keys 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 librados: calling monclient init 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient: init 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9640748e0 0x7fb96415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient(hunting): picked mon.noname-b con 0x7fb9640748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb9640c92b0 0x7fb9641458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient(hunting): picked mon.noname-a con 0x7fb9640c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb96415d1e0 0x7fb964145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:46.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient(hunting): picked mon.noname-c con 0x7fb96415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb964074d30 con 0x7fb9640c92b0 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb9640c8680 con 0x7fb9640748e0 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb964153d20 con 0x7fb96415d1e0 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb96a32c640 10 monclient(hunting): authenticate will time out at 1170.135674s 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb9688a2640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb96415d1e0 0x7fb964145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.505+0000 7fb9637fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb9640c92b0 0x7fb9641458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb963fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9640748e0 0x7fb96415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:46.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9688a2640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb96415d1e0 0x7fb964145e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36996/0 (socket says 10.20.193.45:36996) 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9688a2640 1 -- 10.20.193.45:0/772834626 learned_addr learned my addr 10.20.193.45:0/772834626 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9688a2640 10 monclient(hunting): get_auth_request con 0x7fb96415d1e0 auth_method 0 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9688a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9688a2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9688a2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9637fe640 10 monclient(hunting): get_auth_request con 0x7fb9640c92b0 auth_method 0 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9637fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb963fff640 10 monclient(hunting): get_auth_request con 0x7fb9640748e0 auth_method 0 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb963fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:46.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb963fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb963fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9688a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9688a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9688a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb9637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb963fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb963fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.506+0000 7fb963fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 10 monclient(hunting): handle_auth_done global_id 4898 payload 824 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 1 -- 10.20.193.45:0/772834626 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9640748e0 msgr2=0x7fb96415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:46.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9640748e0 0x7fb96415c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 1 -- 10.20.193.45:0/772834626 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb9640c92b0 msgr2=0x7fb9641458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb9640c92b0 0x7fb9641458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 10 monclient: _finish_hunting 0 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 1 monclient: found mon.noname-c 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.507+0000 7fb9688a2640 1 -- 10.20.193.45:0/772834626 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9641547a0 con 0x7fb96415d1e0 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.508+0000 7fb9688a2640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb96415d1e0 0x7fb964145e00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb95800cc80 tx=0x7fb95800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.508+0000 7fb960ff9640 10 client.?.objecter ms_handle_connect 0x7fb96415d1e0 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.508+0000 7fb960ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 1 -- 10.20.193.45:0/772834626 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958003a70 con 0x7fb96415d1e0 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:46.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 10 monclient: dump: 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:46.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 10 monclient: _finish_auth 0 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 1 -- 10.20.193.45:0/772834626 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb958003c10 con 0x7fb96415d1e0 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 1 -- 10.20.193.45:0/772834626 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9580050d0 con 0x7fb96415d1e0 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 5 monclient: authenticate success, global_id 4898 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb9627fc640 4 set_mon_vals no callback set 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb960ff9640 10 monclient: dump: 2026-02-17T21:09:46.515 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 10 monclient: _renew_subs 2026-02-17T21:09:46.516 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb964154a80 con 0x7fb96415d1e0 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 10 client.4898.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 10 monclient: _renew_subs 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb964155040 con 0x7fb96415d1e0 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 1 librados: init done 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:46.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.510+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96415d5c0 con 0x7fb96415d1e0 2026-02-17T21:09:46.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.616+0000 7fb960ff9640 1 -- 10.20.193.45:0/772834626 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb958005270 con 0x7fb96415d1e0 2026-02-17T21:09:46.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.617+0000 7fb960ff9640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb934079300 0x7fb93407b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:46.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.617+0000 7fb963fff640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb934079300 0x7fb93407b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:46.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.617+0000 7fb963fff640 10 monclient: get_auth_request con 0x7fb934079300 auth_method 0 2026-02-17T21:09:46.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.617+0000 7fb963fff640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb934079300 0x7fb93407b7c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb950007b60 tx=0x7fb950007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:46.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.617+0000 7fb960ff9640 10 client.4898.objecter ms_handle_connect 0x7fb934079300 2026-02-17T21:09:46.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.619+0000 7fb960ff9640 1 -- 10.20.193.45:0/772834626 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fb95805eb10 con 0x7fb96415d1e0 2026-02-17T21:09:46.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.619+0000 7fb960ff9640 10 client.4898.objecter ms_dispatch2 0x7fb964000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:46.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.619+0000 7fb960ff9640 3 client.4898.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:46.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.619+0000 7fb960ff9640 3 client.4898.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:46.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.619+0000 7fb960ff9640 20 client.4898.objecter dump_active .. 0 homeless 2026-02-17T21:09:46.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.635+0000 7fb960ff9640 1 -- 10.20.193.45:0/772834626 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb958062ad0 con 0x7fb96415d1e0 2026-02-17T21:09:46.627 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.635+0000 7fb960ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:46.628 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.635+0000 7fb960ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:46.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.736+0000 7fb96a32c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:46.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.736+0000 7fb96a32c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:46.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.736+0000 7fb96a32c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:46.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.736+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9640c68e0 con 0x7fb96415d1e0 2026-02-17T21:09:46.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.739+0000 7fb960ff9640 1 -- 10.20.193.45:0/772834626 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb958066dd0 con 0x7fb96415d1e0 2026-02-17T21:09:46.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.739+0000 7fb960ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:46.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.739+0000 7fb960ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:46.732 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:46.732 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:46.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 10 librados: watch_flush enter 2026-02-17T21:09:46.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 10 librados: watch_flush exit 2026-02-17T21:09:46.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 20 client.4898.objecter shutdown clearing up homeless session... 2026-02-17T21:09:46.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 10 client.4898.objecter successfully canceled tick 2026-02-17T21:09:46.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb934079300 msgr2=0x7fb93407b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:46.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb934079300 0x7fb93407b7c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb950007b60 tx=0x7fb950007ab0 comp rx=0 tx=0).stop 2026-02-17T21:09:46.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 10 monclient: shutdown 2026-02-17T21:09:46.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:46.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb96415d1e0 msgr2=0x7fb964145e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb96415d1e0 0x7fb964145e00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb95800cc80 tx=0x7fb95800a430 comp rx=0 tx=0).stop 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 shutdown_connections 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb934079300 0x7fb93407b7c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb96415d1e0 0x7fb964145e00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb9640c92b0 0x7fb9641458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 --2- 10.20.193.45:0/772834626 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9640748e0 0x7fb96415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 >> 10.20.193.45:0/772834626 conn(0x7fb9640c9d40 msgr2=0x7fb9641533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 shutdown_connections 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 -- 10.20.193.45:0/772834626 wait complete. 2026-02-17T21:09:46.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:46.740+0000 7fb96a32c640 1 librados: shutdown 2026-02-17T21:09:49.743 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:49.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.821+0000 7f49afaea640 10 monclient: get_monmap_and_config 2026-02-17T21:09:49.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.821+0000 7f49afaea640 10 monclient: build_initial_monmap 2026-02-17T21:09:49.814 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.821+0000 7f49afaea640 10 monclient: monmap: 2026-02-17T21:09:49.814 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:49.814 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:49.814 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:49.822266+0000 2026-02-17T21:09:49.814 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:49.822266+0000 2026-02-17T21:09:49.814 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:49.814 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:49.814 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:49.815 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:49.815 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:49.815 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:49.815 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:49.815 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:49.815 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:49.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 1 Processor -- start 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 1 -- start start 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 10 monclient: init 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 10 monclient: _add_conns ranks=[0,3,2,5,1,4] 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f49a8155e40 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f49a8074c90 0x7f49a80ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 10 monclient(hunting): picked mon.noname-a con 0x7f49a8074c90 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f49a8156220 addr v1:10.20.193.92:6789/0 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49a80734e0 con 0x7f49a8155e40 2026-02-17T21:09:49.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49a80737c0 con 0x7f49a8156220 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f49a80cd800 con 0x7f49a8074c90 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.822+0000 7f49afaea640 10 monclient(hunting): authenticate will time out at 1173.452709s 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.823+0000 7f49ad05e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f49a8074c90 0x7f49a80ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.823+0000 7f49ae060640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f49a8156220 0x7f49a815f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:36550/0 (socket says 10.20.193.45:36550) 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.823+0000 7f49ae060640 1 -- 10.20.193.45:0/3145082574 learned_addr learned my addr 10.20.193.45:0/3145082574 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.823+0000 7f49ad05e640 10 monclient(hunting): get_auth_request con 0x7f49a8074c90 auth_method 0 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.823+0000 7f49ad05e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.823+0000 7f49ad05e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.823+0000 7f49ad05e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:49.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.824+0000 7f49ad05e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.824+0000 7f49ad05e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.824+0000 7f49ad05e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.824+0000 7f49ac85d640 1 -- 10.20.193.45:0/3145082574 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207463810 0 0) 0x7f49a80737c0 con 0x7f49a8156220 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.824+0000 7f49ac85d640 10 monclient(hunting): _negotiate 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.824+0000 7f49ac85d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.824+0000 7f49ac85d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.824+0000 7f49ac85d640 10 monclient(hunting): my global_id is 4901 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.824+0000 7f49ac85d640 1 -- 10.20.193.45:0/3145082574 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4990003620 con 0x7f49a8156220 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.825+0000 7f49ad05e640 10 monclient(hunting): handle_auth_done global_id 4797 payload 274 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.825+0000 7f49ad05e640 1 -- 10.20.193.45:0/3145082574 >> v1:10.20.193.92:6789/0 conn(0x7f49a8156220 legacy=0x7f49a815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.825+0000 7f49ad05e640 1 -- 10.20.193.45:0/3145082574 >> v1:10.20.193.45:6789/0 conn(0x7f49a8155e40 legacy=0x7f49a8074580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.825+0000 7f49ad05e640 10 monclient: _finish_hunting 0 2026-02-17T21:09:49.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.825+0000 7f49ad05e640 1 monclient: found mon.noname-a 2026-02-17T21:09:49.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.825+0000 7f49ad05e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:49.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.825+0000 7f49ad05e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:09:49.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.825+0000 7f49ad05e640 1 -- 10.20.193.45:0/3145082574 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a8073aa0 con 0x7f49a8074c90 2026-02-17T21:09:49.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.827+0000 7f49ad05e640 1 --2- 10.20.193.45:0/3145082574 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8074c90 0x7f49a80ccb80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f499c0098a0 tx=0x7f499c02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c19546f1587d535 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:49.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 1 -- 10.20.193.45:0/3145082574 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c03c070 con 0x7f49a8074c90 2026-02-17T21:09:49.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:49.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:09:49.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 10 monclient: dump: 2026-02-17T21:09:49.827 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:49.827 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:49.827 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 10 monclient: _finish_auth 0 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 10 monclient: _check_auth_tickets 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 1 -- 10.20.193.45:0/3145082574 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499c02fb70 con 0x7f49a8074c90 2026-02-17T21:09:49.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 5 monclient: authenticate success, global_id 4797 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 1 -- 10.20.193.45:0/3145082574 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c037440 con 0x7f49a8074c90 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 4 set_mon_vals no callback set 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49ac85d640 10 monclient: dump: 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:49.829 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 10 monclient: shutdown 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 1 -- 10.20.193.45:0/3145082574 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8074c90 msgr2=0x7f49a80ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 1 --2- 10.20.193.45:0/3145082574 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8074c90 0x7f49a80ccb80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f499c0098a0 tx=0x7f499c02ee60 comp rx=0 tx=0).stop 2026-02-17T21:09:49.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 1 -- 10.20.193.45:0/3145082574 shutdown_connections 2026-02-17T21:09:49.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 1 --2- 10.20.193.45:0/3145082574 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8074c90 0x7f49a80ccb80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:49.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.829+0000 7f49afaea640 1 -- 10.20.193.45:0/3145082574 >> 10.20.193.45:0/3145082574 conn(0x7f49a80ce270 msgr2=0x7f49a80ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:49.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 1 -- 10.20.193.45:0/3145082574 shutdown_connections 2026-02-17T21:09:49.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 1 -- 10.20.193.45:0/3145082574 wait complete. 2026-02-17T21:09:49.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 10 monclient: build_initial_monmap 2026-02-17T21:09:49.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 10 monclient: monmap: 2026-02-17T21:09:49.832 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:49.832 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:49.832 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:49.832 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:49.832 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:49.832 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:49.832 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 1 librados: starting msgr at 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 1 librados: starting objecter 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 1 Processor -- start 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 1 -- start start 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 1 librados: setting wanted keys 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 1 librados: calling monclient init 2026-02-17T21:09:49.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.830+0000 7f49afaea640 10 monclient: init 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49a8074c90 0x7f49a81eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient(hunting): picked mon.noname-c con 0x7f49a8074c90 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8155e40 0x7f49a8144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient(hunting): picked mon.noname-a con 0x7f49a8155e40 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f49a8156220 0x7f49a81f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient(hunting): picked mon.noname-b con 0x7f49a8156220 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f49a80c4830 con 0x7f49a8155e40 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:49.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f49a8074060 con 0x7f49a8156220 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49a80c49b0 con 0x7f49a8074c90 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49afaea640 10 monclient(hunting): authenticate will time out at 1173.461086s 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8155e40 0x7f49a8144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8155e40 0x7f49a8144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:60836/0 (socket says 10.20.193.45:60836) 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 1 -- 10.20.193.45:0/2461110300 learned_addr learned my addr 10.20.193.45:0/2461110300 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 10 monclient(hunting): get_auth_request con 0x7f49a8155e40 auth_method 0 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:49.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad85f640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49a8074c90 0x7f49a81eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ae060640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f49a8156220 0x7f49a81f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad85f640 10 monclient(hunting): get_auth_request con 0x7f49a8074c90 auth_method 0 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad85f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad85f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad85f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ad05e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ae060640 10 monclient(hunting): get_auth_request con 0x7f49a8156220 auth_method 0 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ae060640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ae060640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.831+0000 7f49ae060640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:49.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.832+0000 7f49ad85f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.832+0000 7f49ad85f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.832+0000 7f49ad85f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.832+0000 7f49ae060640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.832+0000 7f49ae060640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.832+0000 7f49ae060640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 10 monclient(hunting): handle_auth_done global_id 4803 payload 824 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 1 -- 10.20.193.45:0/2461110300 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49a8074c90 msgr2=0x7f49a81eb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49a8074c90 0x7f49a81eb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 1 -- 10.20.193.45:0/2461110300 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f49a8156220 msgr2=0x7f49a81f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f49a8156220 0x7f49a81f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 10 monclient: _finish_hunting 0 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 1 monclient: found mon.noname-a 2026-02-17T21:09:49.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:49.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:09:49.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.833+0000 7f49ad05e640 1 -- 10.20.193.45:0/2461110300 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a815c840 con 0x7f49a8155e40 2026-02-17T21:09:49.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.834+0000 7f49ad05e640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8155e40 0x7f49a8144b70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f499c02f390 tx=0x7f499c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:49.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.834+0000 7f49967fc640 10 client.?.objecter ms_handle_connect 0x7f49a8155e40 2026-02-17T21:09:49.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.834+0000 7f49967fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:49.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 1 -- 10.20.193.45:0/2461110300 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c03c040 con 0x7f49a8155e40 2026-02-17T21:09:49.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:49.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:09:49.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 10 monclient: dump: 2026-02-17T21:09:49.840 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:49.840 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 10 monclient: _finish_auth 0 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 10 monclient: _check_auth_tickets 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:49.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 1 -- 10.20.193.45:0/2461110300 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f499c042630 con 0x7f49a8155e40 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 1 -- 10.20.193.45:0/2461110300 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499c042a20 con 0x7f49a8155e40 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f4997fff640 4 set_mon_vals no callback set 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49967fc640 10 monclient: dump: 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:49.842 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:49.843 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:49.843 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:49.843 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:49.843 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:49.843 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:49.843 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:49.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 5 monclient: authenticate success, global_id 4803 2026-02-17T21:09:49.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 10 monclient: _renew_subs 2026-02-17T21:09:49.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:49.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a81f1ba0 con 0x7f49a8155e40 2026-02-17T21:09:49.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 10 client.4803.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:49.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 10 monclient: _renew_subs 2026-02-17T21:09:49.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:49.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a81f2160 con 0x7f49a8155e40 2026-02-17T21:09:49.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 1 librados: init done 2026-02-17T21:09:49.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:49.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:49.845 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:49.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.836+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a8074580 con 0x7f49a8155e40 2026-02-17T21:09:49.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.848+0000 7f49967fc640 1 -- 10.20.193.45:0/2461110300 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f499c04b450 con 0x7f49a8155e40 2026-02-17T21:09:49.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.849+0000 7f49967fc640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f49780792d0 0x7f497807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:49.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.849+0000 7f49ad85f640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f49780792d0 0x7f497807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:49.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.849+0000 7f49ad85f640 10 monclient: get_auth_request con 0x7f49780792d0 auth_method 0 2026-02-17T21:09:49.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.849+0000 7f49ad85f640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f49780792d0 0x7f497807b790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4998002770 tx=0x7f4998007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:49.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.849+0000 7f49967fc640 10 client.4803.objecter ms_handle_connect 0x7f49780792d0 2026-02-17T21:09:49.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.851+0000 7f49967fc640 1 -- 10.20.193.45:0/2461110300 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f499c02fab0 con 0x7f49a8155e40 2026-02-17T21:09:49.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.851+0000 7f49967fc640 10 client.4803.objecter ms_dispatch2 0x7f49a8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:49.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.851+0000 7f49967fc640 3 client.4803.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:49.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.851+0000 7f49967fc640 3 client.4803.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:49.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.851+0000 7f49967fc640 20 client.4803.objecter dump_active .. 0 homeless 2026-02-17T21:09:49.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.957+0000 7f49967fc640 1 -- 10.20.193.45:0/2461110300 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f499c086bc0 con 0x7f49a8155e40 2026-02-17T21:09:49.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.957+0000 7f49967fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:49.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:49.957+0000 7f49967fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:50.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.059+0000 7f49afaea640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:50.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.059+0000 7f49afaea640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:50.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.059+0000 7f49afaea640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:09:50.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.059+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f49a8159770 con 0x7f49a8155e40 2026-02-17T21:09:50.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.061+0000 7f49967fc640 1 -- 10.20.193.45:0/2461110300 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f499c08f030 con 0x7f49a8155e40 2026-02-17T21:09:50.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.061+0000 7f49967fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:50.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.061+0000 7f49967fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:50.053 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:50.054 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 10 librados: watch_flush enter 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 10 librados: watch_flush exit 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 20 client.4803.objecter shutdown clearing up homeless session... 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 10 client.4803.objecter successfully canceled tick 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f49780792d0 msgr2=0x7f497807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f49780792d0 0x7f497807b790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4998002770 tx=0x7f4998007ef0 comp rx=0 tx=0).stop 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 10 monclient: shutdown 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8155e40 msgr2=0x7f49a8144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8155e40 0x7f49a8144b70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f499c02f390 tx=0x7f499c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 shutdown_connections 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f49780792d0 0x7f497807b790 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f49a8156220 0x7f49a81f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f49a8155e40 0x7f49a8144b70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 --2- 10.20.193.45:0/2461110300 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49a8074c90 0x7f49a81eb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 >> 10.20.193.45:0/2461110300 conn(0x7f49a80ce270 msgr2=0x7f49a81500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:50.055 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 shutdown_connections 2026-02-17T21:09:50.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 -- 10.20.193.45:0/2461110300 wait complete. 2026-02-17T21:09:50.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:50.063+0000 7f49afaea640 1 librados: shutdown 2026-02-17T21:09:50.161 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:57.374 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:50.162 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:57.375 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:50.170 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:04:57.383 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:50.189 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:04:57.398 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:50.189 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:04:57.362 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:50.190 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:04:57.400 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:50.191 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:04:57.364 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:50.198 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:04:57.408 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:50.199 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:04:57.372 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:09:53.065 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:53.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.142+0000 7f46ab585640 10 monclient: get_monmap_and_config 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.142+0000 7f46ab585640 10 monclient: build_initial_monmap 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.142+0000 7f46ab585640 10 monclient: monmap: 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:53.143585+0000 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:53.143585+0000 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:53.135 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:53.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 1 Processor -- start 2026-02-17T21:09:53.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 1 -- start start 2026-02-17T21:09:53.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient: init 2026-02-17T21:09:53.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:53.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient: _add_conns ranks=[5,2,4,3,0,1] 2026-02-17T21:09:53.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f46a4152620 0x7f46a415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient(hunting): picked mon.noname-c con 0x7f46a4152620 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f46a4152a00 addr v1:10.20.193.92:6789/0 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f46a40c94a0 0x7f46a415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient(hunting): picked mon.noname-b con 0x7f46a40c94a0 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a40c71a0 con 0x7f46a4152a00 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f46a40c7760 con 0x7f46a40c94a0 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f46a40c7480 con 0x7f46a4152620 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.143+0000 7f46ab585640 10 monclient(hunting): authenticate will time out at 1176.773833s 2026-02-17T21:09:53.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f46a40c94a0 0x7f46a415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a92fa640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f46a4152620 0x7f46a415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f46a40c94a0 0x7f46a415ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38406/0 (socket says 10.20.193.45:38406) 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 1 -- 10.20.193.45:0/3336620791 learned_addr learned my addr 10.20.193.45:0/3336620791 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 10 monclient(hunting): get_auth_request con 0x7f46a40c94a0 auth_method 0 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a92fa640 10 monclient(hunting): get_auth_request con 0x7f46a4152620 auth_method 0 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a92fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a92fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:53.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a92fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.144+0000 7f46a9afb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.145+0000 7f46a92fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.145+0000 7f46a92fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.145+0000 7f46a92fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.146+0000 7f46a9afb640 10 monclient(hunting): handle_auth_done global_id 4861 payload 274 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.146+0000 7f46a9afb640 1 -- 10.20.193.45:0/3336620791 >> v2:10.20.193.92:3300/0 conn(0x7f46a4152620 msgr2=0x7f46a415a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.146+0000 7f46a9afb640 1 --2- 10.20.193.45:0/3336620791 >> v2:10.20.193.92:3300/0 conn(0x7f46a4152620 0x7f46a415a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.146+0000 7f46a9afb640 1 -- 10.20.193.45:0/3336620791 >> v1:10.20.193.92:6789/0 conn(0x7f46a4152a00 legacy=0x7f46a40c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.146+0000 7f46a9afb640 10 monclient: _finish_hunting 0 2026-02-17T21:09:53.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.146+0000 7f46a9afb640 1 monclient: found mon.noname-b 2026-02-17T21:09:53.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.146+0000 7f46a9afb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:53.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.146+0000 7f46a9afb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:53.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.146+0000 7f46a9afb640 1 -- 10.20.193.45:0/3336620791 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a4159e00 con 0x7f46a40c94a0 2026-02-17T21:09:53.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.147+0000 7f46a9afb640 1 --2- 10.20.193.45:0/3336620791 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a40c94a0 0x7f46a415ae20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f46a4076d30 tx=0x7f46a002f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29cbd42b627e453f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:53.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.148+0000 7f4693fff640 1 -- 10.20.193.45:0/3336620791 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a002fd70 con 0x7f46a40c94a0 2026-02-17T21:09:53.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.148+0000 7f4693fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:53.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.148+0000 7f4693fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.148+0000 7f4693fff640 10 monclient: dump: 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:53.149 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.148+0000 7f4693fff640 10 monclient: _finish_auth 0 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.148+0000 7f4693fff640 10 monclient: _check_auth_tickets 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.148+0000 7f4693fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.148+0000 7f46ab585640 5 monclient: authenticate success, global_id 4861 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.148+0000 7f46ab585640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f4693fff640 1 -- 10.20.193.45:0/3336620791 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a00373f0 con 0x7f46a40c94a0 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f4693fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f4693fff640 1 -- 10.20.193.45:0/3336620791 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a00377c0 con 0x7f46a40c94a0 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f4693fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:53.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f4693fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f4693fff640 10 monclient: dump: 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:53.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f46ab585640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f46ab585640 4 set_mon_vals no callback set 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f46ab585640 10 monclient: shutdown 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f46ab585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f46ab585640 1 -- 10.20.193.45:0/3336620791 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a40c94a0 msgr2=0x7f46a415ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f46ab585640 1 --2- 10.20.193.45:0/3336620791 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a40c94a0 0x7f46a415ae20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f46a4076d30 tx=0x7f46a002f270 comp rx=0 tx=0).stop 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.149+0000 7f46ab585640 1 -- 10.20.193.45:0/3336620791 shutdown_connections 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 --2- 10.20.193.45:0/3336620791 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a40c94a0 0x7f46a415ae20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 --2- 10.20.193.45:0/3336620791 >> v2:10.20.193.92:3300/0 conn(0x7f46a4152620 0x7f46a415a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 -- 10.20.193.45:0/3336620791 >> 10.20.193.45:0/3336620791 conn(0x7f46a40c9d40 msgr2=0x7f46a40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 -- 10.20.193.45:0/3336620791 shutdown_connections 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 -- 10.20.193.45:0/3336620791 wait complete. 2026-02-17T21:09:53.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 10 monclient: build_initial_monmap 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 10 monclient: monmap: 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:53.153 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 librados: starting msgr at 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 librados: starting objecter 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 Processor -- start 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 -- start start 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 librados: setting wanted keys 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 1 librados: calling monclient init 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.150+0000 7f46ab585640 10 monclient: init 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f46a40c94a0 0x7f46a40736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient(hunting): picked mon.noname-c con 0x7f46a40c94a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:53.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f46a4152620 0x7f46a41572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient(hunting): picked mon.noname-a con 0x7f46a4152620 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a4152a00 0x7f46a40cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient(hunting): picked mon.noname-b con 0x7f46a4152a00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40c7c40 con 0x7f46a4152620 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f46a415a3c0 con 0x7f46a4152a00 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46a40c7dc0 con 0x7f46a40c94a0 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46ab585640 10 monclient(hunting): authenticate will time out at 1176.781147s 2026-02-17T21:09:53.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a4152a00 0x7f46a40cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:53.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a92fa640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f46a40c94a0 0x7f46a40736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:53.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a8af9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f46a4152620 0x7f46a41572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:53.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a4152a00 0x7f46a40cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38418/0 (socket says 10.20.193.45:38418) 2026-02-17T21:09:53.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 1 -- 10.20.193.45:0/4115595361 learned_addr learned my addr 10.20.193.45:0/4115595361 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:53.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 10 monclient(hunting): get_auth_request con 0x7f46a4152a00 auth_method 0 2026-02-17T21:09:53.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:53.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:53.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a92fa640 10 monclient(hunting): get_auth_request con 0x7f46a40c94a0 auth_method 0 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a92fa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a92fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a92fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a9afb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a8af9640 10 monclient(hunting): get_auth_request con 0x7f46a4152620 auth_method 0 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a8af9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a8af9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a8af9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:53.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a92fa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a92fa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.151+0000 7f46a92fa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.152+0000 7f46a8af9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.152+0000 7f46a8af9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.152+0000 7f46a8af9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 10 monclient(hunting): handle_auth_done global_id 4864 payload 824 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 1 -- 10.20.193.45:0/4115595361 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f46a40c94a0 msgr2=0x7f46a40736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f46a40c94a0 0x7f46a40736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 1 -- 10.20.193.45:0/4115595361 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f46a4152620 msgr2=0x7f46a41572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f46a4152620 0x7f46a41572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 10 monclient: _finish_hunting 0 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 1 monclient: found mon.noname-b 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:53.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:09:53.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.153+0000 7f46a9afb640 1 -- 10.20.193.45:0/4115595361 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a40cbb90 con 0x7f46a4152a00 2026-02-17T21:09:53.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.155+0000 7f46a9afb640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a4152a00 0x7f46a40cb0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f46a0039040 tx=0x7f46a0004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:53.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.155+0000 7f4691ffb640 10 client.?.objecter ms_handle_connect 0x7f46a4152a00 2026-02-17T21:09:53.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.155+0000 7f4691ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:53.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 1 -- 10.20.193.45:0/4115595361 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0046020 con 0x7f46a4152a00 2026-02-17T21:09:53.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:53.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 10 monclient: dump: 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:53.161 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 10 monclient: _finish_auth 0 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 1 -- 10.20.193.45:0/4115595361 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0041450 con 0x7f46a4152a00 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 1 -- 10.20.193.45:0/4115595361 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0009510 con 0x7f46a4152a00 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f4691ffb640 10 monclient: dump: 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:53.162 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46937fe640 4 set_mon_vals no callback set 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46ab585640 5 monclient: authenticate success, global_id 4864 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46ab585640 10 monclient: _renew_subs 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46ab585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a40cbe70 con 0x7f46a4152a00 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46ab585640 10 client.4864.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46ab585640 10 monclient: _renew_subs 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46ab585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a4156ad0 con 0x7f46a4152a00 2026-02-17T21:09:53.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.157+0000 7f46ab585640 1 librados: init done 2026-02-17T21:09:53.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.158+0000 7f46ab585640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:53.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.158+0000 7f46ab585640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:53.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.158+0000 7f46ab585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:53.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.158+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a415b0a0 con 0x7f46a4152a00 2026-02-17T21:09:53.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.267+0000 7f4691ffb640 1 -- 10.20.193.45:0/4115595361 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f46a0041860 con 0x7f46a4152a00 2026-02-17T21:09:53.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.267+0000 7f4691ffb640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f46740792d0 0x7f467407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:53.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.267+0000 7f46a92fa640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f46740792d0 0x7f467407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:53.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.267+0000 7f46a92fa640 10 monclient: get_auth_request con 0x7f46740792d0 auth_method 0 2026-02-17T21:09:53.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.267+0000 7f46a92fa640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f46740792d0 0x7f467407b790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4694009c40 tx=0x7f4694009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:53.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.267+0000 7f4691ffb640 10 client.4864.objecter ms_handle_connect 0x7f46740792d0 2026-02-17T21:09:53.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.269+0000 7f4691ffb640 1 -- 10.20.193.45:0/4115595361 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f46a0083b90 con 0x7f46a4152a00 2026-02-17T21:09:53.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.269+0000 7f4691ffb640 10 client.4864.objecter ms_dispatch2 0x7f46a4000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:53.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.269+0000 7f4691ffb640 3 client.4864.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:53.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.269+0000 7f4691ffb640 3 client.4864.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:53.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.269+0000 7f4691ffb640 20 client.4864.objecter dump_active .. 0 homeless 2026-02-17T21:09:53.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.276+0000 7f4691ffb640 1 -- 10.20.193.45:0/4115595361 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f46a0050030 con 0x7f46a4152a00 2026-02-17T21:09:53.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.276+0000 7f4691ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:53.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.276+0000 7f4691ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:53.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.379+0000 7f46ab585640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:53.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.379+0000 7f46ab585640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:53.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.379+0000 7f46ab585640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:09:53.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.379+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f46a4144450 con 0x7f46a4152a00 2026-02-17T21:09:53.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f4691ffb640 1 -- 10.20.193.45:0/4115595361 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f46a0087b50 con 0x7f46a4152a00 2026-02-17T21:09:53.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f4691ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:53.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f4691ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:53.374 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:53.375 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:53.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f46ab585640 10 librados: watch_flush enter 2026-02-17T21:09:53.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f46ab585640 10 librados: watch_flush exit 2026-02-17T21:09:53.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f46ab585640 20 client.4864.objecter shutdown clearing up homeless session... 2026-02-17T21:09:53.376 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f46ab585640 10 client.4864.objecter successfully canceled tick 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f46740792d0 msgr2=0x7f467407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f46ab585640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f46740792d0 0x7f467407b790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4694009c40 tx=0x7f4694009290 comp rx=0 tx=0).stop 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f46ab585640 10 monclient: shutdown 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.382+0000 7f46ab585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a4152a00 msgr2=0x7f46a40cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a4152a00 0x7f46a40cb0a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f46a0039040 tx=0x7f46a0004b40 comp rx=0 tx=0).stop 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 shutdown_connections 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f46740792d0 0x7f467407b790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f46a4152a00 0x7f46a40cb0a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f46a4152620 0x7f46a41572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 --2- 10.20.193.45:0/4115595361 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f46a40c94a0 0x7f46a40736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:53.377 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 >> 10.20.193.45:0/4115595361 conn(0x7f46a40c9d40 msgr2=0x7f46a406b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:53.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 shutdown_connections 2026-02-17T21:09:53.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 -- 10.20.193.45:0/4115595361 wait complete. 2026-02-17T21:09:53.378 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:53.383+0000 7f46ab585640 1 librados: shutdown 2026-02-17T21:09:56.384 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:56.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.461+0000 7f59c0cdb640 10 monclient: get_monmap_and_config 2026-02-17T21:09:56.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.461+0000 7f59c0cdb640 10 monclient: build_initial_monmap 2026-02-17T21:09:56.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.461+0000 7f59c0cdb640 10 monclient: monmap: 2026-02-17T21:09:56.454 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:56.454 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:56.454 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:56.462208+0000 2026-02-17T21:09:56.454 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:56.462208+0000 2026-02-17T21:09:56.454 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:56.454 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:56.454 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:56.455 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:56.455 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:56.455 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:56.455 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:56.455 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:56.455 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:56.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.461+0000 7f59c0cdb640 1 Processor -- start 2026-02-17T21:09:56.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.461+0000 7f59c0cdb640 1 -- start start 2026-02-17T21:09:56.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.461+0000 7f59c0cdb640 10 monclient: init 2026-02-17T21:09:56.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:56.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 10 monclient: _add_conns ranks=[1,4,5,0,3,2] 2026-02-17T21:09:56.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f59bc15d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f59bc0c92b0 0x7f59bc15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 10 monclient(hunting): picked mon.noname-b con 0x7f59bc0c92b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f59bc0748e0 0x7f59bc153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 10 monclient(hunting): picked mon.noname-c con 0x7f59bc0748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59bc0c5860 con 0x7f59bc15d1e0 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f59bc0c5580 con 0x7f59bc0c92b0 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f59bc0c7de0 con 0x7f59bc0748e0 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59c0cdb640 10 monclient(hunting): authenticate will time out at 1180.092466s 2026-02-17T21:09:56.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59ba575640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f59bc15d1e0 0x7f59bc0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:44568/0 (socket says 10.20.193.45:44568) 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59ba575640 1 -- 10.20.193.45:0/1456127127 learned_addr learned my addr 10.20.193.45:0/1456127127 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.462+0000 7f59bad76640 1 --2- 10.20.193.45:0/1456127127 >> v2:10.20.193.92:3300/0 conn(0x7f59bc0748e0 0x7f59bc153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.463+0000 7f59bad76640 10 monclient(hunting): get_auth_request con 0x7f59bc0748e0 auth_method 0 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.463+0000 7f59bad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.463+0000 7f59bad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.463+0000 7f59bad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.463+0000 7f59bad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.463+0000 7f59bad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.463+0000 7f59bad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9573640 1 -- 10.20.193.45:0/1456127127 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984535498 0 0) 0x7f59bc0c5860 con 0x7f59bc15d1e0 2026-02-17T21:09:56.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9573640 10 monclient(hunting): _negotiate 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9573640 10 monclient(hunting): my global_id is 4867 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9573640 1 -- 10.20.193.45:0/1456127127 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8003620 con 0x7f59bc15d1e0 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9d74640 1 --2- 10.20.193.45:0/1456127127 >> v2:10.20.193.86:3300/0 conn(0x7f59bc0c92b0 0x7f59bc15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9d74640 10 monclient(hunting): get_auth_request con 0x7f59bc0c92b0 auth_method 0 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59b9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:56.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59bad76640 10 monclient(hunting): handle_auth_done global_id 4916 payload 274 2026-02-17T21:09:56.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59bad76640 1 -- 10.20.193.45:0/1456127127 >> v2:10.20.193.86:3300/0 conn(0x7f59bc0c92b0 msgr2=0x7f59bc15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:56.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59bad76640 1 --2- 10.20.193.45:0/1456127127 >> v2:10.20.193.86:3300/0 conn(0x7f59bc0c92b0 0x7f59bc15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59bad76640 1 -- 10.20.193.45:0/1456127127 >> v1:10.20.193.86:6789/0 conn(0x7f59bc15d1e0 legacy=0x7f59bc0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:56.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59bad76640 10 monclient: _finish_hunting 0 2026-02-17T21:09:56.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59bad76640 1 monclient: found mon.noname-c 2026-02-17T21:09:56.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59bad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:56.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59bad76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:56.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.464+0000 7f59bad76640 1 -- 10.20.193.45:0/1456127127 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc0c80c0 con 0x7f59bc0748e0 2026-02-17T21:09:56.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.466+0000 7f59bad76640 1 --2- 10.20.193.45:0/1456127127 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 0x7f59bc153610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009d90 tx=0x7f59ac02f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637a870ef489659f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:56.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 1 -- 10.20.193.45:0/1456127127 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac03c070 con 0x7f59bc0748e0 2026-02-17T21:09:56.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:56.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:56.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 10 monclient: dump: 2026-02-17T21:09:56.470 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:56.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 10 monclient: _finish_auth 0 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 10 monclient: _check_auth_tickets 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 1 -- 10.20.193.45:0/1456127127 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ac037440 con 0x7f59bc0748e0 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59c0cdb640 5 monclient: authenticate success, global_id 4916 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59c0cdb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 1 -- 10.20.193.45:0/1456127127 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac037810 con 0x7f59bc0748e0 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:56.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59b9573640 10 monclient: dump: 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59c0cdb640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:56.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.468+0000 7f59c0cdb640 4 set_mon_vals no callback set 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 10 monclient: shutdown 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1456127127 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 msgr2=0x7f59bc153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 --2- 10.20.193.45:0/1456127127 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 0x7f59bc153610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009d90 tx=0x7f59ac02f1e0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1456127127 shutdown_connections 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 --2- 10.20.193.45:0/1456127127 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 0x7f59bc153610 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 --2- 10.20.193.45:0/1456127127 >> v2:10.20.193.86:3300/0 conn(0x7f59bc0c92b0 0x7f59bc15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1456127127 >> 10.20.193.45:0/1456127127 conn(0x7f59bc0c9d40 msgr2=0x7f59bc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1456127127 shutdown_connections 2026-02-17T21:09:56.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1456127127 wait complete. 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 10 monclient: build_initial_monmap 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 10 monclient: monmap: 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:56.475 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 librados: starting msgr at 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.469+0000 7f59c0cdb640 1 librados: starting objecter 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 Processor -- start 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 -- start start 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 librados: setting wanted keys 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 librados: calling monclient init 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient: init 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:56.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 0x7f59bc1f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient(hunting): picked mon.noname-c con 0x7f59bc0748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f59bc0c92b0 0x7f59bc1f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient(hunting): picked mon.noname-a con 0x7f59bc0c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f59bc15d1e0 0x7f59bc06b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient(hunting): picked mon.noname-b con 0x7f59bc15d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc074d30 con 0x7f59bc0c92b0 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc0c8680 con 0x7f59bc15d1e0 2026-02-17T21:09:56.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc153b50 con 0x7f59bc0748e0 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59c0cdb640 10 monclient(hunting): authenticate will time out at 1180.100486s 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59ba575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 0x7f59bc1f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59bad76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f59bc15d1e0 0x7f59bc06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59b9d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f59bc0c92b0 0x7f59bc1f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59ba575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 0x7f59bc1f6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:49582/0 (socket says 10.20.193.45:49582) 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59ba575640 1 -- 10.20.193.45:0/1237177055 learned_addr learned my addr 10.20.193.45:0/1237177055 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59ba575640 10 monclient(hunting): get_auth_request con 0x7f59bc0748e0 auth_method 0 2026-02-17T21:09:56.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59ba575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59ba575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59ba575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59bad76640 10 monclient(hunting): get_auth_request con 0x7f59bc15d1e0 auth_method 0 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59bad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59bad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.470+0000 7f59bad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59b9d74640 10 monclient(hunting): get_auth_request con 0x7f59bc0c92b0 auth_method 0 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59b9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59b9d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59b9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:56.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59ba575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59ba575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59ba575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59bad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59bad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59bad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59b9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59b9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.471+0000 7f59b9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 10 monclient(hunting): handle_auth_done global_id 4919 payload 824 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 1 -- 10.20.193.45:0/1237177055 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f59bc15d1e0 msgr2=0x7f59bc06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:56.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f59bc15d1e0 0x7f59bc06b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 1 -- 10.20.193.45:0/1237177055 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f59bc0c92b0 msgr2=0x7f59bc1f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f59bc0c92b0 0x7f59bc1f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 10 monclient: _finish_hunting 0 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 1 monclient: found mon.noname-c 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.472+0000 7f59ba575640 1 -- 10.20.193.45:0/1237177055 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc1f7d70 con 0x7f59bc0748e0 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.473+0000 7f59ba575640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 0x7f59bc1f6e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c550 tx=0x7f59b000ca20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.473+0000 7f59a2ffd640 10 client.?.objecter ms_handle_connect 0x7f59bc0748e0 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.473+0000 7f59a2ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:56.481 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 1 -- 10.20.193.45:0/1237177055 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0017070 con 0x7f59bc0748e0 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 10 monclient: dump: 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:56.482 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 10 monclient: _finish_auth 0 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59c0cdb640 5 monclient: authenticate success, global_id 4919 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59c0cdb640 10 monclient: _renew_subs 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59c0cdb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59bc1f74d0 con 0x7f59bc0748e0 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59c0cdb640 10 client.4919.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59c0cdb640 10 monclient: _renew_subs 2026-02-17T21:09:56.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59c0cdb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59bc1f7a90 con 0x7f59bc0748e0 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59c0cdb640 1 librados: init done 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 1 -- 10.20.193.45:0/1237177055 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b0002a20 con 0x7f59bc0748e0 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 1 -- 10.20.193.45:0/1237177055 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0021060 con 0x7f59bc0748e0 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59a2ffd640 10 monclient: dump: 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:56.484 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.474+0000 7f59b8d72640 4 set_mon_vals no callback set 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.475+0000 7f59c0cdb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:56.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.475+0000 7f59c0cdb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:56.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.475+0000 7f59c0cdb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:56.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.475+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59bc153f30 con 0x7f59bc0748e0 2026-02-17T21:09:56.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.486+0000 7f59a2ffd640 1 -- 10.20.193.45:0/1237177055 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f59b0024080 con 0x7f59bc0748e0 2026-02-17T21:09:56.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.486+0000 7f59a2ffd640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f59880792b0 0x7f598807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:56.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.486+0000 7f59b9d74640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f59880792b0 0x7f598807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:56.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.486+0000 7f59b9d74640 10 monclient: get_auth_request con 0x7f59880792b0 auth_method 0 2026-02-17T21:09:56.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.486+0000 7f59b9d74640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f59880792b0 0x7f598807b770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06f200 tx=0x7f59a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:56.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.486+0000 7f59a2ffd640 10 client.4919.objecter ms_handle_connect 0x7f59880792b0 2026-02-17T21:09:56.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.487+0000 7f59a2ffd640 1 -- 10.20.193.45:0/1237177055 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f59b005d7c0 con 0x7f59bc0748e0 2026-02-17T21:09:56.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.487+0000 7f59a2ffd640 10 client.4919.objecter ms_dispatch2 0x7f59bc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:56.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.487+0000 7f59a2ffd640 3 client.4919.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:56.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.487+0000 7f59a2ffd640 3 client.4919.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:56.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.487+0000 7f59a2ffd640 20 client.4919.objecter dump_active .. 0 homeless 2026-02-17T21:09:56.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.585+0000 7f59a2ffd640 1 -- 10.20.193.45:0/1237177055 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f59b0061780 con 0x7f59bc0748e0 2026-02-17T21:09:56.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.585+0000 7f59a2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:56.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.585+0000 7f59a2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:56.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.684+0000 7f59c0cdb640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:56.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.684+0000 7f59c0cdb640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:56.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.684+0000 7f59c0cdb640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:56.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.684+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f59bc0c9b20 con 0x7f59bc0748e0 2026-02-17T21:09:56.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.688+0000 7f59a2ffd640 1 -- 10.20.193.45:0/1237177055 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f59b0065a80 con 0x7f59bc0748e0 2026-02-17T21:09:56.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.688+0000 7f59a2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:56.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.688+0000 7f59a2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:56.681 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:56.681 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:56.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 10 librados: watch_flush enter 2026-02-17T21:09:56.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 10 librados: watch_flush exit 2026-02-17T21:09:56.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 20 client.4919.objecter shutdown clearing up homeless session... 2026-02-17T21:09:56.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 10 client.4919.objecter successfully canceled tick 2026-02-17T21:09:56.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f59880792b0 msgr2=0x7f598807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:56.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f59880792b0 0x7f598807b770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06f200 tx=0x7f59a4008040 comp rx=0 tx=0).stop 2026-02-17T21:09:56.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 10 monclient: shutdown 2026-02-17T21:09:56.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:56.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 msgr2=0x7f59bc1f6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:56.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 0x7f59bc1f6e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c550 tx=0x7f59b000ca20 comp rx=0 tx=0).stop 2026-02-17T21:09:56.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 shutdown_connections 2026-02-17T21:09:56.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f59880792b0 0x7f598807b770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f59bc15d1e0 0x7f59bc06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f59bc0c92b0 0x7f59bc1f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 --2- 10.20.193.45:0/1237177055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f59bc0748e0 0x7f59bc1f6e70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:56.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 >> 10.20.193.45:0/1237177055 conn(0x7f59bc0c9d40 msgr2=0x7f59bc14e670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:56.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 shutdown_connections 2026-02-17T21:09:56.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 -- 10.20.193.45:0/1237177055 wait complete. 2026-02-17T21:09:56.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:56.689+0000 7f59c0cdb640 1 librados: shutdown 2026-02-17T21:09:59.691 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:09:59.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.771+0000 7f516b285640 10 monclient: get_monmap_and_config 2026-02-17T21:09:59.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.771+0000 7f516b285640 10 monclient: build_initial_monmap 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.771+0000 7f516b285640 10 monclient: monmap: 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:09:59.772775+0000 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:09:59.772775+0000 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 1 Processor -- start 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 1 -- start start 2026-02-17T21:09:59.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient: init 2026-02-17T21:09:59.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:59.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient: _add_conns ranks=[3,5,0,4,1,2] 2026-02-17T21:09:59.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f516415d1e0 0x7f516415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:59.768 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient(hunting): picked mon.noname-a con 0x7f516415d1e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f51640748e0 0x7f51640c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient(hunting): picked mon.noname-c con 0x7f51640748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f51640c90e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51640c9570 con 0x7f51640c90e0 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f51640c5860 con 0x7f516415d1e0 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f51640c5580 con 0x7f51640748e0 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.772+0000 7f516b285640 10 monclient(hunting): authenticate will time out at 1183.402987s 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f5168ffa640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f516415d1e0 0x7f516415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:59.769 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f51640748e0 0x7f51640c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f51640748e0 0x7f51640c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:40986/0 (socket says 10.20.193.45:40986) 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 1 -- 10.20.193.45:0/2836787314 learned_addr learned my addr 10.20.193.45:0/2836787314 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 10 monclient(hunting): get_auth_request con 0x7f51640748e0 auth_method 0 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f5168ffa640 10 monclient(hunting): get_auth_request con 0x7f516415d1e0 auth_method 0 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f5168ffa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f5168ffa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f5168ffa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:59.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.773+0000 7f515bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.774+0000 7f5168ffa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.774+0000 7f5168ffa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.774+0000 7f5168ffa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.775+0000 7f515bfff640 10 monclient(hunting): handle_auth_done global_id 4922 payload 274 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.775+0000 7f515bfff640 1 -- 10.20.193.45:0/2836787314 >> v2:10.20.193.45:3300/0 conn(0x7f516415d1e0 msgr2=0x7f516415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.775+0000 7f515bfff640 1 --2- 10.20.193.45:0/2836787314 >> v2:10.20.193.45:3300/0 conn(0x7f516415d1e0 0x7f516415d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.775+0000 7f515bfff640 1 -- 10.20.193.45:0/2836787314 >> v1:10.20.193.45:6789/0 conn(0x7f51640c90e0 legacy=0x7f5164153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.775+0000 7f515bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.775+0000 7f515bfff640 1 monclient: found mon.noname-c 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.775+0000 7f515bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.775+0000 7f515bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:59.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.775+0000 7f515bfff640 1 -- 10.20.193.45:0/2836787314 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51640c7de0 con 0x7f51640748e0 2026-02-17T21:09:59.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.776+0000 7f515bfff640 1 --2- 10.20.193.45:0/2836787314 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640748e0 0x7f51640c8ba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f514c009970 tx=0x7f514c02eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d62d3c9a0f19beb2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:59.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 1 -- 10.20.193.45:0/2836787314 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c03c070 con 0x7f51640748e0 2026-02-17T21:09:59.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:59.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:59.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 10 monclient: dump: 2026-02-17T21:09:59.778 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:59.778 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:59.778 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:59.778 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 1 -- 10.20.193.45:0/2836787314 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c02fbc0 con 0x7f51640748e0 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 5 monclient: authenticate success, global_id 4922 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:09:59.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 10 monclient: get_monmap_and_config success 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 1 -- 10.20.193.45:0/2836787314 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c037440 con 0x7f51640748e0 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 4 set_mon_vals no callback set 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f515b7fe640 10 monclient: dump: 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:59.780 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 10 monclient: shutdown 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 1 -- 10.20.193.45:0/2836787314 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640748e0 msgr2=0x7f51640c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 1 --2- 10.20.193.45:0/2836787314 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640748e0 0x7f51640c8ba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f514c009970 tx=0x7f514c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 1 -- 10.20.193.45:0/2836787314 shutdown_connections 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 1 --2- 10.20.193.45:0/2836787314 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640748e0 0x7f51640c8ba0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 1 --2- 10.20.193.45:0/2836787314 >> v2:10.20.193.45:3300/0 conn(0x7f516415d1e0 0x7f516415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 1 -- 10.20.193.45:0/2836787314 >> 10.20.193.45:0/2836787314 conn(0x7f51640c9d40 msgr2=0x7f51640ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 1 -- 10.20.193.45:0/2836787314 shutdown_connections 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.778+0000 7f516b285640 1 -- 10.20.193.45:0/2836787314 wait complete. 2026-02-17T21:09:59.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient: build_initial_monmap 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient: monmap: 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 librados: starting msgr at 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 librados: starting objecter 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 Processor -- start 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 -- start start 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 librados: setting wanted keys 2026-02-17T21:09:59.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 librados: calling monclient init 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient: init 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient: _reopen_session rank -1 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51640748e0 0x7f516406ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient(hunting): picked mon.noname-b con 0x7f51640748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640c90e0 0x7f51641f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient(hunting): picked mon.noname-c con 0x7f51640c90e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f516415d1e0 0x7f51641f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient(hunting): picked mon.noname-a con 0x7f516415d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f51640c8680 con 0x7f516415d1e0 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f51640c83a0 con 0x7f51640748e0 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient(hunting): start opening mon connection 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5164074d30 con 0x7f51640c90e0 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient(hunting): _renew_subs 2026-02-17T21:09:59.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.779+0000 7f516b285640 10 monclient(hunting): authenticate will time out at 1183.409749s 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f516415d1e0 0x7f51641f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f515bfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640c90e0 0x7f51641f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f5168ffa640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51640748e0 0x7f516406ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f516415d1e0 0x7f51641f2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:52428/0 (socket says 10.20.193.45:52428) 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 1 -- 10.20.193.45:0/3994579357 learned_addr learned my addr 10.20.193.45:0/3994579357 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 10 monclient(hunting): get_auth_request con 0x7f516415d1e0 auth_method 0 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f515bfff640 10 monclient(hunting): get_auth_request con 0x7f51640c90e0 auth_method 0 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f515bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f515bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f515bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f5168ffa640 10 monclient(hunting): get_auth_request con 0x7f51640748e0 auth_method 0 2026-02-17T21:09:59.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f5168ffa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f5168ffa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f5168ffa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f51697fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f515bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f515bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f515bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f5168ffa640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f5168ffa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.780+0000 7f5168ffa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 10 monclient(hunting): handle_auth_done global_id 4925 payload 824 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 1 -- 10.20.193.45:0/3994579357 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51640748e0 msgr2=0x7f516406ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51640748e0 0x7f516406ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 1 -- 10.20.193.45:0/3994579357 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f516415d1e0 msgr2=0x7f51641f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f516415d1e0 0x7f51641f2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:09:59.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 1 monclient: found mon.noname-c 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.781+0000 7f515bfff640 1 -- 10.20.193.45:0/3994579357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51641f51e0 con 0x7f51640c90e0 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.783+0000 7f515bfff640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640c90e0 0x7f51641f6560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51640c5700 tx=0x7f514c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.783+0000 7f51597fa640 10 client.?.objecter ms_handle_connect 0x7f51640c90e0 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.783+0000 7f51597fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 1 -- 10.20.193.45:0/3994579357 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c03c040 con 0x7f51640c90e0 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 10 monclient: dump: 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:59.786 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 10 monclient: _finish_auth 0 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 10 monclient: _check_auth_tickets 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 1 -- 10.20.193.45:0/3994579357 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c042430 con 0x7f51640c90e0 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 5 monclient: authenticate success, global_id 4925 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 10 monclient: _renew_subs 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51641f54c0 con 0x7f51640c90e0 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 1 -- 10.20.193.45:0/3994579357 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c042820 con 0x7f51640c90e0 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f51597fa640 10 monclient: dump: 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:09:59.787 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f515affd640 4 set_mon_vals no callback set 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 10 client.4925.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 10 monclient: _renew_subs 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51641f5a80 con 0x7f51640c90e0 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 1 librados: init done 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:59.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.785+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51640c8ba0 con 0x7f51640c90e0 2026-02-17T21:09:59.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.892+0000 7f51597fa640 1 -- 10.20.193.45:0/3994579357 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f514c0429c0 con 0x7f51640c90e0 2026-02-17T21:09:59.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.893+0000 7f51597fa640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5134079280 0x7f513407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:09:59.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.893+0000 7f5168ffa640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5134079280 0x7f513407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:09:59.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.893+0000 7f5168ffa640 10 monclient: get_auth_request con 0x7f5134079280 auth_method 0 2026-02-17T21:09:59.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.893+0000 7f5168ffa640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5134079280 0x7f513407b740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5154009ba0 tx=0x7f5154009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:09:59.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.893+0000 7f51597fa640 10 client.4925.objecter ms_handle_connect 0x7f5134079280 2026-02-17T21:09:59.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.895+0000 7f51597fa640 1 -- 10.20.193.45:0/3994579357 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f514c044d60 con 0x7f51640c90e0 2026-02-17T21:09:59.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.895+0000 7f51597fa640 10 client.4925.objecter ms_dispatch2 0x7f5164000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:09:59.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.895+0000 7f51597fa640 3 client.4925.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:09:59.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.895+0000 7f51597fa640 3 client.4925.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:09:59.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.895+0000 7f51597fa640 20 client.4925.objecter dump_active .. 0 homeless 2026-02-17T21:09:59.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.901+0000 7f51597fa640 1 -- 10.20.193.45:0/3994579357 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f514c087a40 con 0x7f51640c90e0 2026-02-17T21:09:59.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.901+0000 7f51597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:09:59.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:09:59.901+0000 7f51597fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:09:59.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.000+0000 7f516b285640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:09:59.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.000+0000 7f516b285640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:59.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.000+0000 7f516b285640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:09:59.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.000+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f51641573a0 con 0x7f51640c90e0 2026-02-17T21:09:59.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.003+0000 7f51597fa640 1 -- 10.20.193.45:0/3994579357 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f514c08bd40 con 0x7f51640c90e0 2026-02-17T21:09:59.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.003+0000 7f51597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:09:59.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.003+0000 7f51597fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:09:59.996 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:09:59.996 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:09:59.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 10 librados: watch_flush enter 2026-02-17T21:09:59.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 10 librados: watch_flush exit 2026-02-17T21:09:59.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 20 client.4925.objecter shutdown clearing up homeless session... 2026-02-17T21:09:59.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 10 client.4925.objecter successfully canceled tick 2026-02-17T21:09:59.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5134079280 msgr2=0x7f513407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:59.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5134079280 0x7f513407b740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5154009ba0 tx=0x7f5154009290 comp rx=0 tx=0).stop 2026-02-17T21:09:59.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 10 monclient: shutdown 2026-02-17T21:09:59.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:09:59.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640c90e0 msgr2=0x7f51641f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:09:59.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640c90e0 0x7f51641f6560 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f51640c5700 tx=0x7f514c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:09:59.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 shutdown_connections 2026-02-17T21:09:59.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5134079280 0x7f513407b740 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:00.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f516415d1e0 0x7f51641f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:00.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51640c90e0 0x7f51641f6560 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:00.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 --2- 10.20.193.45:0/3994579357 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51640748e0 0x7f516406ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:00.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 >> 10.20.193.45:0/3994579357 conn(0x7f51640c9d40 msgr2=0x7f51641523b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:00.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 shutdown_connections 2026-02-17T21:10:00.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 -- 10.20.193.45:0/3994579357 wait complete. 2026-02-17T21:10:00.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:00.005+0000 7f516b285640 1 librados: shutdown 2026-02-17T21:10:03.007 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:03.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.085+0000 7f9954587640 10 monclient: get_monmap_and_config 2026-02-17T21:10:03.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.085+0000 7f9954587640 10 monclient: build_initial_monmap 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.085+0000 7f9954587640 10 monclient: monmap: 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:03.086698+0000 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:03.086698+0000 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:03.079 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:03.080 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:03.080 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:03.080 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:03.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 1 Processor -- start 2026-02-17T21:10:03.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 1 -- start start 2026-02-17T21:10:03.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 10 monclient: init 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 10 monclient: _add_conns ranks=[1,3,2,5,4,0] 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f994c15d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f994c0c92b0 0x7f994c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 10 monclient(hunting): picked mon.noname-a con 0x7f994c0c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f994c0748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994c0c5860 con 0x7f994c15d1e0 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994c0c5580 con 0x7f994c0748e0 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:03.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f994c0c7de0 con 0x7f994c0c92b0 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.086+0000 7f9954587640 10 monclient(hunting): authenticate will time out at 1186.716827s 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f99522fc640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f994c15d1e0 0x7f994c0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:36772/0 (socket says 10.20.193.45:36772) 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f99522fc640 1 -- 10.20.193.45:0/3375205602 learned_addr learned my addr 10.20.193.45:0/3375205602 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f9951afb640 1 --2- 10.20.193.45:0/3375205602 >> v2:10.20.193.45:3300/0 conn(0x7f994c0c92b0 0x7f994c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f9951afb640 10 monclient(hunting): get_auth_request con 0x7f994c0c92b0 auth_method 0 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f9951afb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f9951afb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f9951afb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f9951afb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f9951afb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:03.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.087+0000 7f9951afb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f99512fa640 1 -- 10.20.193.45:0/3375205602 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2593465356 0 0) 0x7f994c0c5860 con 0x7f994c15d1e0 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f99512fa640 10 monclient(hunting): _negotiate 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f99512fa640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f99512fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f99512fa640 10 monclient(hunting): my global_id is 4879 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f99512fa640 1 -- 10.20.193.45:0/3375205602 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9934003620 con 0x7f994c15d1e0 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f9951afb640 10 monclient(hunting): handle_auth_done global_id 4821 payload 274 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f9951afb640 1 -- 10.20.193.45:0/3375205602 >> v1:10.20.193.92:6789/0 conn(0x7f994c0748e0 legacy=0x7f994c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f9951afb640 1 -- 10.20.193.45:0/3375205602 >> v1:10.20.193.86:6789/0 conn(0x7f994c15d1e0 legacy=0x7f994c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f9951afb640 10 monclient: _finish_hunting 0 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f9951afb640 1 monclient: found mon.noname-a 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f9951afb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:03.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f9951afb640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:03.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.088+0000 7f9951afb640 1 -- 10.20.193.45:0/3375205602 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c0c80c0 con 0x7f994c0c92b0 2026-02-17T21:10:03.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.089+0000 7f9951afb640 1 --2- 10.20.193.45:0/3375205602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0c92b0 0x7f994c15d5c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99400098d0 tx=0x7f994002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba3e6af1c6f4ae5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:03.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 1 -- 10.20.193.45:0/3375205602 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994003c070 con 0x7f994c0c92b0 2026-02-17T21:10:03.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:03.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 10 monclient: dump: 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:03.091 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 10 monclient: _finish_auth 0 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 10 monclient: _check_auth_tickets 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 1 -- 10.20.193.45:0/3375205602 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994002fba0 con 0x7f994c0c92b0 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 1 -- 10.20.193.45:0/3375205602 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940037440 con 0x7f994c0c92b0 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f9954587640 5 monclient: authenticate success, global_id 4821 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f9954587640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f9954587640 4 set_mon_vals no callback set 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.091+0000 7f99512fa640 10 monclient: dump: 2026-02-17T21:10:03.092 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 10 monclient: shutdown 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:03.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 1 -- 10.20.193.45:0/3375205602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0c92b0 msgr2=0x7f994c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 1 --2- 10.20.193.45:0/3375205602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0c92b0 0x7f994c15d5c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99400098d0 tx=0x7f994002eed0 comp rx=0 tx=0).stop 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 1 -- 10.20.193.45:0/3375205602 shutdown_connections 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 1 --2- 10.20.193.45:0/3375205602 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0c92b0 0x7f994c15d5c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 1 -- 10.20.193.45:0/3375205602 >> 10.20.193.45:0/3375205602 conn(0x7f994c0c9d40 msgr2=0x7f994c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 1 -- 10.20.193.45:0/3375205602 shutdown_connections 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 1 -- 10.20.193.45:0/3375205602 wait complete. 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 10 monclient: build_initial_monmap 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.092+0000 7f9954587640 10 monclient: monmap: 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:03.094 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:03.095 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:03.095 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:03.095 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:03.095 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:03.095 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:03.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 librados: starting msgr at 2026-02-17T21:10:03.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 librados: starting objecter 2026-02-17T21:10:03.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 Processor -- start 2026-02-17T21:10:03.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 -- start start 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 librados: setting wanted keys 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 librados: calling monclient init 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient: init 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0748e0 0x7f994c15c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient(hunting): picked mon.noname-a con 0x7f994c0748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f994c0c92b0 0x7f994c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient(hunting): picked mon.noname-b con 0x7f994c0c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f994c15d1e0 0x7f994c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient(hunting): picked mon.noname-c con 0x7f994c15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:03.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f994c074d30 con 0x7f994c0748e0 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f994c0c8680 con 0x7f994c0c92b0 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f994c153d20 con 0x7f994c15d1e0 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9954587640 10 monclient(hunting): authenticate will time out at 1186.723554s 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f99522fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0748e0 0x7f994c15c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.093+0000 7f9951afb640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f994c0c92b0 0x7f994c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9952afd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f994c15d1e0 0x7f994c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f99522fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0748e0 0x7f994c15c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:52448/0 (socket says 10.20.193.45:52448) 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f99522fc640 1 -- 10.20.193.45:0/229512575 learned_addr learned my addr 10.20.193.45:0/229512575 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:03.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f99522fc640 10 monclient(hunting): get_auth_request con 0x7f994c0748e0 auth_method 0 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f99522fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f99522fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f99522fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9951afb640 10 monclient(hunting): get_auth_request con 0x7f994c0c92b0 auth_method 0 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9951afb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9951afb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9951afb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9952afd640 10 monclient(hunting): get_auth_request con 0x7f994c15d1e0 auth_method 0 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9952afd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9952afd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:03.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9952afd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f99522fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f99522fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f99522fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9951afb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9951afb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9951afb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9952afd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9952afd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.094+0000 7f9952afd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 10 monclient(hunting): handle_auth_done global_id 4882 payload 824 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 1 -- 10.20.193.45:0/229512575 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f994c15d1e0 msgr2=0x7f994c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:03.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f994c15d1e0 0x7f994c06df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 1 -- 10.20.193.45:0/229512575 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0748e0 msgr2=0x7f994c15c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0748e0 0x7f994c15c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 10 monclient: _finish_hunting 0 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 1 monclient: found mon.noname-b 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.095+0000 7f9951afb640 1 -- 10.20.193.45:0/229512575 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994c06d170 con 0x7f994c0c92b0 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.096+0000 7f9951afb640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f994c0c92b0 0x7f994c06b7e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9940036000 tx=0x7f99400047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.096+0000 7f9932ffd640 10 client.?.objecter ms_handle_connect 0x7f994c0c92b0 2026-02-17T21:10:03.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.096+0000 7f9932ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:03.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 1 -- 10.20.193.45:0/229512575 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994003c040 con 0x7f994c0c92b0 2026-02-17T21:10:03.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:03.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 10 monclient: dump: 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:03.103 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 10 monclient: _finish_auth 0 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 1 -- 10.20.193.45:0/229512575 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9940004250 con 0x7f994c0c92b0 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 1 -- 10.20.193.45:0/229512575 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940003710 con 0x7f994c0c92b0 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9954587640 5 monclient: authenticate success, global_id 4882 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9950af9640 4 set_mon_vals no callback set 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9954587640 10 monclient: _renew_subs 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9954587640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994c15b8f0 con 0x7f994c0c92b0 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:03.104 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9932ffd640 10 monclient: dump: 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9954587640 10 client.4882.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:03.105 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9954587640 10 monclient: _renew_subs 2026-02-17T21:10:03.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9954587640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:03.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f994c06d430 con 0x7f994c0c92b0 2026-02-17T21:10:03.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.098+0000 7f9954587640 1 librados: init done 2026-02-17T21:10:03.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.099+0000 7f9954587640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:03.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.099+0000 7f9954587640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:03.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.099+0000 7f9954587640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:03.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.099+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994c15d5c0 con 0x7f994c0c92b0 2026-02-17T21:10:03.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.110+0000 7f9932ffd640 1 -- 10.20.193.45:0/229512575 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f9940053080 con 0x7f994c0c92b0 2026-02-17T21:10:03.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.111+0000 7f9932ffd640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f991c0792d0 0x7f991c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:03.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.111+0000 7f99522fc640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f991c0792d0 0x7f991c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:03.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.111+0000 7f99522fc640 10 monclient: get_auth_request con 0x7f991c0792d0 auth_method 0 2026-02-17T21:10:03.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.111+0000 7f9932ffd640 10 client.4882.objecter ms_handle_connect 0x7f991c0792d0 2026-02-17T21:10:03.108 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.111+0000 7f99522fc640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f991c0792d0 0x7f991c07b790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f993c005980 tx=0x7f993c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:03.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.207+0000 7f9932ffd640 1 -- 10.20.193.45:0/229512575 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f994002fa60 con 0x7f994c0c92b0 2026-02-17T21:10:03.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.207+0000 7f9932ffd640 10 client.4882.objecter ms_dispatch2 0x7f994c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:03.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.207+0000 7f9932ffd640 3 client.4882.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:03.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.207+0000 7f9932ffd640 3 client.4882.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:03.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.207+0000 7f9932ffd640 20 client.4882.objecter dump_active .. 0 homeless 2026-02-17T21:10:03.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.214+0000 7f9932ffd640 1 -- 10.20.193.45:0/229512575 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9940086f90 con 0x7f994c0c92b0 2026-02-17T21:10:03.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.214+0000 7f9932ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:03.206 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.214+0000 7f9932ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:03.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.313+0000 7f9954587640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:03.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.313+0000 7f9954587640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:03.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.313+0000 7f9954587640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:03.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.313+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f994c0c9b20 con 0x7f994c0c92b0 2026-02-17T21:10:03.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.316+0000 7f9932ffd640 1 -- 10.20.193.45:0/229512575 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f994008b290 con 0x7f994c0c92b0 2026-02-17T21:10:03.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.316+0000 7f9932ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:03.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.316+0000 7f9932ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:03.309 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:03.309 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:03.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 10 librados: watch_flush enter 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 10 librados: watch_flush exit 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 20 client.4882.objecter shutdown clearing up homeless session... 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 10 client.4882.objecter successfully canceled tick 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f991c0792d0 msgr2=0x7f991c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f991c0792d0 0x7f991c07b790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f993c005980 tx=0x7f993c009040 comp rx=0 tx=0).stop 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 10 monclient: shutdown 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f994c0c92b0 msgr2=0x7f994c06b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f994c0c92b0 0x7f994c06b7e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9940036000 tx=0x7f99400047c0 comp rx=0 tx=0).stop 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 shutdown_connections 2026-02-17T21:10:03.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f991c0792d0 0x7f991c07b790 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:03.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f994c15d1e0 0x7f994c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:03.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f994c0c92b0 0x7f994c06b7e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:03.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 --2- 10.20.193.45:0/229512575 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f994c0748e0 0x7f994c15c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:03.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 >> 10.20.193.45:0/229512575 conn(0x7f994c0c9d40 msgr2=0x7f994c1489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:03.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 shutdown_connections 2026-02-17T21:10:03.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 -- 10.20.193.45:0/229512575 wait complete. 2026-02-17T21:10:03.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:03.317+0000 7f9954587640 1 librados: shutdown 2026-02-17T21:10:06.319 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:06.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.395+0000 7fba43ac6640 10 monclient: get_monmap_and_config 2026-02-17T21:10:06.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.395+0000 7fba43ac6640 10 monclient: build_initial_monmap 2026-02-17T21:10:06.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.395+0000 7fba43ac6640 10 monclient: monmap: 2026-02-17T21:10:06.389 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:06.389 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:06.397337+0000 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:06.397337+0000 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:06.390 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.395+0000 7fba43ac6640 1 Processor -- start 2026-02-17T21:10:06.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.395+0000 7fba43ac6640 1 -- start start 2026-02-17T21:10:06.391 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.395+0000 7fba43ac6640 10 monclient: init 2026-02-17T21:10:06.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:06.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 10 monclient: _add_conns ranks=[2,0,4,1,5,3] 2026-02-17T21:10:06.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fba3c152620 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fba3c15aff0 addr v1:10.20.193.45:6789/0 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fba3c0c6ca0 0x7fba3c163160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 10 monclient(hunting): picked mon.noname-b con 0x7fba3c0c6ca0 addr v2:10.20.193.86:3300/0 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c0c71a0 con 0x7fba3c15aff0 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba3c0c7480 con 0x7fba3c152620 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fba3c0c7760 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba43ac6640 10 monclient(hunting): authenticate will time out at 1190.027479s 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba4103a640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fba3c15aff0 0x7fba3c0c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:35262/0 (socket says 10.20.193.45:35262) 2026-02-17T21:10:06.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.396+0000 7fba4103a640 1 -- 10.20.193.45:0/961906199 learned_addr learned my addr 10.20.193.45:0/961906199 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.397+0000 7fba4203c640 1 --2- 10.20.193.45:0/961906199 >> v2:10.20.193.86:3300/0 conn(0x7fba3c0c6ca0 0x7fba3c163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.397+0000 7fba4203c640 10 monclient(hunting): get_auth_request con 0x7fba3c0c6ca0 auth_method 0 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.397+0000 7fba4203c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.397+0000 7fba4203c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.397+0000 7fba4203c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.397+0000 7fba4203c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.397+0000 7fba4203c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.397+0000 7fba4203c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 1 -- 10.20.193.45:0/961906199 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054435179 0 0) 0x7fba3c0c71a0 con 0x7fba3c15aff0 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 10 monclient(hunting): _negotiate 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:06.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 10 monclient(hunting): my global_id is 4827 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 1 -- 10.20.193.45:0/961906199 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba24003620 con 0x7fba3c15aff0 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 1 -- 10.20.193.45:0/961906199 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220268041 0 0) 0x7fba3c0c7480 con 0x7fba3c152620 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 10 monclient(hunting): _negotiate 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 10 monclient(hunting): my global_id is 4934 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba40839640 1 -- 10.20.193.45:0/961906199 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba3c0c71a0 con 0x7fba3c152620 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba4203c640 10 monclient(hunting): handle_auth_done global_id 4885 payload 274 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba4203c640 1 -- 10.20.193.45:0/961906199 >> v1:10.20.193.92:6789/0 conn(0x7fba3c152620 legacy=0x7fba3c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba4203c640 1 -- 10.20.193.45:0/961906199 >> v1:10.20.193.45:6789/0 conn(0x7fba3c15aff0 legacy=0x7fba3c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba4203c640 10 monclient: _finish_hunting 0 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba4203c640 1 monclient: found mon.noname-b 2026-02-17T21:10:06.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba4203c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:06.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba4203c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:06.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.398+0000 7fba4203c640 1 -- 10.20.193.45:0/961906199 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c159e00 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.399+0000 7fba4203c640 1 --2- 10.20.193.45:0/961906199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fba3c0c6ca0 0x7fba3c163160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba38009d90 tx=0x7fba3802f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81879229d0fdcce7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:06.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 1 -- 10.20.193.45:0/961906199 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3803c070 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:06.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:06.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 10 monclient: dump: 2026-02-17T21:10:06.403 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:06.403 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 10 monclient: _finish_auth 0 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 10 monclient: _check_auth_tickets 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:06.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 1 -- 10.20.193.45:0/961906199 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba38037440 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 1 -- 10.20.193.45:0/961906199 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38037810 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba40839640 10 monclient: dump: 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:06.405 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 5 monclient: authenticate success, global_id 4885 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 4 set_mon_vals no callback set 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 10 monclient: shutdown 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 1 -- 10.20.193.45:0/961906199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fba3c0c6ca0 msgr2=0x7fba3c163160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 1 --2- 10.20.193.45:0/961906199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fba3c0c6ca0 0x7fba3c163160 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fba38009d90 tx=0x7fba3802f230 comp rx=0 tx=0).stop 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 1 -- 10.20.193.45:0/961906199 shutdown_connections 2026-02-17T21:10:06.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 1 --2- 10.20.193.45:0/961906199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fba3c0c6ca0 0x7fba3c163160 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.401+0000 7fba43ac6640 1 -- 10.20.193.45:0/961906199 >> 10.20.193.45:0/961906199 conn(0x7fba3c0c9d40 msgr2=0x7fba3c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 1 -- 10.20.193.45:0/961906199 shutdown_connections 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 1 -- 10.20.193.45:0/961906199 wait complete. 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 10 monclient: build_initial_monmap 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 10 monclient: monmap: 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:06.407 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 1 librados: starting msgr at 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 1 librados: starting objecter 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 1 Processor -- start 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 1 -- start start 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 1 librados: setting wanted keys 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 1 librados: calling monclient init 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.402+0000 7fba43ac6640 10 monclient: init 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fba3c0c6ca0 0x7fba3c1f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:06.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient(hunting): picked mon.noname-a con 0x7fba3c0c6ca0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fba3c152620 0x7fba3c06b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient(hunting): picked mon.noname-b con 0x7fba3c152620 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fba3c15aff0 0x7fba3c151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient(hunting): picked mon.noname-c con 0x7fba3c15aff0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c0c94a0 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c15a3c0 con 0x7fba3c152620 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c0c9620 con 0x7fba3c15aff0 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba43ac6640 10 monclient(hunting): authenticate will time out at 1190.034166s 2026-02-17T21:10:06.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fba3c0c6ca0 0x7fba3c1f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4103a640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fba3c152620 0x7fba3c06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fba3c0c6ca0 0x7fba3c1f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:52460/0 (socket says 10.20.193.45:52460) 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 1 -- 10.20.193.45:0/1371744136 learned_addr learned my addr 10.20.193.45:0/1371744136 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 10 monclient(hunting): get_auth_request con 0x7fba3c0c6ca0 auth_method 0 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4103a640 10 monclient(hunting): get_auth_request con 0x7fba3c152620 auth_method 0 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4103a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4103a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:06.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4103a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4203c640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fba3c15aff0 0x7fba3c151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4183b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4203c640 10 monclient(hunting): get_auth_request con 0x7fba3c15aff0 auth_method 0 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4203c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4203c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4203c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4103a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.403+0000 7fba4103a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.404+0000 7fba4103a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.404+0000 7fba4203c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:06.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.404+0000 7fba4203c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.404+0000 7fba4203c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 10 monclient(hunting): handle_auth_done global_id 4830 payload 824 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 1 -- 10.20.193.45:0/1371744136 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fba3c15aff0 msgr2=0x7fba3c151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fba3c15aff0 0x7fba3c151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 1 -- 10.20.193.45:0/1371744136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fba3c152620 msgr2=0x7fba3c06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fba3c152620 0x7fba3c06b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 10 monclient: _finish_hunting 0 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 1 monclient: found mon.noname-a 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.405+0000 7fba4183b640 1 -- 10.20.193.45:0/1371744136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c1f59a0 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.406+0000 7fba4183b640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fba3c0c6ca0 0x7fba3c1f5460 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00c700 tx=0x7fba2c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:06.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.406+0000 7fba2a7fc640 10 client.?.objecter ms_handle_connect 0x7fba3c0c6ca0 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.406+0000 7fba2a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 1 -- 10.20.193.45:0/1371744136 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0052d0 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 10 monclient: dump: 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:06.413 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 5 monclient: authenticate success, global_id 4830 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 1 -- 10.20.193.45:0/1371744136 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2c005490 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 10 monclient: _renew_subs 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c1f2170 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:06.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 1 -- 10.20.193.45:0/1371744136 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0038d0 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2bfff640 4 set_mon_vals no callback set 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba2a7fc640 10 monclient: dump: 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:06.415 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 10 client.4830.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 10 monclient: _renew_subs 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c1507c0 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 1 librados: init done 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:06.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.408+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c14d570 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.518+0000 7fba2a7fc640 1 -- 10.20.193.45:0/1371744136 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fba2c003a70 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.518+0000 7fba2a7fc640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fba0c0792d0 0x7fba0c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:06.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.518+0000 7fba4103a640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fba0c0792d0 0x7fba0c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:06.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.518+0000 7fba4103a640 10 monclient: get_auth_request con 0x7fba0c0792d0 auth_method 0 2026-02-17T21:10:06.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.519+0000 7fba4103a640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fba0c0792d0 0x7fba0c07b790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba30002410 tx=0x7fba300075a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:06.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.519+0000 7fba2a7fc640 10 client.4830.objecter ms_handle_connect 0x7fba0c0792d0 2026-02-17T21:10:06.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.526+0000 7fba2a7fc640 1 -- 10.20.193.45:0/1371744136 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fba2c05e480 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.526+0000 7fba2a7fc640 10 client.4830.objecter ms_dispatch2 0x7fba3c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:06.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.526+0000 7fba2a7fc640 3 client.4830.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:06.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.526+0000 7fba2a7fc640 3 client.4830.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:06.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.526+0000 7fba2a7fc640 20 client.4830.objecter dump_active .. 0 homeless 2026-02-17T21:10:06.520 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.526+0000 7fba2a7fc640 1 -- 10.20.193.45:0/1371744136 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fba3c14d570 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.526+0000 7fba2a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:06.521 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.526+0000 7fba2a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:06.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.627+0000 7fba43ac6640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:06.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.627+0000 7fba43ac6640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:06.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.627+0000 7fba43ac6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:06.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.627+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fba3c152a00 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.639+0000 7fba2a7fc640 1 -- 10.20.193.45:0/1371744136 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fba2c062440 con 0x7fba3c0c6ca0 2026-02-17T21:10:06.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.639+0000 7fba2a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:06.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.639+0000 7fba2a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:06.633 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:06.633 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:06.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.640+0000 7fba43ac6640 10 librados: watch_flush enter 2026-02-17T21:10:06.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.640+0000 7fba43ac6640 10 librados: watch_flush exit 2026-02-17T21:10:06.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.640+0000 7fba43ac6640 20 client.4830.objecter shutdown clearing up homeless session... 2026-02-17T21:10:06.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.640+0000 7fba43ac6640 10 client.4830.objecter successfully canceled tick 2026-02-17T21:10:06.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fba0c0792d0 msgr2=0x7fba0c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fba0c0792d0 0x7fba0c07b790 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fba30002410 tx=0x7fba300075a0 comp rx=0 tx=0).stop 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 10 monclient: shutdown 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fba3c0c6ca0 msgr2=0x7fba3c1f5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fba3c0c6ca0 0x7fba3c1f5460 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00c700 tx=0x7fba2c00cbd0 comp rx=0 tx=0).stop 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 shutdown_connections 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fba0c0792d0 0x7fba0c07b790 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fba3c15aff0 0x7fba3c151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fba3c152620 0x7fba3c06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 --2- 10.20.193.45:0/1371744136 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fba3c0c6ca0 0x7fba3c1f5460 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 >> 10.20.193.45:0/1371744136 conn(0x7fba3c0c9d40 msgr2=0x7fba3c14d990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:06.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 shutdown_connections 2026-02-17T21:10:06.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 -- 10.20.193.45:0/1371744136 wait complete. 2026-02-17T21:10:06.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:06.641+0000 7fba43ac6640 1 librados: shutdown 2026-02-17T21:10:09.644 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.722+0000 7fce9d901640 10 monclient: get_monmap_and_config 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.722+0000 7fce9d901640 10 monclient: build_initial_monmap 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.722+0000 7fce9d901640 10 monclient: monmap: 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:09.722915+0000 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:09.722915+0000 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.722+0000 7fce9d901640 1 Processor -- start 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.722+0000 7fce9d901640 1 -- start start 2026-02-17T21:10:09.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.722+0000 7fce9d901640 10 monclient: init 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 10 monclient: _add_conns ranks=[2,4,1,5,0,3] 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fce98152620 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fce9815aff0 0x7fce980c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 10 monclient(hunting): picked mon.noname-b con 0x7fce9815aff0 addr v2:10.20.193.86:3300/0 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fce98152a00 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce980c71a0 con 0x7fce98152a00 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce980c7480 con 0x7fce98152620 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fce980c7760 con 0x7fce9815aff0 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce9d901640 10 monclient(hunting): authenticate will time out at 1193.353127s 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce977fe640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fce98152a00 0x7fce980c5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:34158/0 (socket says 10.20.193.45:34158) 2026-02-17T21:10:09.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.723+0000 7fce977fe640 1 -- 10.20.193.45:0/4211455377 learned_addr learned my addr 10.20.193.45:0/4211455377 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532439775 0 0) 0x7fce980c71a0 con 0x7fce98152a00 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 10 monclient(hunting): my global_id is 4891 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce84003620 con 0x7fce98152a00 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086130537 0 0) 0x7fce980c7480 con 0x7fce98152620 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 10 monclient(hunting): my global_id is 4940 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce980c71a0 con 0x7fce98152620 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce967fc640 1 --2- 10.20.193.45:0/4211455377 >> v2:10.20.193.86:3300/0 conn(0x7fce9815aff0 0x7fce980c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce967fc640 10 monclient(hunting): get_auth_request con 0x7fce9815aff0 auth_method 0 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce967fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce967fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:09.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.725+0000 7fce967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.726+0000 7fce967fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.726+0000 7fce967fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce967fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 <== mon.2 v1:10.20.193.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1802778698 0 0) 0x7fce980c71a0 con 0x7fce98152620 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 >> v2:10.20.193.86:3300/0 conn(0x7fce9815aff0 msgr2=0x7fce980c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 --2- 10.20.193.45:0/4211455377 >> v2:10.20.193.86:3300/0 conn(0x7fce9815aff0 0x7fce980c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 >> v1:10.20.193.86:6789/0 conn(0x7fce98152a00 legacy=0x7fce980c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient: _finish_hunting 0 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:10:09.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.92:6789/0 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 --> v1:10.20.193.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce98159e00 con 0x7fce98152620 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient: _finish_auth 0 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 <== mon.2 v1:10.20.193.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7fce8c002ee0 con 0x7fce98152620 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient: dump: 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] but i'm connected to v1:10.20.193.92:6789/0, reconnecting 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 >> v1:10.20.193.92:6789/0 conn(0x7fce98152620 legacy=0x7fce9815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce84004e30 0x7fce84005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient(hunting): picked mon.b con 0x7fce84004e30 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fce840038a0 0x7fce84003d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient(hunting): picked mon.c con 0x7fce840038a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce84004430 0x7fce8400bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient(hunting): picked mon.a con 0x7fce84004430 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce980c7760 con 0x7fce84004430 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce8400c380 con 0x7fce84004e30 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce8400c580 con 0x7fce840038a0 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:09.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce95ffb640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce977fe640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce84004430 0x7fce8400bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce977fe640 10 monclient(hunting): get_auth_request con 0x7fce84004430 auth_method 0 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.727+0000 7fce977fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.728+0000 7fce977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.728+0000 7fce977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.728+0000 7fce977fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.728+0000 7fce967fc640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fce840038a0 0x7fce84003d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce967fc640 10 monclient(hunting): get_auth_request con 0x7fce840038a0 auth_method 0 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce967fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce967fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce967fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce967fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce967fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce967fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:10:09.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 10 monclient(hunting): handle_auth_done global_id 4940 payload 293 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 1 -- 10.20.193.45:0/4211455377 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fce840038a0 msgr2=0x7fce84003d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fce840038a0 0x7fce84003d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 1 -- 10.20.193.45:0/4211455377 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce84004e30 msgr2=0x7fce84005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce84004e30 0x7fce84005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 10 monclient: _finish_hunting 0 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 1 monclient: found mon.a 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 1 -- 10.20.193.45:0/4211455377 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce980c71a0 con 0x7fce84004430 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 10 monclient: _finish_auth 0 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 10 monclient: _check_auth_tickets 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce9d901640 5 monclient: authenticate success, global_id 4940 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce9d901640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.729+0000 7fce977fe640 1 -- 10.20.193.45:0/4211455377 reap_dead start 2026-02-17T21:10:09.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.730+0000 7fce977fe640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce84004430 0x7fce8400bac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c490 tx=0x7fce8802f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccfd794af69030f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8800c0e0 con 0x7fce84004430 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 10 monclient: dump: 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce88037430 con 0x7fce84004430 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 1 -- 10.20.193.45:0/4211455377 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88037820 con 0x7fce84004430 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 4 set_mon_vals no callback set 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:09.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce95ffb640 10 monclient: dump: 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 10 monclient: shutdown 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 1 -- 10.20.193.45:0/4211455377 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce84004430 msgr2=0x7fce8400bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce84004430 0x7fce8400bac0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c490 tx=0x7fce8802f6c0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 1 -- 10.20.193.45:0/4211455377 shutdown_connections 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 1 --2- 10.20.193.45:0/4211455377 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce84004430 0x7fce8400bac0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 1 -- 10.20.193.45:0/4211455377 >> 10.20.193.45:0/4211455377 conn(0x7fce980c9d40 msgr2=0x7fce980ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 1 -- 10.20.193.45:0/4211455377 shutdown_connections 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.732+0000 7fce9d901640 1 -- 10.20.193.45:0/4211455377 wait complete. 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 10 monclient: build_initial_monmap 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 10 monclient: monmap: 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:09.725 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 1 librados: starting msgr at 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 1 librados: starting objecter 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 1 Processor -- start 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 1 -- start start 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 1 librados: setting wanted keys 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 1 librados: calling monclient init 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 10 monclient: init 2026-02-17T21:10:09.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fce84004430 0x7fce98072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 10 monclient(hunting): picked mon.noname-c con 0x7fce84004430 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce981f6630 0x7fce980cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.733+0000 7fce9d901640 10 monclient(hunting): picked mon.noname-b con 0x7fce981f6630 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce981f38d0 0x7fce980c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 10 monclient(hunting): picked mon.noname-a con 0x7fce981f38d0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce9815a8e0 con 0x7fce981f38d0 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fce9815a3c0 con 0x7fce981f6630 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce9815aa60 con 0x7fce84004430 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce9d901640 10 monclient(hunting): authenticate will time out at 1193.364018s 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce981f6630 0x7fce980cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce977fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce981f38d0 0x7fce980c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce981f6630 0x7fce980cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:40288/0 (socket says 10.20.193.45:40288) 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 1 -- 10.20.193.45:0/4208090776 learned_addr learned my addr 10.20.193.45:0/4208090776 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 10 monclient(hunting): get_auth_request con 0x7fce981f6630 auth_method 0 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce977fe640 10 monclient(hunting): get_auth_request con 0x7fce981f38d0 auth_method 0 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce96ffd640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fce84004430 0x7fce98072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce967fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce96ffd640 10 monclient(hunting): get_auth_request con 0x7fce84004430 auth_method 0 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce96ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce96ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:09.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.734+0000 7fce96ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.735+0000 7fce96ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 10 monclient(hunting): handle_auth_done global_id 4833 payload 824 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 1 -- 10.20.193.45:0/4208090776 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fce84004430 msgr2=0x7fce98072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fce84004430 0x7fce98072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 1 -- 10.20.193.45:0/4208090776 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce981f6630 msgr2=0x7fce980cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce981f6630 0x7fce980cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 10 monclient: _finish_hunting 0 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 1 monclient: found mon.noname-a 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce977fe640 1 -- 10.20.193.45:0/4208090776 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce981f3130 con 0x7fce981f38d0 2026-02-17T21:10:09.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.736+0000 7fce967fc640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce981f6630 0x7fce980cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:10:09.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.737+0000 7fce977fe640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce981f38d0 0x7fce980c6570 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fce9815bd00 tx=0x7fce88002f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:09.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.737+0000 7fce6ffff640 10 client.?.objecter ms_handle_connect 0x7fce981f38d0 2026-02-17T21:10:09.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.737+0000 7fce6ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 1 -- 10.20.193.45:0/4208090776 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce880375e0 con 0x7fce981f38d0 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 10 monclient: dump: 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 10 monclient: _finish_auth 0 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 1 -- 10.20.193.45:0/4208090776 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce88046070 con 0x7fce981f38d0 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 1 -- 10.20.193.45:0/4208090776 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88037980 con 0x7fce981f38d0 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce957fa640 4 set_mon_vals no callback set 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce6ffff640 10 monclient: dump: 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce9d901640 5 monclient: authenticate success, global_id 4833 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce9d901640 10 monclient: _renew_subs 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce9d901640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce980729d0 con 0x7fce981f38d0 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce9d901640 10 client.4833.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce9d901640 10 monclient: _renew_subs 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce9d901640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:09.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce981f6e40 con 0x7fce981f38d0 2026-02-17T21:10:09.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.738+0000 7fce9d901640 1 librados: init done 2026-02-17T21:10:09.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.739+0000 7fce9d901640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:09.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.739+0000 7fce9d901640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:09.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.739+0000 7fce9d901640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:09.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.739+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce980c8d90 con 0x7fce981f38d0 2026-02-17T21:10:09.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.750+0000 7fce6ffff640 1 -- 10.20.193.45:0/4208090776 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fce88037b20 con 0x7fce981f38d0 2026-02-17T21:10:09.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.751+0000 7fce6ffff640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fce68079300 0x7fce6807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:09.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.751+0000 7fce96ffd640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fce68079300 0x7fce6807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:09.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.751+0000 7fce96ffd640 10 monclient: get_auth_request con 0x7fce68079300 auth_method 0 2026-02-17T21:10:09.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.751+0000 7fce96ffd640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fce68079300 0x7fce6807b7c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce8c003050 tx=0x7fce8c00a490 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:09.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.751+0000 7fce6ffff640 10 client.4833.objecter ms_handle_connect 0x7fce68079300 2026-02-17T21:10:09.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.753+0000 7fce6ffff640 1 -- 10.20.193.45:0/4208090776 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fce8800c150 con 0x7fce981f38d0 2026-02-17T21:10:09.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.753+0000 7fce6ffff640 10 client.4833.objecter ms_dispatch2 0x7fce98000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:09.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.753+0000 7fce6ffff640 3 client.4833.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:09.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.753+0000 7fce6ffff640 3 client.4833.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:09.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.753+0000 7fce6ffff640 20 client.4833.objecter dump_active .. 0 homeless 2026-02-17T21:10:09.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.857+0000 7fce6ffff640 1 -- 10.20.193.45:0/4208090776 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fce88087aa0 con 0x7fce981f38d0 2026-02-17T21:10:09.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.857+0000 7fce6ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:09.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.857+0000 7fce6ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:09.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.959+0000 7fce9d901640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:09.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.959+0000 7fce9d901640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:09.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.959+0000 7fce9d901640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:09.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.959+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fce9814e510 con 0x7fce981f38d0 2026-02-17T21:10:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.961+0000 7fce6ffff640 1 -- 10.20.193.45:0/4208090776 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fce880873a0 con 0x7fce981f38d0 2026-02-17T21:10:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.961+0000 7fce6ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:09.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.961+0000 7fce6ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:09.954 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:09.954 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 10 librados: watch_flush enter 2026-02-17T21:10:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 10 librados: watch_flush exit 2026-02-17T21:10:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 20 client.4833.objecter shutdown clearing up homeless session... 2026-02-17T21:10:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 10 client.4833.objecter successfully canceled tick 2026-02-17T21:10:09.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fce68079300 msgr2=0x7fce6807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fce68079300 0x7fce6807b7c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce8c003050 tx=0x7fce8c00a490 comp rx=0 tx=0).stop 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 10 monclient: shutdown 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce981f38d0 msgr2=0x7fce980c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce981f38d0 0x7fce980c6570 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fce9815bd00 tx=0x7fce88002f00 comp rx=0 tx=0).stop 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 shutdown_connections 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fce68079300 0x7fce6807b7c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fce981f38d0 0x7fce980c6570 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fce981f6630 0x7fce980cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 --2- 10.20.193.45:0/4208090776 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fce84004430 0x7fce98072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 >> 10.20.193.45:0/4208090776 conn(0x7fce980c9d40 msgr2=0x7fce9815ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 shutdown_connections 2026-02-17T21:10:09.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 -- 10.20.193.45:0/4208090776 wait complete. 2026-02-17T21:10:09.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:09.963+0000 7fce9d901640 1 librados: shutdown 2026-02-17T21:10:10.189 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:17.402 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:10.192 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:17.405 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:10.199 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:17.413 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:10.221 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:05:17.394 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:10.222 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:05:17.432 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:10.223 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:05:17.395 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:10.223 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:05:17.433 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:10.230 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:05:17.403 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:10.231 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:05:17.441 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:12.965 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.042+0000 7f25dd429640 10 monclient: get_monmap_and_config 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.042+0000 7f25dd429640 10 monclient: build_initial_monmap 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.042+0000 7f25dd429640 10 monclient: monmap: 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:13.043810+0000 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:13.043810+0000 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:13.035 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:13.036 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:13.036 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:13.036 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:13.036 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:13.036 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 1 Processor -- start 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 1 -- start start 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient: init 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient: _add_conns ranks=[4,5,0,3,2,1] 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f25d815d1e0 0x7f25d815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient(hunting): picked mon.noname-b con 0x7f25d815d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f25d80748e0 0x7f25d80c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient(hunting): picked mon.noname-c con 0x7f25d80748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f25d80c90e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25d80c9570 con 0x7f25d80c90e0 2026-02-17T21:10:13.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f25d80c5860 con 0x7f25d815d1e0 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f25d80c5580 con 0x7f25d80748e0 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.043+0000 7f25dd429640 10 monclient(hunting): authenticate will time out at 1196.673937s 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d77fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f25d80c90e0 0x7f25d8153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:45484/0 (socket says 10.20.193.45:45484) 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d77fe640 1 -- 10.20.193.45:0/3359400349 learned_addr learned my addr 10.20.193.45:0/3359400349 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d6ffd640 1 --2- 10.20.193.45:0/3359400349 >> v2:10.20.193.86:3300/0 conn(0x7f25d815d1e0 0x7f25d815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d67fc640 1 --2- 10.20.193.45:0/3359400349 >> v2:10.20.193.92:3300/0 conn(0x7f25d80748e0 0x7f25d80c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d6ffd640 10 monclient(hunting): get_auth_request con 0x7f25d815d1e0 auth_method 0 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d67fc640 10 monclient(hunting): get_auth_request con 0x7f25d80748e0 auth_method 0 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:13.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.044+0000 7f25d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.045+0000 7f25d5ffb640 1 -- 10.20.193.45:0/3359400349 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984088763 0 0) 0x7f25d80c9570 con 0x7f25d80c90e0 2026-02-17T21:10:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.045+0000 7f25d5ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:10:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.045+0000 7f25d5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.045+0000 7f25d5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.045+0000 7f25d5ffb640 10 monclient(hunting): my global_id is 4836 2026-02-17T21:10:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.045+0000 7f25d5ffb640 1 -- 10.20.193.45:0/3359400349 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25c4003620 con 0x7f25d80c90e0 2026-02-17T21:10:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.046+0000 7f25d6ffd640 10 monclient(hunting): handle_auth_done global_id 4900 payload 274 2026-02-17T21:10:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.046+0000 7f25d6ffd640 1 -- 10.20.193.45:0/3359400349 >> v2:10.20.193.92:3300/0 conn(0x7f25d80748e0 msgr2=0x7f25d80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:13.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.046+0000 7f25d6ffd640 1 --2- 10.20.193.45:0/3359400349 >> v2:10.20.193.92:3300/0 conn(0x7f25d80748e0 0x7f25d80c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.046+0000 7f25d6ffd640 1 -- 10.20.193.45:0/3359400349 >> v1:10.20.193.45:6789/0 conn(0x7f25d80c90e0 legacy=0x7f25d8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.046+0000 7f25d6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:10:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.046+0000 7f25d6ffd640 1 monclient: found mon.noname-b 2026-02-17T21:10:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.046+0000 7f25d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.046+0000 7f25d6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.046+0000 7f25d6ffd640 1 -- 10.20.193.45:0/3359400349 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d80c7de0 con 0x7f25d815d1e0 2026-02-17T21:10:13.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.047+0000 7f25d6ffd640 1 --2- 10.20.193.45:0/3359400349 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25d815d1e0 0x7f25d815d5c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0098a0 tx=0x7f25cc02ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=442fcb0e2aba2896 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 1 -- 10.20.193.45:0/3359400349 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc03c070 con 0x7f25d815d1e0 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 10 monclient: dump: 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:13.042 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 1 -- 10.20.193.45:0/3359400349 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc02fae0 con 0x7f25d815d1e0 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 1 -- 10.20.193.45:0/3359400349 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc037440 con 0x7f25d815d1e0 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25dd429640 5 monclient: authenticate success, global_id 4900 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25dd429640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25dd429640 4 set_mon_vals no callback set 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25d5ffb640 10 monclient: dump: 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:13.043 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25dd429640 10 monclient: shutdown 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25dd429640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25dd429640 1 -- 10.20.193.45:0/3359400349 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25d815d1e0 msgr2=0x7f25d815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.049+0000 7f25dd429640 1 --2- 10.20.193.45:0/3359400349 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25d815d1e0 0x7f25d815d5c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f25cc0098a0 tx=0x7f25cc02ee10 comp rx=0 tx=0).stop 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 -- 10.20.193.45:0/3359400349 shutdown_connections 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 --2- 10.20.193.45:0/3359400349 >> v2:10.20.193.92:3300/0 conn(0x7f25d80748e0 0x7f25d80c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 --2- 10.20.193.45:0/3359400349 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25d815d1e0 0x7f25d815d5c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 -- 10.20.193.45:0/3359400349 >> 10.20.193.45:0/3359400349 conn(0x7f25d80c9d40 msgr2=0x7f25d80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 -- 10.20.193.45:0/3359400349 shutdown_connections 2026-02-17T21:10:13.044 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 -- 10.20.193.45:0/3359400349 wait complete. 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 10 monclient: build_initial_monmap 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 10 monclient: monmap: 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:13.046 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 librados: starting msgr at 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 librados: starting objecter 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 Processor -- start 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 -- start start 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 librados: setting wanted keys 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 1 librados: calling monclient init 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.050+0000 7f25dd429640 10 monclient: init 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25d80748e0 0x7f25d815ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient(hunting): picked mon.noname-a con 0x7f25d80748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25d80c90e0 0x7f25d806f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient(hunting): picked mon.noname-b con 0x7f25d80c90e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25d815d1e0 0x7f25d8072c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient(hunting): picked mon.noname-c con 0x7f25d815d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f25d80c8680 con 0x7f25d80748e0 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f25d80c83a0 con 0x7f25d80c90e0 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25d8074d30 con 0x7f25d815d1e0 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:13.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25dd429640 10 monclient(hunting): authenticate will time out at 1196.681266s 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25d815d1e0 0x7f25d8072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d67fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25d80c90e0 0x7f25d806f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d6ffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25d80748e0 0x7f25d815ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25d815d1e0 0x7f25d8072c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:39280/0 (socket says 10.20.193.45:39280) 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 1 -- 10.20.193.45:0/1191037676 learned_addr learned my addr 10.20.193.45:0/1191037676 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 10 monclient(hunting): get_auth_request con 0x7f25d815d1e0 auth_method 0 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d67fc640 10 monclient(hunting): get_auth_request con 0x7f25d80c90e0 auth_method 0 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d6ffd640 10 monclient(hunting): get_auth_request con 0x7f25d80748e0 auth_method 0 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.051+0000 7f25d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.052+0000 7f25d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.052+0000 7f25d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.052+0000 7f25d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:13.048 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.052+0000 7f25d6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.052+0000 7f25d6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.052+0000 7f25d6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 10 monclient(hunting): handle_auth_done global_id 4949 payload 824 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 1 -- 10.20.193.45:0/1191037676 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25d80c90e0 msgr2=0x7f25d806f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25d80c90e0 0x7f25d806f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 1 -- 10.20.193.45:0/1191037676 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25d80748e0 msgr2=0x7f25d815ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25d80748e0 0x7f25d815ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 1 monclient: found mon.noname-c 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:10:13.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.053+0000 7f25d77fe640 1 -- 10.20.193.45:0/1191037676 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d815b3f0 con 0x7f25d815d1e0 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.054+0000 7f25d77fe640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25d815d1e0 0x7f25d8072c00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f25c800cb40 tx=0x7f25c800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.054+0000 7f25b77fe640 10 client.?.objecter ms_handle_connect 0x7f25d815d1e0 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.054+0000 7f25b77fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 1 -- 10.20.193.45:0/1191037676 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c800ad50 con 0x7f25d815d1e0 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 10 monclient: dump: 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:13.050 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 10 monclient: _finish_auth 0 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 1 -- 10.20.193.45:0/1191037676 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c8012400 con 0x7f25d815d1e0 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 5 monclient: authenticate success, global_id 4949 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 10 monclient: _renew_subs 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d815b6d0 con 0x7f25d815d1e0 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 1 -- 10.20.193.45:0/1191037676 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80127f0 con 0x7f25d815d1e0 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25d57fa640 4 set_mon_vals no callback set 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25b77fe640 10 monclient: dump: 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:13.051 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 10 client.4949.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 10 monclient: _renew_subs 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d815bc90 con 0x7f25d815d1e0 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 1 librados: init done 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:13.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.056+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d80c8ba0 con 0x7f25d815d1e0 2026-02-17T21:10:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.164+0000 7f25b77fe640 1 -- 10.20.193.45:0/1191037676 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f25c8012990 con 0x7f25d815d1e0 2026-02-17T21:10:13.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.164+0000 7f25b77fe640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f25a4079280 0x7f25a407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.164+0000 7f25d6ffd640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f25a4079280 0x7f25a407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.164+0000 7f25d6ffd640 10 monclient: get_auth_request con 0x7f25a4079280 auth_method 0 2026-02-17T21:10:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.165+0000 7f25b77fe640 10 client.4949.objecter ms_handle_connect 0x7f25a4079280 2026-02-17T21:10:13.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.165+0000 7f25d6ffd640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f25a4079280 0x7f25a407b740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f25cc039000 tx=0x7f25cc033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.166+0000 7f25b77fe640 1 -- 10.20.193.45:0/1191037676 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f25c805ecd0 con 0x7f25d815d1e0 2026-02-17T21:10:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.166+0000 7f25b77fe640 10 client.4949.objecter ms_dispatch2 0x7f25d8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.166+0000 7f25b77fe640 3 client.4949.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.166+0000 7f25b77fe640 3 client.4949.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:13.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.166+0000 7f25b77fe640 20 client.4949.objecter dump_active .. 0 homeless 2026-02-17T21:10:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.172+0000 7f25b77fe640 1 -- 10.20.193.45:0/1191037676 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f25c8062c90 con 0x7f25d815d1e0 2026-02-17T21:10:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.172+0000 7f25b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:13.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.172+0000 7f25b77fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:13.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.273+0000 7f25dd429640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:13.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.273+0000 7f25dd429640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:13.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.273+0000 7f25dd429640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:13.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.273+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f25d80c9b20 con 0x7f25d815d1e0 2026-02-17T21:10:13.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.275+0000 7f25b77fe640 1 -- 10.20.193.45:0/1191037676 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f25c8066f90 con 0x7f25d815d1e0 2026-02-17T21:10:13.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.275+0000 7f25b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:13.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.275+0000 7f25b77fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:13.267 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:13.267 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 10 librados: watch_flush enter 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 10 librados: watch_flush exit 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 20 client.4949.objecter shutdown clearing up homeless session... 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 10 client.4949.objecter successfully canceled tick 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f25a4079280 msgr2=0x7f25a407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f25a4079280 0x7f25a407b740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f25cc039000 tx=0x7f25cc033000 comp rx=0 tx=0).stop 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 10 monclient: shutdown 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25d815d1e0 msgr2=0x7f25d8072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25d815d1e0 0x7f25d8072c00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f25c800cb40 tx=0x7f25c800a430 comp rx=0 tx=0).stop 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 shutdown_connections 2026-02-17T21:10:13.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f25a4079280 0x7f25a407b740 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:13.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f25d815d1e0 0x7f25d8072c00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:13.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f25d80c90e0 0x7f25d806f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:13.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 --2- 10.20.193.45:0/1191037676 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f25d80748e0 0x7f25d815ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:13.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 >> 10.20.193.45:0/1191037676 conn(0x7f25d80c9d40 msgr2=0x7f25d81510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:13.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 shutdown_connections 2026-02-17T21:10:13.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 -- 10.20.193.45:0/1191037676 wait complete. 2026-02-17T21:10:13.270 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:13.276+0000 7f25dd429640 1 librados: shutdown 2026-02-17T21:10:16.279 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:16.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.355+0000 7f160a2b9640 10 monclient: get_monmap_and_config 2026-02-17T21:10:16.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.355+0000 7f160a2b9640 10 monclient: build_initial_monmap 2026-02-17T21:10:16.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.355+0000 7f160a2b9640 10 monclient: monmap: 2026-02-17T21:10:16.348 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:16.348 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:16.348 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:16.356571+0000 2026-02-17T21:10:16.348 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:16.356571+0000 2026-02-17T21:10:16.349 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:16.349 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:16.349 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:16.349 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:16.349 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:16.349 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:16.349 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:16.349 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:16.349 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:16.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 1 Processor -- start 2026-02-17T21:10:16.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 1 -- start start 2026-02-17T21:10:16.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 10 monclient: init 2026-02-17T21:10:16.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:16.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 10 monclient: _add_conns ranks=[1,3,2,4,0,5] 2026-02-17T21:10:16.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f160415d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f16040c92b0 0x7f160415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 10 monclient(hunting): picked mon.noname-a con 0x7f16040c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f16040748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16040c5860 con 0x7f160415d1e0 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16040c5580 con 0x7f16040748e0 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f16040c7de0 con 0x7f16040c92b0 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.356+0000 7f160a2b9640 10 monclient(hunting): authenticate will time out at 1199.986807s 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f1603fff640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f160415d1e0 0x7f16040c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:34168/0 (socket says 10.20.193.45:34168) 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f1603fff640 1 -- 10.20.193.45:0/2289378404 learned_addr learned my addr 10.20.193.45:0/2289378404 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:16.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f16037fe640 1 --2- 10.20.193.45:0/2289378404 >> v2:10.20.193.45:3300/0 conn(0x7f16040c92b0 0x7f160415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f16037fe640 10 monclient(hunting): get_auth_request con 0x7f16040c92b0 auth_method 0 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f16037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f16037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f16037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f16037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f16037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.357+0000 7f16037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 1 -- 10.20.193.45:0/2289378404 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947306191 0 0) 0x7f16040c5860 con 0x7f160415d1e0 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:16.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 10 monclient(hunting): my global_id is 4906 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 1 -- 10.20.193.45:0/2289378404 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e8003620 con 0x7f160415d1e0 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 1 -- 10.20.193.45:0/2289378404 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735784358 0 0) 0x7f16040c5580 con 0x7f16040748e0 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 10 monclient(hunting): my global_id is 4952 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f1602ffd640 1 -- 10.20.193.45:0/2289378404 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16040c5860 con 0x7f16040748e0 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f16037fe640 10 monclient(hunting): handle_auth_done global_id 4842 payload 274 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f16037fe640 1 -- 10.20.193.45:0/2289378404 >> v1:10.20.193.92:6789/0 conn(0x7f16040748e0 legacy=0x7f1604153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f16037fe640 1 -- 10.20.193.45:0/2289378404 >> v1:10.20.193.86:6789/0 conn(0x7f160415d1e0 legacy=0x7f16040c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f16037fe640 10 monclient: _finish_hunting 0 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f16037fe640 1 monclient: found mon.noname-a 2026-02-17T21:10:16.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f16037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:16.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f16037fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:16.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.358+0000 7f16037fe640 1 -- 10.20.193.45:0/2289378404 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16040c80c0 con 0x7f16040c92b0 2026-02-17T21:10:16.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.359+0000 7f16037fe640 1 --2- 10.20.193.45:0/2289378404 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16040c92b0 0x7f160415d5c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15f40098d0 tx=0x7f15f402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ad359d9e846f2e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:16.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 1 -- 10.20.193.45:0/2289378404 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f403c070 con 0x7f16040c92b0 2026-02-17T21:10:16.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:16.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:16.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 10 monclient: dump: 2026-02-17T21:10:16.362 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:16.362 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:16.362 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:16.362 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 10 monclient: _finish_auth 0 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 1 -- 10.20.193.45:0/2289378404 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f402fba0 con 0x7f16040c92b0 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:16.363 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 1 -- 10.20.193.45:0/2289378404 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4037440 con 0x7f16040c92b0 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 5 monclient: authenticate success, global_id 4842 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f1602ffd640 10 monclient: dump: 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:16.364 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 4 set_mon_vals no callback set 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 10 monclient: shutdown 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 1 -- 10.20.193.45:0/2289378404 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16040c92b0 msgr2=0x7f160415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 1 --2- 10.20.193.45:0/2289378404 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16040c92b0 0x7f160415d5c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f15f40098d0 tx=0x7f15f402eed0 comp rx=0 tx=0).stop 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 1 -- 10.20.193.45:0/2289378404 shutdown_connections 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 1 --2- 10.20.193.45:0/2289378404 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16040c92b0 0x7f160415d5c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 1 -- 10.20.193.45:0/2289378404 >> 10.20.193.45:0/2289378404 conn(0x7f16040c9d40 msgr2=0x7f16040ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.361+0000 7f160a2b9640 1 -- 10.20.193.45:0/2289378404 shutdown_connections 2026-02-17T21:10:16.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 1 -- 10.20.193.45:0/2289378404 wait complete. 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 10 monclient: build_initial_monmap 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 10 monclient: monmap: 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:16.366 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 1 librados: starting msgr at 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 1 librados: starting objecter 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 1 Processor -- start 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 1 -- start start 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 1 librados: setting wanted keys 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 1 librados: calling monclient init 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.362+0000 7f160a2b9640 10 monclient: init 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f16040748e0 0x7f160415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient(hunting): picked mon.noname-b con 0x7f16040748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f16040c92b0 0x7f160406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:16.367 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient(hunting): picked mon.noname-c con 0x7f16040c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f160415d1e0 0x7f160406df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient(hunting): picked mon.noname-a con 0x7f160415d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1604074d30 con 0x7f160415d1e0 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f16040c8680 con 0x7f16040748e0 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1604153d20 con 0x7f16040c92b0 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160a2b9640 10 monclient(hunting): authenticate will time out at 1199.993109s 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f160415d1e0 0x7f160406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:16.368 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f1603fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f16040748e0 0x7f160415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f160415d1e0 0x7f160406df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:60916/0 (socket says 10.20.193.45:60916) 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 1 -- 10.20.193.45:0/2677248783 learned_addr learned my addr 10.20.193.45:0/2677248783 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 10 monclient(hunting): get_auth_request con 0x7f160415d1e0 auth_method 0 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f16037fe640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f16040c92b0 0x7f160406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f1603fff640 10 monclient(hunting): get_auth_request con 0x7f16040748e0 auth_method 0 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f1603fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f1603fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f1603fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:16.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f160882f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f16037fe640 10 monclient(hunting): get_auth_request con 0x7f16040c92b0 auth_method 0 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f16037fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f16037fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f16037fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f1603fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f1603fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.363+0000 7f1603fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.364+0000 7f16037fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.364+0000 7f16037fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.364+0000 7f16037fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 10 monclient(hunting): handle_auth_done global_id 4845 payload 824 2026-02-17T21:10:16.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 1 -- 10.20.193.45:0/2677248783 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f16040c92b0 msgr2=0x7f160406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f16040c92b0 0x7f160406b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 1 -- 10.20.193.45:0/2677248783 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f16040748e0 msgr2=0x7f160415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f16040748e0 0x7f160415c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 10 monclient: _finish_hunting 0 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 1 monclient: found mon.noname-a 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.365+0000 7f160882f640 1 -- 10.20.193.45:0/2677248783 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160406d170 con 0x7f160415d1e0 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.366+0000 7f160882f640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f160415d1e0 0x7f160406df10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f15f800cc20 tx=0x7f15f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.366+0000 7f1600ff9640 10 client.?.objecter ms_handle_connect 0x7f160415d1e0 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.366+0000 7f1600ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:16.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 1 -- 10.20.193.45:0/2677248783 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f800ce40 con 0x7f160415d1e0 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 10 monclient: dump: 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:16.372 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 10 monclient: _finish_auth 0 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 1 -- 10.20.193.45:0/2677248783 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f8003a70 con 0x7f160415d1e0 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 1 -- 10.20.193.45:0/2677248783 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8003e60 con 0x7f160415d1e0 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f1600ff9640 10 monclient: dump: 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:16.373 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f16027fc640 4 set_mon_vals no callback set 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f160a2b9640 5 monclient: authenticate success, global_id 4845 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f160a2b9640 10 monclient: _renew_subs 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f160a2b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160415b8f0 con 0x7f160415d1e0 2026-02-17T21:10:16.374 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f160a2b9640 10 client.4845.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f160a2b9640 10 monclient: _renew_subs 2026-02-17T21:10:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f160a2b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160406d430 con 0x7f160415d1e0 2026-02-17T21:10:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.367+0000 7f160a2b9640 1 librados: init done 2026-02-17T21:10:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.368+0000 7f160a2b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.368+0000 7f160a2b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.368+0000 7f160a2b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:16.375 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.368+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160415d5c0 con 0x7f160415d1e0 2026-02-17T21:10:16.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.482+0000 7f1600ff9640 1 -- 10.20.193.45:0/2677248783 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f15f80050d0 con 0x7f160415d1e0 2026-02-17T21:10:16.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.482+0000 7f1600ff9640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f15d4079280 0x7f15d407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:16.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.482+0000 7f1603fff640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f15d4079280 0x7f15d407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:16.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.482+0000 7f1603fff640 10 monclient: get_auth_request con 0x7f15d4079280 auth_method 0 2026-02-17T21:10:16.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.483+0000 7f1603fff640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f15d4079280 0x7f15d407b740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15f0007b60 tx=0x7f15f0007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:16.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.483+0000 7f1600ff9640 10 client.4845.objecter ms_handle_connect 0x7f15d4079280 2026-02-17T21:10:16.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.490+0000 7f1600ff9640 1 -- 10.20.193.45:0/2677248783 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f15f805eaa0 con 0x7f160415d1e0 2026-02-17T21:10:16.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.490+0000 7f1600ff9640 10 client.4845.objecter ms_dispatch2 0x7f1604000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:16.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.490+0000 7f1600ff9640 3 client.4845.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:16.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.490+0000 7f1600ff9640 3 client.4845.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:16.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.491+0000 7f1600ff9640 20 client.4845.objecter dump_active .. 0 homeless 2026-02-17T21:10:16.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.491+0000 7f1600ff9640 1 -- 10.20.193.45:0/2677248783 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f15f8062a60 con 0x7f160415d1e0 2026-02-17T21:10:16.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.491+0000 7f1600ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:16.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.491+0000 7f1600ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:16.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.591+0000 7f160a2b9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:16.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.591+0000 7f160a2b9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:16.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.591+0000 7f160a2b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:16.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.591+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f16040c9b20 con 0x7f160415d1e0 2026-02-17T21:10:16.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.593+0000 7f1600ff9640 1 -- 10.20.193.45:0/2677248783 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f15f8066d60 con 0x7f160415d1e0 2026-02-17T21:10:16.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.593+0000 7f1600ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:16.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.593+0000 7f1600ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:16.586 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:16.586 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:16.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 10 librados: watch_flush enter 2026-02-17T21:10:16.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 10 librados: watch_flush exit 2026-02-17T21:10:16.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 20 client.4845.objecter shutdown clearing up homeless session... 2026-02-17T21:10:16.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 10 client.4845.objecter successfully canceled tick 2026-02-17T21:10:16.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f15d4079280 msgr2=0x7f15d407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:16.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f15d4079280 0x7f15d407b740 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f15f0007b60 tx=0x7f15f0007ab0 comp rx=0 tx=0).stop 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 10 monclient: shutdown 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f160415d1e0 msgr2=0x7f160406df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f160415d1e0 0x7f160406df10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f15f800cc20 tx=0x7f15f800a430 comp rx=0 tx=0).stop 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 shutdown_connections 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f15d4079280 0x7f15d407b740 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f160415d1e0 0x7f160406df10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f16040c92b0 0x7f160406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 --2- 10.20.193.45:0/2677248783 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f16040748e0 0x7f160415c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 >> 10.20.193.45:0/2677248783 conn(0x7f16040c9d40 msgr2=0x7f16041489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:16.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 shutdown_connections 2026-02-17T21:10:16.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 -- 10.20.193.45:0/2677248783 wait complete. 2026-02-17T21:10:16.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:16.594+0000 7f160a2b9640 1 librados: shutdown 2026-02-17T21:10:19.596 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:19.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.672+0000 7fa21120e640 10 monclient: get_monmap_and_config 2026-02-17T21:10:19.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.672+0000 7fa21120e640 10 monclient: build_initial_monmap 2026-02-17T21:10:19.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.672+0000 7fa21120e640 10 monclient: monmap: 2026-02-17T21:10:19.665 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:19.665 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:19.673313+0000 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:19.673313+0000 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:19.666 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:19.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.672+0000 7fa21120e640 1 Processor -- start 2026-02-17T21:10:19.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.672+0000 7fa21120e640 1 -- start start 2026-02-17T21:10:19.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.672+0000 7fa21120e640 10 monclient: init 2026-02-17T21:10:19.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 10 monclient: _add_conns ranks=[5,4,1,2,3,0] 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fa20c152620 0x7fa20c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 10 monclient(hunting): picked mon.noname-c con 0x7fa20c152620 addr v2:10.20.193.92:3300/0 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa20c152a00 0x7fa20c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 10 monclient(hunting): picked mon.noname-b con 0x7fa20c152a00 addr v2:10.20.193.86:3300/0 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa20c0c8d90 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20c0c71a0 con 0x7fa20c0c8d90 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa20c0c7760 con 0x7fa20c152a00 2026-02-17T21:10:19.670 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa20c0c7480 con 0x7fa20c152620 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa21120e640 10 monclient(hunting): authenticate will time out at 1203.303442s 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa20ad76640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fa20c152620 0x7fa20c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.673+0000 7fa20a575640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa20c152a00 0x7fa20c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20ad76640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fa20c152620 0x7fa20c15a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:41160/0 (socket says 10.20.193.45:41160) 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20ad76640 1 -- 10.20.193.45:0/672903261 learned_addr learned my addr 10.20.193.45:0/672903261 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20a575640 10 monclient(hunting): get_auth_request con 0x7fa20c152a00 auth_method 0 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:19.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20ad76640 10 monclient(hunting): get_auth_request con 0x7fa20c152620 auth_method 0 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.674+0000 7fa20ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.675+0000 7fa20a575640 10 monclient(hunting): handle_auth_done global_id 4912 payload 274 2026-02-17T21:10:19.672 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.675+0000 7fa20a575640 1 -- 10.20.193.45:0/672903261 >> v2:10.20.193.92:3300/0 conn(0x7fa20c152620 msgr2=0x7fa20c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:19.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.675+0000 7fa20a575640 1 --2- 10.20.193.45:0/672903261 >> v2:10.20.193.92:3300/0 conn(0x7fa20c152620 0x7fa20c15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.675+0000 7fa20a575640 1 -- 10.20.193.45:0/672903261 >> v1:10.20.193.86:6789/0 conn(0x7fa20c0c8d90 legacy=0x7fa20c0c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:19.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.675+0000 7fa20a575640 10 monclient: _finish_hunting 0 2026-02-17T21:10:19.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.675+0000 7fa20a575640 1 monclient: found mon.noname-b 2026-02-17T21:10:19.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.675+0000 7fa20a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:19.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.675+0000 7fa20a575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:19.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.675+0000 7fa20a575640 1 -- 10.20.193.45:0/672903261 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c159e00 con 0x7fa20c152a00 2026-02-17T21:10:19.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.676+0000 7fa20a575640 1 --2- 10.20.193.45:0/672903261 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 0x7fa20c15ae20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa20c1563b0 tx=0x7fa1f402ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=490fc8cd325243cc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:19.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 1 -- 10.20.193.45:0/672903261 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f403c070 con 0x7fa20c152a00 2026-02-17T21:10:19.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 10 monclient: dump: 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:19.680 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 10 monclient: _finish_auth 0 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 10 monclient: _check_auth_tickets 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 1 -- 10.20.193.45:0/672903261 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f402fa50 con 0x7fa20c152a00 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 1 -- 10.20.193.45:0/672903261 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f402fe20 con 0x7fa20c152a00 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa21120e640 5 monclient: authenticate success, global_id 4912 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa21120e640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa21120e640 4 set_mon_vals no callback set 2026-02-17T21:10:19.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.678+0000 7fa209d74640 10 monclient: dump: 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:19.682 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 10 monclient: shutdown 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 -- 10.20.193.45:0/672903261 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 msgr2=0x7fa20c15ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 --2- 10.20.193.45:0/672903261 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 0x7fa20c15ae20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa20c1563b0 tx=0x7fa1f402ede0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 -- 10.20.193.45:0/672903261 shutdown_connections 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 --2- 10.20.193.45:0/672903261 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 0x7fa20c15ae20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 --2- 10.20.193.45:0/672903261 >> v2:10.20.193.92:3300/0 conn(0x7fa20c152620 0x7fa20c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 -- 10.20.193.45:0/672903261 >> 10.20.193.45:0/672903261 conn(0x7fa20c0c9d40 msgr2=0x7fa20c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 -- 10.20.193.45:0/672903261 shutdown_connections 2026-02-17T21:10:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 -- 10.20.193.45:0/672903261 wait complete. 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 10 monclient: build_initial_monmap 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 10 monclient: monmap: 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:19.684 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 librados: starting msgr at 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 librados: starting objecter 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 Processor -- start 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 -- start start 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 librados: setting wanted keys 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 1 librados: calling monclient init 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.679+0000 7fa21120e640 10 monclient: init 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa20c0c8d90 0x7fa20c156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient(hunting): picked mon.noname-a con 0x7fa20c0c8d90 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa20c152620 0x7fa20c13d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient(hunting): picked mon.noname-c con 0x7fa20c152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 0x7fa20c0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient(hunting): picked mon.noname-b con 0x7fa20c152a00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c0c7c40 con 0x7fa20c0c8d90 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c15a3c0 con 0x7fa20c152a00 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa20c0c7dc0 con 0x7fa20c152620 2026-02-17T21:10:19.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa21120e640 10 monclient(hunting): authenticate will time out at 1203.310486s 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20b577640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 0x7fa20c0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20a575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa20c152620 0x7fa20c13d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20b577640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 0x7fa20c0cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:36460/0 (socket says 10.20.193.45:36460) 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20b577640 1 -- 10.20.193.45:0/455280379 learned_addr learned my addr 10.20.193.45:0/455280379 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20b577640 10 monclient(hunting): get_auth_request con 0x7fa20c152a00 auth_method 0 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20a575640 10 monclient(hunting): get_auth_request con 0x7fa20c152620 auth_method 0 2026-02-17T21:10:19.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.680+0000 7fa20a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20ad76640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa20c0c8d90 0x7fa20c156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20ad76640 10 monclient(hunting): get_auth_request con 0x7fa20c0c8d90 auth_method 0 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:19.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.681+0000 7fa20ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 10 monclient(hunting): handle_auth_done global_id 4915 payload 824 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 1 -- 10.20.193.45:0/455280379 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa20c152620 msgr2=0x7fa20c13d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa20c152620 0x7fa20c13d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 1 -- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa20c0c8d90 msgr2=0x7fa20c156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa20c0c8d90 0x7fa20c156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 10 monclient: _finish_hunting 0 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 1 monclient: found mon.noname-b 2026-02-17T21:10:19.689 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.682+0000 7fa20b577640 1 -- 10.20.193.45:0/455280379 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20c156b90 con 0x7fa20c152a00 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.683+0000 7fa20b577640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 0x7fa20c0cbf00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b990 tx=0x7fa1fc00be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.683+0000 7fa1eb7fe640 10 client.?.objecter ms_handle_connect 0x7fa20c152a00 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.683+0000 7fa1eb7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa1eb7fe640 1 -- 10.20.193.45:0/455280379 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc006e60 con 0x7fa20c152a00 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa1eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa1eb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa1eb7fe640 10 monclient: dump: 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:19.690 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa1eb7fe640 10 monclient: _finish_auth 0 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa1eb7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:10:19.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa1eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa21120e640 5 monclient: authenticate success, global_id 4915 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa21120e640 10 monclient: _renew_subs 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa21120e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20c143a20 con 0x7fa20c152a00 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa21120e640 10 client.4915.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa21120e640 10 monclient: _renew_subs 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa21120e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20c0cb140 con 0x7fa20c152a00 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.684+0000 7fa21120e640 1 librados: init done 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa1eb7fe640 1 -- 10.20.193.45:0/455280379 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc010070 con 0x7fa20c152a00 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa1eb7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa1eb7fe640 1 -- 10.20.193.45:0/455280379 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00c990 con 0x7fa20c152a00 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa1eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa1eb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa1eb7fe640 10 monclient: dump: 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:19.693 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:19.694 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa209573640 4 set_mon_vals no callback set 2026-02-17T21:10:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa21120e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa21120e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa21120e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.685+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20c0c9170 con 0x7fa20c152a00 2026-02-17T21:10:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.696+0000 7fa1eb7fe640 1 -- 10.20.193.45:0/455280379 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fa1fc01d030 con 0x7fa20c152a00 2026-02-17T21:10:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.697+0000 7fa1eb7fe640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa1d8079280 0x7fa1d807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.697+0000 7fa20ad76640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa1d8079280 0x7fa1d807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.697+0000 7fa20ad76640 10 monclient: get_auth_request con 0x7fa1d8079280 auth_method 0 2026-02-17T21:10:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.697+0000 7fa1eb7fe640 10 client.4915.objecter ms_handle_connect 0x7fa1d8079280 2026-02-17T21:10:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.697+0000 7fa20ad76640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa1d8079280 0x7fa1d807b740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa200006dc0 tx=0x7fa200009340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.699+0000 7fa1eb7fe640 1 -- 10.20.193.45:0/455280379 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fa1fc0974c0 con 0x7fa20c152a00 2026-02-17T21:10:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.699+0000 7fa1eb7fe640 10 client.4915.objecter ms_dispatch2 0x7fa20c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.699+0000 7fa1eb7fe640 3 client.4915.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.699+0000 7fa1eb7fe640 3 client.4915.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.699+0000 7fa1eb7fe640 20 client.4915.objecter dump_active .. 0 homeless 2026-02-17T21:10:19.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.803+0000 7fa1eb7fe640 1 -- 10.20.193.45:0/455280379 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa1fc061a50 con 0x7fa20c152a00 2026-02-17T21:10:19.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.803+0000 7fa1eb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:19.796 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.803+0000 7fa1eb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:19.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.903+0000 7fa21120e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:19.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.903+0000 7fa21120e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:19.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.903+0000 7fa21120e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:19.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.903+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa20c147ef0 con 0x7fa20c152a00 2026-02-17T21:10:19.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.907+0000 7fa1eb7fe640 1 -- 10.20.193.45:0/455280379 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fa1fc065d50 con 0x7fa20c152a00 2026-02-17T21:10:19.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.907+0000 7fa1eb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:19.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.907+0000 7fa1eb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:19.899 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:19.899 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:19.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 10 librados: watch_flush enter 2026-02-17T21:10:19.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 10 librados: watch_flush exit 2026-02-17T21:10:19.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 20 client.4915.objecter shutdown clearing up homeless session... 2026-02-17T21:10:19.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 10 client.4915.objecter successfully canceled tick 2026-02-17T21:10:19.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa1d8079280 msgr2=0x7fa1d807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:19.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa1d8079280 0x7fa1d807b740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa200006dc0 tx=0x7fa200009340 comp rx=0 tx=0).stop 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 10 monclient: shutdown 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 msgr2=0x7fa20c0cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 0x7fa20c0cbf00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b990 tx=0x7fa1fc00be60 comp rx=0 tx=0).stop 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 shutdown_connections 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa1d8079280 0x7fa1d807b740 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa20c152a00 0x7fa20c0cbf00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa20c152620 0x7fa20c13d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 --2- 10.20.193.45:0/455280379 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa20c0c8d90 0x7fa20c156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 >> 10.20.193.45:0/455280379 conn(0x7fa20c0c9d40 msgr2=0x7fa20c144340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 shutdown_connections 2026-02-17T21:10:19.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 -- 10.20.193.45:0/455280379 wait complete. 2026-02-17T21:10:19.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:19.908+0000 7fa21120e640 1 librados: shutdown 2026-02-17T21:10:22.910 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:22.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.988+0000 7fdbde48f640 10 monclient: get_monmap_and_config 2026-02-17T21:10:22.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.988+0000 7fdbde48f640 10 monclient: build_initial_monmap 2026-02-17T21:10:22.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.988+0000 7fdbde48f640 10 monclient: monmap: 2026-02-17T21:10:22.981 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:22.989676+0000 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:22.989676+0000 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:22.982 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:22.983 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:22.983 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:22.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 1 Processor -- start 2026-02-17T21:10:22.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 1 -- start start 2026-02-17T21:10:22.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 10 monclient: init 2026-02-17T21:10:22.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 10 monclient: _add_conns ranks=[4,0,2,1,5,3] 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fdbd8152620 0x7fdbd815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 10 monclient(hunting): picked mon.noname-b con 0x7fdbd8152620 addr v2:10.20.193.86:3300/0 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdbd8152a00 addr v1:10.20.193.45:6789/0 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdbd80c94a0 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd80c71a0 con 0x7fdbd8152a00 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd80c7480 con 0x7fdbd80c94a0 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fdbd80c7760 con 0x7fdbd8152620 2026-02-17T21:10:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.989+0000 7fdbde48f640 10 monclient(hunting): authenticate will time out at 1206.619872s 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.990+0000 7fdbd77fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fdbd8152a00 0x7fdbd80c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58898/0 (socket says 10.20.193.45:58898) 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.990+0000 7fdbd77fe640 1 -- 10.20.193.45:0/2693056550 learned_addr learned my addr 10.20.193.45:0/2693056550 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.990+0000 7fdbd7fff640 1 --2- 10.20.193.45:0/2693056550 >> v2:10.20.193.86:3300/0 conn(0x7fdbd8152620 0x7fdbd815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.990+0000 7fdbd7fff640 10 monclient(hunting): get_auth_request con 0x7fdbd8152620 auth_method 0 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.990+0000 7fdbd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.990+0000 7fdbd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.990+0000 7fdbd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 1 -- 10.20.193.45:0/2693056550 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104568123 0 0) 0x7fdbd80c71a0 con 0x7fdbd8152a00 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 10 monclient(hunting): my global_id is 4851 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 1 -- 10.20.193.45:0/2693056550 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbbc003620 con 0x7fdbd8152a00 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 1 -- 10.20.193.45:0/2693056550 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703062795 0 0) 0x7fdbd80c7480 con 0x7fdbd80c94a0 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 10 monclient(hunting): my global_id is 4964 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.991+0000 7fdbd6ffd640 1 -- 10.20.193.45:0/2693056550 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd80c71a0 con 0x7fdbd80c94a0 2026-02-17T21:10:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.992+0000 7fdbd7fff640 10 monclient(hunting): handle_auth_done global_id 4918 payload 274 2026-02-17T21:10:22.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.992+0000 7fdbd7fff640 1 -- 10.20.193.45:0/2693056550 >> v1:10.20.193.92:6789/0 conn(0x7fdbd80c94a0 legacy=0x7fdbd80c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:22.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.992+0000 7fdbd7fff640 1 -- 10.20.193.45:0/2693056550 >> v1:10.20.193.45:6789/0 conn(0x7fdbd8152a00 legacy=0x7fdbd80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:22.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.992+0000 7fdbd7fff640 10 monclient: _finish_hunting 0 2026-02-17T21:10:22.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.992+0000 7fdbd7fff640 1 monclient: found mon.noname-b 2026-02-17T21:10:22.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.992+0000 7fdbd7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:22.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.992+0000 7fdbd7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:22.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.992+0000 7fdbd7fff640 1 -- 10.20.193.45:0/2693056550 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd8159e00 con 0x7fdbd8152620 2026-02-17T21:10:22.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.993+0000 7fdbd7fff640 1 --2- 10.20.193.45:0/2693056550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdbd8152620 0x7fdbd815a8e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40098a0 tx=0x7fdbc402ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee09b3aa45c1b371 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:22.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 1 -- 10.20.193.45:0/2693056550 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc403c070 con 0x7fdbd8152620 2026-02-17T21:10:22.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:22.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:22.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 10 monclient: dump: 2026-02-17T21:10:22.997 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:22.997 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:22.997 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:22.997 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:22.997 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 1 -- 10.20.193.45:0/2693056550 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc402fb70 con 0x7fdbd8152620 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 1 -- 10.20.193.45:0/2693056550 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4037440 con 0x7fdbd8152620 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 5 monclient: authenticate success, global_id 4918 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 4 set_mon_vals no callback set 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbd6ffd640 10 monclient: dump: 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:22.999 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 10 monclient: shutdown 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 1 -- 10.20.193.45:0/2693056550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdbd8152620 msgr2=0x7fdbd815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 1 --2- 10.20.193.45:0/2693056550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdbd8152620 0x7fdbd815a8e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40098a0 tx=0x7fdbc402ee60 comp rx=0 tx=0).stop 2026-02-17T21:10:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 1 -- 10.20.193.45:0/2693056550 shutdown_connections 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 1 --2- 10.20.193.45:0/2693056550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdbd8152620 0x7fdbd815a8e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 1 -- 10.20.193.45:0/2693056550 >> 10.20.193.45:0/2693056550 conn(0x7fdbd80c9d40 msgr2=0x7fdbd80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 1 -- 10.20.193.45:0/2693056550 shutdown_connections 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.995+0000 7fdbde48f640 1 -- 10.20.193.45:0/2693056550 wait complete. 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 10 monclient: build_initial_monmap 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 10 monclient: monmap: 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:23.001 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 1 librados: starting msgr at 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 1 librados: starting objecter 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 1 Processor -- start 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 1 -- start start 2026-02-17T21:10:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 1 librados: setting wanted keys 2026-02-17T21:10:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 1 librados: calling monclient init 2026-02-17T21:10:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 10 monclient: init 2026-02-17T21:10:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:10:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.996+0000 7fdbde48f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdbd80c94a0 0x7fdbd8153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 10 monclient(hunting): picked mon.noname-c con 0x7fdbd80c94a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdbd8152620 0x7fdbd8157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 10 monclient(hunting): picked mon.noname-a con 0x7fdbd8152620 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdbd8152a00 0x7fdbd81558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 10 monclient(hunting): picked mon.noname-b con 0x7fdbd8152a00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd815ae20 con 0x7fdbd8152620 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd815a3c0 con 0x7fdbd8152a00 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd815afa0 con 0x7fdbd80c94a0 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbde48f640 10 monclient(hunting): authenticate will time out at 1206.627031s 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdbd8152620 0x7fdbd8157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbdca05640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdbd8152a00 0x7fdbd81558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd7fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdbd80c94a0 0x7fdbd8153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdbd8152620 0x7fdbd8157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:39002/0 (socket says 10.20.193.45:39002) 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 1 -- 10.20.193.45:0/3736504856 learned_addr learned my addr 10.20.193.45:0/3736504856 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 10 monclient(hunting): get_auth_request con 0x7fdbd8152620 auth_method 0 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbdca05640 10 monclient(hunting): get_auth_request con 0x7fdbd8152a00 auth_method 0 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbdca05640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbdca05640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbdca05640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd7fff640 10 monclient(hunting): get_auth_request con 0x7fdbd80c94a0 auth_method 0 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbdca05640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbdca05640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.997+0000 7fdbdca05640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 10 monclient(hunting): handle_auth_done global_id 4967 payload 824 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 1 -- 10.20.193.45:0/3736504856 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdbd8152a00 msgr2=0x7fdbd81558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdbd8152a00 0x7fdbd81558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 1 -- 10.20.193.45:0/3736504856 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdbd8152620 msgr2=0x7fdbd8157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdbd8152620 0x7fdbd8157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 10 monclient: _finish_hunting 0 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 1 monclient: found mon.noname-c 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:22.999+0000 7fdbd7fff640 1 -- 10.20.193.45:0/3736504856 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd8154560 con 0x7fdbd80c94a0 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.000+0000 7fdbd7fff640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdbd80c94a0 0x7fdbd8153f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4036000 tx=0x7fdbc40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.000+0000 7fdbd4ff9640 10 client.?.objecter ms_handle_connect 0x7fdbd80c94a0 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.000+0000 7fdbd4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 1 -- 10.20.193.45:0/3736504856 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc403c040 con 0x7fdbd80c94a0 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:23.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 10 monclient: dump: 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 10 monclient: _finish_auth 0 2026-02-17T21:10:23.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 1 -- 10.20.193.45:0/3736504856 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc4004030 con 0x7fdbd80c94a0 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbde48f640 5 monclient: authenticate success, global_id 4967 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbde48f640 10 monclient: _renew_subs 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbde48f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd8154840 con 0x7fdbd80c94a0 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 1 -- 10.20.193.45:0/3736504856 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40043e0 con 0x7fdbd80c94a0 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd4ff9640 10 monclient: dump: 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:23.009 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbd67fc640 4 set_mon_vals no callback set 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbde48f640 10 client.4967.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.001+0000 7fdbde48f640 10 monclient: _renew_subs 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.002+0000 7fdbde48f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.002+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd8154e00 con 0x7fdbd80c94a0 2026-02-17T21:10:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.002+0000 7fdbde48f640 1 librados: init done 2026-02-17T21:10:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.002+0000 7fdbde48f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.002+0000 7fdbde48f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.002+0000 7fdbde48f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.002+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd80cd0b0 con 0x7fdbd80c94a0 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.013+0000 7fdbd4ff9640 1 -- 10.20.193.45:0/3736504856 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fdbc4053080 con 0x7fdbd80c94a0 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.014+0000 7fdbd4ff9640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdba8079280 0x7fdba807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.014+0000 7fdbd77fe640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdba8079280 0x7fdba807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.014+0000 7fdbd77fe640 10 monclient: get_auth_request con 0x7fdba8079280 auth_method 0 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.014+0000 7fdbd77fe640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdba8079280 0x7fdba807b740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8167a30 tx=0x7fdbc8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.014+0000 7fdbd4ff9640 10 client.4967.objecter ms_handle_connect 0x7fdba8079280 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.015+0000 7fdbd4ff9640 1 -- 10.20.193.45:0/3736504856 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fdbc4004580 con 0x7fdbd80c94a0 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.015+0000 7fdbd4ff9640 10 client.4967.objecter ms_dispatch2 0x7fdbd8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.015+0000 7fdbd4ff9640 3 client.4967.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.015+0000 7fdbd4ff9640 3 client.4967.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:23.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.015+0000 7fdbd4ff9640 20 client.4967.objecter dump_active .. 0 homeless 2026-02-17T21:10:23.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.114+0000 7fdbd4ff9640 1 -- 10.20.193.45:0/3736504856 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdbd80cd0b0 con 0x7fdbd80c94a0 2026-02-17T21:10:23.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.114+0000 7fdbd4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:23.107 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.114+0000 7fdbd4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:23.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.214+0000 7fdbde48f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:23.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.214+0000 7fdbde48f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:23.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.214+0000 7fdbde48f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:23.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.214+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdbd815a8e0 con 0x7fdbd80c94a0 2026-02-17T21:10:23.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.218+0000 7fdbd4ff9640 1 -- 10.20.193.45:0/3736504856 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fdbc4086e90 con 0x7fdbd80c94a0 2026-02-17T21:10:23.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.218+0000 7fdbd4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:23.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.218+0000 7fdbd4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:23.211 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:23.211 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:23.212 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 10 librados: watch_flush enter 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 10 librados: watch_flush exit 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 20 client.4967.objecter shutdown clearing up homeless session... 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 10 client.4967.objecter successfully canceled tick 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdba8079280 msgr2=0x7fdba807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdba8079280 0x7fdba807b740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8167a30 tx=0x7fdbc8009040 comp rx=0 tx=0).stop 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 10 monclient: shutdown 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdbd80c94a0 msgr2=0x7fdbd8153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdbd80c94a0 0x7fdbd8153f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4036000 tx=0x7fdbc40047c0 comp rx=0 tx=0).stop 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 shutdown_connections 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdba8079280 0x7fdba807b740 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:23.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdbd8152a00 0x7fdbd81558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:23.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdbd8152620 0x7fdbd8157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:23.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 --2- 10.20.193.45:0/3736504856 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdbd80c94a0 0x7fdbd8153f30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:23.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 >> 10.20.193.45:0/3736504856 conn(0x7fdbd80c9d40 msgr2=0x7fdbd814d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:23.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 shutdown_connections 2026-02-17T21:10:23.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 -- 10.20.193.45:0/3736504856 wait complete. 2026-02-17T21:10:23.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:23.219+0000 7fdbde48f640 1 librados: shutdown 2026-02-17T21:10:26.222 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:26.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.301+0000 7f510ec9d640 10 monclient: get_monmap_and_config 2026-02-17T21:10:26.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.301+0000 7f510ec9d640 10 monclient: build_initial_monmap 2026-02-17T21:10:26.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.301+0000 7f510ec9d640 10 monclient: monmap: 2026-02-17T21:10:26.294 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:26.294 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:26.294 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:26.302202+0000 2026-02-17T21:10:26.294 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:26.302202+0000 2026-02-17T21:10:26.294 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:26.294 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:26.294 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:26.295 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:26.295 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:26.295 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:26.295 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:26.295 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:26.295 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.301+0000 7f510ec9d640 1 Processor -- start 2026-02-17T21:10:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.301+0000 7f510ec9d640 1 -- start start 2026-02-17T21:10:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.301+0000 7f510ec9d640 10 monclient: init 2026-02-17T21:10:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 10 monclient: _add_conns ranks=[3,5,2,1,0,4] 2026-02-17T21:10:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f510815d1e0 0x7f510815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 10 monclient(hunting): picked mon.noname-a con 0x7f510815d1e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:10:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f51080748e0 0x7f51080c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 10 monclient(hunting): picked mon.noname-c con 0x7f51080748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:10:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f51080c90e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51080c9570 con 0x7f51080c90e0 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f51080c5860 con 0x7f510815d1e0 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f51080c5580 con 0x7f51080748e0 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ec9d640 10 monclient(hunting): authenticate will time out at 1209.932420s 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f510ca12640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f510815d1e0 0x7f510815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.302+0000 7f50fffff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f51080748e0 0x7f51080c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f510ca12640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f510815d1e0 0x7f510815d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:39012/0 (socket says 10.20.193.45:39012) 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f510ca12640 1 -- 10.20.193.45:0/2581120915 learned_addr learned my addr 10.20.193.45:0/2581120915 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f510ca12640 10 monclient(hunting): get_auth_request con 0x7f510815d1e0 auth_method 0 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f510ca12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f510ca12640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f510ca12640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f50fffff640 10 monclient(hunting): get_auth_request con 0x7f51080748e0 auth_method 0 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f50fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f50fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f50fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f510ca12640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f510ca12640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:26.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f510ca12640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f50fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f50fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.303+0000 7f50fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.304+0000 7f510ca12640 10 monclient(hunting): handle_auth_done global_id 4857 payload 274 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.304+0000 7f510ca12640 1 -- 10.20.193.45:0/2581120915 >> v2:10.20.193.92:3300/0 conn(0x7f51080748e0 msgr2=0x7f51080c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.304+0000 7f510ca12640 1 --2- 10.20.193.45:0/2581120915 >> v2:10.20.193.92:3300/0 conn(0x7f51080748e0 0x7f51080c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.304+0000 7f510ca12640 1 -- 10.20.193.45:0/2581120915 >> v1:10.20.193.92:6789/0 conn(0x7f51080c90e0 legacy=0x7f5108153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.304+0000 7f510ca12640 10 monclient: _finish_hunting 0 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.304+0000 7f510ca12640 1 monclient: found mon.noname-a 2026-02-17T21:10:26.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.304+0000 7f510ca12640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:26.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.304+0000 7f510ca12640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:26.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.304+0000 7f510ca12640 1 -- 10.20.193.45:0/2581120915 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080c7de0 con 0x7f510815d1e0 2026-02-17T21:10:26.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.305+0000 7f510ca12640 1 --2- 10.20.193.45:0/2581120915 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f510815d1e0 0x7f510815d5c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009970 tx=0x7f50f802eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6effa1106551ba5f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:26.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 1 -- 10.20.193.45:0/2581120915 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f803c070 con 0x7f510815d1e0 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 10 monclient: dump: 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:26.309 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 10 monclient: _finish_auth 0 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 1 -- 10.20.193.45:0/2581120915 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f802fbc0 con 0x7f510815d1e0 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f510ec9d640 5 monclient: authenticate success, global_id 4857 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f510ec9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 1 -- 10.20.193.45:0/2581120915 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8037440 con 0x7f510815d1e0 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f510ec9d640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f510ec9d640 4 set_mon_vals no callback set 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.307+0000 7f50ff7fe640 10 monclient: dump: 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:26.311 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 10 monclient: shutdown 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 -- 10.20.193.45:0/2581120915 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f510815d1e0 msgr2=0x7f510815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 --2- 10.20.193.45:0/2581120915 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f510815d1e0 0x7f510815d5c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009970 tx=0x7f50f802eef0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 -- 10.20.193.45:0/2581120915 shutdown_connections 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 --2- 10.20.193.45:0/2581120915 >> v2:10.20.193.92:3300/0 conn(0x7f51080748e0 0x7f51080c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 --2- 10.20.193.45:0/2581120915 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f510815d1e0 0x7f510815d5c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 -- 10.20.193.45:0/2581120915 >> 10.20.193.45:0/2581120915 conn(0x7f51080c9d40 msgr2=0x7f51080ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 -- 10.20.193.45:0/2581120915 shutdown_connections 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 -- 10.20.193.45:0/2581120915 wait complete. 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 10 monclient: build_initial_monmap 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 10 monclient: monmap: 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:26.313 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 librados: starting msgr at 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 librados: starting objecter 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 Processor -- start 2026-02-17T21:10:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 -- start start 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 librados: setting wanted keys 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 1 librados: calling monclient init 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.308+0000 7f510ec9d640 10 monclient: init 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f51080748e0 0x7f51080cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient(hunting): picked mon.noname-a con 0x7f51080748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51080c90e0 0x7f51080ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient(hunting): picked mon.noname-b con 0x7f51080c90e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f510815d1e0 0x7f51081f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:26.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient(hunting): picked mon.noname-c con 0x7f510815d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f51080c8680 con 0x7f51080748e0 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f51080c83a0 con 0x7f51080c90e0 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5108074d30 con 0x7f510815d1e0 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ec9d640 10 monclient(hunting): authenticate will time out at 1209.939380s 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ca12640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f51080748e0 0x7f51080cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510d213640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f510815d1e0 0x7f51081f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f50fffff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51080c90e0 0x7f51080ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ca12640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f51080748e0 0x7f51080cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:39020/0 (socket says 10.20.193.45:39020) 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ca12640 1 -- 10.20.193.45:0/2355025935 learned_addr learned my addr 10.20.193.45:0/2355025935 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ca12640 10 monclient(hunting): get_auth_request con 0x7f51080748e0 auth_method 0 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ca12640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ca12640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.309+0000 7f510ca12640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510d213640 10 monclient(hunting): get_auth_request con 0x7f510815d1e0 auth_method 0 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510d213640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510d213640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510d213640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f50fffff640 10 monclient(hunting): get_auth_request con 0x7f51080c90e0 auth_method 0 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f50fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f50fffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f50fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510ca12640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510ca12640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510ca12640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510d213640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510d213640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f510d213640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f50fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f50fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.310+0000 7f50fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 10 monclient(hunting): handle_auth_done global_id 4860 payload 824 2026-02-17T21:10:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 1 -- 10.20.193.45:0/2355025935 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f510815d1e0 msgr2=0x7f51081f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f510815d1e0 0x7f51081f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 1 -- 10.20.193.45:0/2355025935 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51080c90e0 msgr2=0x7f51080ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51080c90e0 0x7f51080ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 10 monclient: _finish_hunting 0 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 1 monclient: found mon.noname-a 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.311+0000 7f510ca12640 1 -- 10.20.193.45:0/2355025935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080cb790 con 0x7f51080748e0 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.312+0000 7f510ca12640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f51080748e0 0x7f51080cb0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009aa0 tx=0x7f50f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.312+0000 7f50fd7fa640 10 client.?.objecter ms_handle_connect 0x7f51080748e0 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.312+0000 7f50fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 1 -- 10.20.193.45:0/2355025935 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f803c040 con 0x7f51080748e0 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 10 monclient: dump: 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:26.320 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 10 monclient: _finish_auth 0 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 1 -- 10.20.193.45:0/2355025935 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8042410 con 0x7f51080748e0 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 1 -- 10.20.193.45:0/2355025935 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8042800 con 0x7f51080748e0 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50fd7fa640 10 monclient: dump: 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:26.321 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f50feffd640 4 set_mon_vals no callback set 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f510ec9d640 5 monclient: authenticate success, global_id 4860 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f510ec9d640 10 monclient: _renew_subs 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f510ec9d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51080cba70 con 0x7f51080748e0 2026-02-17T21:10:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f510ec9d640 10 client.4860.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f510ec9d640 10 monclient: _renew_subs 2026-02-17T21:10:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f510ec9d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51080cc030 con 0x7f51080748e0 2026-02-17T21:10:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.314+0000 7f510ec9d640 1 librados: init done 2026-02-17T21:10:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.315+0000 7f510ec9d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.315+0000 7f510ec9d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.315+0000 7f510ec9d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.315+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51080c8ba0 con 0x7f51080748e0 2026-02-17T21:10:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.327+0000 7f50fd7fa640 1 -- 10.20.193.45:0/2355025935 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f50f80429a0 con 0x7f51080748e0 2026-02-17T21:10:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.328+0000 7f50fd7fa640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50d8079280 0x7f50d807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.328+0000 7f50fffff640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50d8079280 0x7f50d807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.328+0000 7f50fffff640 10 monclient: get_auth_request con 0x7f50d8079280 auth_method 0 2026-02-17T21:10:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.328+0000 7f50fffff640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50d8079280 0x7f50d807b740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f51081ef360 tx=0x7f50f0009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.328+0000 7f50fd7fa640 10 client.4860.objecter ms_handle_connect 0x7f50d8079280 2026-02-17T21:10:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.331+0000 7f50fd7fa640 1 -- 10.20.193.45:0/2355025935 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f50f8083a50 con 0x7f51080748e0 2026-02-17T21:10:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.331+0000 7f50fd7fa640 10 client.4860.objecter ms_dispatch2 0x7f5108000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:26.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.331+0000 7f50fd7fa640 3 client.4860.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:26.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.331+0000 7f50fd7fa640 3 client.4860.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:26.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.331+0000 7f50fd7fa640 20 client.4860.objecter dump_active .. 0 homeless 2026-02-17T21:10:26.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.436+0000 7f50fd7fa640 1 -- 10.20.193.45:0/2355025935 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f50f8087a10 con 0x7f51080748e0 2026-02-17T21:10:26.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.436+0000 7f50fd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:26.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.436+0000 7f50fd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:26.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.536+0000 7f510ec9d640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:26.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.536+0000 7f510ec9d640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:26.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.536+0000 7f510ec9d640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:26.529 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.536+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f51080c9b20 con 0x7f51080748e0 2026-02-17T21:10:26.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.539+0000 7f50fd7fa640 1 -- 10.20.193.45:0/2355025935 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f50f808bd10 con 0x7f51080748e0 2026-02-17T21:10:26.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.539+0000 7f50fd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:26.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.539+0000 7f50fd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:26.532 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:26.532 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:26.533 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 10 librados: watch_flush enter 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 10 librados: watch_flush exit 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 20 client.4860.objecter shutdown clearing up homeless session... 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 10 client.4860.objecter successfully canceled tick 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50d8079280 msgr2=0x7f50d807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50d8079280 0x7f50d807b740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f51081ef360 tx=0x7f50f0009290 comp rx=0 tx=0).stop 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 10 monclient: shutdown 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f51080748e0 msgr2=0x7f51080cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f51080748e0 0x7f51080cb0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f50f8009aa0 tx=0x7f50f80047c0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 shutdown_connections 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f50d8079280 0x7f50d807b740 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f510815d1e0 0x7f51081f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f51080c90e0 0x7f51080ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 --2- 10.20.193.45:0/2355025935 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f51080748e0 0x7f51080cb0a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:26.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 >> 10.20.193.45:0/2355025935 conn(0x7f51080c9d40 msgr2=0x7f5108149160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:26.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 shutdown_connections 2026-02-17T21:10:26.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 -- 10.20.193.45:0/2355025935 wait complete. 2026-02-17T21:10:26.535 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:26.540+0000 7f510ec9d640 1 librados: shutdown 2026-02-17T21:10:29.543 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:29.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.622+0000 7fc16e432640 10 monclient: get_monmap_and_config 2026-02-17T21:10:29.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.622+0000 7fc16e432640 10 monclient: build_initial_monmap 2026-02-17T21:10:29.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.622+0000 7fc16e432640 10 monclient: monmap: 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:29.623709+0000 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:29.623709+0000 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:29.616 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:29.617 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:29.617 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:29.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 1 Processor -- start 2026-02-17T21:10:29.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 1 -- start start 2026-02-17T21:10:29.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient: init 2026-02-17T21:10:29.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:29.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient: _add_conns ranks=[2,3,5,1,0,4] 2026-02-17T21:10:29.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc168155d30 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:29.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc16806e290 0x7fc1680c9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:29.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient(hunting): picked mon.noname-a con 0x7fc16806e290 addr v2:10.20.193.45:3300/0 2026-02-17T21:10:29.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fc16806e6e0 0x7fc1680c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient(hunting): picked mon.noname-c con 0x7fc16806e6e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc168156110 con 0x7fc168155d30 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fc16806ec90 con 0x7fc16806e290 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc16806ef70 con 0x7fc16806e6e0 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.623+0000 7fc16e432640 10 monclient(hunting): authenticate will time out at 1213.253956s 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc16806e290 0x7fc1680c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc16806e290 0x7fc1680c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:45438/0 (socket says 10.20.193.45:45438) 2026-02-17T21:10:29.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 1 -- 10.20.193.45:0/290385280 learned_addr learned my addr 10.20.193.45:0/290385280 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 10 monclient(hunting): get_auth_request con 0x7fc16806e290 auth_method 0 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.624+0000 7fc1677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc16c9a8640 1 --2- 10.20.193.45:0/290385280 >> v2:10.20.193.92:3300/0 conn(0x7fc16806e6e0 0x7fc1680c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc16c9a8640 10 monclient(hunting): get_auth_request con 0x7fc16806e6e0 auth_method 0 2026-02-17T21:10:29.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc16c9a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc16c9a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc16c9a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc1677fe640 10 monclient(hunting): handle_auth_done global_id 4863 payload 274 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc1677fe640 1 -- 10.20.193.45:0/290385280 >> v2:10.20.193.92:3300/0 conn(0x7fc16806e6e0 msgr2=0x7fc1680c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc1677fe640 1 --2- 10.20.193.45:0/290385280 >> v2:10.20.193.92:3300/0 conn(0x7fc16806e6e0 0x7fc1680c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc1677fe640 1 -- 10.20.193.45:0/290385280 >> v1:10.20.193.92:6789/0 conn(0x7fc168155d30 legacy=0x7fc168068e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc1677fe640 10 monclient: _finish_hunting 0 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc1677fe640 1 monclient: found mon.noname-a 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc1677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc1677fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.625+0000 7fc1677fe640 1 -- 10.20.193.45:0/290385280 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1680c8d60 con 0x7fc16806e290 2026-02-17T21:10:29.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.626+0000 7fc1677fe640 1 --2- 10.20.193.45:0/290385280 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e290 0x7fc1680c9840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc1680720d0 tx=0x7fc15802efe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf26cc22bbbb98a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:29.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 1 -- 10.20.193.45:0/290385280 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15803c070 con 0x7fc16806e290 2026-02-17T21:10:29.630 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 10 monclient: dump: 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:29.631 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 10 monclient: _finish_auth 0 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 1 -- 10.20.193.45:0/290385280 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15802fcf0 con 0x7fc16806e290 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc16e432640 5 monclient: authenticate success, global_id 4863 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 1 -- 10.20.193.45:0/290385280 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158037660 con 0x7fc16806e290 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc166ffd640 10 monclient: dump: 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:29.632 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc16e432640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc16e432640 4 set_mon_vals no callback set 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc16e432640 10 monclient: shutdown 2026-02-17T21:10:29.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc16e432640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc16e432640 1 -- 10.20.193.45:0/290385280 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e290 msgr2=0x7fc1680c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.628+0000 7fc16e432640 1 --2- 10.20.193.45:0/290385280 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e290 0x7fc1680c9840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc1680720d0 tx=0x7fc15802efe0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 -- 10.20.193.45:0/290385280 shutdown_connections 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 --2- 10.20.193.45:0/290385280 >> v2:10.20.193.92:3300/0 conn(0x7fc16806e6e0 0x7fc1680c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 --2- 10.20.193.45:0/290385280 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e290 0x7fc1680c9840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 -- 10.20.193.45:0/290385280 >> 10.20.193.45:0/290385280 conn(0x7fc168074050 msgr2=0x7fc168074460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 -- 10.20.193.45:0/290385280 shutdown_connections 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 -- 10.20.193.45:0/290385280 wait complete. 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 10 monclient: build_initial_monmap 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 10 monclient: monmap: 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:29.634 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 librados: starting msgr at 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 librados: starting objecter 2026-02-17T21:10:29.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 Processor -- start 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 -- start start 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 librados: setting wanted keys 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 1 librados: calling monclient init 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.629+0000 7fc16e432640 10 monclient: init 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc16806e290 0x7fc1680caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient(hunting): picked mon.noname-b con 0x7fc16806e290 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e6e0 0x7fc16814e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient(hunting): picked mon.noname-a con 0x7fc16806e6e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:29.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc168155d30 0x7fc16814e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient(hunting): picked mon.noname-c con 0x7fc168155d30 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc16806f250 con 0x7fc16806e6e0 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1680c9320 con 0x7fc16806e290 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc16815ff70 con 0x7fc168155d30 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16e432640 10 monclient(hunting): authenticate will time out at 1213.260326s 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc1677fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e6e0 0x7fc16814e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:29.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc16c9a8640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc168155d30 0x7fc16814e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc1677fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e6e0 0x7fc16814e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:45450/0 (socket says 10.20.193.45:45450) 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc1677fe640 1 -- 10.20.193.45:0/741364535 learned_addr learned my addr 10.20.193.45:0/741364535 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc1677fe640 10 monclient(hunting): get_auth_request con 0x7fc16806e6e0 auth_method 0 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc1677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc1677fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc1677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.630+0000 7fc167fff640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc16806e290 0x7fc1680caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc167fff640 10 monclient(hunting): get_auth_request con 0x7fc16806e290 auth_method 0 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc167fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:29.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc167fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc167fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc16c9a8640 10 monclient(hunting): get_auth_request con 0x7fc168155d30 auth_method 0 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc16c9a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc16c9a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc16c9a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc1677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc1677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc1677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc16c9a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc16c9a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:29.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc16c9a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc167fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc167fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.631+0000 7fc167fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 10 monclient(hunting): handle_auth_done global_id 4982 payload 824 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 1 -- 10.20.193.45:0/741364535 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc16806e290 msgr2=0x7fc1680caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc16806e290 0x7fc1680caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 1 -- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e6e0 msgr2=0x7fc16814e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e6e0 0x7fc16814e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 10 monclient: _finish_hunting 0 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 1 monclient: found mon.noname-c 2026-02-17T21:10:29.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc16c9a8640 1 -- 10.20.193.45:0/741364535 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16814cfa0 con 0x7fc168155d30 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.632+0000 7fc1677fe640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e6e0 0x7fc16814e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.633+0000 7fc16c9a8640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc168155d30 0x7fc16814e580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc15c007d20 tx=0x7fc15c00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.633+0000 7fc164ff9640 10 client.?.objecter ms_handle_connect 0x7fc168155d30 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.633+0000 7fc164ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 1 -- 10.20.193.45:0/741364535 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00ede0 con 0x7fc168155d30 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 10 monclient: dump: 2026-02-17T21:10:29.641 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 10 monclient: _finish_auth 0 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:10:29.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 5 monclient: authenticate success, global_id 4982 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 10 monclient: _renew_subs 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16814d280 con 0x7fc168155d30 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 10 client.4982.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 10 monclient: _renew_subs 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16814d840 con 0x7fc168155d30 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 1 librados: init done 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 1 -- 10.20.193.45:0/741364535 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c003a90 con 0x7fc168155d30 2026-02-17T21:10:29.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc1667fc640 4 set_mon_vals no callback set 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 1 -- 10.20.193.45:0/741364535 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c004020 con 0x7fc168155d30 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc164ff9640 10 monclient: dump: 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:29.644 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:29.645 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:29.645 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:29.645 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:29.645 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:29.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:29.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:29.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:29.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.635+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc168068e20 con 0x7fc168155d30 2026-02-17T21:10:29.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.647+0000 7fc164ff9640 1 -- 10.20.193.45:0/741364535 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc15c0041c0 con 0x7fc168155d30 2026-02-17T21:10:29.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.648+0000 7fc164ff9640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc138079280 0x7fc13807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:29.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.648+0000 7fc167fff640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc138079280 0x7fc13807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:29.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.648+0000 7fc167fff640 10 monclient: get_auth_request con 0x7fc138079280 auth_method 0 2026-02-17T21:10:29.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.648+0000 7fc167fff640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc138079280 0x7fc13807b740 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc1540051f0 tx=0x7fc154007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:29.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.648+0000 7fc164ff9640 10 client.4982.objecter ms_handle_connect 0x7fc138079280 2026-02-17T21:10:29.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.650+0000 7fc164ff9640 1 -- 10.20.193.45:0/741364535 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fc15c098a70 con 0x7fc168155d30 2026-02-17T21:10:29.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.650+0000 7fc164ff9640 10 client.4982.objecter ms_dispatch2 0x7fc168000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:29.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.650+0000 7fc164ff9640 3 client.4982.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:29.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.650+0000 7fc164ff9640 3 client.4982.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:29.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.650+0000 7fc164ff9640 20 client.4982.objecter dump_active .. 0 homeless 2026-02-17T21:10:29.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.751+0000 7fc164ff9640 1 -- 10.20.193.45:0/741364535 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc15c062ef0 con 0x7fc168155d30 2026-02-17T21:10:29.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.751+0000 7fc164ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:29.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.751+0000 7fc164ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:29.843 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.851+0000 7fc16e432640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:29.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.851+0000 7fc16e432640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:29.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.851+0000 7fc16e432640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:29.844 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.851+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc1680ca3b0 con 0x7fc168155d30 2026-02-17T21:10:29.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc164ff9640 1 -- 10.20.193.45:0/741364535 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc15c0671f0 con 0x7fc168155d30 2026-02-17T21:10:29.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc164ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:29.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc164ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:29.847 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:29.847 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:29.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 10 librados: watch_flush enter 2026-02-17T21:10:29.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 10 librados: watch_flush exit 2026-02-17T21:10:29.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 20 client.4982.objecter shutdown clearing up homeless session... 2026-02-17T21:10:29.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 10 client.4982.objecter successfully canceled tick 2026-02-17T21:10:29.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc138079280 msgr2=0x7fc13807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:29.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc138079280 0x7fc13807b740 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc1540051f0 tx=0x7fc154007f30 comp rx=0 tx=0).stop 2026-02-17T21:10:29.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 10 monclient: shutdown 2026-02-17T21:10:29.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:29.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc168155d30 msgr2=0x7fc16814e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.854+0000 7fc16e432640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc168155d30 0x7fc16814e580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc15c007d20 tx=0x7fc15c00e4b0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.855+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 shutdown_connections 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.855+0000 7fc16e432640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc138079280 0x7fc13807b740 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.855+0000 7fc16e432640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc168155d30 0x7fc16814e580 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.855+0000 7fc16e432640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc16806e6e0 0x7fc16814e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.855+0000 7fc16e432640 1 --2- 10.20.193.45:0/741364535 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc16806e290 0x7fc1680caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.855+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 >> 10.20.193.45:0/741364535 conn(0x7fc168074050 msgr2=0x7fc1680cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.855+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 shutdown_connections 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.855+0000 7fc16e432640 1 -- 10.20.193.45:0/741364535 wait complete. 2026-02-17T21:10:29.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:29.855+0000 7fc16e432640 1 librados: shutdown 2026-02-17T21:10:30.191 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:37.404 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:30.219 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:37.432 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:30.228 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:37.441 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:30.247 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:05:37.420 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:30.248 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:05:37.421 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:30.248 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:05:37.458 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:30.249 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:05:37.459 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:30.258 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:05:37.431 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:30.259 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:05:37.469 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:32.856 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:32.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.933+0000 7f83cca0e640 10 monclient: get_monmap_and_config 2026-02-17T21:10:32.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.933+0000 7f83cca0e640 10 monclient: build_initial_monmap 2026-02-17T21:10:32.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.933+0000 7f83cca0e640 10 monclient: monmap: 2026-02-17T21:10:32.927 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:32.935392+0000 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:32.935392+0000 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:32.928 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:32.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.933+0000 7f83cca0e640 1 Processor -- start 2026-02-17T21:10:32.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.933+0000 7f83cca0e640 1 -- start start 2026-02-17T21:10:32.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.933+0000 7f83cca0e640 10 monclient: init 2026-02-17T21:10:32.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:32.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 10 monclient: _add_conns ranks=[1,5,4,3,2,0] 2026-02-17T21:10:32.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f83c80c3e40 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:32.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f83c815f8e0 0x7f83c806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:32.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 10 monclient(hunting): picked mon.noname-c con 0x7f83c815f8e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:10:32.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f83c80c92a0 0x7f83c8073060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 10 monclient(hunting): picked mon.noname-b con 0x7f83c80c92a0 addr v2:10.20.193.86:3300/0 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83c80c96d0 con 0x7f83c80c3e40 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f83c80c8e10 con 0x7f83c80c92a0 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f83c80c7c40 con 0x7f83c815f8e0 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83cca0e640 10 monclient(hunting): authenticate will time out at 1216.565527s 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.934+0000 7f83c6d76640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f83c80c92a0 0x7f83c8073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c5d74640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f83c815f8e0 0x7f83c806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c6d76640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f83c80c92a0 0x7f83c8073060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:46516/0 (socket says 10.20.193.45:46516) 2026-02-17T21:10:32.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c6d76640 1 -- 10.20.193.45:0/1231679059 learned_addr learned my addr 10.20.193.45:0/1231679059 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c6d76640 10 monclient(hunting): get_auth_request con 0x7f83c80c92a0 auth_method 0 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c5d74640 10 monclient(hunting): get_auth_request con 0x7f83c815f8e0 auth_method 0 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:32.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.935+0000 7f83c5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.936+0000 7f83c6d76640 10 monclient(hunting): handle_auth_done global_id 4930 payload 274 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.936+0000 7f83c6d76640 1 -- 10.20.193.45:0/1231679059 >> v2:10.20.193.92:3300/0 conn(0x7f83c815f8e0 msgr2=0x7f83c806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.936+0000 7f83c6d76640 1 --2- 10.20.193.45:0/1231679059 >> v2:10.20.193.92:3300/0 conn(0x7f83c815f8e0 0x7f83c806d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.936+0000 7f83c6d76640 1 -- 10.20.193.45:0/1231679059 >> v1:10.20.193.86:6789/0 conn(0x7f83c80c3e40 legacy=0x7f83c815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.936+0000 7f83c6d76640 10 monclient: _finish_hunting 0 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.936+0000 7f83c6d76640 1 monclient: found mon.noname-b 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.936+0000 7f83c6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.936+0000 7f83c6d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.936+0000 7f83c6d76640 1 -- 10.20.193.45:0/1231679059 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c80c7f20 con 0x7f83c80c92a0 2026-02-17T21:10:32.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.937+0000 7f83c6d76640 1 --2- 10.20.193.45:0/1231679059 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c92a0 0x7f83c8073060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f83c80c9c60 tx=0x7f83b802f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eff4ac6210f3c299 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:32.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 1 -- 10.20.193.45:0/1231679059 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b802fcd0 con 0x7f83c80c92a0 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 10 monclient: dump: 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:32.941 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 10 monclient: _finish_auth 0 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 10 monclient: _check_auth_tickets 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 1 -- 10.20.193.45:0/1231679059 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83b80373f0 con 0x7f83c80c92a0 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83cca0e640 5 monclient: authenticate success, global_id 4930 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83cca0e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 1 -- 10.20.193.45:0/1231679059 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b80377c0 con 0x7f83c80c92a0 2026-02-17T21:10:32.942 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83cca0e640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83cca0e640 4 set_mon_vals no callback set 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.939+0000 7f83c5573640 10 monclient: dump: 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:32.943 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 10 monclient: shutdown 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 -- 10.20.193.45:0/1231679059 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c92a0 msgr2=0x7f83c8073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 --2- 10.20.193.45:0/1231679059 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c92a0 0x7f83c8073060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f83c80c9c60 tx=0x7f83b802f270 comp rx=0 tx=0).stop 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 -- 10.20.193.45:0/1231679059 shutdown_connections 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 --2- 10.20.193.45:0/1231679059 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c92a0 0x7f83c8073060 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 --2- 10.20.193.45:0/1231679059 >> v2:10.20.193.92:3300/0 conn(0x7f83c815f8e0 0x7f83c806d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 -- 10.20.193.45:0/1231679059 >> 10.20.193.45:0/1231679059 conn(0x7f83c80c9d40 msgr2=0x7f83c80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 -- 10.20.193.45:0/1231679059 shutdown_connections 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 -- 10.20.193.45:0/1231679059 wait complete. 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 10 monclient: build_initial_monmap 2026-02-17T21:10:32.944 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 10 monclient: monmap: 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 librados: starting msgr at 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 librados: starting objecter 2026-02-17T21:10:32.945 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 Processor -- start 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 -- start start 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 librados: setting wanted keys 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 1 librados: calling monclient init 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.940+0000 7f83cca0e640 10 monclient: init 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c3e40 0x7f83c80cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient(hunting): picked mon.noname-b con 0x7f83c80c3e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f83c80c92a0 0x7f83c815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient(hunting): picked mon.noname-c con 0x7f83c80c92a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f83c815f8e0 0x7f83c815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient(hunting): picked mon.noname-a con 0x7f83c815f8e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:32.946 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f83c80c87c0 con 0x7f83c815f8e0 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f83c80c84e0 con 0x7f83c80c3e40 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f83c80c8aa0 con 0x7f83c80c92a0 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83cca0e640 10 monclient(hunting): authenticate will time out at 1216.572342s 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c3e40 0x7f83c80cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c5d74640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f83c80c92a0 0x7f83c815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c3e40 0x7f83c80cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:46520/0 (socket says 10.20.193.45:46520) 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 1 -- 10.20.193.45:0/893616141 learned_addr learned my addr 10.20.193.45:0/893616141 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:32.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 10 monclient(hunting): get_auth_request con 0x7f83c80c3e40 auth_method 0 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c5d74640 10 monclient(hunting): get_auth_request con 0x7f83c80c92a0 auth_method 0 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6d76640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f83c815f8e0 0x7f83c815e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.941+0000 7f83c6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:32.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c6d76640 10 monclient(hunting): get_auth_request con 0x7f83c815f8e0 auth_method 0 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.942+0000 7f83c6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 10 monclient(hunting): handle_auth_done global_id 4933 payload 824 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 1 -- 10.20.193.45:0/893616141 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f83c80c92a0 msgr2=0x7f83c815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f83c80c92a0 0x7f83c815e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 1 -- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f83c815f8e0 msgr2=0x7f83c815e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:32.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f83c815f8e0 0x7f83c815e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 10 monclient: _finish_hunting 0 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 1 monclient: found mon.noname-b 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.943+0000 7f83c6575640 1 -- 10.20.193.45:0/893616141 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c81f3660 con 0x7f83c80c3e40 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.944+0000 7f83c6575640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c3e40 0x7f83c80cc440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00b4d0 tx=0x7f83bc00b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.944+0000 7f83aeffd640 10 client.?.objecter ms_handle_connect 0x7f83c80c3e40 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.944+0000 7f83aeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 1 -- 10.20.193.45:0/893616141 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc004480 con 0x7f83c80c3e40 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 10 monclient: dump: 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:32.950 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 10 monclient: _finish_auth 0 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:32.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 1 -- 10.20.193.45:0/893616141 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc015070 con 0x7f83c80c3e40 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 1 -- 10.20.193.45:0/893616141 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc002920 con 0x7f83c80c3e40 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83aeffd640 10 monclient: dump: 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:32.952 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83c4d72640 4 set_mon_vals no callback set 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 5 monclient: authenticate success, global_id 4933 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 10 monclient: _renew_subs 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c81f38d0 con 0x7f83c80c3e40 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 10 client.4933.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 10 monclient: _renew_subs 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c81f3e90 con 0x7f83c80c3e40 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 1 librados: init done 2026-02-17T21:10:32.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:32.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:32.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:32.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.946+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c8070d50 con 0x7f83c80c3e40 2026-02-17T21:10:32.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.958+0000 7f83aeffd640 1 -- 10.20.193.45:0/893616141 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f83bc010480 con 0x7f83c80c3e40 2026-02-17T21:10:32.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.958+0000 7f83aeffd640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f83940792d0 0x7f839407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:32.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.958+0000 7f83c5d74640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f83940792d0 0x7f839407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:32.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.958+0000 7f83c5d74640 10 monclient: get_auth_request con 0x7f83940792d0 auth_method 0 2026-02-17T21:10:32.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.959+0000 7f83aeffd640 10 client.4933.objecter ms_handle_connect 0x7f83940792d0 2026-02-17T21:10:32.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.959+0000 7f83c5d74640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f83940792d0 0x7f839407b790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f83c81561c0 tx=0x7f83b0009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:32.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.960+0000 7f83aeffd640 1 -- 10.20.193.45:0/893616141 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f83bc05e550 con 0x7f83c80c3e40 2026-02-17T21:10:32.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.960+0000 7f83aeffd640 10 client.4933.objecter ms_dispatch2 0x7f83c8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:32.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.960+0000 7f83aeffd640 3 client.4933.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:32.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.960+0000 7f83aeffd640 3 client.4933.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:32.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:32.961+0000 7f83aeffd640 20 client.4933.objecter dump_active .. 0 homeless 2026-02-17T21:10:33.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.064+0000 7f83aeffd640 1 -- 10.20.193.45:0/893616141 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f83bc062510 con 0x7f83c80c3e40 2026-02-17T21:10:33.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.064+0000 7f83aeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:33.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.064+0000 7f83aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:33.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.162+0000 7f83cca0e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:33.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.162+0000 7f83cca0e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:33.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.162+0000 7f83cca0e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:33.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.162+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f83c815e020 con 0x7f83c80c3e40 2026-02-17T21:10:33.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83aeffd640 1 -- 10.20.193.45:0/893616141 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f83bc066810 con 0x7f83c80c3e40 2026-02-17T21:10:33.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83aeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:33.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83aeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:33.159 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:33.159 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:33.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 10 librados: watch_flush enter 2026-02-17T21:10:33.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 10 librados: watch_flush exit 2026-02-17T21:10:33.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 20 client.4933.objecter shutdown clearing up homeless session... 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 10 client.4933.objecter successfully canceled tick 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f83940792d0 msgr2=0x7f839407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f83940792d0 0x7f839407b790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f83c81561c0 tx=0x7f83b0009290 comp rx=0 tx=0).stop 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 10 monclient: shutdown 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c3e40 msgr2=0x7f83c80cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c3e40 0x7f83c80cc440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00b4d0 tx=0x7f83bc00b9a0 comp rx=0 tx=0).stop 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 shutdown_connections 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f83940792d0 0x7f839407b790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f83c815f8e0 0x7f83c815e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:33.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f83c80c92a0 0x7f83c815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:33.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 --2- 10.20.193.45:0/893616141 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f83c80c3e40 0x7f83c80cc440 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:33.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 >> 10.20.193.45:0/893616141 conn(0x7f83c80c9d40 msgr2=0x7f83c806de10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:33.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 shutdown_connections 2026-02-17T21:10:33.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 -- 10.20.193.45:0/893616141 wait complete. 2026-02-17T21:10:33.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:33.166+0000 7f83cca0e640 1 librados: shutdown 2026-02-17T21:10:36.169 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:36.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.246+0000 7f267965f640 10 monclient: get_monmap_and_config 2026-02-17T21:10:36.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.246+0000 7f267965f640 10 monclient: build_initial_monmap 2026-02-17T21:10:36.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.246+0000 7f267965f640 10 monclient: monmap: 2026-02-17T21:10:36.239 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:36.239 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:36.239 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:36.247249+0000 2026-02-17T21:10:36.239 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:36.247249+0000 2026-02-17T21:10:36.239 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:36.239 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:36.239 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:36.240 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:36.240 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:36.240 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:36.240 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:36.240 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:36.240 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:36.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.246+0000 7f267965f640 1 Processor -- start 2026-02-17T21:10:36.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.246+0000 7f267965f640 1 -- start start 2026-02-17T21:10:36.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.246+0000 7f267965f640 10 monclient: init 2026-02-17T21:10:36.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:36.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 10 monclient: _add_conns ranks=[3,2,4,1,0,5] 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f26740c3e40 0x7f267406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 10 monclient(hunting): picked mon.noname-a con 0x7f26740c3e40 addr v2:10.20.193.45:3300/0 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f26740c92a0 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f267415f8e0 0x7f2674073060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 10 monclient(hunting): picked mon.noname-b con 0x7f267415f8e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26740c96f0 con 0x7f26740c92a0 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f26740c8e10 con 0x7f26740c3e40 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f26740c7c40 con 0x7f267415f8e0 2026-02-17T21:10:36.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f267965f640 10 monclient(hunting): authenticate will time out at 1219.877490s 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f2672ffd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f26740c3e40 0x7f267406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f26727fc640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f26740c92a0 0x7f267415f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:46560/0 (socket says 10.20.193.45:46560) 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.247+0000 7f26727fc640 1 -- 10.20.193.45:0/1903813204 learned_addr learned my addr 10.20.193.45:0/1903813204 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f2672ffd640 10 monclient(hunting): get_auth_request con 0x7f26740c3e40 auth_method 0 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f2672ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f2672ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f2672ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f26737fe640 1 --2- 10.20.193.45:0/1903813204 >> v2:10.20.193.86:3300/0 conn(0x7f267415f8e0 0x7f2674073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f26737fe640 10 monclient(hunting): get_auth_request con 0x7f267415f8e0 auth_method 0 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f26737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f26737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:36.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f26737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f2672ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f2672ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f2672ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f26737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f26737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.248+0000 7f26737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2671ffb640 1 -- 10.20.193.45:0/1903813204 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234884649 0 0) 0x7f26740c96f0 con 0x7f26740c92a0 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2671ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2671ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2671ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2671ffb640 10 monclient(hunting): my global_id is 4991 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2671ffb640 1 -- 10.20.193.45:0/1903813204 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2660003620 con 0x7f26740c92a0 2026-02-17T21:10:36.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2672ffd640 10 monclient(hunting): handle_auth_done global_id 4872 payload 274 2026-02-17T21:10:36.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2672ffd640 1 -- 10.20.193.45:0/1903813204 >> v2:10.20.193.86:3300/0 conn(0x7f267415f8e0 msgr2=0x7f2674073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:36.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2672ffd640 1 --2- 10.20.193.45:0/1903813204 >> v2:10.20.193.86:3300/0 conn(0x7f267415f8e0 0x7f2674073060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2672ffd640 1 -- 10.20.193.45:0/1903813204 >> v1:10.20.193.92:6789/0 conn(0x7f26740c92a0 legacy=0x7f267415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:36.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2672ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:10:36.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2672ffd640 1 monclient: found mon.noname-a 2026-02-17T21:10:36.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2672ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:36.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2672ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:36.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.249+0000 7f2672ffd640 1 -- 10.20.193.45:0/1903813204 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26740c7f20 con 0x7f26740c3e40 2026-02-17T21:10:36.247 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.250+0000 7f2672ffd640 1 --2- 10.20.193.45:0/1903813204 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c3e40 0x7f267406d170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2674159720 tx=0x7f266802ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82b465441831090 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:36.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 1 -- 10.20.193.45:0/1903813204 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266803c070 con 0x7f26740c3e40 2026-02-17T21:10:36.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 10 monclient: dump: 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:36.254 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 10 monclient: _finish_auth 0 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 1 -- 10.20.193.45:0/1903813204 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266802faf0 con 0x7f26740c3e40 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 1 -- 10.20.193.45:0/1903813204 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2668037440 con 0x7f26740c3e40 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 5 monclient: authenticate success, global_id 4872 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 4 set_mon_vals no callback set 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:36.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f2671ffb640 10 monclient: dump: 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 10 monclient: shutdown 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:36.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 1 -- 10.20.193.45:0/1903813204 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c3e40 msgr2=0x7f267406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 1 --2- 10.20.193.45:0/1903813204 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c3e40 0x7f267406d170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2674159720 tx=0x7f266802ede0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 1 -- 10.20.193.45:0/1903813204 shutdown_connections 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 1 --2- 10.20.193.45:0/1903813204 >> v2:10.20.193.86:3300/0 conn(0x7f267415f8e0 0x7f2674073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 1 --2- 10.20.193.45:0/1903813204 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c3e40 0x7f267406d170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 1 -- 10.20.193.45:0/1903813204 >> 10.20.193.45:0/1903813204 conn(0x7f26740c9d40 msgr2=0x7f26740ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 1 -- 10.20.193.45:0/1903813204 shutdown_connections 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.252+0000 7f267965f640 1 -- 10.20.193.45:0/1903813204 wait complete. 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.253+0000 7f267965f640 10 monclient: build_initial_monmap 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.253+0000 7f267965f640 10 monclient: monmap: 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:36.257 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.253+0000 7f267965f640 1 librados: starting msgr at 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.253+0000 7f267965f640 1 librados: starting objecter 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.253+0000 7f267965f640 1 Processor -- start 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.253+0000 7f267965f640 1 -- start start 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.253+0000 7f267965f640 1 librados: setting wanted keys 2026-02-17T21:10:36.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.253+0000 7f267965f640 1 librados: calling monclient init 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.253+0000 7f267965f640 10 monclient: init 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f26740c3e40 0x7f26741f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient(hunting): picked mon.noname-b con 0x7f26740c3e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c92a0 0x7f26741f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient(hunting): picked mon.noname-a con 0x7f26740c92a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f267415f8e0 0x7f267414a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient(hunting): picked mon.noname-c con 0x7f267415f8e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f26740c87c0 con 0x7f26740c92a0 2026-02-17T21:10:36.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f26740c84e0 con 0x7f26740c3e40 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f26740c8aa0 con 0x7f267415f8e0 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f267965f640 10 monclient(hunting): authenticate will time out at 1219.884279s 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f2672ffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f26740c3e40 0x7f26741f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26737fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f267415f8e0 0x7f267414a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26727fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c92a0 0x7f26741f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f2672ffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f26740c3e40 0x7f26741f4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:46544/0 (socket says 10.20.193.45:46544) 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26727fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c92a0 0x7f26741f6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:45484/0 (socket says 10.20.193.45:45484) 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f2672ffd640 1 -- 10.20.193.45:0/254135946 learned_addr learned my addr 10.20.193.45:0/254135946 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:36.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f2672ffd640 10 monclient(hunting): get_auth_request con 0x7f26740c3e40 auth_method 0 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f2672ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f2672ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f2672ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26727fc640 10 monclient(hunting): get_auth_request con 0x7f26740c92a0 auth_method 0 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26737fe640 10 monclient(hunting): get_auth_request con 0x7f267415f8e0 auth_method 0 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.254+0000 7f26737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.255+0000 7f26727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:36.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.255+0000 7f26727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.255+0000 7f26727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.255+0000 7f26737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.255+0000 7f26737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.255+0000 7f26737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.255+0000 7f2672ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.255+0000 7f2672ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.255+0000 7f2672ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 10 monclient(hunting): handle_auth_done global_id 4875 payload 824 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 1 -- 10.20.193.45:0/254135946 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f267415f8e0 msgr2=0x7f267414a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f267415f8e0 0x7f267414a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 1 -- 10.20.193.45:0/254135946 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f26740c3e40 msgr2=0x7f26741f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f26740c3e40 0x7f26741f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 10 monclient: _finish_hunting 0 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 1 monclient: found mon.noname-a 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.256+0000 7f26727fc640 1 -- 10.20.193.45:0/254135946 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26741f4d60 con 0x7f26740c92a0 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.257+0000 7f26727fc640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c92a0 0x7f26741f6920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c500 tx=0x7f265c00c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.257+0000 7f26537fe640 10 client.?.objecter ms_handle_connect 0x7f26740c92a0 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.257+0000 7f26537fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 1 -- 10.20.193.45:0/254135946 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c017070 con 0x7f26740c92a0 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 10 monclient: dump: 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:36.263 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 10 monclient: _finish_auth 0 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 10 monclient: _check_auth_tickets 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:36.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f267965f640 5 monclient: authenticate success, global_id 4875 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 1 -- 10.20.193.45:0/254135946 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c005de0 con 0x7f26740c92a0 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 1 -- 10.20.193.45:0/254135946 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c007270 con 0x7f26740c92a0 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26717fa640 4 set_mon_vals no callback set 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f26537fe640 10 monclient: dump: 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:36.265 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f267965f640 10 monclient: _renew_subs 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f267965f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26741f7340 con 0x7f26740c92a0 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f267965f640 10 client.4875.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f267965f640 10 monclient: _renew_subs 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f267965f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26741f35a0 con 0x7f26740c92a0 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.259+0000 7f267965f640 1 librados: init done 2026-02-17T21:10:36.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.260+0000 7f267965f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:36.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.260+0000 7f267965f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:36.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.260+0000 7f267965f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:36.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.260+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2674152590 con 0x7f26740c92a0 2026-02-17T21:10:36.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.367+0000 7f26537fe640 1 -- 10.20.193.45:0/254135946 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f265c007410 con 0x7f26740c92a0 2026-02-17T21:10:36.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.368+0000 7f26537fe640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f26400792d0 0x7f264007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:36.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.368+0000 7f2672ffd640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f26400792d0 0x7f264007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:36.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.368+0000 7f2672ffd640 10 monclient: get_auth_request con 0x7f26400792d0 auth_method 0 2026-02-17T21:10:36.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.368+0000 7f2672ffd640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f26400792d0 0x7f264007b790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f266802ee20 tx=0x7f2668033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:36.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.368+0000 7f26537fe640 10 client.4875.objecter ms_handle_connect 0x7f26400792d0 2026-02-17T21:10:36.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.377+0000 7f26537fe640 1 -- 10.20.193.45:0/254135946 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f265c007730 con 0x7f26740c92a0 2026-02-17T21:10:36.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.377+0000 7f26537fe640 10 client.4875.objecter ms_dispatch2 0x7f2674000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:36.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.377+0000 7f26537fe640 3 client.4875.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:36.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.377+0000 7f26537fe640 3 client.4875.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:36.370 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.377+0000 7f26537fe640 20 client.4875.objecter dump_active .. 0 homeless 2026-02-17T21:10:36.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.377+0000 7f26537fe640 1 -- 10.20.193.45:0/254135946 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f265c022080 con 0x7f26740c92a0 2026-02-17T21:10:36.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.377+0000 7f26537fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:36.371 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.377+0000 7f26537fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:36.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.477+0000 7f267965f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:36.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.477+0000 7f267965f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:36.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.477+0000 7f267965f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:36.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.477+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26741518b0 con 0x7f26740c92a0 2026-02-17T21:10:36.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.479+0000 7f26537fe640 1 -- 10.20.193.45:0/254135946 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f265c061680 con 0x7f26740c92a0 2026-02-17T21:10:36.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.479+0000 7f26537fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:36.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.479+0000 7f26537fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:36.472 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:36.472 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 10 librados: watch_flush enter 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 10 librados: watch_flush exit 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 20 client.4875.objecter shutdown clearing up homeless session... 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 10 client.4875.objecter successfully canceled tick 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f26400792d0 msgr2=0x7f264007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f26400792d0 0x7f264007b790 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f266802ee20 tx=0x7f2668033000 comp rx=0 tx=0).stop 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 10 monclient: shutdown 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c92a0 msgr2=0x7f26741f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c92a0 0x7f26741f6920 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f265c00c500 tx=0x7f265c00c9d0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.474 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 shutdown_connections 2026-02-17T21:10:36.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f26400792d0 0x7f264007b790 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f267415f8e0 0x7f267414a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f26740c92a0 0x7f26741f6920 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 --2- 10.20.193.45:0/254135946 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f26740c3e40 0x7f26741f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:36.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 >> 10.20.193.45:0/254135946 conn(0x7f26740c9d40 msgr2=0x7f267406d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:36.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 shutdown_connections 2026-02-17T21:10:36.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 -- 10.20.193.45:0/254135946 wait complete. 2026-02-17T21:10:36.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:36.480+0000 7f267965f640 1 librados: shutdown 2026-02-17T21:10:39.484 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:39.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.562+0000 7fc092796640 10 monclient: get_monmap_and_config 2026-02-17T21:10:39.554 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.562+0000 7fc092796640 10 monclient: build_initial_monmap 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.562+0000 7fc092796640 10 monclient: monmap: 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:39.562928+0000 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:39.562928+0000 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:39.555 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:39.556 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:39.556 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:39.556 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:39.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.562+0000 7fc092796640 1 Processor -- start 2026-02-17T21:10:39.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.562+0000 7fc092796640 1 -- start start 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.562+0000 7fc092796640 10 monclient: init 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 10 monclient: _add_conns ranks=[5,2,1,0,3,4] 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fc08c155fe0 0x7fc08c0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 10 monclient(hunting): picked mon.noname-c con 0x7fc08c155fe0 addr v2:10.20.193.92:3300/0 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc08c0c98b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc08c0c9cf0 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08c0c8b60 con 0x7fc08c0c9cf0 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08c15cbb0 con 0x7fc08c0c98b0 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:39.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc08c0c9420 con 0x7fc08c155fe0 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc092796640 10 monclient(hunting): authenticate will time out at 1223.193181s 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc090d0c640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fc08c0c9cf0 0x7fc08c0ce170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:34842/0 (socket says 10.20.193.45:34842) 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc090d0c640 1 -- 10.20.193.45:0/1246940458 learned_addr learned my addr 10.20.193.45:0/1246940458 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc08bfff640 1 --2- 10.20.193.45:0/1246940458 >> v2:10.20.193.92:3300/0 conn(0x7fc08c155fe0 0x7fc08c0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc08bfff640 10 monclient(hunting): get_auth_request con 0x7fc08c155fe0 auth_method 0 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc08bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc08bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.563+0000 7fc08bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.564+0000 7fc08bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.564+0000 7fc08bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.564+0000 7fc08bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:39.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.564+0000 7fc08affd640 1 -- 10.20.193.45:0/1246940458 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039703280 0 0) 0x7fc08c0c8b60 con 0x7fc08c0c9cf0 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.564+0000 7fc08affd640 10 monclient(hunting): _negotiate 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.564+0000 7fc08affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.564+0000 7fc08affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.564+0000 7fc08affd640 10 monclient(hunting): my global_id is 4942 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.564+0000 7fc08affd640 1 -- 10.20.193.45:0/1246940458 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc070003620 con 0x7fc08c0c9cf0 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.565+0000 7fc08bfff640 10 monclient(hunting): handle_auth_done global_id 4997 payload 274 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.565+0000 7fc08bfff640 1 -- 10.20.193.45:0/1246940458 >> v1:10.20.193.92:6789/0 conn(0x7fc08c0c98b0 legacy=0x7fc08c0d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.565+0000 7fc08bfff640 1 -- 10.20.193.45:0/1246940458 >> v1:10.20.193.86:6789/0 conn(0x7fc08c0c9cf0 legacy=0x7fc08c0ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.565+0000 7fc08bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.565+0000 7fc08bfff640 1 monclient: found mon.noname-c 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.565+0000 7fc08bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:39.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.565+0000 7fc08bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:10:39.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.565+0000 7fc08bfff640 1 -- 10.20.193.45:0/1246940458 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c0d2250 con 0x7fc08c155fe0 2026-02-17T21:10:39.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.567+0000 7fc08bfff640 1 --2- 10.20.193.45:0/1246940458 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 0x7fc08c0cb550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0780098a0 tx=0x7fc07802ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83437b62f9a7a5ce server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:39.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 1 -- 10.20.193.45:0/1246940458 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07803c070 con 0x7fc08c155fe0 2026-02-17T21:10:39.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:39.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:10:39.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 10 monclient: dump: 2026-02-17T21:10:39.567 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:39.567 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:39.567 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:39.567 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 10 monclient: _finish_auth 0 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 10 monclient: _check_auth_tickets 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 1 -- 10.20.193.45:0/1246940458 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07802fc10 con 0x7fc08c155fe0 2026-02-17T21:10:39.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 5 monclient: authenticate success, global_id 4997 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 1 -- 10.20.193.45:0/1246940458 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078037440 con 0x7fc08c155fe0 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 4 set_mon_vals no callback set 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc08affd640 10 monclient: dump: 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:39.569 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 10 monclient: shutdown 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 1 -- 10.20.193.45:0/1246940458 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 msgr2=0x7fc08c0cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 1 --2- 10.20.193.45:0/1246940458 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 0x7fc08c0cb550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0780098a0 tx=0x7fc07802ef00 comp rx=0 tx=0).stop 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 1 -- 10.20.193.45:0/1246940458 shutdown_connections 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 1 --2- 10.20.193.45:0/1246940458 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 0x7fc08c0cb550 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:39.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 1 -- 10.20.193.45:0/1246940458 >> 10.20.193.45:0/1246940458 conn(0x7fc08c06d930 msgr2=0x7fc08c06dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 1 -- 10.20.193.45:0/1246940458 shutdown_connections 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.569+0000 7fc092796640 1 -- 10.20.193.45:0/1246940458 wait complete. 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient: build_initial_monmap 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient: monmap: 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:39.571 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 librados: starting msgr at 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 librados: starting objecter 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 Processor -- start 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 -- start start 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 librados: setting wanted keys 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 librados: calling monclient init 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient: init 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc08c0c98b0 0x7fc08c158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:39.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient(hunting): picked mon.noname-b con 0x7fc08c0c98b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc08c0c9cf0 0x7fc08c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient(hunting): picked mon.noname-a con 0x7fc08c0c9cf0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 0x7fc08c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient(hunting): picked mon.noname-c con 0x7fc08c155fe0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c0c90b0 con 0x7fc08c0c9cf0 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c0c8dd0 con 0x7fc08c0c98b0 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c0cc0e0 con 0x7fc08c155fe0 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.570+0000 7fc092796640 10 monclient(hunting): authenticate will time out at 1223.200957s 2026-02-17T21:10:39.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 0x7fc08c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08bfff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc08c0c98b0 0x7fc08c158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08b7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc08c0c9cf0 0x7fc08c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 0x7fc08c14bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:48120/0 (socket says 10.20.193.45:48120) 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 1 -- 10.20.193.45:0/4276671519 learned_addr learned my addr 10.20.193.45:0/4276671519 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 10 monclient(hunting): get_auth_request con 0x7fc08c155fe0 auth_method 0 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08bfff640 10 monclient(hunting): get_auth_request con 0x7fc08c0c98b0 auth_method 0 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:39.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08b7fe640 10 monclient(hunting): get_auth_request con 0x7fc08c0c9cf0 auth_method 0 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc090d0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:39.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.571+0000 7fc08bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 10 monclient(hunting): handle_auth_done global_id 5000 payload 824 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 1 -- 10.20.193.45:0/4276671519 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc08c0c98b0 msgr2=0x7fc08c158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc08c0c98b0 0x7fc08c158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 1 -- 10.20.193.45:0/4276671519 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc08c0c9cf0 msgr2=0x7fc08c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc08c0c9cf0 0x7fc08c1544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 10 monclient: _finish_hunting 0 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 1 monclient: found mon.noname-c 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:10:39.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.572+0000 7fc090d0c640 1 -- 10.20.193.45:0/4276671519 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c157990 con 0x7fc08c155fe0 2026-02-17T21:10:39.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.573+0000 7fc090d0c640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 0x7fc08c14bb50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc08000cb70 tx=0x7fc08000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:39.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.573+0000 7fc088ff9640 10 client.?.objecter ms_handle_connect 0x7fc08c155fe0 2026-02-17T21:10:39.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.573+0000 7fc088ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:39.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 1 -- 10.20.193.45:0/4276671519 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08000ad50 con 0x7fc08c155fe0 2026-02-17T21:10:39.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:39.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:10:39.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 10 monclient: dump: 2026-02-17T21:10:39.579 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:39.579 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:39.579 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:39.579 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:39.579 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 10 monclient: _finish_auth 0 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 1 -- 10.20.193.45:0/4276671519 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc080012400 con 0x7fc08c155fe0 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc092796640 5 monclient: authenticate success, global_id 5000 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc092796640 10 monclient: _renew_subs 2026-02-17T21:10:39.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc092796640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c157c70 con 0x7fc08c155fe0 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 1 -- 10.20.193.45:0/4276671519 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800127b0 con 0x7fc08c155fe0 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc088ff9640 10 monclient: dump: 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:39.581 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc08a7fc640 4 set_mon_vals no callback set 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc092796640 10 client.5000.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc092796640 10 monclient: _renew_subs 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc092796640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c158230 con 0x7fc08c155fe0 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.575+0000 7fc092796640 1 librados: init done 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.576+0000 7fc092796640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.576+0000 7fc092796640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.576+0000 7fc092796640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:39.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.576+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c0cb550 con 0x7fc08c155fe0 2026-02-17T21:10:39.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.682+0000 7fc088ff9640 1 -- 10.20.193.45:0/4276671519 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc080012950 con 0x7fc08c155fe0 2026-02-17T21:10:39.675 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.682+0000 7fc088ff9640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc05c0792d0 0x7fc05c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:39.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.682+0000 7fc08bfff640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc05c0792d0 0x7fc05c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:39.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.682+0000 7fc08bfff640 10 monclient: get_auth_request con 0x7fc05c0792d0 auth_method 0 2026-02-17T21:10:39.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.683+0000 7fc08bfff640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc05c0792d0 0x7fc05c07b790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc078039000 tx=0x7fc078033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:39.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.683+0000 7fc088ff9640 10 client.5000.objecter ms_handle_connect 0x7fc05c0792d0 2026-02-17T21:10:39.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.683+0000 7fc088ff9640 1 -- 10.20.193.45:0/4276671519 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fc08005ec40 con 0x7fc08c155fe0 2026-02-17T21:10:39.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.683+0000 7fc088ff9640 10 client.5000.objecter ms_dispatch2 0x7fc08c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:39.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.683+0000 7fc088ff9640 3 client.5000.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:39.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.683+0000 7fc088ff9640 3 client.5000.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:39.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.684+0000 7fc088ff9640 20 client.5000.objecter dump_active .. 0 homeless 2026-02-17T21:10:39.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.690+0000 7fc088ff9640 1 -- 10.20.193.45:0/4276671519 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc080012c70 con 0x7fc08c155fe0 2026-02-17T21:10:39.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.690+0000 7fc088ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:39.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.690+0000 7fc088ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:39.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.792+0000 7fc092796640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:39.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.792+0000 7fc092796640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:39.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.792+0000 7fc092796640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:39.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.792+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc08c152070 con 0x7fc08c155fe0 2026-02-17T21:10:39.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.795+0000 7fc088ff9640 1 -- 10.20.193.45:0/4276671519 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc080062c00 con 0x7fc08c155fe0 2026-02-17T21:10:39.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.795+0000 7fc088ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:39.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.795+0000 7fc088ff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:39.788 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:39.788 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:39.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.795+0000 7fc092796640 10 librados: watch_flush enter 2026-02-17T21:10:39.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 10 librados: watch_flush exit 2026-02-17T21:10:39.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 20 client.5000.objecter shutdown clearing up homeless session... 2026-02-17T21:10:39.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 10 client.5000.objecter successfully canceled tick 2026-02-17T21:10:39.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc05c0792d0 msgr2=0x7fc05c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:39.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc05c0792d0 0x7fc05c07b790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc078039000 tx=0x7fc078033000 comp rx=0 tx=0).stop 2026-02-17T21:10:39.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 10 monclient: shutdown 2026-02-17T21:10:39.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:39.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 msgr2=0x7fc08c14bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 0x7fc08c14bb50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc08000cb70 tx=0x7fc08000a430 comp rx=0 tx=0).stop 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 shutdown_connections 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc05c0792d0 0x7fc05c07b790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc08c155fe0 0x7fc08c14bb50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc08c0c9cf0 0x7fc08c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 --2- 10.20.193.45:0/4276671519 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc08c0c98b0 0x7fc08c158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 >> 10.20.193.45:0/4276671519 conn(0x7fc08c06d930 msgr2=0x7fc08c150d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 shutdown_connections 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 -- 10.20.193.45:0/4276671519 wait complete. 2026-02-17T21:10:39.791 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:39.796+0000 7fc092796640 1 librados: shutdown 2026-02-17T21:10:42.797 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:42.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.873+0000 7fdb91f80640 10 monclient: get_monmap_and_config 2026-02-17T21:10:42.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.873+0000 7fdb91f80640 10 monclient: build_initial_monmap 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.873+0000 7fdb91f80640 10 monclient: monmap: 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:42.874328+0000 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:42.874328+0000 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:42.866 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:42.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.873+0000 7fdb91f80640 1 Processor -- start 2026-02-17T21:10:42.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.873+0000 7fdb91f80640 1 -- start start 2026-02-17T21:10:42.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient: init 2026-02-17T21:10:42.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:42.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient: _add_conns ranks=[1,3,4,2,5,0] 2026-02-17T21:10:42.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fdb8c15d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:42.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fdb8c0c92b0 0x7fdb8c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient(hunting): picked mon.noname-a con 0x7fdb8c0c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fdb8c0748e0 0x7fdb8c153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient(hunting): picked mon.noname-b con 0x7fdb8c0748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8c0c5860 con 0x7fdb8c15d1e0 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fdb8c0c5580 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fdb8c0c7de0 con 0x7fdb8c0748e0 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb91f80640 10 monclient(hunting): authenticate will time out at 1226.504534s 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.874+0000 7fdb8affd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fdb8c0c92b0 0x7fdb8c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:42.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8bfff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fdb8c0748e0 0x7fdb8c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8affd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fdb8c0c92b0 0x7fdb8c15d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:40810/0 (socket says 10.20.193.45:40810) 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8affd640 1 -- 10.20.193.45:0/1646419349 learned_addr learned my addr 10.20.193.45:0/1646419349 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8affd640 10 monclient(hunting): get_auth_request con 0x7fdb8c0c92b0 auth_method 0 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8bfff640 10 monclient(hunting): get_auth_request con 0x7fdb8c0748e0 auth_method 0 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:42.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.875+0000 7fdb8affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.876+0000 7fdb8bfff640 10 monclient(hunting): handle_auth_done global_id 4948 payload 274 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.876+0000 7fdb8bfff640 1 -- 10.20.193.45:0/1646419349 >> v2:10.20.193.45:3300/0 conn(0x7fdb8c0c92b0 msgr2=0x7fdb8c15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.876+0000 7fdb8bfff640 1 --2- 10.20.193.45:0/1646419349 >> v2:10.20.193.45:3300/0 conn(0x7fdb8c0c92b0 0x7fdb8c15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.876+0000 7fdb8bfff640 1 -- 10.20.193.45:0/1646419349 >> v1:10.20.193.86:6789/0 conn(0x7fdb8c15d1e0 legacy=0x7fdb8c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:42.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.876+0000 7fdb8bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:10:42.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.876+0000 7fdb8bfff640 1 monclient: found mon.noname-b 2026-02-17T21:10:42.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.876+0000 7fdb8bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:42.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.876+0000 7fdb8bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:42.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.876+0000 7fdb8bfff640 1 -- 10.20.193.45:0/1646419349 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c0c80c0 con 0x7fdb8c0748e0 2026-02-17T21:10:42.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.877+0000 7fdb8bfff640 1 --2- 10.20.193.45:0/1646419349 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0748e0 0x7fdb8c153610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009d90 tx=0x7fdb8002f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da5a61d65e347bf8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:42.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 1 -- 10.20.193.45:0/1646419349 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8003c070 con 0x7fdb8c0748e0 2026-02-17T21:10:42.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:42.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:42.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 10 monclient: dump: 2026-02-17T21:10:42.880 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:42.880 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:42.880 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:42.880 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb91f80640 5 monclient: authenticate success, global_id 4948 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb91f80640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:42.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 1 -- 10.20.193.45:0/1646419349 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8002fe10 con 0x7fdb8c0748e0 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 1 -- 10.20.193.45:0/1646419349 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80037660 con 0x7fdb8c0748e0 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb8a7fc640 10 monclient: dump: 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:42.882 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb91f80640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb91f80640 4 set_mon_vals no callback set 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb91f80640 10 monclient: shutdown 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb91f80640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb91f80640 1 -- 10.20.193.45:0/1646419349 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0748e0 msgr2=0x7fdb8c153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.879+0000 7fdb91f80640 1 --2- 10.20.193.45:0/1646419349 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0748e0 0x7fdb8c153610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009d90 tx=0x7fdb8002f1e0 comp rx=0 tx=0).stop 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 -- 10.20.193.45:0/1646419349 shutdown_connections 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 --2- 10.20.193.45:0/1646419349 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0748e0 0x7fdb8c153610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:42.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 --2- 10.20.193.45:0/1646419349 >> v2:10.20.193.45:3300/0 conn(0x7fdb8c0c92b0 0x7fdb8c15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 -- 10.20.193.45:0/1646419349 >> 10.20.193.45:0/1646419349 conn(0x7fdb8c0c9d40 msgr2=0x7fdb8c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 -- 10.20.193.45:0/1646419349 shutdown_connections 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 -- 10.20.193.45:0/1646419349 wait complete. 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 10 monclient: build_initial_monmap 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 10 monclient: monmap: 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:42.884 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 librados: starting msgr at 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 librados: starting objecter 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 Processor -- start 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 -- start start 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 librados: setting wanted keys 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 1 librados: calling monclient init 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.880+0000 7fdb91f80640 10 monclient: init 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:42.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdb8c0748e0 0x7fdb8c1f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient(hunting): picked mon.noname-c con 0x7fdb8c0748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0c92b0 0x7fdb8c073f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient(hunting): picked mon.noname-b con 0x7fdb8c0c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdb8c15d1e0 0x7fdb8c072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient(hunting): picked mon.noname-a con 0x7fdb8c15d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c074d30 con 0x7fdb8c15d1e0 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c0c8680 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c153b50 con 0x7fdb8c0748e0 2026-02-17T21:10:42.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb91f80640 10 monclient(hunting): authenticate will time out at 1226.511204s 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8bfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdb8c15d1e0 0x7fdb8c072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0c92b0 0x7fdb8c073f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0c92b0 0x7fdb8c073f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:34098/0 (socket says 10.20.193.45:34098) 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 1 -- 10.20.193.45:0/816139572 learned_addr learned my addr 10.20.193.45:0/816139572 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 10 monclient(hunting): get_auth_request con 0x7fdb8c0c92b0 auth_method 0 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8b7fe640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdb8c0748e0 0x7fdb8c1f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:42.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8bfff640 10 monclient(hunting): get_auth_request con 0x7fdb8c15d1e0 auth_method 0 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8b7fe640 10 monclient(hunting): get_auth_request con 0x7fdb8c0748e0 auth_method 0 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.881+0000 7fdb8affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.882+0000 7fdb8bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.882+0000 7fdb8bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:42.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.882+0000 7fdb8bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.882+0000 7fdb8b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.882+0000 7fdb8b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.882+0000 7fdb8b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 10 monclient(hunting): handle_auth_done global_id 4951 payload 824 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 1 -- 10.20.193.45:0/816139572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdb8c0748e0 msgr2=0x7fdb8c1f4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdb8c0748e0 0x7fdb8c1f4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 1 -- 10.20.193.45:0/816139572 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdb8c15d1e0 msgr2=0x7fdb8c072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdb8c15d1e0 0x7fdb8c072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 10 monclient: _finish_hunting 0 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 1 monclient: found mon.noname-b 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:42.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.883+0000 7fdb8affd640 1 -- 10.20.193.45:0/816139572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c074470 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.884+0000 7fdb8affd640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0c92b0 0x7fdb8c073f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00e930 tx=0x7fdb7c00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.884+0000 7fdb67fff640 10 client.?.objecter ms_handle_connect 0x7fdb8c0c92b0 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.884+0000 7fdb67fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb67fff640 1 -- 10.20.193.45:0/816139572 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c017070 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb67fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb67fff640 10 monclient: dump: 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:42.890 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb67fff640 10 monclient: _finish_auth 0 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb67fff640 10 monclient: _check_auth_tickets 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 5 monclient: authenticate success, global_id 4951 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 10 monclient: _renew_subs 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:42.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8c0729d0 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 10 client.4951.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 10 monclient: _renew_subs 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb8c072f80 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 1 librados: init done 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.885+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb8c153f30 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.886+0000 7fdb67fff640 1 -- 10.20.193.45:0/816139572 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c005a90 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.886+0000 7fdb67fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:42.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.886+0000 7fdb67fff640 1 -- 10.20.193.45:0/816139572 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c021060 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.886+0000 7fdb67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.886+0000 7fdb67fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.886+0000 7fdb67fff640 10 monclient: dump: 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:42.893 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:42.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.886+0000 7fdb89ffb640 4 set_mon_vals no callback set 2026-02-17T21:10:42.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.995+0000 7fdb67fff640 1 -- 10.20.193.45:0/816139572 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fdb7c024060 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.995+0000 7fdb67fff640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdb5c0792b0 0x7fdb5c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:42.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.995+0000 7fdb8b7fe640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdb5c0792b0 0x7fdb5c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:42.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.995+0000 7fdb8b7fe640 10 monclient: get_auth_request con 0x7fdb5c0792b0 auth_method 0 2026-02-17T21:10:42.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.996+0000 7fdb8b7fe640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdb5c0792b0 0x7fdb5c07b770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb78004660 tx=0x7fdb78009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:42.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.996+0000 7fdb67fff640 10 client.4951.objecter ms_handle_connect 0x7fdb5c0792b0 2026-02-17T21:10:42.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.997+0000 7fdb67fff640 1 -- 10.20.193.45:0/816139572 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fdb7c097fa0 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.997+0000 7fdb67fff640 10 client.4951.objecter ms_dispatch2 0x7fdb8c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:42.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.997+0000 7fdb67fff640 3 client.4951.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:42.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.997+0000 7fdb67fff640 3 client.4951.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:42.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:42.997+0000 7fdb67fff640 20 client.4951.objecter dump_active .. 0 homeless 2026-02-17T21:10:42.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.004+0000 7fdb67fff640 1 -- 10.20.193.45:0/816139572 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdb7c062420 con 0x7fdb8c0c92b0 2026-02-17T21:10:42.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.004+0000 7fdb67fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:42.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.004+0000 7fdb67fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:43.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.103+0000 7fdb91f80640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:43.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.103+0000 7fdb91f80640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:43.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.103+0000 7fdb91f80640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:43.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.103+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdb8c15e080 con 0x7fdb8c0c92b0 2026-02-17T21:10:43.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.106+0000 7fdb67fff640 1 -- 10.20.193.45:0/816139572 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fdb7c066720 con 0x7fdb8c0c92b0 2026-02-17T21:10:43.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.106+0000 7fdb67fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:43.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.106+0000 7fdb67fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:43.099 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:43.099 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:43.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 10 librados: watch_flush enter 2026-02-17T21:10:43.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 10 librados: watch_flush exit 2026-02-17T21:10:43.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 20 client.4951.objecter shutdown clearing up homeless session... 2026-02-17T21:10:43.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 10 client.4951.objecter successfully canceled tick 2026-02-17T21:10:43.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdb5c0792b0 msgr2=0x7fdb5c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:43.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdb5c0792b0 0x7fdb5c07b770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb78004660 tx=0x7fdb78009110 comp rx=0 tx=0).stop 2026-02-17T21:10:43.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 10 monclient: shutdown 2026-02-17T21:10:43.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:43.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0c92b0 msgr2=0x7fdb8c073f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0c92b0 0x7fdb8c073f30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00e930 tx=0x7fdb7c00ee00 comp rx=0 tx=0).stop 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 shutdown_connections 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdb5c0792b0 0x7fdb5c07b770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdb8c15d1e0 0x7fdb8c072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdb8c0c92b0 0x7fdb8c073f30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 --2- 10.20.193.45:0/816139572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdb8c0748e0 0x7fdb8c1f4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 >> 10.20.193.45:0/816139572 conn(0x7fdb8c0c9d40 msgr2=0x7fdb8c1533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 shutdown_connections 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 -- 10.20.193.45:0/816139572 wait complete. 2026-02-17T21:10:43.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:43.107+0000 7fdb91f80640 1 librados: shutdown 2026-02-17T21:10:46.110 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:46.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.189+0000 7fcdfeb4f640 10 monclient: get_monmap_and_config 2026-02-17T21:10:46.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.189+0000 7fcdfeb4f640 10 monclient: build_initial_monmap 2026-02-17T21:10:46.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.189+0000 7fcdfeb4f640 10 monclient: monmap: 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:46.190368+0000 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:46.190368+0000 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.189+0000 7fcdfeb4f640 1 Processor -- start 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 1 -- start start 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 10 monclient: init 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:46.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 10 monclient: _add_conns ranks=[5,2,0,4,3,1] 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fcdf8152620 0x7fcdf815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 10 monclient(hunting): picked mon.noname-c con 0x7fcdf8152620 addr v2:10.20.193.92:3300/0 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fcdf8152a00 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcdf80c94a0 addr v1:10.20.193.45:6789/0 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf80c71a0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf80c7480 con 0x7fcdf8152a00 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf80c7760 con 0x7fcdf8152620 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.190+0000 7fcdfeb4f640 10 monclient(hunting): authenticate will time out at 1229.820570s 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfc8c4640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fcdf8152620 0x7fcdf815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfd0c5640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fcdf80c94a0 0x7fcdf80c5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:52200/0 (socket says 10.20.193.45:52200) 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfd0c5640 1 -- 10.20.193.45:0/715052254 learned_addr learned my addr 10.20.193.45:0/715052254 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfc8c4640 10 monclient(hunting): get_auth_request con 0x7fcdf8152620 auth_method 0 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfc8c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfc8c4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfc8c4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:46.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfc8c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:46.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfc8c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:46.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.191+0000 7fcdfc8c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:46.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.192+0000 7fcdef7fe640 1 -- 10.20.193.45:0/715052254 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756902689 0 0) 0x7fcdf80c71a0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.192+0000 7fcdef7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:10:46.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.192+0000 7fcdef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:46.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.192+0000 7fcdef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:46.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.192+0000 7fcdef7fe640 10 monclient(hunting): my global_id is 4887 2026-02-17T21:10:46.184 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.192+0000 7fcdef7fe640 1 -- 10.20.193.45:0/715052254 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcde4003620 con 0x7fcdf80c94a0 2026-02-17T21:10:46.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.193+0000 7fcdfc8c4640 10 monclient(hunting): handle_auth_done global_id 5006 payload 274 2026-02-17T21:10:46.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.193+0000 7fcdfc8c4640 1 -- 10.20.193.45:0/715052254 >> v1:10.20.193.92:6789/0 conn(0x7fcdf8152a00 legacy=0x7fcdf80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:46.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.193+0000 7fcdfc8c4640 1 -- 10.20.193.45:0/715052254 >> v1:10.20.193.45:6789/0 conn(0x7fcdf80c94a0 legacy=0x7fcdf80c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:46.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.193+0000 7fcdfc8c4640 10 monclient: _finish_hunting 0 2026-02-17T21:10:46.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.193+0000 7fcdfc8c4640 1 monclient: found mon.noname-c 2026-02-17T21:10:46.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.193+0000 7fcdfc8c4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:46.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.193+0000 7fcdfc8c4640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:10:46.185 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.193+0000 7fcdfc8c4640 1 -- 10.20.193.45:0/715052254 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf8159e00 con 0x7fcdf8152620 2026-02-17T21:10:46.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.195+0000 7fcdfc8c4640 1 --2- 10.20.193.45:0/715052254 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf8152620 0x7fcdf815a8e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcde80098a0 tx=0x7fcde802ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da6917786966e2db server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 1 -- 10.20.193.45:0/715052254 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde803c070 con 0x7fcdf8152620 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 10 monclient: dump: 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 10 monclient: _finish_auth 0 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 1 -- 10.20.193.45:0/715052254 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde802fb70 con 0x7fcdf8152620 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdfeb4f640 5 monclient: authenticate success, global_id 5006 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdfeb4f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 1 -- 10.20.193.45:0/715052254 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8037440 con 0x7fcdf8152620 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdfeb4f640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdfeb4f640 4 set_mon_vals no callback set 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.197+0000 7fcdef7fe640 10 monclient: dump: 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:46.190 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 10 monclient: shutdown 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/715052254 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf8152620 msgr2=0x7fcdf815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 --2- 10.20.193.45:0/715052254 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf8152620 0x7fcdf815a8e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcde80098a0 tx=0x7fcde802ee60 comp rx=0 tx=0).stop 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/715052254 shutdown_connections 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 --2- 10.20.193.45:0/715052254 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf8152620 0x7fcdf815a8e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/715052254 >> 10.20.193.45:0/715052254 conn(0x7fcdf80c9d40 msgr2=0x7fcdf80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/715052254 shutdown_connections 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/715052254 wait complete. 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 10 monclient: build_initial_monmap 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 10 monclient: monmap: 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:46.191 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 librados: starting msgr at 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 librados: starting objecter 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 Processor -- start 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 -- start start 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 librados: setting wanted keys 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 1 librados: calling monclient init 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.198+0000 7fcdfeb4f640 10 monclient: init 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf80c94a0 0x7fcdf80cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient(hunting): picked mon.noname-c con 0x7fcdf80c94a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcdf8152620 0x7fcdf80734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient(hunting): picked mon.noname-a con 0x7fcdf8152620 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcdf8152a00 0x7fcdf8145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient(hunting): picked mon.noname-b con 0x7fcdf8152a00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf815ae20 con 0x7fcdf8152620 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf815a3c0 con 0x7fcdf8152a00 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf815afa0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:46.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfeb4f640 10 monclient(hunting): authenticate will time out at 1229.829340s 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdeffff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcdf8152620 0x7fcdf80734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfc8c4640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf80c94a0 0x7fcdf80cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdeffff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcdf8152620 0x7fcdf80734f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:40816/0 (socket says 10.20.193.45:40816) 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfc8c4640 10 monclient(hunting): get_auth_request con 0x7fcdf80c94a0 auth_method 0 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdeffff640 1 -- 10.20.193.45:0/2178298794 learned_addr learned my addr 10.20.193.45:0/2178298794 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfc8c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfc8c4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfc8c4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdeffff640 10 monclient(hunting): get_auth_request con 0x7fcdf8152620 auth_method 0 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdeffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdeffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdeffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.199+0000 7fcdfd0c5640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcdf8152a00 0x7fcdf8145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfc8c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfc8c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfc8c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdeffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdeffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdeffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfd0c5640 10 monclient(hunting): get_auth_request con 0x7fcdf8152a00 auth_method 0 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfd0c5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfd0c5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfd0c5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfd0c5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfd0c5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:46.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.200+0000 7fcdfd0c5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 10 monclient(hunting): handle_auth_done global_id 5012 payload 824 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 1 -- 10.20.193.45:0/2178298794 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcdf8152a00 msgr2=0x7fcdf8145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcdf8152a00 0x7fcdf8145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 1 -- 10.20.193.45:0/2178298794 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcdf8152620 msgr2=0x7fcdf80734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcdf8152620 0x7fcdf80734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 10 monclient: _finish_hunting 0 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 1 monclient: found mon.noname-c 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.201+0000 7fcdfc8c4640 1 -- 10.20.193.45:0/2178298794 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf8072490 con 0x7fcdf80c94a0 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.202+0000 7fcdfc8c4640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf80c94a0 0x7fcdf80cca60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcde8036000 tx=0x7fcde80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:46.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.202+0000 7fcded7fa640 10 client.?.objecter ms_handle_connect 0x7fcdf80c94a0 2026-02-17T21:10:46.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.202+0000 7fcded7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:46.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 1 -- 10.20.193.45:0/2178298794 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde803c040 con 0x7fcdf80c94a0 2026-02-17T21:10:46.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:46.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:10:46.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 10 monclient: dump: 2026-02-17T21:10:46.196 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 10 monclient: _finish_auth 0 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 1 -- 10.20.193.45:0/2178298794 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde8042630 con 0x7fcdf80c94a0 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdfeb4f640 5 monclient: authenticate success, global_id 5012 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdfeb4f640 10 monclient: _renew_subs 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdfeb4f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf80ccfa0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 1 -- 10.20.193.45:0/2178298794 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde8042a20 con 0x7fcdf80c94a0 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcded7fa640 10 monclient: dump: 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdeeffd640 4 set_mon_vals no callback set 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdfeb4f640 10 client.5012.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdfeb4f640 10 monclient: _renew_subs 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdfeb4f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf8072730 con 0x7fcdf80c94a0 2026-02-17T21:10:46.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.204+0000 7fcdfeb4f640 1 librados: init done 2026-02-17T21:10:46.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.205+0000 7fcdfeb4f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:46.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.205+0000 7fcdfeb4f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:46.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.205+0000 7fcdfeb4f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:46.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.205+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf80749b0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.216+0000 7fcded7fa640 1 -- 10.20.193.45:0/2178298794 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fcde80413b0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.216+0000 7fcded7fa640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcdc80792d0 0x7fcdc807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:46.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.216+0000 7fcdeffff640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcdc80792d0 0x7fcdc807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:46.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.216+0000 7fcdeffff640 10 monclient: get_auth_request con 0x7fcdc80792d0 auth_method 0 2026-02-17T21:10:46.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.217+0000 7fcdeffff640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcdc80792d0 0x7fcdc807b790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcde0002b60 tx=0x7fcde0002af0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:46.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.217+0000 7fcded7fa640 10 client.5012.objecter ms_handle_connect 0x7fcdc80792d0 2026-02-17T21:10:46.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.218+0000 7fcded7fa640 1 -- 10.20.193.45:0/2178298794 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fcde802fab0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.218+0000 7fcded7fa640 10 client.5012.objecter ms_dispatch2 0x7fcdf8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:46.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.218+0000 7fcded7fa640 3 client.5012.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:46.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.218+0000 7fcded7fa640 3 client.5012.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:46.210 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.218+0000 7fcded7fa640 20 client.5012.objecter dump_active .. 0 homeless 2026-02-17T21:10:46.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.320+0000 7fcded7fa640 1 -- 10.20.193.45:0/2178298794 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcdf80749b0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.320+0000 7fcded7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:46.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.320+0000 7fcded7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:46.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.421+0000 7fcdfeb4f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:46.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.421+0000 7fcdfeb4f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:46.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.421+0000 7fcdfeb4f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:46.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.421+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcdf815a8e0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.424+0000 7fcded7fa640 1 -- 10.20.193.45:0/2178298794 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fcde80872d0 con 0x7fcdf80c94a0 2026-02-17T21:10:46.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.424+0000 7fcded7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:46.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.424+0000 7fcded7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:46.417 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:46.417 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:46.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 10 librados: watch_flush enter 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 10 librados: watch_flush exit 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 20 client.5012.objecter shutdown clearing up homeless session... 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 10 client.5012.objecter successfully canceled tick 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcdc80792d0 msgr2=0x7fcdc807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcdc80792d0 0x7fcdc807b790 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcde0002b60 tx=0x7fcde0002af0 comp rx=0 tx=0).stop 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 10 monclient: shutdown 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf80c94a0 msgr2=0x7fcdf80cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf80c94a0 0x7fcdf80cca60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcde8036000 tx=0x7fcde80047c0 comp rx=0 tx=0).stop 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 shutdown_connections 2026-02-17T21:10:46.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fcdc80792d0 0x7fcdc807b790 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:46.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fcdf8152a00 0x7fcdf8145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:46.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fcdf8152620 0x7fcdf80734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:46.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 --2- 10.20.193.45:0/2178298794 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcdf80c94a0 0x7fcdf80cca60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:46.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 >> 10.20.193.45:0/2178298794 conn(0x7fcdf80c9d40 msgr2=0x7fcdf80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:46.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 shutdown_connections 2026-02-17T21:10:46.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 -- 10.20.193.45:0/2178298794 wait complete. 2026-02-17T21:10:46.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:46.425+0000 7fcdfeb4f640 1 librados: shutdown 2026-02-17T21:10:49.427 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:49.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.503+0000 7f45df27c640 10 monclient: get_monmap_and_config 2026-02-17T21:10:49.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.503+0000 7f45df27c640 10 monclient: build_initial_monmap 2026-02-17T21:10:49.495 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.503+0000 7f45df27c640 10 monclient: monmap: 2026-02-17T21:10:49.495 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:49.495 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:49.495 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:49.503968+0000 2026-02-17T21:10:49.495 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:49.503968+0000 2026-02-17T21:10:49.495 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:49.495 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:49.496 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:49.496 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:49.496 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:49.496 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:49.496 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:49.496 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:49.496 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:49.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.503+0000 7f45df27c640 1 Processor -- start 2026-02-17T21:10:49.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.503+0000 7f45df27c640 1 -- start start 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.503+0000 7f45df27c640 10 monclient: init 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 10 monclient: _add_conns ranks=[2,1,0,3,4,5] 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f45d815d1e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f45d80c92b0 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f45d8153d20 addr v1:10.20.193.45:6789/0 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d80c5860 con 0x7f45d8153d20 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d80c5580 con 0x7f45d80c92b0 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d80c7de0 con 0x7f45d815d1e0 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45df27c640 10 monclient(hunting): authenticate will time out at 1233.134192s 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45dd7f2640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f45d8153d20 0x7f45d80c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58614/0 (socket says 10.20.193.45:58614) 2026-02-17T21:10:49.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.504+0000 7f45dd7f2640 1 -- 10.20.193.45:0/4123251652 learned_addr learned my addr 10.20.193.45:0/4123251652 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:49.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.505+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272379248 0 0) 0x7f45d80c5860 con 0x7f45d8153d20 2026-02-17T21:10:49.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:10:49.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:49.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:49.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): my global_id is 4893 2026-02-17T21:10:49.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45c4003620 con 0x7f45d8153d20 2026-02-17T21:10:49.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017739624 0 0) 0x7f45d80c5580 con 0x7f45d80c92b0 2026-02-17T21:10:49.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): my global_id is 4957 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45d80c5860 con 0x7f45d80c92b0 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712889897 0 0) 0x7f45d80c7de0 con 0x7f45d815d1e0 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 10 monclient(hunting): my global_id is 5015 2026-02-17T21:10:49.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.506+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45d80c5580 con 0x7f45d815d1e0 2026-02-17T21:10:49.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 <== mon.0 v1:10.20.193.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 285825890 0 0) 0x7f45c4003620 con 0x7f45d8153d20 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 >> v1:10.20.193.92:6789/0 conn(0x7f45d815d1e0 legacy=0x7f45d80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 >> v1:10.20.193.86:6789/0 conn(0x7f45d80c92b0 legacy=0x7f45d8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 1 monclient: found mon.noname-a-legacy 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.45:6789/0 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 --> v1:10.20.193.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d80c80c0 con 0x7f45d8153d20 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 <== mon.0 v1:10.20.193.45:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f45d4003280 con 0x7f45d8153d20 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.507+0000 7f45cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient: dump: 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:49.501 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] but i'm connected to v1:10.20.193.45:6789/0, reconnecting 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 >> v1:10.20.193.45:6789/0 conn(0x7f45d8153d20 legacy=0x7f45d80c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4005040 0x7f45c40038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient(hunting): picked mon.a con 0x7f45c4005040 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f45c4003de0 0x7f45c4004260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient(hunting): picked mon.c con 0x7f45c4003de0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45c4009ab0 0x7f45c400bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient(hunting): picked mon.b con 0x7f45c4009ab0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f45c400c570 con 0x7f45c4005040 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f45c400c6f0 con 0x7f45c4009ab0 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45c400c8f0 con 0x7f45c4003de0 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45cf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:10:49.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45dcff1640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4005040 0x7f45c40038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:49.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.508+0000 7f45dd7f2640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45c4009ab0 0x7f45c400bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dd7f2640 10 monclient(hunting): get_auth_request con 0x7f45c4009ab0 auth_method 0 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dd7f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dd7f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dd7f2640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45cffff640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f45c4003de0 0x7f45c4004260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dd7f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dd7f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dd7f2640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45cffff640 10 monclient(hunting): get_auth_request con 0x7f45c4003de0 auth_method 0 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45cffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45cffff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dcff1640 10 monclient(hunting): get_auth_request con 0x7f45c4005040 auth_method 0 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dcff1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dcff1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dcff1640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45cffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dcff1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dcff1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:49.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.509+0000 7f45dcff1640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 10 monclient(hunting): handle_auth_done global_id 4893 payload 293 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 1 -- 10.20.193.45:0/4123251652 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f45c4003de0 msgr2=0x7f45c4004260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f45c4003de0 0x7f45c4004260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 1 -- 10.20.193.45:0/4123251652 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4005040 msgr2=0x7f45c40038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4005040 0x7f45c40038a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 10 monclient: _finish_hunting 0 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 1 monclient: found mon.b 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 1 -- 10.20.193.45:0/4123251652 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c4003620 con 0x7f45c4009ab0 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 10 monclient: _finish_auth 0 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 10 monclient: _check_auth_tickets 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45df27c640 5 monclient: authenticate success, global_id 4893 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45df27c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.510+0000 7f45dd7f2640 1 -- 10.20.193.45:0/4123251652 reap_dead start 2026-02-17T21:10:49.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.511+0000 7f45dd7f2640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45c4009ab0 0x7f45c400bea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f45d400a770 tx=0x7f45d402fb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a058369e7d755555 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:49.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d4037020 con 0x7f45c4009ab0 2026-02-17T21:10:49.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:49.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:49.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 10 monclient: dump: 2026-02-17T21:10:49.506 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:49.506 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:49.506 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.506 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45d4033620 con 0x7f45c4009ab0 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 1 -- 10.20.193.45:0/4123251652 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d400a390 con 0x7f45c4009ab0 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45cf7fe640 10 monclient: dump: 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 4 set_mon_vals no callback set 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 10 monclient: shutdown 2026-02-17T21:10:49.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 1 -- 10.20.193.45:0/4123251652 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45c4009ab0 msgr2=0x7f45c400bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45c4009ab0 0x7f45c400bea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f45d400a770 tx=0x7f45d402fb10 comp rx=0 tx=0).stop 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 1 -- 10.20.193.45:0/4123251652 shutdown_connections 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 1 --2- 10.20.193.45:0/4123251652 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45c4009ab0 0x7f45c400bea0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 1 -- 10.20.193.45:0/4123251652 >> 10.20.193.45:0/4123251652 conn(0x7f45d80c9d40 msgr2=0x7f45d80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 1 -- 10.20.193.45:0/4123251652 shutdown_connections 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.513+0000 7f45df27c640 1 -- 10.20.193.45:0/4123251652 wait complete. 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient: build_initial_monmap 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient: monmap: 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 librados: starting msgr at 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 librados: starting objecter 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 Processor -- start 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 -- start start 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 librados: setting wanted keys 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 librados: calling monclient init 2026-02-17T21:10:49.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient: init 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4009ab0 0x7f45d81f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient(hunting): picked mon.noname-a con 0x7f45c4009ab0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45d80743e0 0x7f45d81486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient(hunting): picked mon.noname-b con 0x7f45d80743e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f45d80cc220 0x7f45d80cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient(hunting): picked mon.noname-c con 0x7f45d80cc220 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f45d815d5c0 con 0x7f45c4009ab0 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f45d80c8680 con 0x7f45d80743e0 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45d815d740 con 0x7f45d80cc220 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45df27c640 10 monclient(hunting): authenticate will time out at 1233.144768s 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.514+0000 7f45dcff1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4009ab0 0x7f45d81f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45cffff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45d80743e0 0x7f45d81486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dcff1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4009ab0 0x7f45d81f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:55606/0 (socket says 10.20.193.45:55606) 2026-02-17T21:10:49.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dcff1640 1 -- 10.20.193.45:0/2100758123 learned_addr learned my addr 10.20.193.45:0/2100758123 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dcff1640 10 monclient(hunting): get_auth_request con 0x7f45c4009ab0 auth_method 0 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dcff1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dcff1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dcff1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45cffff640 10 monclient(hunting): get_auth_request con 0x7f45d80743e0 auth_method 0 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45cffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dd7f2640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f45d80cc220 0x7f45d80cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dcff1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dcff1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dcff1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dd7f2640 10 monclient(hunting): get_auth_request con 0x7f45d80cc220 auth_method 0 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dd7f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dd7f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dd7f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dd7f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dd7f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.515+0000 7f45dd7f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 10 monclient(hunting): handle_auth_done global_id 4896 payload 824 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 1 -- 10.20.193.45:0/2100758123 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f45d80cc220 msgr2=0x7f45d80cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f45d80cc220 0x7f45d80cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 1 -- 10.20.193.45:0/2100758123 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45d80743e0 msgr2=0x7f45d81486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45d80743e0 0x7f45d81486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 10 monclient: _finish_hunting 0 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 1 monclient: found mon.noname-a 2026-02-17T21:10:49.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:49.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:49.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.516+0000 7f45dcff1640 1 -- 10.20.193.45:0/2100758123 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d80ccbe0 con 0x7f45c4009ab0 2026-02-17T21:10:49.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.517+0000 7f45dcff1640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4009ab0 0x7f45d81f4d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45c800ebc0 tx=0x7f45c800c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:49.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.517+0000 7f45cd7fa640 10 client.?.objecter ms_handle_connect 0x7f45c4009ab0 2026-02-17T21:10:49.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.517+0000 7f45cd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:49.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 1 -- 10.20.193.45:0/2100758123 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c800cad0 con 0x7f45c4009ab0 2026-02-17T21:10:49.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:49.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 10 monclient: dump: 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 10 monclient: _finish_auth 0 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 1 -- 10.20.193.45:0/2100758123 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c801a070 con 0x7f45c4009ab0 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45df27c640 5 monclient: authenticate success, global_id 4896 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45df27c640 10 monclient: _renew_subs 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45df27c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d8072d80 con 0x7f45c4009ab0 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 1 -- 10.20.193.45:0/2100758123 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8015430 con 0x7f45c4009ab0 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45cd7fa640 10 monclient: dump: 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:49.513 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45ceffd640 4 set_mon_vals no callback set 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45df27c640 10 client.4896.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45df27c640 10 monclient: _renew_subs 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45df27c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d8073340 con 0x7f45c4009ab0 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.519+0000 7f45df27c640 1 librados: init done 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.520+0000 7f45df27c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.520+0000 7f45df27c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.520+0000 7f45df27c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:49.514 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.520+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d80748e0 con 0x7f45c4009ab0 2026-02-17T21:10:49.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.531+0000 7f45cd7fa640 1 -- 10.20.193.45:0/2100758123 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f45c8014070 con 0x7f45c4009ab0 2026-02-17T21:10:49.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.532+0000 7f45cd7fa640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f45a80792d0 0x7f45a807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:49.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.532+0000 7f45cffff640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f45a80792d0 0x7f45a807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:49.524 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.532+0000 7f45cffff640 10 monclient: get_auth_request con 0x7f45a80792d0 auth_method 0 2026-02-17T21:10:49.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.532+0000 7f45cffff640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f45a80792d0 0x7f45a807b790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45c0002910 tx=0x7f45c0007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:49.525 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.532+0000 7f45cd7fa640 10 client.4896.objecter ms_handle_connect 0x7f45a80792d0 2026-02-17T21:10:49.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.534+0000 7f45cd7fa640 1 -- 10.20.193.45:0/2100758123 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f45c805eba0 con 0x7f45c4009ab0 2026-02-17T21:10:49.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.534+0000 7f45cd7fa640 10 client.4896.objecter ms_dispatch2 0x7f45d8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:49.526 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.534+0000 7f45cd7fa640 3 client.4896.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:49.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.534+0000 7f45cd7fa640 3 client.4896.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:49.527 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.534+0000 7f45cd7fa640 20 client.4896.objecter dump_active .. 0 homeless 2026-02-17T21:10:49.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.638+0000 7f45cd7fa640 1 -- 10.20.193.45:0/2100758123 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f45c8063260 con 0x7f45c4009ab0 2026-02-17T21:10:49.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.638+0000 7f45cd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:49.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.638+0000 7f45cd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:49.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.737+0000 7f45df27c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:49.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.737+0000 7f45df27c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:49.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.737+0000 7f45df27c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:49.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.737+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f45d80c9b20 con 0x7f45c4009ab0 2026-02-17T21:10:49.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.740+0000 7f45cd7fa640 1 -- 10.20.193.45:0/2100758123 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f45c8062b60 con 0x7f45c4009ab0 2026-02-17T21:10:49.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.740+0000 7f45cd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:49.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.740+0000 7f45cd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:49.733 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:49.733 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 10 librados: watch_flush enter 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 10 librados: watch_flush exit 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 20 client.4896.objecter shutdown clearing up homeless session... 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 10 client.4896.objecter successfully canceled tick 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f45a80792d0 msgr2=0x7f45a807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f45a80792d0 0x7f45a807b790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f45c0002910 tx=0x7f45c0007dc0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 10 monclient: shutdown 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4009ab0 msgr2=0x7f45d81f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:49.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4009ab0 0x7f45d81f4d30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45c800ebc0 tx=0x7f45c800c4b0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 shutdown_connections 2026-02-17T21:10:49.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f45a80792d0 0x7f45a807b790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f45d80cc220 0x7f45d80cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f45d80743e0 0x7f45d81486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 --2- 10.20.193.45:0/2100758123 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f45c4009ab0 0x7f45d81f4d30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:49.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 >> 10.20.193.45:0/2100758123 conn(0x7f45d80c9d40 msgr2=0x7f45d81533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:49.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 shutdown_connections 2026-02-17T21:10:49.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 -- 10.20.193.45:0/2100758123 wait complete. 2026-02-17T21:10:49.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:49.741+0000 7f45df27c640 1 librados: shutdown 2026-02-17T21:10:50.243 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:57.456 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:50.245 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:57.458 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:50.252 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:05:57.465 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:50.272 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:05:57.445 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:50.273 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:05:57.482 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:50.273 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:05:57.483 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:50.274 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:05:57.446 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:50.282 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:05:57.492 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:50.282 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:05:57.454 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:10:52.743 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:52.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.818+0000 7f4866245640 10 monclient: get_monmap_and_config 2026-02-17T21:10:52.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.818+0000 7f4866245640 10 monclient: build_initial_monmap 2026-02-17T21:10:52.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.818+0000 7f4866245640 10 monclient: monmap: 2026-02-17T21:10:52.811 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:52.811 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:52.811 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:52.819433+0000 2026-02-17T21:10:52.811 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:52.819433+0000 2026-02-17T21:10:52.811 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:52.812 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:52.812 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:52.812 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:52.812 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:52.812 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:52.812 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:52.812 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:52.812 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:52.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 1 Processor -- start 2026-02-17T21:10:52.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 1 -- start start 2026-02-17T21:10:52.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient: init 2026-02-17T21:10:52.815 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient: _add_conns ranks=[0,4,5,1,2,3] 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f486015d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f48600c92b0 0x7f486015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient(hunting): picked mon.noname-b con 0x7f48600c92b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f48600748e0 0x7f4860153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient(hunting): picked mon.noname-c con 0x7f48600748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48600c5860 con 0x7f486015d1e0 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f48600c5580 con 0x7f48600c92b0 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f48600c7de0 con 0x7f48600748e0 2026-02-17T21:10:52.816 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.819+0000 7f4866245640 10 monclient(hunting): authenticate will time out at 1236.449647s 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485ffff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f48600748e0 0x7f4860153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485f7fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f486015d1e0 0x7f48600c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:58626/0 (socket says 10.20.193.45:58626) 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485f7fe640 1 -- 10.20.193.45:0/3599810387 learned_addr learned my addr 10.20.193.45:0/3599810387 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485effd640 1 --2- 10.20.193.45:0/3599810387 >> v2:10.20.193.86:3300/0 conn(0x7f48600c92b0 0x7f486015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485ffff640 10 monclient(hunting): get_auth_request con 0x7f48600748e0 auth_method 0 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485effd640 10 monclient(hunting): get_auth_request con 0x7f48600c92b0 auth_method 0 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:52.817 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.820+0000 7f485effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485e7fc640 1 -- 10.20.193.45:0/3599810387 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1908078689 0 0) 0x7f48600c5860 con 0x7f486015d1e0 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485e7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485e7fc640 10 monclient(hunting): my global_id is 4899 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485e7fc640 1 -- 10.20.193.45:0/3599810387 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4844003620 con 0x7f486015d1e0 2026-02-17T21:10:52.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485ffff640 10 monclient(hunting): handle_auth_done global_id 5021 payload 274 2026-02-17T21:10:52.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485ffff640 1 -- 10.20.193.45:0/3599810387 >> v2:10.20.193.86:3300/0 conn(0x7f48600c92b0 msgr2=0x7f486015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:52.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485ffff640 1 --2- 10.20.193.45:0/3599810387 >> v2:10.20.193.86:3300/0 conn(0x7f48600c92b0 0x7f486015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:52.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485ffff640 1 -- 10.20.193.45:0/3599810387 >> v1:10.20.193.45:6789/0 conn(0x7f486015d1e0 legacy=0x7f48600c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:52.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:10:52.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485ffff640 1 monclient: found mon.noname-c 2026-02-17T21:10:52.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:52.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:10:52.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.821+0000 7f485ffff640 1 -- 10.20.193.45:0/3599810387 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48600c80c0 con 0x7f48600748e0 2026-02-17T21:10:52.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.822+0000 7f485ffff640 1 --2- 10.20.193.45:0/3599810387 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 0x7f4860153610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4854009d90 tx=0x7f485402f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39840972b101528a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:52.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 1 -- 10.20.193.45:0/3599810387 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485403c070 con 0x7f48600748e0 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 10 monclient: dump: 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:52.826 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 1 -- 10.20.193.45:0/3599810387 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4854037440 con 0x7f48600748e0 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f4866245640 5 monclient: authenticate success, global_id 5021 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f4866245640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 1 -- 10.20.193.45:0/3599810387 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854037810 con 0x7f48600748e0 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:52.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f485e7fc640 10 monclient: dump: 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:52.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f4866245640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.824+0000 7f4866245640 4 set_mon_vals no callback set 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 10 monclient: shutdown 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 -- 10.20.193.45:0/3599810387 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 msgr2=0x7f4860153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 --2- 10.20.193.45:0/3599810387 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 0x7f4860153610 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4854009d90 tx=0x7f485402f1e0 comp rx=0 tx=0).stop 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 -- 10.20.193.45:0/3599810387 shutdown_connections 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 --2- 10.20.193.45:0/3599810387 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 0x7f4860153610 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 --2- 10.20.193.45:0/3599810387 >> v2:10.20.193.86:3300/0 conn(0x7f48600c92b0 0x7f486015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 -- 10.20.193.45:0/3599810387 >> 10.20.193.45:0/3599810387 conn(0x7f48600c9d40 msgr2=0x7f48600ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 -- 10.20.193.45:0/3599810387 shutdown_connections 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 -- 10.20.193.45:0/3599810387 wait complete. 2026-02-17T21:10:52.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 10 monclient: build_initial_monmap 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 10 monclient: monmap: 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:52.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 librados: starting msgr at 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.825+0000 7f4866245640 1 librados: starting objecter 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 Processor -- start 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 -- start start 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 librados: setting wanted keys 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 librados: calling monclient init 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient: init 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 0x7f48601f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient(hunting): picked mon.noname-c con 0x7f48600748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f48600c92b0 0x7f4860156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient(hunting): picked mon.noname-a con 0x7f48600c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:52.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f486015d1e0 0x7f48601569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient(hunting): picked mon.noname-b con 0x7f486015d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4860074d30 con 0x7f48600c92b0 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f48600c8680 con 0x7f486015d1e0 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4860153b50 con 0x7f48600748e0 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f4866245640 10 monclient(hunting): authenticate will time out at 1236.456482s 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f485effd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f48600c92b0 0x7f4860156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f485ffff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f486015d1e0 0x7f48601569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:52.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f485f7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 0x7f48601f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f485effd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f48600c92b0 0x7f4860156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:55614/0 (socket says 10.20.193.45:55614) 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.826+0000 7f485effd640 1 -- 10.20.193.45:0/2144270396 learned_addr learned my addr 10.20.193.45:0/2144270396 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485effd640 10 monclient(hunting): get_auth_request con 0x7f48600c92b0 auth_method 0 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485f7fe640 10 monclient(hunting): get_auth_request con 0x7f48600748e0 auth_method 0 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485ffff640 10 monclient(hunting): get_auth_request con 0x7f486015d1e0 auth_method 0 2026-02-17T21:10:52.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.827+0000 7f485f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:52.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 10 monclient(hunting): handle_auth_done global_id 5024 payload 824 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 1 -- 10.20.193.45:0/2144270396 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f486015d1e0 msgr2=0x7f48601569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f486015d1e0 0x7f48601569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 1 -- 10.20.193.45:0/2144270396 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f48600c92b0 msgr2=0x7f4860156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f48600c92b0 0x7f4860156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 1 monclient: found mon.noname-c 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.828+0000 7f485f7fe640 1 -- 10.20.193.45:0/2144270396 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48601559f0 con 0x7f48600748e0 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.829+0000 7f485f7fe640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 0x7f48601f4280 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f484c00c450 tx=0x7f484c00c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.829+0000 7f483bfff640 10 client.?.objecter ms_handle_connect 0x7f48600748e0 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.829+0000 7f483bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:52.835 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 1 -- 10.20.193.45:0/2144270396 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c017070 con 0x7f48600748e0 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 10 monclient: dump: 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:52.836 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 10 monclient: _finish_auth 0 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 5 monclient: authenticate success, global_id 5024 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 10 monclient: _renew_subs 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48601550f0 con 0x7f48600748e0 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 10 client.5024.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 10 monclient: _renew_subs 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48601556b0 con 0x7f48600748e0 2026-02-17T21:10:52.837 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 1 librados: init done 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 1 -- 10.20.193.45:0/2144270396 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c005de0 con 0x7f48600748e0 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 1 -- 10.20.193.45:0/2144270396 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c021060 con 0x7f48600748e0 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f483bfff640 10 monclient: dump: 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:52.838 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:52.839 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:52.839 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:52.839 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:52.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f485dffb640 4 set_mon_vals no callback set 2026-02-17T21:10:52.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:52.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:52.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:52.839 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.831+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f486015e0c0 con 0x7f48600748e0 2026-02-17T21:10:52.840 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.842+0000 7f483bfff640 1 -- 10.20.193.45:0/2144270396 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f484c024080 con 0x7f48600748e0 2026-02-17T21:10:52.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.843+0000 7f483bfff640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f48300792b0 0x7f483007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:52.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.843+0000 7f485effd640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f48300792b0 0x7f483007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:52.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.843+0000 7f485effd640 10 monclient: get_auth_request con 0x7f48300792b0 auth_method 0 2026-02-17T21:10:52.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.843+0000 7f485effd640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f48300792b0 0x7f483007b770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f48601f1bd0 tx=0x7f4850009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:52.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.843+0000 7f483bfff640 10 client.5024.objecter ms_handle_connect 0x7f48300792b0 2026-02-17T21:10:52.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.844+0000 7f483bfff640 1 -- 10.20.193.45:0/2144270396 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f484c05d7b0 con 0x7f48600748e0 2026-02-17T21:10:52.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.844+0000 7f483bfff640 10 client.5024.objecter ms_dispatch2 0x7f4860000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:52.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.845+0000 7f483bfff640 3 client.5024.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:52.841 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.845+0000 7f483bfff640 3 client.5024.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:52.842 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.845+0000 7f483bfff640 20 client.5024.objecter dump_active .. 0 homeless 2026-02-17T21:10:52.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.948+0000 7f483bfff640 1 -- 10.20.193.45:0/2144270396 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f486015e0c0 con 0x7f48600748e0 2026-02-17T21:10:52.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.948+0000 7f483bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:52.941 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:52.948+0000 7f483bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:53.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.048+0000 7f4866245640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:53.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.048+0000 7f4866245640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:53.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.048+0000 7f4866245640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:10:53.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.048+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f48600698c0 con 0x7f48600748e0 2026-02-17T21:10:53.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.050+0000 7f483bfff640 1 -- 10.20.193.45:0/2144270396 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f48600698c0 con 0x7f48600748e0 2026-02-17T21:10:53.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.050+0000 7f483bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:53.043 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.050+0000 7f483bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:53.043 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:53.044 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:53.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.051+0000 7f4866245640 10 librados: watch_flush enter 2026-02-17T21:10:53.045 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.051+0000 7f4866245640 10 librados: watch_flush exit 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.051+0000 7f4866245640 20 client.5024.objecter shutdown clearing up homeless session... 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.051+0000 7f4866245640 10 client.5024.objecter successfully canceled tick 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f48300792b0 msgr2=0x7f483007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f48300792b0 0x7f483007b770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f48601f1bd0 tx=0x7f4850009290 comp rx=0 tx=0).stop 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 10 monclient: shutdown 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 msgr2=0x7f48601f4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 0x7f48601f4280 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f484c00c450 tx=0x7f484c00c920 comp rx=0 tx=0).stop 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 shutdown_connections 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f48300792b0 0x7f483007b770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:53.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f486015d1e0 0x7f48601569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:53.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f48600c92b0 0x7f4860156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:53.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 --2- 10.20.193.45:0/2144270396 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f48600748e0 0x7f48601f4280 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:53.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 >> 10.20.193.45:0/2144270396 conn(0x7f48600c9d40 msgr2=0x7f486006b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:53.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 shutdown_connections 2026-02-17T21:10:53.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 -- 10.20.193.45:0/2144270396 wait complete. 2026-02-17T21:10:53.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:53.052+0000 7f4866245640 1 librados: shutdown 2026-02-17T21:10:56.053 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:56.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.131+0000 7f4a6f533640 10 monclient: get_monmap_and_config 2026-02-17T21:10:56.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.131+0000 7f4a6f533640 10 monclient: build_initial_monmap 2026-02-17T21:10:56.124 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.131+0000 7f4a6f533640 10 monclient: monmap: 2026-02-17T21:10:56.124 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:56.124 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:56.124 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:56.132257+0000 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:56.132257+0000 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.131+0000 7f4a6f533640 1 Processor -- start 2026-02-17T21:10:56.125 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.131+0000 7f4a6f533640 1 -- start start 2026-02-17T21:10:56.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.131+0000 7f4a6f533640 10 monclient: init 2026-02-17T21:10:56.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:56.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 10 monclient: _add_conns ranks=[0,1,3,4,2,5] 2026-02-17T21:10:56.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4a68152620 addr v1:10.20.193.45:6789/0 2026-02-17T21:10:56.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f4a6815aff0 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4a680c6ca0 0x7f4a68163160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 10 monclient(hunting): picked mon.noname-a con 0x7f4a680c6ca0 addr v2:10.20.193.45:3300/0 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a680c71a0 con 0x7f4a68152620 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a680c7480 con 0x7f4a6815aff0 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f4a680c7760 con 0x7f4a680c6ca0 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6f533640 10 monclient(hunting): authenticate will time out at 1239.762379s 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6daa9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4a680c6ca0 0x7f4a68163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6caa7640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f4a6815aff0 0x7f4a680c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:32810/0 (socket says 10.20.193.45:32810) 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.132+0000 7f4a6caa7640 1 -- 10.20.193.45:0/1679096313 learned_addr learned my addr 10.20.193.45:0/1679096313 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:56.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.133+0000 7f4a6daa9640 10 monclient(hunting): get_auth_request con 0x7f4a680c6ca0 auth_method 0 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.133+0000 7f4a6daa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.133+0000 7f4a6daa9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.133+0000 7f4a6daa9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.133+0000 7f4a6daa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.133+0000 7f4a6daa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.133+0000 7f4a6daa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a57fff640 1 -- 10.20.193.45:0/1679096313 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715561681 0 0) 0x7f4a680c7480 con 0x7f4a6815aff0 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a57fff640 10 monclient(hunting): _negotiate 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a57fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a57fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a57fff640 10 monclient(hunting): my global_id is 4969 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a57fff640 1 -- 10.20.193.45:0/1679096313 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a50003620 con 0x7f4a6815aff0 2026-02-17T21:10:56.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a6daa9640 10 monclient(hunting): handle_auth_done global_id 4905 payload 274 2026-02-17T21:10:56.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a6daa9640 1 -- 10.20.193.45:0/1679096313 >> v1:10.20.193.86:6789/0 conn(0x7f4a6815aff0 legacy=0x7f4a680c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:56.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a6daa9640 1 -- 10.20.193.45:0/1679096313 >> v1:10.20.193.45:6789/0 conn(0x7f4a68152620 legacy=0x7f4a6815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:56.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a6daa9640 10 monclient: _finish_hunting 0 2026-02-17T21:10:56.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a6daa9640 1 monclient: found mon.noname-a 2026-02-17T21:10:56.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a6daa9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:56.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a6daa9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:56.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.134+0000 7f4a6daa9640 1 -- 10.20.193.45:0/1679096313 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a68159e00 con 0x7f4a680c6ca0 2026-02-17T21:10:56.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.136+0000 7f4a6daa9640 1 --2- 10.20.193.45:0/1679096313 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 0x7f4a68163160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009d90 tx=0x7f4a6402f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e27cc9c1537a883 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:56.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 1 -- 10.20.193.45:0/1679096313 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6403c070 con 0x7f4a680c6ca0 2026-02-17T21:10:56.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:56.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 10 monclient: dump: 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:56.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 10 monclient: _finish_auth 0 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 10 monclient: _check_auth_tickets 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 1 -- 10.20.193.45:0/1679096313 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a64037440 con 0x7f4a680c6ca0 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 1 -- 10.20.193.45:0/1679096313 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a64037810 con 0x7f4a680c6ca0 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a6f533640 5 monclient: authenticate success, global_id 4905 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a57fff640 10 monclient: dump: 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:56.138 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a6f533640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a6f533640 4 set_mon_vals no callback set 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a6f533640 10 monclient: shutdown 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a6f533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:56.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.138+0000 7f4a6f533640 1 -- 10.20.193.45:0/1679096313 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 msgr2=0x7f4a68163160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 --2- 10.20.193.45:0/1679096313 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 0x7f4a68163160 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009d90 tx=0x7f4a6402f230 comp rx=0 tx=0).stop 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 -- 10.20.193.45:0/1679096313 shutdown_connections 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 --2- 10.20.193.45:0/1679096313 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 0x7f4a68163160 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 -- 10.20.193.45:0/1679096313 >> 10.20.193.45:0/1679096313 conn(0x7f4a680c9d40 msgr2=0x7f4a680ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 -- 10.20.193.45:0/1679096313 shutdown_connections 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 -- 10.20.193.45:0/1679096313 wait complete. 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 10 monclient: build_initial_monmap 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 10 monclient: monmap: 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:56.140 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 librados: starting msgr at 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 librados: starting objecter 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 Processor -- start 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 -- start start 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 librados: setting wanted keys 2026-02-17T21:10:56.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 1 librados: calling monclient init 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.139+0000 7f4a6f533640 10 monclient: init 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 0x7f4a681476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient(hunting): picked mon.noname-a con 0x7f4a680c6ca0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4a68152620 0x7f4a6814baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient(hunting): picked mon.noname-c con 0x7f4a68152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a6815aff0 0x7f4a6814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient(hunting): picked mon.noname-b con 0x7f4a6815aff0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4a680c94a0 con 0x7f4a680c6ca0 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:56.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6815a3c0 con 0x7f4a6815aff0 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4a680c9620 con 0x7f4a68152620 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6f533640 10 monclient(hunting): authenticate will time out at 1239.770243s 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 0x7f4a681476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 0x7f4a681476b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:55642/0 (socket says 10.20.193.45:55642) 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 1 -- 10.20.193.45:0/1675916553 learned_addr learned my addr 10.20.193.45:0/1675916553 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 10 monclient(hunting): get_auth_request con 0x7f4a680c6ca0 auth_method 0 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:56.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6daa9640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a6815aff0 0x7f4a6814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6caa7640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4a68152620 0x7f4a6814baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6daa9640 10 monclient(hunting): get_auth_request con 0x7f4a6815aff0 auth_method 0 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6daa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6daa9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6daa9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.140+0000 7f4a6d2a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6caa7640 10 monclient(hunting): get_auth_request con 0x7f4a68152620 auth_method 0 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6caa7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6caa7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:56.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6caa7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6daa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6daa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6daa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6caa7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6caa7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.141+0000 7f4a6caa7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 10 monclient(hunting): handle_auth_done global_id 4911 payload 824 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 1 -- 10.20.193.45:0/1675916553 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4a68152620 msgr2=0x7f4a6814baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4a68152620 0x7f4a6814baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 1 -- 10.20.193.45:0/1675916553 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a6815aff0 msgr2=0x7f4a6814c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a6815aff0 0x7f4a6814c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:56.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 10 monclient: _finish_hunting 0 2026-02-17T21:10:56.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 1 monclient: found mon.noname-a 2026-02-17T21:10:56.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:56.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:56.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.142+0000 7f4a6d2a8640 1 -- 10.20.193.45:0/1675916553 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a681efb70 con 0x7f4a680c6ca0 2026-02-17T21:10:56.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.143+0000 7f4a6d2a8640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 0x7f4a681476b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800c730 tx=0x7f4a5800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:56.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.143+0000 7f4a55ffb640 10 client.?.objecter ms_handle_connect 0x7f4a680c6ca0 2026-02-17T21:10:56.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.143+0000 7f4a55ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:56.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 1 -- 10.20.193.45:0/1675916553 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a58017070 con 0x7f4a680c6ca0 2026-02-17T21:10:56.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:56.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:56.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 10 monclient: dump: 2026-02-17T21:10:56.148 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:56.148 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:56.148 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 10 monclient: _finish_auth 0 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 1 -- 10.20.193.45:0/1675916553 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a580052d0 con 0x7f4a680c6ca0 2026-02-17T21:10:56.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a6f533640 5 monclient: authenticate success, global_id 4911 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a6f533640 10 monclient: _renew_subs 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a6f533640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a68073e30 con 0x7f4a680c6ca0 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 1 -- 10.20.193.45:0/1675916553 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a58003660 con 0x7f4a680c6ca0 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a55ffb640 10 monclient: dump: 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:56.150 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a577fe640 4 set_mon_vals no callback set 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a6f533640 10 client.4911.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a6f533640 10 monclient: _renew_subs 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a6f533640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a680743f0 con 0x7f4a680c6ca0 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.144+0000 7f4a6f533640 1 librados: init done 2026-02-17T21:10:56.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.145+0000 7f4a6f533640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:56.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.145+0000 7f4a6f533640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:56.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.145+0000 7f4a6f533640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:56.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.145+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a68152a00 con 0x7f4a680c6ca0 2026-02-17T21:10:56.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.157+0000 7f4a55ffb640 1 -- 10.20.193.45:0/1675916553 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4a5800a640 con 0x7f4a680c6ca0 2026-02-17T21:10:56.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.157+0000 7f4a55ffb640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a380792d0 0x7f4a3807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:56.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.158+0000 7f4a6caa7640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a380792d0 0x7f4a3807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:56.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.158+0000 7f4a6caa7640 10 monclient: get_auth_request con 0x7f4a380792d0 auth_method 0 2026-02-17T21:10:56.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.158+0000 7f4a6caa7640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a380792d0 0x7f4a3807b790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4a680c4560 tx=0x7f4a5c007dd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:56.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.158+0000 7f4a55ffb640 10 client.4911.objecter ms_handle_connect 0x7f4a380792d0 2026-02-17T21:10:56.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.159+0000 7f4a55ffb640 1 -- 10.20.193.45:0/1675916553 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f4a5805d890 con 0x7f4a680c6ca0 2026-02-17T21:10:56.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.159+0000 7f4a55ffb640 10 client.4911.objecter ms_dispatch2 0x7f4a68000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:56.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.159+0000 7f4a55ffb640 3 client.4911.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:56.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.159+0000 7f4a55ffb640 3 client.4911.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:56.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.159+0000 7f4a55ffb640 20 client.4911.objecter dump_active .. 0 homeless 2026-02-17T21:10:56.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.261+0000 7f4a55ffb640 1 -- 10.20.193.45:0/1675916553 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4a58021020 con 0x7f4a680c6ca0 2026-02-17T21:10:56.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.261+0000 7f4a55ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:56.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.261+0000 7f4a55ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:56.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.363+0000 7f4a6f533640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:56.355 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.363+0000 7f4a6f533640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:56.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.363+0000 7f4a6f533640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:56.356 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.363+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4a680c8d20 con 0x7f4a680c6ca0 2026-02-17T21:10:56.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.365+0000 7f4a55ffb640 1 -- 10.20.193.45:0/1675916553 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f4a58061850 con 0x7f4a680c6ca0 2026-02-17T21:10:56.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.365+0000 7f4a55ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:56.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.365+0000 7f4a55ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:56.358 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:56.358 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:56.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 10 librados: watch_flush enter 2026-02-17T21:10:56.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 10 librados: watch_flush exit 2026-02-17T21:10:56.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 20 client.4911.objecter shutdown clearing up homeless session... 2026-02-17T21:10:56.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 10 client.4911.objecter successfully canceled tick 2026-02-17T21:10:56.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a380792d0 msgr2=0x7f4a3807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:56.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a380792d0 0x7f4a3807b790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4a680c4560 tx=0x7f4a5c007dd0 comp rx=0 tx=0).stop 2026-02-17T21:10:56.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 10 monclient: shutdown 2026-02-17T21:10:56.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:56.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 msgr2=0x7f4a681476b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 0x7f4a681476b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800c730 tx=0x7f4a5800cc00 comp rx=0 tx=0).stop 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 shutdown_connections 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4a380792d0 0x7f4a3807b790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4a6815aff0 0x7f4a6814c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4a68152620 0x7f4a6814baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 --2- 10.20.193.45:0/1675916553 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4a680c6ca0 0x7f4a681476b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 >> 10.20.193.45:0/1675916553 conn(0x7f4a680c9d40 msgr2=0x7f4a680ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 shutdown_connections 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.366+0000 7f4a6f533640 1 -- 10.20.193.45:0/1675916553 wait complete. 2026-02-17T21:10:56.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:56.367+0000 7f4a6f533640 1 librados: shutdown 2026-02-17T21:10:59.368 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:10:59.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.443+0000 7f4bd77dc640 10 monclient: get_monmap_and_config 2026-02-17T21:10:59.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.443+0000 7f4bd77dc640 10 monclient: build_initial_monmap 2026-02-17T21:10:59.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.443+0000 7f4bd77dc640 10 monclient: monmap: 2026-02-17T21:10:59.437 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:59.437 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:59.437 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:10:59.445117+0000 2026-02-17T21:10:59.437 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:10:59.445117+0000 2026-02-17T21:10:59.437 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:59.437 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:59.438 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:10:59.438 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:10:59.438 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:10:59.438 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:10:59.438 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:10:59.438 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:10:59.438 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.443+0000 7f4bd77dc640 1 Processor -- start 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.443+0000 7f4bd77dc640 1 -- start start 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.443+0000 7f4bd77dc640 10 monclient: init 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 10 monclient: _add_conns ranks=[1,2,3,0,5,4] 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f4bd0155f90 addr v1:10.20.193.86:6789/0 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4bd00cef10 addr v1:10.20.193.92:6789/0 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4bd0073b50 0x7f4bd015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 10 monclient(hunting): picked mon.noname-a con 0x7f4bd0073b50 addr v2:10.20.193.45:3300/0 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd00cd200 con 0x7f4bd0155f90 2026-02-17T21:10:59.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd00cbb40 con 0x7f4bd00cef10 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd0160220 con 0x7f4bd0073b50 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd77dc640 10 monclient(hunting): authenticate will time out at 1243.075349s 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd5551640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f4bd0155f90 0x7f4bd00ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:42082/0 (socket says 10.20.193.45:42082) 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.444+0000 7f4bd5551640 1 -- 10.20.193.45:0/1243503550 learned_addr learned my addr 10.20.193.45:0/1243503550 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.445+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432352981 0 0) 0x7f4bd00cbb40 con 0x7f4bd00cef10 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.445+0000 7f4bbffff640 10 monclient(hunting): _negotiate 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.445+0000 7f4bbffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.445+0000 7f4bbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:59.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.445+0000 7f4bbffff640 10 monclient(hunting): my global_id is 5030 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.445+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bb8003620 con 0x7f4bd00cef10 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.446+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491944369 0 0) 0x7f4bd00cd200 con 0x7f4bd0155f90 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.446+0000 7f4bbffff640 10 monclient(hunting): _negotiate 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.446+0000 7f4bbffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.446+0000 7f4bbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.446+0000 7f4bbffff640 10 monclient(hunting): my global_id is 4975 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.446+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bd00cbb40 con 0x7f4bd0155f90 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bd5d52640 1 --2- 10.20.193.45:0/1243503550 >> v2:10.20.193.45:3300/0 conn(0x7f4bd0073b50 0x7f4bd015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bd5d52640 10 monclient(hunting): get_auth_request con 0x7f4bd0073b50 auth_method 0 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bd5d52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bd5d52640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:59.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bd5d52640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 <== mon.1 v1:10.20.193.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3409037088 0 0) 0x7f4bd00cbb40 con 0x7f4bd0155f90 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 >> v2:10.20.193.45:3300/0 conn(0x7f4bd0073b50 msgr2=0x7f4bd015fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 --2- 10.20.193.45:0/1243503550 >> v2:10.20.193.45:3300/0 conn(0x7f4bd0073b50 0x7f4bd015fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 >> v1:10.20.193.92:6789/0 conn(0x7f4bd00cef10 legacy=0x7f4bd015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient: _finish_hunting 0 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.86:6789/0 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 --> v1:10.20.193.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd00ccc40 con 0x7f4bd0155f90 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient: _finish_auth 0 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient: _check_auth_tickets 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:59.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 <== mon.1 v1:10.20.193.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f4bc0002ee0 con 0x7f4bd0155f90 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bd77dc640 5 monclient: authenticate success, global_id 4975 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bd77dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient: dump: 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:59.449 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] but i'm connected to v1:10.20.193.86:6789/0, reconnecting 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 >> v1:10.20.193.86:6789/0 conn(0x7f4bd0155f90 legacy=0x7f4bd00ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4bb8003dd0 0x7f4bb80041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient(hunting): picked mon.b con 0x7f4bb8003dd0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bb8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient(hunting): picked mon.a con 0x7f4bb8004950 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:59.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4bb8009ab0 0x7f4bb800bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient(hunting): picked mon.c con 0x7f4bb8009ab0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd0160220 con 0x7f4bb8004950 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb800c4c0 con 0x7f4bb8003dd0 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb800c6c0 con 0x7f4bb8009ab0 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bbffff640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.447+0000 7f4bd77dc640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.448+0000 7f4bd4d50640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bb8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:59.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd4d50640 10 monclient(hunting): get_auth_request con 0x7f4bb8004950 auth_method 0 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd4d50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd4d50640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd4d50640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5551640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4bb8003dd0 0x7f4bb80041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd4d50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd4d50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd4d50640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5d52640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4bb8009ab0 0x7f4bb800bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5551640 10 monclient(hunting): get_auth_request con 0x7f4bb8003dd0 auth_method 0 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5551640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5551640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:59.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5551640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5d52640 10 monclient(hunting): get_auth_request con 0x7f4bb8009ab0 auth_method 0 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5d52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5d52640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5d52640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5551640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5551640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5551640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5d52640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5d52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.449+0000 7f4bd5d52640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 10 monclient(hunting): handle_auth_done global_id 4975 payload 293 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 1 -- 10.20.193.45:0/1243503550 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4bb8009ab0 msgr2=0x7f4bb800bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4bb8009ab0 0x7f4bb800bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 1 -- 10.20.193.45:0/1243503550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4bb8003dd0 msgr2=0x7f4bb80041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4bb8003dd0 0x7f4bb80041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 10 monclient: _finish_hunting 0 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 1 monclient: found mon.a 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 1 -- 10.20.193.45:0/1243503550 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd00cbb40 con 0x7f4bb8004950 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 10 monclient: _finish_auth 0 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 10 monclient: _check_auth_tickets 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd4d50640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.450+0000 7f4bd5d52640 1 -- 10.20.193.45:0/1243503550 reap_dead start 2026-02-17T21:10:59.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.451+0000 7f4bd4d50640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bb8004db0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40032d0 tx=0x7f4bc402ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1104f0c673d5b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:59.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4002ef0 con 0x7f4bb8004950 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 10 monclient: dump: 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:59.461 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc40052f0 con 0x7f4bb8004950 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bd77dc640 10 monclient: get_monmap_and_config success 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 1 -- 10.20.193.45:0/1243503550 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc402f870 con 0x7f4bb8004950 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bd77dc640 4 set_mon_vals no callback set 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.452+0000 7f4bbffff640 10 monclient: dump: 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:59.462 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 10 monclient: shutdown 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 1 -- 10.20.193.45:0/1243503550 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 msgr2=0x7f4bb8004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bb8004db0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40032d0 tx=0x7f4bc402ef50 comp rx=0 tx=0).stop 2026-02-17T21:10:59.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 1 -- 10.20.193.45:0/1243503550 shutdown_connections 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 1 --2- 10.20.193.45:0/1243503550 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bb8004db0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 1 -- 10.20.193.45:0/1243503550 >> 10.20.193.45:0/1243503550 conn(0x7f4bd0073030 msgr2=0x7f4bd0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 1 -- 10.20.193.45:0/1243503550 shutdown_connections 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 1 -- 10.20.193.45:0/1243503550 wait complete. 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 10 monclient: build_initial_monmap 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 10 monclient: monmap: 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:10:59.464 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 1 librados: starting msgr at 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.453+0000 7f4bd77dc640 1 librados: starting objecter 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 Processor -- start 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 -- start start 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 librados: setting wanted keys 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 librados: calling monclient init 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient: init 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient: _reopen_session rank -1 2026-02-17T21:10:59.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bd01f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient(hunting): picked mon.noname-a con 0x7f4bb8004950 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4bd01e7510 0x7f4bd01e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient(hunting): picked mon.noname-b con 0x7f4bd01e7510 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4bd01e7990 0x7f4bd015dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient(hunting): picked mon.noname-c con 0x7f4bd01e7990 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd00ce2e0 con 0x7f4bb8004950 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd00ce000 con 0x7f4bd01e7510 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:10:59.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd00cd980 con 0x7f4bd01e7990 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient(hunting): _renew_subs 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd77dc640 10 monclient(hunting): authenticate will time out at 1243.085466s 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd5551640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bd01f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd4d50640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4bd01e7510 0x7f4bd01e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd5551640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bd01f7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:39450/0 (socket says 10.20.193.45:39450) 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd5551640 1 -- 10.20.193.45:0/508436229 learned_addr learned my addr 10.20.193.45:0/508436229 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd5551640 10 monclient(hunting): get_auth_request con 0x7f4bb8004950 auth_method 0 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd5551640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd5551640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd5551640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.454+0000 7f4bd5d52640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4bd01e7990 0x7f4bd015dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:59.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd4d50640 10 monclient(hunting): get_auth_request con 0x7f4bd01e7510 auth_method 0 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd4d50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd4d50640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd4d50640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5d52640 10 monclient(hunting): get_auth_request con 0x7f4bd01e7990 auth_method 0 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5d52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5d52640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5d52640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5551640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5551640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5551640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd4d50640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd4d50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:59.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd4d50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5d52640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5d52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.455+0000 7f4bd5d52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 10 monclient(hunting): handle_auth_done global_id 4917 payload 824 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 1 -- 10.20.193.45:0/508436229 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4bd01e7990 msgr2=0x7f4bd015dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4bd01e7990 0x7f4bd015dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 1 -- 10.20.193.45:0/508436229 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4bd01e7510 msgr2=0x7f4bd01e93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4bd01e7510 0x7f4bd01e93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 10 monclient: _finish_hunting 0 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 1 monclient: found mon.noname-a 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:10:59.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.456+0000 7f4bd5551640 1 -- 10.20.193.45:0/508436229 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd01e9ec0 con 0x7f4bb8004950 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.457+0000 7f4bd5551640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bd01f7aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00072c0 tx=0x7f4bc0007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.457+0000 7f4bbdffb640 10 client.?.objecter ms_handle_connect 0x7f4bb8004950 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.457+0000 7f4bbdffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 1 -- 10.20.193.45:0/508436229 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc001a070 con 0x7f4bb8004950 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 10 monclient: dump: 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.470 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 10 monclient: _finish_auth 0 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 10 monclient: _check_auth_tickets 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 1 -- 10.20.193.45:0/508436229 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc000f8c0 con 0x7f4bb8004950 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 1 -- 10.20.193.45:0/508436229 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc000fc90 con 0x7f4bb8004950 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:10:59.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbdffb640 10 monclient: dump: 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bbf7fe640 4 set_mon_vals no callback set 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 5 monclient: authenticate success, global_id 4917 2026-02-17T21:10:59.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 10 monclient: _renew_subs 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd01ea1a0 con 0x7f4bb8004950 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 10 client.4917.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 10 monclient: _renew_subs 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd015d500 con 0x7f4bb8004950 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 1 librados: init done 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:59.473 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.459+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd00cdc80 con 0x7f4bb8004950 2026-02-17T21:10:59.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.518+0000 7f4bbdffb640 1 -- 10.20.193.45:0/508436229 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4bc00133b0 con 0x7f4bb8004950 2026-02-17T21:10:59.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.518+0000 7f4bbdffb640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4ba0079280 0x7f4ba007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:10:59.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.518+0000 7f4bd4d50640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4ba0079280 0x7f4ba007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:10:59.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.518+0000 7f4bd4d50640 10 monclient: get_auth_request con 0x7f4ba0079280 auth_method 0 2026-02-17T21:10:59.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.518+0000 7f4bbdffb640 10 client.4917.objecter ms_handle_connect 0x7f4ba0079280 2026-02-17T21:10:59.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.518+0000 7f4bd4d50640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4ba0079280 0x7f4ba007b740 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4037000 tx=0x7f4bc4033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:10:59.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.579+0000 7f4bbdffb640 1 -- 10.20.193.45:0/508436229 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f4bc000fe30 con 0x7f4bb8004950 2026-02-17T21:10:59.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.579+0000 7f4bbdffb640 10 client.4917.objecter ms_dispatch2 0x7f4bd0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:10:59.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.579+0000 7f4bbdffb640 3 client.4917.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:10:59.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.579+0000 7f4bbdffb640 3 client.4917.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:10:59.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.580+0000 7f4bbdffb640 20 client.4917.objecter dump_active .. 0 homeless 2026-02-17T21:10:59.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.580+0000 7f4bbdffb640 1 -- 10.20.193.45:0/508436229 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4bc0061890 con 0x7f4bb8004950 2026-02-17T21:10:59.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.580+0000 7f4bbdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:10:59.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.580+0000 7f4bbdffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:10:59.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.680+0000 7f4bd77dc640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:10:59.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.680+0000 7f4bd77dc640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:59.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.680+0000 7f4bd77dc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:10:59.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.680+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4bd0159720 con 0x7f4bb8004950 2026-02-17T21:10:59.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.682+0000 7f4bbdffb640 1 -- 10.20.193.45:0/508436229 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f4bc0065b90 con 0x7f4bb8004950 2026-02-17T21:10:59.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.682+0000 7f4bbdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:10:59.677 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.682+0000 7f4bbdffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:10:59.677 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:10:59.677 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:10:59.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 10 librados: watch_flush enter 2026-02-17T21:10:59.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 10 librados: watch_flush exit 2026-02-17T21:10:59.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 20 client.4917.objecter shutdown clearing up homeless session... 2026-02-17T21:10:59.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 10 client.4917.objecter successfully canceled tick 2026-02-17T21:10:59.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4ba0079280 msgr2=0x7f4ba007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:59.681 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4ba0079280 0x7f4ba007b740 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4037000 tx=0x7f4bc4033000 comp rx=0 tx=0).stop 2026-02-17T21:10:59.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 10 monclient: shutdown 2026-02-17T21:10:59.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:10:59.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 msgr2=0x7f4bd01f7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:10:59.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bd01f7aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00072c0 tx=0x7f4bc0007790 comp rx=0 tx=0).stop 2026-02-17T21:10:59.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 shutdown_connections 2026-02-17T21:10:59.682 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4ba0079280 0x7f4ba007b740 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4bd01e7990 0x7f4bd015dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4bd01e7510 0x7f4bd01e93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 --2- 10.20.193.45:0/508436229 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4bb8004950 0x7f4bd01f7aa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:10:59.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 >> 10.20.193.45:0/508436229 conn(0x7f4bd0073030 msgr2=0x7f4bd00ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:10:59.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 shutdown_connections 2026-02-17T21:10:59.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 -- 10.20.193.45:0/508436229 wait complete. 2026-02-17T21:10:59.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:10:59.683+0000 7f4bd77dc640 1 librados: shutdown 2026-02-17T21:11:02.687 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:02.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.765+0000 7fb98fe15640 10 monclient: get_monmap_and_config 2026-02-17T21:11:02.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.765+0000 7fb98fe15640 10 monclient: build_initial_monmap 2026-02-17T21:11:02.758 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.766+0000 7fb98fe15640 10 monclient: monmap: 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:02.766846+0000 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:02.766846+0000 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:02.759 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:02.760 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:02.760 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:02.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.766+0000 7fb98fe15640 1 Processor -- start 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.766+0000 7fb98fe15640 1 -- start start 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.766+0000 7fb98fe15640 10 monclient: init 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 10 monclient: _add_conns ranks=[5,3,0,4,1,2] 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fb988155cf0 0x7fb9880cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 10 monclient(hunting): picked mon.noname-c con 0x7fb988155cf0 addr v2:10.20.193.92:3300/0 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fb9881560d0 0x7fb988076230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 10 monclient(hunting): picked mon.noname-a con 0x7fb9881560d0 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb9880c8e20 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:02.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb98806e730 con 0x7fb9880c8e20 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fb98806ea10 con 0x7fb9881560d0 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fb98806ecf0 con 0x7fb988155cf0 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98fe15640 10 monclient(hunting): authenticate will time out at 1246.397074s 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98db8a640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fb988155cf0 0x7fb9880cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98db8a640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fb988155cf0 0x7fb9880cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:54458/0 (socket says 10.20.193.45:54458) 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98db8a640 1 -- 10.20.193.45:0/4098924755 learned_addr learned my addr 10.20.193.45:0/4098924755 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98db8a640 10 monclient(hunting): get_auth_request con 0x7fb988155cf0 auth_method 0 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98db8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98db8a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:02.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.767+0000 7fb98db8a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.768+0000 7fb98db8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.768+0000 7fb98db8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.768+0000 7fb98db8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.768+0000 7fb98d389640 1 --2- 10.20.193.45:0/4098924755 >> v2:10.20.193.45:3300/0 conn(0x7fb9881560d0 0x7fb988076230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.769+0000 7fb98db8a640 10 monclient(hunting): handle_auth_done global_id 5036 payload 274 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.769+0000 7fb98db8a640 1 -- 10.20.193.45:0/4098924755 >> v2:10.20.193.45:3300/0 conn(0x7fb9881560d0 msgr2=0x7fb988076230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.769+0000 7fb98db8a640 1 --2- 10.20.193.45:0/4098924755 >> v2:10.20.193.45:3300/0 conn(0x7fb9881560d0 0x7fb988076230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.769+0000 7fb98db8a640 1 -- 10.20.193.45:0/4098924755 >> v1:10.20.193.45:6789/0 conn(0x7fb9880c8e20 legacy=0x7fb9880c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.769+0000 7fb98db8a640 10 monclient: _finish_hunting 0 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.769+0000 7fb98db8a640 1 monclient: found mon.noname-c 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.769+0000 7fb98db8a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:02.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.769+0000 7fb98db8a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:02.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.769+0000 7fb98db8a640 1 -- 10.20.193.45:0/4098924755 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9880c8620 con 0x7fb988155cf0 2026-02-17T21:11:02.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.770+0000 7fb98db8a640 1 --2- 10.20.193.45:0/4098924755 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 0x7fb9880cb0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb988069dc0 tx=0x7fb97802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54112a4d159d817 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:02.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 1 -- 10.20.193.45:0/4098924755 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97803c070 con 0x7fb988155cf0 2026-02-17T21:11:02.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:02.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:02.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 10 monclient: dump: 2026-02-17T21:11:02.770 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 10 monclient: _finish_auth 0 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 10 monclient: _check_auth_tickets 2026-02-17T21:11:02.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 5 monclient: authenticate success, global_id 5036 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 1 -- 10.20.193.45:0/4098924755 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97802fb40 con 0x7fb988155cf0 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 1 -- 10.20.193.45:0/4098924755 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978037440 con 0x7fb988155cf0 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 4 set_mon_vals no callback set 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98cb88640 10 monclient: dump: 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:02.772 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 10 monclient: shutdown 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 1 -- 10.20.193.45:0/4098924755 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 msgr2=0x7fb9880cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 1 --2- 10.20.193.45:0/4098924755 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 0x7fb9880cb0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb988069dc0 tx=0x7fb97802eed0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 1 -- 10.20.193.45:0/4098924755 shutdown_connections 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 1 --2- 10.20.193.45:0/4098924755 >> v2:10.20.193.45:3300/0 conn(0x7fb9881560d0 0x7fb988076230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 1 --2- 10.20.193.45:0/4098924755 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 0x7fb9880cb0c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 1 -- 10.20.193.45:0/4098924755 >> 10.20.193.45:0/4098924755 conn(0x7fb9880ca5a0 msgr2=0x7fb9880ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 1 -- 10.20.193.45:0/4098924755 shutdown_connections 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 1 -- 10.20.193.45:0/4098924755 wait complete. 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 10 monclient: build_initial_monmap 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.772+0000 7fb98fe15640 10 monclient: monmap: 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:02.774 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 librados: starting msgr at 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 librados: starting objecter 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 Processor -- start 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 -- start start 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 librados: setting wanted keys 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 librados: calling monclient init 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient: init 2026-02-17T21:11:02.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9880c8e20 0x7fb988142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient(hunting): picked mon.noname-b con 0x7fb9880c8e20 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 0x7fb988144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient(hunting): picked mon.noname-c con 0x7fb988155cf0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb9881560d0 0x7fb9881446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient(hunting): picked mon.noname-a con 0x7fb9881560d0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb98815f2c0 con 0x7fb9881560d0 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb988076770 con 0x7fb9880c8e20 2026-02-17T21:11:02.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb98815f440 con 0x7fb988155cf0 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98fe15640 10 monclient(hunting): authenticate will time out at 1246.403622s 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.773+0000 7fb98d389640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 0x7fb988144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98db8a640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9880c8e20 0x7fb988142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98d389640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 0x7fb988144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:54474/0 (socket says 10.20.193.45:54474) 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98d389640 1 -- 10.20.193.45:0/1859152573 learned_addr learned my addr 10.20.193.45:0/1859152573 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98d389640 10 monclient(hunting): get_auth_request con 0x7fb988155cf0 auth_method 0 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98d389640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98d389640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98d389640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:02.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98db8a640 10 monclient(hunting): get_auth_request con 0x7fb9880c8e20 auth_method 0 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98db8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98db8a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98db8a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98d389640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98d389640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98d389640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98db8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98db8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.774+0000 7fb98db8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 10 monclient(hunting): handle_auth_done global_id 5039 payload 824 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 1 -- 10.20.193.45:0/1859152573 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9880c8e20 msgr2=0x7fb988142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9880c8e20 0x7fb988142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 1 -- 10.20.193.45:0/1859152573 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb9881560d0 msgr2=0x7fb9881446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:02.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb9881560d0 0x7fb9881446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 10 monclient: _finish_hunting 0 2026-02-17T21:11:02.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 1 monclient: found mon.noname-c 2026-02-17T21:11:02.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:02.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:02.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.775+0000 7fb98d389640 1 -- 10.20.193.45:0/1859152573 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9881f3860 con 0x7fb988155cf0 2026-02-17T21:11:02.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.776+0000 7fb98d389640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 0x7fb988144180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00c820 tx=0x7fb97c00ccf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:02.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.776+0000 7fb9767fc640 10 client.?.objecter ms_handle_connect 0x7fb988155cf0 2026-02-17T21:11:02.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.776+0000 7fb9767fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:02.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 1 -- 10.20.193.45:0/1859152573 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c015070 con 0x7fb988155cf0 2026-02-17T21:11:02.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:02.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:02.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 10 monclient: dump: 2026-02-17T21:11:02.781 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:02.781 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:02.781 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 10 monclient: _finish_auth 0 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 10 monclient: _check_auth_tickets 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 1 -- 10.20.193.45:0/1859152573 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97c004220 con 0x7fb988155cf0 2026-02-17T21:11:02.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 1 -- 10.20.193.45:0/1859152573 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c007830 con 0x7fb988155cf0 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb9767fc640 10 monclient: dump: 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:02.783 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb977fff640 4 set_mon_vals no callback set 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb98fe15640 5 monclient: authenticate success, global_id 5039 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb98fe15640 10 monclient: _renew_subs 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb98fe15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9881f3b00 con 0x7fb988155cf0 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb98fe15640 10 client.5039.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb98fe15640 10 monclient: _renew_subs 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb98fe15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9881f40c0 con 0x7fb988155cf0 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.778+0000 7fb98fe15640 1 librados: init done 2026-02-17T21:11:02.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.779+0000 7fb98fe15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:02.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.779+0000 7fb98fe15640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:02.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.779+0000 7fb98fe15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:02.785 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.779+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb988076230 con 0x7fb988155cf0 2026-02-17T21:11:02.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.790+0000 7fb9767fc640 1 -- 10.20.193.45:0/1859152573 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb97c0079d0 con 0x7fb988155cf0 2026-02-17T21:11:02.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.791+0000 7fb9767fc640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9580792d0 0x7fb95807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:02.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.791+0000 7fb98db8a640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9580792d0 0x7fb95807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:02.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.791+0000 7fb98db8a640 10 monclient: get_auth_request con 0x7fb9580792d0 auth_method 0 2026-02-17T21:11:02.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.791+0000 7fb98db8a640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9580792d0 0x7fb95807b790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb9880c4dc0 tx=0x7fb978033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:02.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.791+0000 7fb9767fc640 10 client.5039.objecter ms_handle_connect 0x7fb9580792d0 2026-02-17T21:11:02.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.793+0000 7fb9767fc640 1 -- 10.20.193.45:0/1859152573 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fb97c007cf0 con 0x7fb988155cf0 2026-02-17T21:11:02.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.793+0000 7fb9767fc640 10 client.5039.objecter ms_dispatch2 0x7fb988000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:02.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.793+0000 7fb9767fc640 3 client.5039.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:02.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.793+0000 7fb9767fc640 3 client.5039.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:02.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.793+0000 7fb9767fc640 20 client.5039.objecter dump_active .. 0 homeless 2026-02-17T21:11:02.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.896+0000 7fb9767fc640 1 -- 10.20.193.45:0/1859152573 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb97c0620f0 con 0x7fb988155cf0 2026-02-17T21:11:02.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.896+0000 7fb9767fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:02.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.896+0000 7fb9767fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:02.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.995+0000 7fb98fe15640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:02.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.995+0000 7fb98fe15640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:02.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.995+0000 7fb98fe15640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:02.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.995+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9881596f0 con 0x7fb988155cf0 2026-02-17T21:11:02.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.998+0000 7fb9767fc640 1 -- 10.20.193.45:0/1859152573 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fb97c0663f0 con 0x7fb988155cf0 2026-02-17T21:11:02.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.998+0000 7fb9767fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:02.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.998+0000 7fb9767fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:02.991 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:02.991 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:02.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 10 librados: watch_flush enter 2026-02-17T21:11:02.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 10 librados: watch_flush exit 2026-02-17T21:11:02.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 20 client.5039.objecter shutdown clearing up homeless session... 2026-02-17T21:11:02.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 10 client.5039.objecter successfully canceled tick 2026-02-17T21:11:02.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9580792d0 msgr2=0x7fb95807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:02.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9580792d0 0x7fb95807b790 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb9880c4dc0 tx=0x7fb978033000 comp rx=0 tx=0).stop 2026-02-17T21:11:02.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 10 monclient: shutdown 2026-02-17T21:11:02.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:02.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 msgr2=0x7fb988144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 0x7fb988144180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00c820 tx=0x7fb97c00ccf0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 shutdown_connections 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb9580792d0 0x7fb95807b790 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb9881560d0 0x7fb9881446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb988155cf0 0x7fb988144180 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 --2- 10.20.193.45:0/1859152573 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb9880c8e20 0x7fb988142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 >> 10.20.193.45:0/1859152573 conn(0x7fb9880ca5a0 msgr2=0x7fb98814e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 shutdown_connections 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 -- 10.20.193.45:0/1859152573 wait complete. 2026-02-17T21:11:02.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:02.999+0000 7fb98fe15640 1 librados: shutdown 2026-02-17T21:11:06.000 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:06.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.078+0000 7fc349288640 10 monclient: get_monmap_and_config 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.078+0000 7fc349288640 10 monclient: build_initial_monmap 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.078+0000 7fc349288640 10 monclient: monmap: 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:06.079002+0000 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:06.079002+0000 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:06.071 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:06.072 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:06.072 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:06.072 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:06.072 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.078+0000 7fc349288640 1 Processor -- start 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.078+0000 7fc349288640 1 -- start start 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.078+0000 7fc349288640 10 monclient: init 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 10 monclient: _add_conns ranks=[4,5,0,3,2,1] 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc344150720 0x7fc34415a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 10 monclient(hunting): picked mon.noname-b con 0x7fc344150720 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fc34415b2b0 0x7fc3440c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 10 monclient(hunting): picked mon.noname-c con 0x7fc34415b2b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:11:06.075 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc3440cca30 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3440c6930 con 0x7fc3440cca30 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc344074a80 con 0x7fc344150720 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc3440c7240 con 0x7fc34415b2b0 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc349288640 10 monclient(hunting): authenticate will time out at 1249.709213s 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc3437fe640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc3440cca30 0x7fc34415d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:33526/0 (socket says 10.20.193.45:33526) 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc3437fe640 1 -- 10.20.193.45:0/1772286253 learned_addr learned my addr 10.20.193.45:0/1772286253 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc342ffd640 1 --2- 10.20.193.45:0/1772286253 >> v2:10.20.193.86:3300/0 conn(0x7fc344150720 0x7fc34415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc3427fc640 1 --2- 10.20.193.45:0/1772286253 >> v2:10.20.193.92:3300/0 conn(0x7fc34415b2b0 0x7fc3440c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:06.076 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc342ffd640 10 monclient(hunting): get_auth_request con 0x7fc344150720 auth_method 0 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc342ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc342ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.079+0000 7fc342ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc3427fc640 10 monclient(hunting): get_auth_request con 0x7fc34415b2b0 auth_method 0 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc3427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc3427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc3427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc342ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc342ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc342ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc3427fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc3427fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:06.077 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.080+0000 7fc3427fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc341ffb640 1 -- 10.20.193.45:0/1772286253 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068216555 0 0) 0x7fc3440c6930 con 0x7fc3440cca30 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc341ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc341ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc341ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc341ffb640 10 monclient(hunting): my global_id is 4920 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc341ffb640 1 -- 10.20.193.45:0/1772286253 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc330003620 con 0x7fc3440cca30 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc342ffd640 10 monclient(hunting): handle_auth_done global_id 4984 payload 274 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc342ffd640 1 -- 10.20.193.45:0/1772286253 >> v2:10.20.193.92:3300/0 conn(0x7fc34415b2b0 msgr2=0x7fc3440c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc342ffd640 1 --2- 10.20.193.45:0/1772286253 >> v2:10.20.193.92:3300/0 conn(0x7fc34415b2b0 0x7fc3440c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc342ffd640 1 -- 10.20.193.45:0/1772286253 >> v1:10.20.193.45:6789/0 conn(0x7fc3440cca30 legacy=0x7fc34415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc342ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc342ffd640 1 monclient: found mon.noname-b 2026-02-17T21:11:06.078 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc342ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:06.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc342ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:06.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.081+0000 7fc342ffd640 1 -- 10.20.193.45:0/1772286253 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3440c95a0 con 0x7fc344150720 2026-02-17T21:11:06.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.082+0000 7fc342ffd640 1 --2- 10.20.193.45:0/1772286253 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc344150720 0x7fc34415a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc344069c40 tx=0x7fc33802eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f007e2b66b4eb49a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:06.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 1 -- 10.20.193.45:0/1772286253 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33803c070 con 0x7fc344150720 2026-02-17T21:11:06.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:06.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 10 monclient: dump: 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:06.086 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 10 monclient: _finish_auth 0 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 1 -- 10.20.193.45:0/1772286253 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33802fb80 con 0x7fc344150720 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc349288640 5 monclient: authenticate success, global_id 4984 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc349288640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 1 -- 10.20.193.45:0/1772286253 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338037440 con 0x7fc344150720 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc341ffb640 10 monclient: dump: 2026-02-17T21:11:06.087 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc349288640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.084+0000 7fc349288640 4 set_mon_vals no callback set 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 10 monclient: shutdown 2026-02-17T21:11:06.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 -- 10.20.193.45:0/1772286253 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc344150720 msgr2=0x7fc34415a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 --2- 10.20.193.45:0/1772286253 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc344150720 0x7fc34415a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc344069c40 tx=0x7fc33802eeb0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 -- 10.20.193.45:0/1772286253 shutdown_connections 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 --2- 10.20.193.45:0/1772286253 >> v2:10.20.193.92:3300/0 conn(0x7fc34415b2b0 0x7fc3440c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 --2- 10.20.193.45:0/1772286253 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc344150720 0x7fc34415a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 -- 10.20.193.45:0/1772286253 >> 10.20.193.45:0/1772286253 conn(0x7fc3440cbf10 msgr2=0x7fc3440cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 -- 10.20.193.45:0/1772286253 shutdown_connections 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 -- 10.20.193.45:0/1772286253 wait complete. 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 10 monclient: build_initial_monmap 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 10 monclient: monmap: 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:06.089 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 librados: starting msgr at 2026-02-17T21:11:06.090 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.085+0000 7fc349288640 1 librados: starting objecter 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 Processor -- start 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 -- start start 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 librados: setting wanted keys 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 librados: calling monclient init 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient: init 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3440cca30 0x7fc3440c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient(hunting): picked mon.noname-c con 0x7fc3440cca30 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc344150720 0x7fc3441547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient(hunting): picked mon.noname-a con 0x7fc344150720 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:06.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc34415b2b0 0x7fc344154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient(hunting): picked mon.noname-b con 0x7fc34415b2b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440c9880 con 0x7fc344150720 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440c6ed0 con 0x7fc34415b2b0 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3440c7c10 con 0x7fc3440cca30 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc349288640 10 monclient(hunting): authenticate will time out at 1249.716487s 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3427fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc344150720 0x7fc3441547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3437fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc34415b2b0 0x7fc344154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:06.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3437fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc34415b2b0 0x7fc344154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:34274/0 (socket says 10.20.193.45:34274) 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3437fe640 1 -- 10.20.193.45:0/1541402315 learned_addr learned my addr 10.20.193.45:0/1541402315 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3437fe640 10 monclient(hunting): get_auth_request con 0x7fc34415b2b0 auth_method 0 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3437fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3427fc640 10 monclient(hunting): get_auth_request con 0x7fc344150720 auth_method 0 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3427fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3427fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc3427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.086+0000 7fc342ffd640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3440cca30 0x7fc3440c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc342ffd640 10 monclient(hunting): get_auth_request con 0x7fc3440cca30 auth_method 0 2026-02-17T21:11:06.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc342ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc342ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc342ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc3437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc3437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc3437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc3427fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc3427fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc3427fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc342ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc342ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.087+0000 7fc342ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 10 monclient(hunting): handle_auth_done global_id 4923 payload 824 2026-02-17T21:11:06.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 1 -- 10.20.193.45:0/1541402315 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3440cca30 msgr2=0x7fc3440c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3440cca30 0x7fc3440c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 1 -- 10.20.193.45:0/1541402315 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc34415b2b0 msgr2=0x7fc344154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc34415b2b0 0x7fc344154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 10 monclient: _finish_hunting 0 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 1 monclient: found mon.noname-a 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.088+0000 7fc3427fc640 1 -- 10.20.193.45:0/1541402315 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34415af70 con 0x7fc344150720 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.089+0000 7fc3427fc640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc344150720 0x7fc3441547d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00e9b0 tx=0x7fc32c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.089+0000 7fc3237fe640 10 client.?.objecter ms_handle_connect 0x7fc344150720 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.089+0000 7fc3237fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 1 -- 10.20.193.45:0/1541402315 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c017070 con 0x7fc344150720 2026-02-17T21:11:06.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 10 monclient: dump: 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:06.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 10 monclient: _finish_auth 0 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 10 monclient: _check_auth_tickets 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 1 -- 10.20.193.45:0/1541402315 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c00ca00 con 0x7fc344150720 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 1 -- 10.20.193.45:0/1541402315 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c00cdf0 con 0x7fc344150720 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3237fe640 10 monclient: dump: 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:06.097 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc3417fa640 4 set_mon_vals no callback set 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc349288640 5 monclient: authenticate success, global_id 4923 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc349288640 10 monclient: _renew_subs 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc349288640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34415c200 con 0x7fc344150720 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc349288640 10 client.4923.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:06.098 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc349288640 10 monclient: _renew_subs 2026-02-17T21:11:06.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc349288640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:06.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34415ac90 con 0x7fc344150720 2026-02-17T21:11:06.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.091+0000 7fc349288640 1 librados: init done 2026-02-17T21:11:06.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.092+0000 7fc349288640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:06.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.092+0000 7fc349288640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:06.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.092+0000 7fc349288640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:06.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.092+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3440c91f0 con 0x7fc344150720 2026-02-17T21:11:06.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.104+0000 7fc3237fe640 1 -- 10.20.193.45:0/1541402315 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc32c024060 con 0x7fc344150720 2026-02-17T21:11:06.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.105+0000 7fc3237fe640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc310079280 0x7fc31007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:06.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.105+0000 7fc342ffd640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc310079280 0x7fc31007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:06.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.105+0000 7fc342ffd640 10 monclient: get_auth_request con 0x7fc310079280 auth_method 0 2026-02-17T21:11:06.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.105+0000 7fc342ffd640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc310079280 0x7fc31007b740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc338039000 tx=0x7fc338033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:06.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.105+0000 7fc3237fe640 10 client.4923.objecter ms_handle_connect 0x7fc310079280 2026-02-17T21:11:06.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.107+0000 7fc3237fe640 1 -- 10.20.193.45:0/1541402315 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fc32c05e0c0 con 0x7fc344150720 2026-02-17T21:11:06.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.107+0000 7fc3237fe640 10 client.4923.objecter ms_dispatch2 0x7fc344000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:06.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.107+0000 7fc3237fe640 3 client.4923.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:06.101 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.107+0000 7fc3237fe640 3 client.4923.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:06.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.107+0000 7fc3237fe640 20 client.4923.objecter dump_active .. 0 homeless 2026-02-17T21:11:06.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.210+0000 7fc3237fe640 1 -- 10.20.193.45:0/1541402315 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc32c062080 con 0x7fc344150720 2026-02-17T21:11:06.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.210+0000 7fc3237fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:06.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.210+0000 7fc3237fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:06.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.311+0000 7fc349288640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:06.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.311+0000 7fc349288640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:06.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.311+0000 7fc349288640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:06.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.311+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc34414d540 con 0x7fc344150720 2026-02-17T21:11:06.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.314+0000 7fc3237fe640 1 -- 10.20.193.45:0/1541402315 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc32c066380 con 0x7fc344150720 2026-02-17T21:11:06.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.314+0000 7fc3237fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:06.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.314+0000 7fc3237fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:06.307 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:06.307 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:06.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 10 librados: watch_flush enter 2026-02-17T21:11:06.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 10 librados: watch_flush exit 2026-02-17T21:11:06.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 20 client.4923.objecter shutdown clearing up homeless session... 2026-02-17T21:11:06.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 10 client.4923.objecter successfully canceled tick 2026-02-17T21:11:06.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc310079280 msgr2=0x7fc31007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc310079280 0x7fc31007b740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc338039000 tx=0x7fc338033000 comp rx=0 tx=0).stop 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 10 monclient: shutdown 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc344150720 msgr2=0x7fc3441547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc344150720 0x7fc3441547d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc32c00e9b0 tx=0x7fc32c00ee80 comp rx=0 tx=0).stop 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 shutdown_connections 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc310079280 0x7fc31007b740 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc34415b2b0 0x7fc344154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc344150720 0x7fc3441547d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 --2- 10.20.193.45:0/1541402315 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc3440cca30 0x7fc3440c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:06.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 >> 10.20.193.45:0/1541402315 conn(0x7fc3440cbf10 msgr2=0x7fc34414e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:06.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 shutdown_connections 2026-02-17T21:11:06.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.315+0000 7fc349288640 1 -- 10.20.193.45:0/1541402315 wait complete. 2026-02-17T21:11:06.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:06.316+0000 7fc349288640 1 librados: shutdown 2026-02-17T21:11:09.317 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:09.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.395+0000 7f6f55901640 10 monclient: get_monmap_and_config 2026-02-17T21:11:09.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.395+0000 7f6f55901640 10 monclient: build_initial_monmap 2026-02-17T21:11:09.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.395+0000 7f6f55901640 10 monclient: monmap: 2026-02-17T21:11:09.388 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:09.388 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:09.388 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:09.395990+0000 2026-02-17T21:11:09.388 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:09.395990+0000 2026-02-17T21:11:09.388 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.395+0000 7f6f55901640 1 Processor -- start 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.395+0000 7f6f55901640 1 -- start start 2026-02-17T21:11:09.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.395+0000 7f6f55901640 10 monclient: init 2026-02-17T21:11:09.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:09.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 10 monclient: _add_conns ranks=[0,1,4,2,3,5] 2026-02-17T21:11:09.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6f5015d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:09.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f6f500c92b0 addr v1:10.20.193.86:6789/0 2026-02-17T21:11:09.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f6f50153d20 0x7f6f5015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:09.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 10 monclient(hunting): picked mon.noname-b con 0x7f6f50153d20 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:09.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f500c5860 con 0x7f6f5015d1e0 2026-02-17T21:11:09.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f500c5580 con 0x7f6f500c92b0 2026-02-17T21:11:09.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f6f500c7de0 con 0x7f6f50153d20 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f55901640 10 monclient(hunting): authenticate will time out at 1253.026131s 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f4effd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f6f5015d1e0 0x7f6f500c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44630/0 (socket says 10.20.193.45:44630) 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f4effd640 1 -- 10.20.193.45:0/1793949930 learned_addr learned my addr 10.20.193.45:0/1793949930 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f4f7fe640 1 --2- 10.20.193.45:0/1793949930 >> v2:10.20.193.86:3300/0 conn(0x7f6f50153d20 0x7f6f5015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f4f7fe640 10 monclient(hunting): get_auth_request con 0x7f6f50153d20 auth_method 0 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f4f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.396+0000 7f6f4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.397+0000 7f6f4f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:09.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.397+0000 7f6f4f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.397+0000 7f6f4f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.397+0000 7f6f4dffb640 1 -- 10.20.193.45:0/1793949930 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302918241 0 0) 0x7f6f500c5860 con 0x7f6f5015d1e0 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.397+0000 7f6f4dffb640 10 monclient(hunting): _negotiate 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.397+0000 7f6f4dffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.397+0000 7f6f4dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.397+0000 7f6f4dffb640 10 monclient(hunting): my global_id is 4926 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.397+0000 7f6f4dffb640 1 -- 10.20.193.45:0/1793949930 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f3c003620 con 0x7f6f5015d1e0 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.398+0000 7f6f4f7fe640 10 monclient(hunting): handle_auth_done global_id 4990 payload 274 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.398+0000 7f6f4f7fe640 1 -- 10.20.193.45:0/1793949930 >> v1:10.20.193.86:6789/0 conn(0x7f6f500c92b0 legacy=0x7f6f50153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.398+0000 7f6f4f7fe640 1 -- 10.20.193.45:0/1793949930 >> v1:10.20.193.45:6789/0 conn(0x7f6f5015d1e0 legacy=0x7f6f500c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.398+0000 7f6f4f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:11:09.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.398+0000 7f6f4f7fe640 1 monclient: found mon.noname-b 2026-02-17T21:11:09.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.398+0000 7f6f4f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:09.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.398+0000 7f6f4f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:09.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.398+0000 7f6f4f7fe640 1 -- 10.20.193.45:0/1793949930 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f500c80c0 con 0x7f6f50153d20 2026-02-17T21:11:09.399 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.400+0000 7f6f4f7fe640 1 --2- 10.20.193.45:0/1793949930 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 0x7f6f5015d5c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009dc0 tx=0x7f6f4002f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61b0c1663010c5ef server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 1 -- 10.20.193.45:0/1793949930 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4003c070 con 0x7f6f50153d20 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 10 monclient: dump: 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:09.400 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 10 monclient: _finish_auth 0 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 10 monclient: _check_auth_tickets 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 1 -- 10.20.193.45:0/1793949930 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f40037440 con 0x7f6f50153d20 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 5 monclient: authenticate success, global_id 4990 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 1 -- 10.20.193.45:0/1793949930 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40037810 con 0x7f6f50153d20 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:09.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f4dffb640 10 monclient: dump: 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:09.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 4 set_mon_vals no callback set 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 10 monclient: shutdown 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 1 -- 10.20.193.45:0/1793949930 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 msgr2=0x7f6f5015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 1 --2- 10.20.193.45:0/1793949930 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 0x7f6f5015d5c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009dc0 tx=0x7f6f4002f230 comp rx=0 tx=0).stop 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 1 -- 10.20.193.45:0/1793949930 shutdown_connections 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 1 --2- 10.20.193.45:0/1793949930 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 0x7f6f5015d5c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 1 -- 10.20.193.45:0/1793949930 >> 10.20.193.45:0/1793949930 conn(0x7f6f500c9d40 msgr2=0x7f6f500ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.402+0000 7f6f55901640 1 -- 10.20.193.45:0/1793949930 shutdown_connections 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 1 -- 10.20.193.45:0/1793949930 wait complete. 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 10 monclient: build_initial_monmap 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 10 monclient: monmap: 2026-02-17T21:11:09.403 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 1 librados: starting msgr at 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 1 librados: starting objecter 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 1 Processor -- start 2026-02-17T21:11:09.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 1 -- start start 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 1 librados: setting wanted keys 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 1 librados: calling monclient init 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.403+0000 7f6f55901640 10 monclient: init 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6f500c92b0 0x7f6f50074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient(hunting): picked mon.noname-c con 0x7f6f500c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 0x7f6f500cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient(hunting): picked mon.noname-b con 0x7f6f50153d20 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6f5015d1e0 0x7f6f501e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient(hunting): picked mon.noname-a con 0x7f6f5015d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:09.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6f500748e0 con 0x7f6f5015d1e0 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f6f500c8680 con 0x7f6f50153d20 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6f50074a60 con 0x7f6f500c92b0 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f55901640 10 monclient(hunting): authenticate will time out at 1253.034168s 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6f5015d1e0 0x7f6f501e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4e7fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 0x7f6f500cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6f5015d1e0 0x7f6f501e75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:37746/0 (socket says 10.20.193.45:37746) 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 1 -- 10.20.193.45:0/1128132168 learned_addr learned my addr 10.20.193.45:0/1128132168 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 10 monclient(hunting): get_auth_request con 0x7f6f5015d1e0 auth_method 0 2026-02-17T21:11:09.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4e7fc640 10 monclient(hunting): get_auth_request con 0x7f6f50153d20 auth_method 0 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4effd640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6f500c92b0 0x7f6f50074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:09.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4effd640 10 monclient(hunting): get_auth_request con 0x7f6f500c92b0 auth_method 0 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.404+0000 7f6f4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.405+0000 7f6f4effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.405+0000 7f6f4effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.405+0000 7f6f4effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 10 monclient(hunting): handle_auth_done global_id 4993 payload 824 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 1 -- 10.20.193.45:0/1128132168 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6f500c92b0 msgr2=0x7f6f50074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6f500c92b0 0x7f6f50074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 1 -- 10.20.193.45:0/1128132168 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6f5015d1e0 msgr2=0x7f6f501e75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6f5015d1e0 0x7f6f501e75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:09.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 10 monclient: _finish_hunting 0 2026-02-17T21:11:09.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 1 monclient: found mon.noname-b 2026-02-17T21:11:09.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:09.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:09.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.406+0000 7f6f4e7fc640 1 -- 10.20.193.45:0/1128132168 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f500ccf80 con 0x7f6f50153d20 2026-02-17T21:11:09.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.407+0000 7f6f4e7fc640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 0x7f6f500cca40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800b550 tx=0x7f6f3800ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:09.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.407+0000 7f6f27fff640 10 client.?.objecter ms_handle_connect 0x7f6f50153d20 2026-02-17T21:11:09.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.407+0000 7f6f27fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:09.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f27fff640 1 -- 10.20.193.45:0/1128132168 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38004500 con 0x7f6f50153d20 2026-02-17T21:11:09.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:09.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f27fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:09.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f27fff640 10 monclient: dump: 2026-02-17T21:11:09.411 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:09.411 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f27fff640 10 monclient: _finish_auth 0 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f27fff640 10 monclient: _check_auth_tickets 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:09.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 5 monclient: authenticate success, global_id 4993 2026-02-17T21:11:09.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 10 monclient: _renew_subs 2026-02-17T21:11:09.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:09.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f501f1570 con 0x7f6f50153d20 2026-02-17T21:11:09.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 10 client.4993.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:09.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 10 monclient: _renew_subs 2026-02-17T21:11:09.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:09.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f50072a10 con 0x7f6f50153d20 2026-02-17T21:11:09.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 1 librados: init done 2026-02-17T21:11:09.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.408+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5015d5c0 con 0x7f6f50153d20 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.409+0000 7f6f27fff640 1 -- 10.20.193.45:0/1128132168 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f38015070 con 0x7f6f50153d20 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.409+0000 7f6f27fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.409+0000 7f6f27fff640 1 -- 10.20.193.45:0/1128132168 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38005c90 con 0x7f6f50153d20 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.409+0000 7f6f27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.409+0000 7f6f27fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.409+0000 7f6f4d7fa640 4 set_mon_vals no callback set 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.409+0000 7f6f27fff640 10 monclient: dump: 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:09.414 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:09.415 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:09.415 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:09.415 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:09.415 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:09.415 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:09.415 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:09.415 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:09.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.517+0000 7f6f27fff640 1 -- 10.20.193.45:0/1128132168 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f6f38010480 con 0x7f6f50153d20 2026-02-17T21:11:09.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.518+0000 7f6f27fff640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6f200792b0 0x7f6f2007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:09.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.518+0000 7f6f4effd640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6f200792b0 0x7f6f2007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:09.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.518+0000 7f6f4effd640 10 monclient: get_auth_request con 0x7f6f200792b0 auth_method 0 2026-02-17T21:11:09.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.518+0000 7f6f4effd640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6f200792b0 0x7f6f2007b770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6f44007b60 tx=0x7f6f44007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:09.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.518+0000 7f6f27fff640 10 client.4993.objecter ms_handle_connect 0x7f6f200792b0 2026-02-17T21:11:09.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.520+0000 7f6f27fff640 1 -- 10.20.193.45:0/1128132168 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f6f38098050 con 0x7f6f50153d20 2026-02-17T21:11:09.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.520+0000 7f6f27fff640 10 client.4993.objecter ms_dispatch2 0x7f6f50000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:09.512 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.520+0000 7f6f27fff640 3 client.4993.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.520+0000 7f6f27fff640 3 client.4993.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:09.513 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.520+0000 7f6f27fff640 20 client.4993.objecter dump_active .. 0 homeless 2026-02-17T21:11:09.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.526+0000 7f6f27fff640 1 -- 10.20.193.45:0/1128132168 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6f38062560 con 0x7f6f50153d20 2026-02-17T21:11:09.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.526+0000 7f6f27fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:09.519 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.526+0000 7f6f27fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:09.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.625+0000 7f6f55901640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:09.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.625+0000 7f6f55901640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:09.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.625+0000 7f6f55901640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:09.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.625+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6f501573a0 con 0x7f6f50153d20 2026-02-17T21:11:09.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f27fff640 1 -- 10.20.193.45:0/1128132168 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f6f38066860 con 0x7f6f50153d20 2026-02-17T21:11:09.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f27fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:09.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f27fff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:09.620 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:09.620 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 10 librados: watch_flush enter 2026-02-17T21:11:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 10 librados: watch_flush exit 2026-02-17T21:11:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 20 client.4993.objecter shutdown clearing up homeless session... 2026-02-17T21:11:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 10 client.4993.objecter successfully canceled tick 2026-02-17T21:11:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6f200792b0 msgr2=0x7f6f2007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6f200792b0 0x7f6f2007b770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6f44007b60 tx=0x7f6f44007ab0 comp rx=0 tx=0).stop 2026-02-17T21:11:09.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 10 monclient: shutdown 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 msgr2=0x7f6f500cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.628+0000 7f6f55901640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 0x7f6f500cca40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800b550 tx=0x7f6f3800ba20 comp rx=0 tx=0).stop 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.629+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 shutdown_connections 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.629+0000 7f6f55901640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6f200792b0 0x7f6f2007b770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.629+0000 7f6f55901640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f6f5015d1e0 0x7f6f501e75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.629+0000 7f6f55901640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f6f50153d20 0x7f6f500cca40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.629+0000 7f6f55901640 1 --2- 10.20.193.45:0/1128132168 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6f500c92b0 0x7f6f50074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.629+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 >> 10.20.193.45:0/1128132168 conn(0x7f6f500c9d40 msgr2=0x7f6f500ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.629+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 shutdown_connections 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.629+0000 7f6f55901640 1 -- 10.20.193.45:0/1128132168 wait complete. 2026-02-17T21:11:09.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:09.629+0000 7f6f55901640 1 librados: shutdown 2026-02-17T21:11:10.275 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:17.487 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:10.276 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:17.489 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:10.284 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:17.497 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:10.304 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:06:17.514 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:10.305 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:06:17.478 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:10.306 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:06:17.516 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:10.307 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:06:17.479 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:10.314 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:06:17.524 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:10.314 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:06:17.487 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:12.631 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:12.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.707+0000 7f3e4c04c640 10 monclient: get_monmap_and_config 2026-02-17T21:11:12.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.707+0000 7f3e4c04c640 10 monclient: build_initial_monmap 2026-02-17T21:11:12.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.707+0000 7f3e4c04c640 10 monclient: monmap: 2026-02-17T21:11:12.700 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:12.708282+0000 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:12.708282+0000 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:12.701 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:12.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.707+0000 7f3e4c04c640 1 Processor -- start 2026-02-17T21:11:12.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.707+0000 7f3e4c04c640 1 -- start start 2026-02-17T21:11:12.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.707+0000 7f3e4c04c640 10 monclient: init 2026-02-17T21:11:12.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:12.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient: _add_conns ranks=[3,5,4,1,0,2] 2026-02-17T21:11:12.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f3e4415d1e0 0x7f3e4415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:12.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient(hunting): picked mon.noname-a con 0x7f3e4415d1e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:12.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3e440748e0 0x7f3e440c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:12.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient(hunting): picked mon.noname-c con 0x7f3e440748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:11:12.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3e440c90e0 0x7f3e44153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:12.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient(hunting): picked mon.noname-b con 0x7f3e440c90e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:12.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f3e440c9570 con 0x7f3e4415d1e0 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3e440c5860 con 0x7f3e440c90e0 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3e440c5580 con 0x7f3e440748e0 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4c04c640 10 monclient(hunting): authenticate will time out at 1256.338378s 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e495c0640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3e440748e0 0x7f3e440c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.708+0000 7f3e4a5c2640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3e440c90e0 0x7f3e44153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e495c0640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3e440748e0 0x7f3e440c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:54822/0 (socket says 10.20.193.45:54822) 2026-02-17T21:11:12.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e495c0640 1 -- 10.20.193.45:0/2784502341 learned_addr learned my addr 10.20.193.45:0/2784502341 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e495c0640 10 monclient(hunting): get_auth_request con 0x7f3e440748e0 auth_method 0 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e495c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e495c0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e495c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e4a5c2640 10 monclient(hunting): get_auth_request con 0x7f3e440c90e0 auth_method 0 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e4a5c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e4a5c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e4a5c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e495c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e495c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e495c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:12.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e4a5c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e4a5c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.709+0000 7f3e4a5c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 10 monclient(hunting): handle_auth_done global_id 5051 payload 274 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 1 -- 10.20.193.45:0/2784502341 >> v2:10.20.193.86:3300/0 conn(0x7f3e440c90e0 msgr2=0x7f3e44153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 1 --2- 10.20.193.45:0/2784502341 >> v2:10.20.193.86:3300/0 conn(0x7f3e440c90e0 0x7f3e44153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 1 -- 10.20.193.45:0/2784502341 >> v2:10.20.193.45:3300/0 conn(0x7f3e4415d1e0 msgr2=0x7f3e4415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 1 --2- 10.20.193.45:0/2784502341 >> v2:10.20.193.45:3300/0 conn(0x7f3e4415d1e0 0x7f3e4415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 10 monclient: _finish_hunting 0 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 1 monclient: found mon.noname-c 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:12.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.710+0000 7f3e495c0640 1 -- 10.20.193.45:0/2784502341 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e440c7de0 con 0x7f3e440748e0 2026-02-17T21:11:12.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.712+0000 7f3e495c0640 1 --2- 10.20.193.45:0/2784502341 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e440748e0 0x7f3e440c8ba0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3e440c6af0 tx=0x7f3e3802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5bf943192719ec server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:12.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 1 -- 10.20.193.45:0/2784502341 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e3803c070 con 0x7f3e440748e0 2026-02-17T21:11:12.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:12.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:12.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 10 monclient: dump: 2026-02-17T21:11:12.715 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:12.715 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:12.715 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:12.715 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 10 monclient: _finish_auth 0 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 10 monclient: _check_auth_tickets 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 5 monclient: authenticate success, global_id 5051 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 1 -- 10.20.193.45:0/2784502341 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3802fb50 con 0x7f3e440748e0 2026-02-17T21:11:12.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 1 -- 10.20.193.45:0/2784502341 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38037440 con 0x7f3e440748e0 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 4 set_mon_vals no callback set 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e48dbf640 10 monclient: dump: 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:12.717 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 10 monclient: shutdown 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 1 -- 10.20.193.45:0/2784502341 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e440748e0 msgr2=0x7f3e440c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/2784502341 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e440748e0 0x7f3e440c8ba0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3e440c6af0 tx=0x7f3e3802eed0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 1 -- 10.20.193.45:0/2784502341 shutdown_connections 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/2784502341 >> v2:10.20.193.86:3300/0 conn(0x7f3e440c90e0 0x7f3e44153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/2784502341 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e440748e0 0x7f3e440c8ba0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/2784502341 >> v2:10.20.193.45:3300/0 conn(0x7f3e4415d1e0 0x7f3e4415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 1 -- 10.20.193.45:0/2784502341 >> 10.20.193.45:0/2784502341 conn(0x7f3e440c9d40 msgr2=0x7f3e440ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 1 -- 10.20.193.45:0/2784502341 shutdown_connections 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.714+0000 7f3e4c04c640 1 -- 10.20.193.45:0/2784502341 wait complete. 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 10 monclient: build_initial_monmap 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 10 monclient: monmap: 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:12.719 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 1 librados: starting msgr at 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 1 librados: starting objecter 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 1 Processor -- start 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 1 -- start start 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 1 librados: setting wanted keys 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 1 librados: calling monclient init 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 10 monclient: init 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.715+0000 7f3e4c04c640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:12.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e440748e0 0x7f3e44072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 10 monclient(hunting): picked mon.noname-b con 0x7f3e440748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e440c90e0 0x7f3e441f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 10 monclient(hunting): picked mon.noname-a con 0x7f3e440c90e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e4415d1e0 0x7f3e44144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 10 monclient(hunting): picked mon.noname-c con 0x7f3e4415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3e440c8680 con 0x7f3e440c90e0 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3e440c83a0 con 0x7f3e440748e0 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e44074d30 con 0x7f3e4415d1e0 2026-02-17T21:11:12.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4c04c640 10 monclient(hunting): authenticate will time out at 1256.346058s 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e440c90e0 0x7f3e441f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4a5c2640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e4415d1e0 0x7f3e44144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e49dc1640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e440748e0 0x7f3e44072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e440c90e0 0x7f3e441f2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:37760/0 (socket says 10.20.193.45:37760) 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 1 -- 10.20.193.45:0/408128080 learned_addr learned my addr 10.20.193.45:0/408128080 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 10 monclient(hunting): get_auth_request con 0x7f3e440c90e0 auth_method 0 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:12.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4a5c2640 10 monclient(hunting): get_auth_request con 0x7f3e4415d1e0 auth_method 0 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4a5c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4a5c2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4a5c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e49dc1640 10 monclient(hunting): get_auth_request con 0x7f3e440748e0 auth_method 0 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e49dc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e49dc1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e49dc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4a5c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4a5c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e4a5c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:12.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e495c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e49dc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e49dc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.716+0000 7f3e49dc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 10 monclient(hunting): handle_auth_done global_id 5054 payload 824 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 1 -- 10.20.193.45:0/408128080 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e440748e0 msgr2=0x7f3e44072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e440748e0 0x7f3e44072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 1 -- 10.20.193.45:0/408128080 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e440c90e0 msgr2=0x7f3e441f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e440c90e0 0x7f3e441f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 10 monclient: _finish_hunting 0 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 1 monclient: found mon.noname-c 2026-02-17T21:11:12.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.718+0000 7f3e4a5c2640 1 -- 10.20.193.45:0/408128080 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e44072b40 con 0x7f3e4415d1e0 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.719+0000 7f3e4a5c2640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e4415d1e0 0x7f3e44144f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000efc0 tx=0x7f3e4000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.719+0000 7f3e327fc640 10 client.?.objecter ms_handle_connect 0x7f3e4415d1e0 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.719+0000 7f3e327fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 1 -- 10.20.193.45:0/408128080 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40018020 con 0x7f3e4415d1e0 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 10 monclient: dump: 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:12.725 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 10 monclient: _finish_auth 0 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 10 monclient: _check_auth_tickets 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 5 monclient: authenticate success, global_id 5054 2026-02-17T21:11:12.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 10 monclient: _renew_subs 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e44072e20 con 0x7f3e4415d1e0 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 10 client.5054.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 10 monclient: _renew_subs 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e440733e0 con 0x7f3e4415d1e0 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 1 librados: init done 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 1 -- 10.20.193.45:0/408128080 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e40014480 con 0x7f3e4415d1e0 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:12.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 1 -- 10.20.193.45:0/408128080 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40014830 con 0x7f3e4415d1e0 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e33fff640 4 set_mon_vals no callback set 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e327fc640 10 monclient: dump: 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:12.728 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:12.729 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.720+0000 7f3e4c04c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.721+0000 7f3e4c04c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.721+0000 7f3e4c04c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:12.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.721+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e440c8ba0 con 0x7f3e4415d1e0 2026-02-17T21:11:12.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.826+0000 7f3e327fc640 1 -- 10.20.193.45:0/408128080 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f3e400149d0 con 0x7f3e4415d1e0 2026-02-17T21:11:12.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.826+0000 7f3e327fc640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e14079280 0x7f3e1407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:12.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.826+0000 7f3e49dc1640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e14079280 0x7f3e1407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:12.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.826+0000 7f3e49dc1640 10 monclient: get_auth_request con 0x7f3e14079280 auth_method 0 2026-02-17T21:11:12.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.827+0000 7f3e49dc1640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e14079280 0x7f3e1407b740 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e440708c0 tx=0x7f3e34009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:12.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.827+0000 7f3e327fc640 10 client.5054.objecter ms_handle_connect 0x7f3e14079280 2026-02-17T21:11:12.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.827+0000 7f3e327fc640 1 -- 10.20.193.45:0/408128080 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f3e4005f540 con 0x7f3e4415d1e0 2026-02-17T21:11:12.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.827+0000 7f3e327fc640 10 client.5054.objecter ms_dispatch2 0x7f3e44000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:12.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.827+0000 7f3e327fc640 3 client.5054.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:12.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.827+0000 7f3e327fc640 3 client.5054.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:12.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.827+0000 7f3e327fc640 20 client.5054.objecter dump_active .. 0 homeless 2026-02-17T21:11:12.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.833+0000 7f3e327fc640 1 -- 10.20.193.45:0/408128080 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3e40022020 con 0x7f3e4415d1e0 2026-02-17T21:11:12.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.833+0000 7f3e327fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:12.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.833+0000 7f3e327fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.933+0000 7f3e4c04c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.933+0000 7f3e4c04c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.933+0000 7f3e4c04c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:12.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.933+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3e44151ce0 con 0x7f3e4415d1e0 2026-02-17T21:11:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.936+0000 7f3e327fc640 1 -- 10.20.193.45:0/408128080 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f3e40010040 con 0x7f3e4415d1e0 2026-02-17T21:11:12.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.936+0000 7f3e327fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:12.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.936+0000 7f3e327fc640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:12.929 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:12.929 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 10 librados: watch_flush enter 2026-02-17T21:11:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 10 librados: watch_flush exit 2026-02-17T21:11:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 20 client.5054.objecter shutdown clearing up homeless session... 2026-02-17T21:11:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 10 client.5054.objecter successfully canceled tick 2026-02-17T21:11:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e14079280 msgr2=0x7f3e1407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e14079280 0x7f3e1407b740 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e440708c0 tx=0x7f3e34009190 comp rx=0 tx=0).stop 2026-02-17T21:11:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 10 monclient: shutdown 2026-02-17T21:11:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:12.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e4415d1e0 msgr2=0x7f3e44144f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e4415d1e0 0x7f3e44144f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000efc0 tx=0x7f3e4000c490 comp rx=0 tx=0).stop 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 shutdown_connections 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e14079280 0x7f3e1407b740 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e4415d1e0 0x7f3e44144f90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e440c90e0 0x7f3e441f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 --2- 10.20.193.45:0/408128080 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e440748e0 0x7f3e44072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 >> 10.20.193.45:0/408128080 conn(0x7f3e440c9d40 msgr2=0x7f3e4414dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 shutdown_connections 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 -- 10.20.193.45:0/408128080 wait complete. 2026-02-17T21:11:12.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:12.937+0000 7f3e4c04c640 1 librados: shutdown 2026-02-17T21:11:15.938 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:16.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.015+0000 7f04e5171640 10 monclient: get_monmap_and_config 2026-02-17T21:11:16.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.015+0000 7f04e5171640 10 monclient: build_initial_monmap 2026-02-17T21:11:16.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.015+0000 7f04e5171640 10 monclient: monmap: 2026-02-17T21:11:16.008 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:16.008 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:16.016210+0000 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:16.016210+0000 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:16.009 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:16.010 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:16.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.015+0000 7f04e5171640 1 Processor -- start 2026-02-17T21:11:16.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.015+0000 7f04e5171640 1 -- start start 2026-02-17T21:11:16.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.015+0000 7f04e5171640 10 monclient: init 2026-02-17T21:11:16.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:16.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 10 monclient: _add_conns ranks=[1,3,4,5,2,0] 2026-02-17T21:11:16.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f04e015d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:11:16.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f04e00c92b0 0x7f04e015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 10 monclient(hunting): picked mon.noname-a con 0x7f04e00c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f04e00748e0 0x7f04e0153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 10 monclient(hunting): picked mon.noname-b con 0x7f04e00748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e00c5860 con 0x7f04e015d1e0 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f04e00c5580 con 0x7f04e00c92b0 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f04e00c7de0 con 0x7f04e00748e0 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:16.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04e5171640 10 monclient(hunting): authenticate will time out at 1259.646321s 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.016+0000 7f04de575640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f04e00c92b0 0x7f04e015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04de575640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f04e00c92b0 0x7f04e015d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:37776/0 (socket says 10.20.193.45:37776) 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04de575640 1 -- 10.20.193.45:0/1949371899 learned_addr learned my addr 10.20.193.45:0/1949371899 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04de575640 10 monclient(hunting): get_auth_request con 0x7f04e00c92b0 auth_method 0 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04de575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04de575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04de575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04de575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04de575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:16.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04de575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.017+0000 7f04df577640 1 --2- 10.20.193.45:0/1949371899 >> v2:10.20.193.86:3300/0 conn(0x7f04e00748e0 0x7f04e0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04df577640 10 monclient(hunting): get_auth_request con 0x7f04e00748e0 auth_method 0 2026-02-17T21:11:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04df577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04df577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04df577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04de575640 10 monclient(hunting): handle_auth_done global_id 4935 payload 274 2026-02-17T21:11:16.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04de575640 1 -- 10.20.193.45:0/1949371899 >> v2:10.20.193.86:3300/0 conn(0x7f04e00748e0 msgr2=0x7f04e0153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04de575640 1 --2- 10.20.193.45:0/1949371899 >> v2:10.20.193.86:3300/0 conn(0x7f04e00748e0 0x7f04e0153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04de575640 1 -- 10.20.193.45:0/1949371899 >> v1:10.20.193.86:6789/0 conn(0x7f04e015d1e0 legacy=0x7f04e00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04de575640 10 monclient: _finish_hunting 0 2026-02-17T21:11:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04de575640 1 monclient: found mon.noname-a 2026-02-17T21:11:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04de575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04de575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:16.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.018+0000 7f04de575640 1 -- 10.20.193.45:0/1949371899 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e00c80c0 con 0x7f04e00c92b0 2026-02-17T21:11:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.019+0000 7f04de575640 1 --2- 10.20.193.45:0/1949371899 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e00c92b0 0x7f04e015d5c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009970 tx=0x7f04c802eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdae1ef56e498b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 1 -- 10.20.193.45:0/1949371899 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c803c070 con 0x7f04e00c92b0 2026-02-17T21:11:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:16.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 10 monclient: dump: 2026-02-17T21:11:16.023 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:16.023 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:16.023 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:16.023 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 10 monclient: _finish_auth 0 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 10 monclient: _check_auth_tickets 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 1 -- 10.20.193.45:0/1949371899 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c802fb20 con 0x7f04e00c92b0 2026-02-17T21:11:16.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 5 monclient: authenticate success, global_id 4935 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 1 -- 10.20.193.45:0/1949371899 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8037440 con 0x7f04e00c92b0 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04ddd74640 10 monclient: dump: 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:16.025 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 4 set_mon_vals no callback set 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 10 monclient: shutdown 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:16.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 1 -- 10.20.193.45:0/1949371899 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e00c92b0 msgr2=0x7f04e015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 1 --2- 10.20.193.45:0/1949371899 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e00c92b0 0x7f04e015d5c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f04c8009970 tx=0x7f04c802eef0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 1 -- 10.20.193.45:0/1949371899 shutdown_connections 2026-02-17T21:11:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 1 --2- 10.20.193.45:0/1949371899 >> v2:10.20.193.86:3300/0 conn(0x7f04e00748e0 0x7f04e0153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 1 --2- 10.20.193.45:0/1949371899 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e00c92b0 0x7f04e015d5c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 1 -- 10.20.193.45:0/1949371899 >> 10.20.193.45:0/1949371899 conn(0x7f04e00c9d40 msgr2=0x7f04e00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 1 -- 10.20.193.45:0/1949371899 shutdown_connections 2026-02-17T21:11:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 1 -- 10.20.193.45:0/1949371899 wait complete. 2026-02-17T21:11:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 10 monclient: build_initial_monmap 2026-02-17T21:11:16.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.021+0000 7f04e5171640 10 monclient: monmap: 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:16.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 librados: starting msgr at 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 librados: starting objecter 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 Processor -- start 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 -- start start 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 librados: setting wanted keys 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 librados: calling monclient init 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient: init 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f04e00748e0 0x7f04e01458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient(hunting): picked mon.noname-b con 0x7f04e00748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f04e00c92b0 0x7f04e0145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:16.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient(hunting): picked mon.noname-c con 0x7f04e00c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e015d1e0 0x7f04e0072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient(hunting): picked mon.noname-a con 0x7f04e015d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f04e0074d30 con 0x7f04e015d1e0 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f04e00c8680 con 0x7f04e00748e0 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04e0153b50 con 0x7f04e00c92b0 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:16.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04e5171640 10 monclient(hunting): authenticate will time out at 1259.652618s 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04df577640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e015d1e0 0x7f04e0072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.022+0000 7f04ded76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f04e00748e0 0x7f04e01458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04df577640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e015d1e0 0x7f04e0072bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:37782/0 (socket says 10.20.193.45:37782) 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04de575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f04e00c92b0 0x7f04e0145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04df577640 1 -- 10.20.193.45:0/618919476 learned_addr learned my addr 10.20.193.45:0/618919476 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04df577640 10 monclient(hunting): get_auth_request con 0x7f04e015d1e0 auth_method 0 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04df577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04df577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04df577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04ded76640 10 monclient(hunting): get_auth_request con 0x7f04e00748e0 auth_method 0 2026-02-17T21:11:16.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04ded76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04ded76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04ded76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04df577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04df577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04df577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04de575640 10 monclient(hunting): get_auth_request con 0x7f04e00c92b0 auth_method 0 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04de575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04de575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04de575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04ded76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04ded76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:16.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04ded76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04de575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04de575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.023+0000 7f04de575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 10 monclient(hunting): handle_auth_done global_id 4938 payload 824 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 1 -- 10.20.193.45:0/618919476 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f04e00c92b0 msgr2=0x7f04e0145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f04e00c92b0 0x7f04e0145e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 1 -- 10.20.193.45:0/618919476 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f04e00748e0 msgr2=0x7f04e01458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f04e00748e0 0x7f04e01458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 10 monclient: _finish_hunting 0 2026-02-17T21:11:16.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 1 monclient: found mon.noname-a 2026-02-17T21:11:16.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:16.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:16.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.024+0000 7f04df577640 1 -- 10.20.193.45:0/618919476 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e00726f0 con 0x7f04e015d1e0 2026-02-17T21:11:16.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.025+0000 7f04df577640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e015d1e0 0x7f04e0072bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04d0007e40 tx=0x7f04d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:16.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.025+0000 7f04bf7fe640 10 client.?.objecter ms_handle_connect 0x7f04e015d1e0 2026-02-17T21:11:16.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.025+0000 7f04bf7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:16.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 1 -- 10.20.193.45:0/618919476 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0014620 con 0x7f04e015d1e0 2026-02-17T21:11:16.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:16.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:16.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 10 monclient: dump: 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:16.038 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 1 -- 10.20.193.45:0/618919476 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d0019070 con 0x7f04e015d1e0 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 5 monclient: authenticate success, global_id 4938 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 10 monclient: _renew_subs 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e015ae10 con 0x7f04e015d1e0 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 1 -- 10.20.193.45:0/618919476 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0014a20 con 0x7f04e015d1e0 2026-02-17T21:11:16.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04bf7fe640 10 monclient: dump: 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:16.040 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04dd573640 4 set_mon_vals no callback set 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 10 client.4938.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 10 monclient: _renew_subs 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e015b3d0 con 0x7f04e015d1e0 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 1 librados: init done 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:16.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:16.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.027+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e0153f30 con 0x7f04e015d1e0 2026-02-17T21:11:16.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.039+0000 7f04bf7fe640 1 -- 10.20.193.45:0/618919476 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f04d0014bc0 con 0x7f04e015d1e0 2026-02-17T21:11:16.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.040+0000 7f04bf7fe640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f04ac0792d0 0x7f04ac07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:16.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.040+0000 7f04ded76640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f04ac0792d0 0x7f04ac07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:16.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.040+0000 7f04ded76640 10 monclient: get_auth_request con 0x7f04ac0792d0 auth_method 0 2026-02-17T21:11:16.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.040+0000 7f04bf7fe640 10 client.4938.objecter ms_handle_connect 0x7f04ac0792d0 2026-02-17T21:11:16.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.040+0000 7f04ded76640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f04ac0792d0 0x7f04ac07b790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04d4004660 tx=0x7f04d4009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:16.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.145+0000 7f04bf7fe640 1 -- 10.20.193.45:0/618919476 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f04d005f3c0 con 0x7f04e015d1e0 2026-02-17T21:11:16.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.145+0000 7f04bf7fe640 10 client.4938.objecter ms_dispatch2 0x7f04e0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:16.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.145+0000 7f04bf7fe640 3 client.4938.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:16.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.145+0000 7f04bf7fe640 3 client.4938.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:16.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.145+0000 7f04bf7fe640 20 client.4938.objecter dump_active .. 0 homeless 2026-02-17T21:11:16.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.145+0000 7f04bf7fe640 1 -- 10.20.193.45:0/618919476 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f04d0063380 con 0x7f04e015d1e0 2026-02-17T21:11:16.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.145+0000 7f04bf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:16.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.145+0000 7f04bf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:16.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.246+0000 7f04e5171640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:16.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.246+0000 7f04e5171640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:16.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.246+0000 7f04e5171640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:16.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.246+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f04e00cd030 con 0x7f04e015d1e0 2026-02-17T21:11:16.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.248+0000 7f04bf7fe640 1 -- 10.20.193.45:0/618919476 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f04d0067680 con 0x7f04e015d1e0 2026-02-17T21:11:16.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.249+0000 7f04bf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:16.241 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.249+0000 7f04bf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:16.242 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:16.242 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:16.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 10 librados: watch_flush enter 2026-02-17T21:11:16.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 10 librados: watch_flush exit 2026-02-17T21:11:16.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 20 client.4938.objecter shutdown clearing up homeless session... 2026-02-17T21:11:16.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 10 client.4938.objecter successfully canceled tick 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f04ac0792d0 msgr2=0x7f04ac07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f04ac0792d0 0x7f04ac07b790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f04d4004660 tx=0x7f04d4009110 comp rx=0 tx=0).stop 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 10 monclient: shutdown 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e015d1e0 msgr2=0x7f04e0072bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e015d1e0 0x7f04e0072bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04d0007e40 tx=0x7f04d000e4b0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 shutdown_connections 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f04ac0792d0 0x7f04ac07b790 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f04e015d1e0 0x7f04e0072bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f04e00c92b0 0x7f04e0145e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 --2- 10.20.193.45:0/618919476 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f04e00748e0 0x7f04e01458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:16.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 >> 10.20.193.45:0/618919476 conn(0x7f04e00c9d40 msgr2=0x7f04e01533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:16.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 shutdown_connections 2026-02-17T21:11:16.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 -- 10.20.193.45:0/618919476 wait complete. 2026-02-17T21:11:16.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:16.250+0000 7f04e5171640 1 librados: shutdown 2026-02-17T21:11:19.252 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:19.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.329+0000 7ffbecded640 10 monclient: get_monmap_and_config 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.329+0000 7ffbecded640 10 monclient: build_initial_monmap 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.329+0000 7ffbecded640 10 monclient: monmap: 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:19.330136+0000 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:19.330136+0000 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:19.322 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:19.323 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:19.323 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:19.323 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:19.323 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:19.323 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:19.325 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.329+0000 7ffbecded640 1 Processor -- start 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.329+0000 7ffbecded640 1 -- start start 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.329+0000 7ffbecded640 10 monclient: init 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 10 monclient: _add_conns ranks=[3,1,0,5,4,2] 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ffbe8152620 0x7ffbe815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 10 monclient(hunting): picked mon.noname-a con 0x7ffbe8152620 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ffbe8152a00 addr v1:10.20.193.86:6789/0 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ffbe80c94a0 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe80c71a0 con 0x7ffbe80c94a0 2026-02-17T21:11:19.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbe80c7480 con 0x7ffbe8152a00 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7ffbe80c7760 con 0x7ffbe8152620 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbecded640 10 monclient(hunting): authenticate will time out at 1262.960345s 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbe6575640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ffbe8152620 0x7ffbe815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbe5d74640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7ffbe8152a00 0x7ffbe80c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:50760/0 (socket says 10.20.193.45:50760) 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.330+0000 7ffbe5d74640 1 -- 10.20.193.45:0/2193377618 learned_addr learned my addr 10.20.193.45:0/2193377618 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.331+0000 7ffbe6575640 10 monclient(hunting): get_auth_request con 0x7ffbe8152620 auth_method 0 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.331+0000 7ffbe6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.331+0000 7ffbe6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.331+0000 7ffbe6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:19.327 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.331+0000 7ffbe6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.331+0000 7ffbe6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.331+0000 7ffbe6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe5573640 1 -- 10.20.193.45:0/2193377618 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467284899 0 0) 0x7ffbe80c7480 con 0x7ffbe8152a00 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe5573640 10 monclient(hunting): _negotiate 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe5573640 10 monclient(hunting): my global_id is 5008 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe5573640 1 -- 10.20.193.45:0/2193377618 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbd4003620 con 0x7ffbe8152a00 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe6575640 10 monclient(hunting): handle_auth_done global_id 4941 payload 274 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe6575640 1 -- 10.20.193.45:0/2193377618 >> v1:10.20.193.86:6789/0 conn(0x7ffbe8152a00 legacy=0x7ffbe80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe6575640 1 -- 10.20.193.45:0/2193377618 >> v1:10.20.193.45:6789/0 conn(0x7ffbe80c94a0 legacy=0x7ffbe80c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe6575640 10 monclient: _finish_hunting 0 2026-02-17T21:11:19.328 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe6575640 1 monclient: found mon.noname-a 2026-02-17T21:11:19.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:19.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe6575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:19.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.332+0000 7ffbe6575640 1 -- 10.20.193.45:0/2193377618 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe8159e00 con 0x7ffbe8152620 2026-02-17T21:11:19.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.334+0000 7ffbe6575640 1 --2- 10.20.193.45:0/2193377618 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 0x7ffbe815a8e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0098a0 tx=0x7ffbdc02ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbfac41fa8ee560 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:19.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 1 -- 10.20.193.45:0/2193377618 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc03c070 con 0x7ffbe8152620 2026-02-17T21:11:19.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:19.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:19.334 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 10 monclient: dump: 2026-02-17T21:11:19.334 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:19.334 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 10 monclient: _finish_auth 0 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 10 monclient: _check_auth_tickets 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:19.335 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 1 -- 10.20.193.45:0/2193377618 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc02fb70 con 0x7ffbe8152620 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbecded640 5 monclient: authenticate success, global_id 4941 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 1 -- 10.20.193.45:0/2193377618 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc037440 con 0x7ffbe8152620 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbecded640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbecded640 4 set_mon_vals no callback set 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.336+0000 7ffbe5573640 10 monclient: dump: 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:19.336 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 10 monclient: shutdown 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 1 -- 10.20.193.45:0/2193377618 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 msgr2=0x7ffbe815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 1 --2- 10.20.193.45:0/2193377618 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 0x7ffbe815a8e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc0098a0 tx=0x7ffbdc02ee60 comp rx=0 tx=0).stop 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 1 -- 10.20.193.45:0/2193377618 shutdown_connections 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 1 --2- 10.20.193.45:0/2193377618 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 0x7ffbe815a8e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:19.337 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 1 -- 10.20.193.45:0/2193377618 >> 10.20.193.45:0/2193377618 conn(0x7ffbe80c9d40 msgr2=0x7ffbe80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 1 -- 10.20.193.45:0/2193377618 shutdown_connections 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 1 -- 10.20.193.45:0/2193377618 wait complete. 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 10 monclient: build_initial_monmap 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.337+0000 7ffbecded640 10 monclient: monmap: 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:19.338 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 librados: starting msgr at 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 librados: starting objecter 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 Processor -- start 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 -- start start 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 librados: setting wanted keys 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 librados: calling monclient init 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient: init 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbe80c94a0 0x7ffbe80743a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient(hunting): picked mon.noname-c con 0x7ffbe80c94a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:19.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 0x7ffbe8147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient(hunting): picked mon.noname-a con 0x7ffbe8152620 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbe8152a00 0x7ffbe8157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient(hunting): picked mon.noname-b con 0x7ffbe8152a00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe815ae20 con 0x7ffbe8152620 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe815a3c0 con 0x7ffbe8152a00 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffbe815afa0 con 0x7ffbe80c94a0 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbecded640 10 monclient(hunting): authenticate will time out at 1262.968659s 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbe5d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 0x7ffbe8147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:19.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.338+0000 7ffbe6d76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbe8152a00 0x7ffbe8157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe5d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 0x7ffbe8147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:33840/0 (socket says 10.20.193.45:33840) 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe5d74640 1 -- 10.20.193.45:0/1025312953 learned_addr learned my addr 10.20.193.45:0/1025312953 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe5d74640 10 monclient(hunting): get_auth_request con 0x7ffbe8152620 auth_method 0 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6d76640 10 monclient(hunting): get_auth_request con 0x7ffbe8152a00 auth_method 0 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6575640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbe80c94a0 0x7ffbe80743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:19.341 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6575640 10 monclient(hunting): get_auth_request con 0x7ffbe80c94a0 auth_method 0 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.339+0000 7ffbe6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 10 monclient(hunting): handle_auth_done global_id 5011 payload 824 2026-02-17T21:11:19.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 1 -- 10.20.193.45:0/1025312953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbe80c94a0 msgr2=0x7ffbe80743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbe80c94a0 0x7ffbe80743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 1 -- 10.20.193.45:0/1025312953 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 msgr2=0x7ffbe8147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 0x7ffbe8147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 10 monclient: _finish_hunting 0 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 1 monclient: found mon.noname-b 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.340+0000 7ffbe6d76640 1 -- 10.20.193.45:0/1025312953 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbe81f46e0 con 0x7ffbe8152a00 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.341+0000 7ffbe6d76640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbe8152a00 0x7ffbe8157660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800cb70 tx=0x7ffbd800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.341+0000 7ffbceffd640 10 client.?.objecter ms_handle_connect 0x7ffbe8152a00 2026-02-17T21:11:19.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.341+0000 7ffbceffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:19.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 1 -- 10.20.193.45:0/1025312953 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd800ad50 con 0x7ffbe8152a00 2026-02-17T21:11:19.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:19.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 10 monclient: dump: 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:19.346 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 10 monclient: _finish_auth 0 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 10 monclient: _check_auth_tickets 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 1 -- 10.20.193.45:0/1025312953 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd8003a90 con 0x7ffbe8152a00 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbecded640 5 monclient: authenticate success, global_id 5011 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbecded640 10 monclient: _renew_subs 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbecded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbe81568a0 con 0x7ffbe8152a00 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 1 -- 10.20.193.45:0/1025312953 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80050d0 con 0x7ffbe8152a00 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:19.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbe4d72640 4 set_mon_vals no callback set 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbceffd640 10 monclient: dump: 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbecded640 10 client.5011.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:19.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbecded640 10 monclient: _renew_subs 2026-02-17T21:11:19.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbecded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:19.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbe8156e60 con 0x7ffbe8152a00 2026-02-17T21:11:19.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.343+0000 7ffbecded640 1 librados: init done 2026-02-17T21:11:19.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.344+0000 7ffbecded640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:19.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.344+0000 7ffbecded640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:19.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.344+0000 7ffbecded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:19.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.344+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbe815a8e0 con 0x7ffbe8152a00 2026-02-17T21:11:19.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.450+0000 7ffbceffd640 1 -- 10.20.193.45:0/1025312953 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ffbd8005270 con 0x7ffbe8152a00 2026-02-17T21:11:19.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.450+0000 7ffbceffd640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffbb40792d0 0x7ffbb407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:19.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.450+0000 7ffbe6575640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffbb40792d0 0x7ffbb407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:19.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.451+0000 7ffbe6575640 10 monclient: get_auth_request con 0x7ffbb40792d0 auth_method 0 2026-02-17T21:11:19.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.451+0000 7ffbe6575640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffbb40792d0 0x7ffbb407b790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc039000 tx=0x7ffbdc033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:19.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.451+0000 7ffbceffd640 10 client.5011.objecter ms_handle_connect 0x7ffbb40792d0 2026-02-17T21:11:19.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.451+0000 7ffbceffd640 1 -- 10.20.193.45:0/1025312953 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ffbd805e9e0 con 0x7ffbe8152a00 2026-02-17T21:11:19.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.451+0000 7ffbceffd640 10 client.5011.objecter ms_dispatch2 0x7ffbe8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:19.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.451+0000 7ffbceffd640 3 client.5011.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:19.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.451+0000 7ffbceffd640 3 client.5011.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:19.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.451+0000 7ffbceffd640 20 client.5011.objecter dump_active .. 0 homeless 2026-02-17T21:11:19.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.457+0000 7ffbceffd640 1 -- 10.20.193.45:0/1025312953 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ffbd80629a0 con 0x7ffbe8152a00 2026-02-17T21:11:19.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.457+0000 7ffbceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:19.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.457+0000 7ffbceffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:19.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.558+0000 7ffbecded640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:19.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.558+0000 7ffbecded640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:19.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.558+0000 7ffbecded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:19.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.558+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffbe814ba00 con 0x7ffbe8152a00 2026-02-17T21:11:19.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.560+0000 7ffbceffd640 1 -- 10.20.193.45:0/1025312953 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ffbd8066ca0 con 0x7ffbe8152a00 2026-02-17T21:11:19.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.560+0000 7ffbceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:19.553 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.560+0000 7ffbceffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:19.553 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:19.553 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:19.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 10 librados: watch_flush enter 2026-02-17T21:11:19.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 10 librados: watch_flush exit 2026-02-17T21:11:19.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 20 client.5011.objecter shutdown clearing up homeless session... 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 10 client.5011.objecter successfully canceled tick 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffbb40792d0 msgr2=0x7ffbb407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffbb40792d0 0x7ffbb407b790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc039000 tx=0x7ffbdc033000 comp rx=0 tx=0).stop 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 10 monclient: shutdown 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbe8152a00 msgr2=0x7ffbe8157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbe8152a00 0x7ffbe8157660 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800cb70 tx=0x7ffbd800a430 comp rx=0 tx=0).stop 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 shutdown_connections 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffbb40792d0 0x7ffbb407b790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbe8152a00 0x7ffbe8157660 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbe8152620 0x7ffbe8147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:19.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 --2- 10.20.193.45:0/1025312953 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbe80c94a0 0x7ffbe80743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:19.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 >> 10.20.193.45:0/1025312953 conn(0x7ffbe80c9d40 msgr2=0x7ffbe806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:19.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 shutdown_connections 2026-02-17T21:11:19.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 -- 10.20.193.45:0/1025312953 wait complete. 2026-02-17T21:11:19.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:19.562+0000 7ffbecded640 1 librados: shutdown 2026-02-17T21:11:22.565 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:22.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.641+0000 7f925c921640 10 monclient: get_monmap_and_config 2026-02-17T21:11:22.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.641+0000 7f925c921640 10 monclient: build_initial_monmap 2026-02-17T21:11:22.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.641+0000 7f925c921640 10 monclient: monmap: 2026-02-17T21:11:22.634 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:22.634 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:22.634 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:22.642175+0000 2026-02-17T21:11:22.634 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:22.642175+0000 2026-02-17T21:11:22.634 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:22.634 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:22.634 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:22.635 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:22.635 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:22.635 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:22.635 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:22.635 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:22.635 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:22.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.641+0000 7f925c921640 1 Processor -- start 2026-02-17T21:11:22.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 1 -- start start 2026-02-17T21:11:22.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 10 monclient: init 2026-02-17T21:11:22.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:22.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 10 monclient: _add_conns ranks=[3,0,2,4,1,5] 2026-02-17T21:11:22.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f9258155da0 0x7f9258159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 10 monclient(hunting): picked mon.noname-a con 0x7f9258155da0 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9258074de0 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f925815f910 addr v1:10.20.193.92:6789/0 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f925815e200 con 0x7f9258074de0 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f925815e4e0 con 0x7f925815f910 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f925815e7c0 con 0x7f9258155da0 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.642+0000 7f925c921640 10 monclient(hunting): authenticate will time out at 1266.272648s 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.643+0000 7f9257577640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f925815f910 0x7f925815d100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:39948/0 (socket says 10.20.193.45:39948) 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.643+0000 7f9257577640 1 -- 10.20.193.45:0/3559765549 learned_addr learned my addr 10.20.193.45:0/3559765549 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:22.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.644+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302075280 0 0) 0x7f925815e4e0 con 0x7f925815f910 2026-02-17T21:11:22.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.644+0000 7f9255d74640 10 monclient(hunting): _negotiate 2026-02-17T21:11:22.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.644+0000 7f9255d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:22.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.644+0000 7f9255d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:22.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.644+0000 7f9255d74640 10 monclient(hunting): my global_id is 5063 2026-02-17T21:11:22.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.644+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9244003620 con 0x7f925815f910 2026-02-17T21:11:22.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 <== mon.2 v1:10.20.193.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3960013753 0 0) 0x7f9244003620 con 0x7f925815f910 2026-02-17T21:11:22.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 >> v2:10.20.193.45:3300/0 conn(0x7f9258155da0 msgr2=0x7f9258159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:22.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 --2- 10.20.193.45:0/3559765549 >> v2:10.20.193.45:3300/0 conn(0x7f9258155da0 0x7f9258159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 >> v1:10.20.193.45:6789/0 conn(0x7f9258074de0 legacy=0x7f925815f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:22.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient: _finish_hunting 0 2026-02-17T21:11:22.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:11:22.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:22.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.92:6789/0 2026-02-17T21:11:22.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 --> v1:10.20.193.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925815eaa0 con 0x7f925815f910 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient: _finish_auth 0 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient: _check_auth_tickets 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 <== mon.2 v1:10.20.193.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f9248003280 con 0x7f925815f910 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient: dump: 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.644 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] but i'm connected to v1:10.20.193.92:6789/0, reconnecting 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 >> v1:10.20.193.92:6789/0 conn(0x7f925815f910 legacy=0x7f925815d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9244003ba0 0x7f9244003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient(hunting): picked mon.c con 0x7f9244003ba0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:22.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f9244004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient(hunting): picked mon.b con 0x7f9244004900 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9244005510 0x7f924400bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient(hunting): picked mon.a con 0x7f9244005510 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f925815e7c0 con 0x7f9244005510 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f924400c450 con 0x7f9244004900 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f924400c650 con 0x7f9244003ba0 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9255d74640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9256575640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f9244004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:22.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9256575640 10 monclient(hunting): get_auth_request con 0x7f9244004900 auth_method 0 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9256575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9256575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.646+0000 7f9256575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.647+0000 7f9256575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.647+0000 7f9256575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.647+0000 7f9256575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.647+0000 7f9256d76640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9244003ba0 0x7f9244003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.647+0000 7f9256d76640 10 monclient(hunting): get_auth_request con 0x7f9244003ba0 auth_method 0 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.647+0000 7f9256d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.647+0000 7f9256d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.647+0000 7f9256d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:11:22.647 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 10 monclient(hunting): handle_auth_done global_id 5063 payload 293 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 1 -- 10.20.193.45:0/3559765549 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9244003ba0 msgr2=0x7f9244003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9244003ba0 0x7f9244003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 1 -- 10.20.193.45:0/3559765549 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9244005510 msgr2=0x7f924400bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9244005510 0x7f924400bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 10 monclient: _finish_hunting 0 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 1 monclient: found mon.b 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 1 -- 10.20.193.45:0/3559765549 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9244003620 con 0x7f9244004900 2026-02-17T21:11:22.648 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9257577640 1 -- 10.20.193.45:0/3559765549 reap_dead start 2026-02-17T21:11:22.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 10 monclient: _finish_auth 0 2026-02-17T21:11:22.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 10 monclient: _check_auth_tickets 2026-02-17T21:11:22.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f9256575640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:22.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f925c921640 5 monclient: authenticate success, global_id 5063 2026-02-17T21:11:22.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.648+0000 7f925c921640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:22.649 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.649+0000 7f9256575640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f9244004d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9240002f60 tx=0x7f924002eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94849f23cbc7d04b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:22.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240002b30 con 0x7f9244004900 2026-02-17T21:11:22.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:22.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:22.655 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 10 monclient: dump: 2026-02-17T21:11:22.655 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9240005290 con 0x7f9244004900 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:22.656 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 1 -- 10.20.193.45:0/3559765549 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240003710 con 0x7f9244004900 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 4 set_mon_vals no callback set 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f9255d74640 10 monclient: dump: 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:22.657 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 10 monclient: shutdown 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 1 -- 10.20.193.45:0/3559765549 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 msgr2=0x7f9244004d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f9244004d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9240002f60 tx=0x7f924002eca0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 1 -- 10.20.193.45:0/3559765549 shutdown_connections 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 1 --2- 10.20.193.45:0/3559765549 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f9244004d80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 1 -- 10.20.193.45:0/3559765549 >> 10.20.193.45:0/3559765549 conn(0x7f92580ce1d0 msgr2=0x7f92580ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:22.658 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 1 -- 10.20.193.45:0/3559765549 shutdown_connections 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 1 -- 10.20.193.45:0/3559765549 wait complete. 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 10 monclient: build_initial_monmap 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.651+0000 7f925c921640 10 monclient: monmap: 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:22.659 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:22.660 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:22.660 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:22.660 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:22.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 librados: starting msgr at 2026-02-17T21:11:22.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 librados: starting objecter 2026-02-17T21:11:22.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 Processor -- start 2026-02-17T21:11:22.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 -- start start 2026-02-17T21:11:22.660 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 librados: setting wanted keys 2026-02-17T21:11:22.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 librados: calling monclient init 2026-02-17T21:11:22.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient: init 2026-02-17T21:11:22.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:22.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:11:22.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f92581f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:22.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient(hunting): picked mon.noname-b con 0x7f9244004900 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:22.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9258147b00 0x7f92581f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:22.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient(hunting): picked mon.noname-c con 0x7f9258147b00 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:22.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9258147f80 0x7f92581f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:22.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient(hunting): picked mon.noname-a con 0x7f9258147f80 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:22.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:22.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9258156300 con 0x7f9258147f80 2026-02-17T21:11:22.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:22.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9258156180 con 0x7f9244004900 2026-02-17T21:11:22.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:22.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f925815f200 con 0x7f9258147b00 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.652+0000 7f925c921640 10 monclient(hunting): authenticate will time out at 1266.282639s 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f92581f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9258147b00 0x7f92581f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f92581f48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:39172/0 (socket says 10.20.193.45:39172) 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 1 -- 10.20.193.45:0/647868093 learned_addr learned my addr 10.20.193.45:0/647868093 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 10 monclient(hunting): get_auth_request con 0x7f9244004900 auth_method 0 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256575640 10 monclient(hunting): get_auth_request con 0x7f9258147b00 auth_method 0 2026-02-17T21:11:22.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.653+0000 7f9256575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 10 monclient(hunting): handle_auth_done global_id 5066 payload 824 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 1 -- 10.20.193.45:0/647868093 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 msgr2=0x7f92581f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f92581f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.664 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 1 -- 10.20.193.45:0/647868093 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9258147f80 msgr2=0x7f92581f78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9258147f80 0x7f92581f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 10 monclient: _finish_hunting 0 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 1 monclient: found mon.noname-c 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.654+0000 7f9256575640 1 -- 10.20.193.45:0/647868093 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92581f7ed0 con 0x7f9258147b00 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.655+0000 7f9256575640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9258147b00 0x7f92581f7390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f924400c620 tx=0x7f92400027c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.655+0000 7f92377fe640 10 client.?.objecter ms_handle_connect 0x7f9258147b00 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.655+0000 7f92377fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 1 -- 10.20.193.45:0/647868093 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240006ab0 con 0x7f9258147b00 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:22.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 10 monclient: dump: 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 10 monclient: _finish_auth 0 2026-02-17T21:11:22.666 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 10 monclient: _check_auth_tickets 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f925c921640 5 monclient: authenticate success, global_id 5066 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 1 -- 10.20.193.45:0/647868093 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9240006c50 con 0x7f9258147b00 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 1 -- 10.20.193.45:0/647868093 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240007070 con 0x7f9258147b00 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f9255573640 4 set_mon_vals no callback set 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f92377fe640 10 monclient: dump: 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:22.667 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f925c921640 10 monclient: _renew_subs 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f925c921640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.657+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92581f81b0 con 0x7f9258147b00 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.658+0000 7f925c921640 10 client.5066.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.658+0000 7f925c921640 10 monclient: _renew_subs 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.658+0000 7f925c921640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.658+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92581567e0 con 0x7f9258147b00 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.658+0000 7f925c921640 1 librados: init done 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.658+0000 7f925c921640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:22.668 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.658+0000 7f925c921640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:22.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.658+0000 7f925c921640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:22.669 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.658+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925815f590 con 0x7f9258147b00 2026-02-17T21:11:22.761 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.769+0000 7f92377fe640 1 -- 10.20.193.45:0/647868093 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f9240007230 con 0x7f9258147b00 2026-02-17T21:11:22.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.769+0000 7f92377fe640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92240792d0 0x7f922407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:22.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.770+0000 7f9256d76640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92240792d0 0x7f922407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:22.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.770+0000 7f9256d76640 10 monclient: get_auth_request con 0x7f92240792d0 auth_method 0 2026-02-17T21:11:22.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.770+0000 7f9256d76640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92240792d0 0x7f922407b790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f924c0028d0 tx=0x7f924c009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:22.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.770+0000 7f92377fe640 10 client.5066.objecter ms_handle_connect 0x7f92240792d0 2026-02-17T21:11:22.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.772+0000 7f92377fe640 1 -- 10.20.193.45:0/647868093 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f9240082fe0 con 0x7f9258147b00 2026-02-17T21:11:22.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.772+0000 7f92377fe640 10 client.5066.objecter ms_dispatch2 0x7f9258000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:22.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.772+0000 7f92377fe640 3 client.5066.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:22.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.772+0000 7f92377fe640 3 client.5066.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:22.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.772+0000 7f92377fe640 20 client.5066.objecter dump_active .. 0 homeless 2026-02-17T21:11:22.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.778+0000 7f92377fe640 1 -- 10.20.193.45:0/647868093 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9240034030 con 0x7f9258147b00 2026-02-17T21:11:22.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.778+0000 7f92377fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:22.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.778+0000 7f92377fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.878+0000 7f925c921640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.878+0000 7f925c921640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.878+0000 7f925c921640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.878+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9258050af0 con 0x7f9258147b00 2026-02-17T21:11:22.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.907+0000 7f92377fe640 1 -- 10.20.193.45:0/647868093 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f92400876a0 con 0x7f9258147b00 2026-02-17T21:11:22.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.907+0000 7f92377fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:22.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.907+0000 7f92377fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:22.899 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:22.899 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:22.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 10 librados: watch_flush enter 2026-02-17T21:11:22.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 10 librados: watch_flush exit 2026-02-17T21:11:22.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 20 client.5066.objecter shutdown clearing up homeless session... 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 10 client.5066.objecter successfully canceled tick 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92240792d0 msgr2=0x7f922407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92240792d0 0x7f922407b790 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f924c0028d0 tx=0x7f924c009110 comp rx=0 tx=0).stop 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 10 monclient: shutdown 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9258147b00 msgr2=0x7f92581f7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9258147b00 0x7f92581f7390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f924400c620 tx=0x7f92400027c0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 shutdown_connections 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f92240792d0 0x7f922407b790 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9258147f80 0x7f92581f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9258147b00 0x7f92581f7390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 --2- 10.20.193.45:0/647868093 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9244004900 0x7f92581f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:22.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 >> 10.20.193.45:0/647868093 conn(0x7f92580ce1d0 msgr2=0x7f925814b180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:22.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 shutdown_connections 2026-02-17T21:11:22.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 -- 10.20.193.45:0/647868093 wait complete. 2026-02-17T21:11:22.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:22.908+0000 7f925c921640 1 librados: shutdown 2026-02-17T21:11:25.910 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:25.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.985+0000 7ff6af333640 10 monclient: get_monmap_and_config 2026-02-17T21:11:25.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.985+0000 7ff6af333640 10 monclient: build_initial_monmap 2026-02-17T21:11:25.979 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.985+0000 7ff6af333640 10 monclient: monmap: 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:25.987346+0000 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:25.987346+0000 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:25.980 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:25.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.985+0000 7ff6af333640 1 Processor -- start 2026-02-17T21:11:25.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.985+0000 7ff6af333640 1 -- start start 2026-02-17T21:11:25.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.985+0000 7ff6af333640 10 monclient: init 2026-02-17T21:11:25.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:25.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 10 monclient: _add_conns ranks=[0,2,4,3,5,1] 2026-02-17T21:11:25.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff6a8152620 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:25.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff6a815aff0 addr v1:10.20.193.92:6789/0 2026-02-17T21:11:25.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff6a80c6ca0 0x7ff6a8163160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:25.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 10 monclient(hunting): picked mon.noname-b con 0x7ff6a80c6ca0 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:25.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a80c71a0 con 0x7ff6a8152620 2026-02-17T21:11:25.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a80c7480 con 0x7ff6a815aff0 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff6a80c7760 con 0x7ff6a80c6ca0 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6af333640 10 monclient(hunting): authenticate will time out at 1269.617482s 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6ad0a8640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7ff6a8152620 0x7ff6a815a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:59942/0 (socket says 10.20.193.45:59942) 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6ad0a8640 1 -- 10.20.193.45:0/14828275 learned_addr learned my addr 10.20.193.45:0/14828275 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.986+0000 7ff6ad8a9640 1 --2- 10.20.193.45:0/14828275 >> v2:10.20.193.86:3300/0 conn(0x7ff6a80c6ca0 0x7ff6a8163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.987+0000 7ff6ad8a9640 10 monclient(hunting): get_auth_request con 0x7ff6a80c6ca0 auth_method 0 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.987+0000 7ff6ad8a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.987+0000 7ff6ad8a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.987+0000 7ff6ad8a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:25.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.987+0000 7ff6ad8a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.987+0000 7ff6ad8a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.987+0000 7ff6ad8a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 1 -- 10.20.193.45:0/14828275 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633817689 0 0) 0x7ff6a80c71a0 con 0x7ff6a8152620 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 10 monclient(hunting): _negotiate 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 10 monclient(hunting): my global_id is 4947 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 1 -- 10.20.193.45:0/14828275 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff690003620 con 0x7ff6a8152620 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 1 -- 10.20.193.45:0/14828275 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487433652 0 0) 0x7ff6a80c7480 con 0x7ff6a815aff0 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 10 monclient(hunting): _negotiate 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:25.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 10 monclient(hunting): my global_id is 5069 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff697fff640 1 -- 10.20.193.45:0/14828275 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6a80c71a0 con 0x7ff6a815aff0 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff6ad8a9640 10 monclient(hunting): handle_auth_done global_id 5017 payload 274 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff6ad8a9640 1 -- 10.20.193.45:0/14828275 >> v1:10.20.193.92:6789/0 conn(0x7ff6a815aff0 legacy=0x7ff6a80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff6ad8a9640 1 -- 10.20.193.45:0/14828275 >> v1:10.20.193.45:6789/0 conn(0x7ff6a8152620 legacy=0x7ff6a815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff6ad8a9640 10 monclient: _finish_hunting 0 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff6ad8a9640 1 monclient: found mon.noname-b 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff6ad8a9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff6ad8a9640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.988+0000 7ff6ad8a9640 1 -- 10.20.193.45:0/14828275 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a8159e00 con 0x7ff6a80c6ca0 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.989+0000 7ff6ad8a9640 1 --2- 10.20.193.45:0/14828275 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 0x7ff6a8163160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009d90 tx=0x7ff6a402f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e0fd234692559d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.990+0000 7ff697fff640 1 -- 10.20.193.45:0/14828275 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a403c070 con 0x7ff6a80c6ca0 2026-02-17T21:11:25.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.990+0000 7ff697fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.990+0000 7ff697fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.990+0000 7ff697fff640 10 monclient: dump: 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:25.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.990+0000 7ff697fff640 10 monclient: _finish_auth 0 2026-02-17T21:11:25.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.990+0000 7ff697fff640 10 monclient: _check_auth_tickets 2026-02-17T21:11:25.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.990+0000 7ff697fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:25.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.990+0000 7ff6af333640 5 monclient: authenticate success, global_id 5017 2026-02-17T21:11:25.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.990+0000 7ff6af333640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:25.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff697fff640 1 -- 10.20.193.45:0/14828275 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a4037440 con 0x7ff6a80c6ca0 2026-02-17T21:11:25.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff697fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:25.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff697fff640 1 -- 10.20.193.45:0/14828275 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a40377f0 con 0x7ff6a80c6ca0 2026-02-17T21:11:25.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff697fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:25.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff697fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:25.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff697fff640 10 monclient: dump: 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:25.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 4 set_mon_vals no callback set 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 10 monclient: shutdown 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 1 -- 10.20.193.45:0/14828275 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 msgr2=0x7ff6a8163160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 1 --2- 10.20.193.45:0/14828275 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 0x7ff6a8163160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009d90 tx=0x7ff6a402f230 comp rx=0 tx=0).stop 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 1 -- 10.20.193.45:0/14828275 shutdown_connections 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 1 --2- 10.20.193.45:0/14828275 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 0x7ff6a8163160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 1 -- 10.20.193.45:0/14828275 >> 10.20.193.45:0/14828275 conn(0x7ff6a80c9d40 msgr2=0x7ff6a80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 1 -- 10.20.193.45:0/14828275 shutdown_connections 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.991+0000 7ff6af333640 1 -- 10.20.193.45:0/14828275 wait complete. 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient: build_initial_monmap 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient: monmap: 2026-02-17T21:11:25.997 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 librados: starting msgr at 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 librados: starting objecter 2026-02-17T21:11:25.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 Processor -- start 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 -- start start 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 librados: setting wanted keys 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 librados: calling monclient init 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient: init 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 0x7ff6a81f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient(hunting): picked mon.noname-b con 0x7ff6a80c6ca0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff6a8152620 0x7ff6a814bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient(hunting): picked mon.noname-a con 0x7ff6a8152620 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6a815aff0 0x7ff6a8158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient(hunting): picked mon.noname-c con 0x7ff6a815aff0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:25.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a80c94a0 con 0x7ff6a8152620 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a815a3c0 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a80c9620 con 0x7ff6a815aff0 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.992+0000 7ff6af333640 10 monclient(hunting): authenticate will time out at 1269.623785s 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 0x7ff6a81f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ac8a7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff6a8152620 0x7ff6a814bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad8a9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6a815aff0 0x7ff6a8158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 0x7ff6a81f4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:39206/0 (socket says 10.20.193.45:39206) 2026-02-17T21:11:26.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 1 -- 10.20.193.45:0/1998227199 learned_addr learned my addr 10.20.193.45:0/1998227199 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 10 monclient(hunting): get_auth_request con 0x7ff6a80c6ca0 auth_method 0 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ac8a7640 10 monclient(hunting): get_auth_request con 0x7ff6a8152620 auth_method 0 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ac8a7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ac8a7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ac8a7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad0a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad8a9640 10 monclient(hunting): get_auth_request con 0x7ff6a815aff0 auth_method 0 2026-02-17T21:11:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad8a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad8a9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad8a9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ac8a7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ac8a7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ac8a7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad8a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad8a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.993+0000 7ff6ad8a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 10 monclient(hunting): handle_auth_done global_id 5020 payload 824 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 1 -- 10.20.193.45:0/1998227199 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6a815aff0 msgr2=0x7ff6a8158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6a815aff0 0x7ff6a8158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 1 -- 10.20.193.45:0/1998227199 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff6a8152620 msgr2=0x7ff6a814bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff6a8152620 0x7ff6a814bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 10 monclient: _finish_hunting 0 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 1 monclient: found mon.noname-b 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.994+0000 7ff6ad0a8640 1 -- 10.20.193.45:0/1998227199 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a8156830 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.995+0000 7ff6ad0a8640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 0x7ff6a81f4260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff69800c700 tx=0x7ff69800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.995+0000 7ff695ffb640 10 client.?.objecter ms_handle_connect 0x7ff6a80c6ca0 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.995+0000 7ff695ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff695ffb640 1 -- 10.20.193.45:0/1998227199 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698017070 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff695ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff695ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff695ffb640 10 monclient: dump: 2026-02-17T21:11:26.003 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff695ffb640 10 monclient: _finish_auth 0 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff695ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:11:26.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff695ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff6af333640 5 monclient: authenticate success, global_id 5020 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff6af333640 10 monclient: _renew_subs 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff6af333640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a8156b10 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff6af333640 10 client.5020.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff6af333640 10 monclient: _renew_subs 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff6af333640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a81570d0 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.996+0000 7ff6af333640 1 librados: init done 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff6af333640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff6af333640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff6af333640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a815cf50 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff695ffb640 1 -- 10.20.193.45:0/1998227199 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff698005bb0 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff695ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff695ffb640 1 -- 10.20.193.45:0/1998227199 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698021060 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff695ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff695ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff695ffb640 10 monclient: dump: 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:26.006 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:26.007 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:25.997+0000 7ff6977fe640 4 set_mon_vals no callback set 2026-02-17T21:11:26.099 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.105+0000 7ff695ffb640 1 -- 10.20.193.45:0/1998227199 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff698024080 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.106+0000 7ff695ffb640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6780792b0 0x7ff67807b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:26.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.106+0000 7ff6ac8a7640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6780792b0 0x7ff67807b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:26.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.106+0000 7ff6ac8a7640 10 monclient: get_auth_request con 0x7ff6780792b0 auth_method 0 2026-02-17T21:11:26.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.106+0000 7ff695ffb640 10 client.5020.objecter ms_handle_connect 0x7ff6780792b0 2026-02-17T21:11:26.100 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.106+0000 7ff6ac8a7640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6780792b0 0x7ff67807b770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff69c002410 tx=0x7ff69c003d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:26.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.108+0000 7ff695ffb640 1 -- 10.20.193.45:0/1998227199 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ff69805d8b0 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.108+0000 7ff695ffb640 10 client.5020.objecter ms_dispatch2 0x7ff6a8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:26.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.108+0000 7ff695ffb640 3 client.5020.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:26.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.108+0000 7ff695ffb640 3 client.5020.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:26.102 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.108+0000 7ff695ffb640 20 client.5020.objecter dump_active .. 0 homeless 2026-02-17T21:11:26.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.115+0000 7ff695ffb640 1 -- 10.20.193.45:0/1998227199 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff6a815cf50 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.115+0000 7ff695ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:26.109 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.115+0000 7ff695ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:26.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.217+0000 7ff6af333640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:26.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.217+0000 7ff6af333640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:26.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.217+0000 7ff6af333640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:26.211 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.217+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff6a81572a0 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff695ffb640 1 -- 10.20.193.45:0/1998227199 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff698061870 con 0x7ff6a80c6ca0 2026-02-17T21:11:26.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff695ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:26.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff695ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:26.214 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:26.214 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 10 librados: watch_flush enter 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 10 librados: watch_flush exit 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 20 client.5020.objecter shutdown clearing up homeless session... 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 10 client.5020.objecter successfully canceled tick 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6780792b0 msgr2=0x7ff67807b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6780792b0 0x7ff67807b770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff69c002410 tx=0x7ff69c003d50 comp rx=0 tx=0).stop 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 10 monclient: shutdown 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 msgr2=0x7ff6a81f4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 0x7ff6a81f4260 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff69800c700 tx=0x7ff69800cbd0 comp rx=0 tx=0).stop 2026-02-17T21:11:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 shutdown_connections 2026-02-17T21:11:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6780792b0 0x7ff67807b770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6a815aff0 0x7ff6a8158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff6a8152620 0x7ff6a814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 --2- 10.20.193.45:0/1998227199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6a80c6ca0 0x7ff6a81f4260 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 >> 10.20.193.45:0/1998227199 conn(0x7ff6a80c9d40 msgr2=0x7ff6a80ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 shutdown_connections 2026-02-17T21:11:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 -- 10.20.193.45:0/1998227199 wait complete. 2026-02-17T21:11:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:26.221+0000 7ff6af333640 1 librados: shutdown 2026-02-17T21:11:29.225 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:29.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 10 monclient: get_monmap_and_config 2026-02-17T21:11:29.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 10 monclient: build_initial_monmap 2026-02-17T21:11:29.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 10 monclient: monmap: 2026-02-17T21:11:29.296 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:29.296 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:29.296 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:29.303905+0000 2026-02-17T21:11:29.296 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:29.303905+0000 2026-02-17T21:11:29.296 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 1 Processor -- start 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 1 -- start start 2026-02-17T21:11:29.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 10 monclient: init 2026-02-17T21:11:29.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:29.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 10 monclient: _add_conns ranks=[1,0,3,5,4,2] 2026-02-17T21:11:29.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f488815d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:11:29.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f48880c92b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:29.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4888153d20 0x7f488815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:29.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.303+0000 7f48902a7640 10 monclient(hunting): picked mon.noname-a con 0x7f4888153d20 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:29.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f48902a7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48880c5860 con 0x7f48880c92b0 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f48902a7640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48880c5580 con 0x7f488815d1e0 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f48902a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f48902a7640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f48880c7de0 con 0x7f4888153d20 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f48902a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f48902a7640 10 monclient(hunting): authenticate will time out at 1272.934023s 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f488e01c640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f488815d1e0 0x7f48880c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:49180/0 (socket says 10.20.193.45:49180) 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f488e01c640 1 -- 10.20.193.45:0/3017681069 learned_addr learned my addr 10.20.193.45:0/3017681069 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f488e81d640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4888153d20 0x7f488815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f488e81d640 10 monclient(hunting): get_auth_request con 0x7f4888153d20 auth_method 0 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f488e81d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:29.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f488e81d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.304+0000 7f488e81d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.305+0000 7f488e81d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.305+0000 7f488e81d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.305+0000 7f488e81d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.305+0000 7f488d01a640 1 -- 10.20.193.45:0/3017681069 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098138672 0 0) 0x7f48880c5580 con 0x7f488815d1e0 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.305+0000 7f488d01a640 10 monclient(hunting): _negotiate 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.305+0000 7f488d01a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.305+0000 7f488d01a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.305+0000 7f488d01a640 10 monclient(hunting): my global_id is 5023 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.306+0000 7f488d01a640 1 -- 10.20.193.45:0/3017681069 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4870003620 con 0x7f488815d1e0 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.306+0000 7f488e81d640 10 monclient(hunting): handle_auth_done global_id 4953 payload 274 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.306+0000 7f488e81d640 1 -- 10.20.193.45:0/3017681069 >> v1:10.20.193.86:6789/0 conn(0x7f488815d1e0 legacy=0x7f48880c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:29.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.306+0000 7f488e81d640 1 -- 10.20.193.45:0/3017681069 >> v1:10.20.193.45:6789/0 conn(0x7f48880c92b0 legacy=0x7f4888153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:29.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.306+0000 7f488e81d640 10 monclient: _finish_hunting 0 2026-02-17T21:11:29.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.306+0000 7f488e81d640 1 monclient: found mon.noname-a 2026-02-17T21:11:29.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.306+0000 7f488e81d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:29.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.306+0000 7f488e81d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:29.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.306+0000 7f488e81d640 1 -- 10.20.193.45:0/3017681069 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48880c80c0 con 0x7f4888153d20 2026-02-17T21:11:29.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.308+0000 7f488e81d640 1 --2- 10.20.193.45:0/3017681069 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4888153d20 0x7f488815d5c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4884009dc0 tx=0x7f488402f280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58dc8824096b2827 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 1 -- 10.20.193.45:0/3017681069 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488403c070 con 0x7f4888153d20 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 10 monclient: dump: 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:29.310 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 10 monclient: _finish_auth 0 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 10 monclient: _check_auth_tickets 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 1 -- 10.20.193.45:0/3017681069 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4884037440 con 0x7f4888153d20 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 5 monclient: authenticate success, global_id 4953 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 1 -- 10.20.193.45:0/3017681069 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884037810 con 0x7f4888153d20 2026-02-17T21:11:29.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 4 set_mon_vals no callback set 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f488d01a640 10 monclient: dump: 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:29.312 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 10 monclient: shutdown 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 1 -- 10.20.193.45:0/3017681069 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4888153d20 msgr2=0x7f488815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 1 --2- 10.20.193.45:0/3017681069 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4888153d20 0x7f488815d5c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4884009dc0 tx=0x7f488402f280 comp rx=0 tx=0).stop 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 1 -- 10.20.193.45:0/3017681069 shutdown_connections 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 1 --2- 10.20.193.45:0/3017681069 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4888153d20 0x7f488815d5c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 1 -- 10.20.193.45:0/3017681069 >> 10.20.193.45:0/3017681069 conn(0x7f48880c9d40 msgr2=0x7f48880ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 1 -- 10.20.193.45:0/3017681069 shutdown_connections 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.310+0000 7f48902a7640 1 -- 10.20.193.45:0/3017681069 wait complete. 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient: build_initial_monmap 2026-02-17T21:11:29.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient: monmap: 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 librados: starting msgr at 2026-02-17T21:11:29.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 librados: starting objecter 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 Processor -- start 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 -- start start 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 librados: setting wanted keys 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 librados: calling monclient init 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient: init 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f48880c92b0 0x7f488813f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient(hunting): picked mon.noname-b con 0x7f48880c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4888153d20 0x7f4888072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient(hunting): picked mon.noname-c con 0x7f4888153d20 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f488815d1e0 0x7f4888072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:29.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient(hunting): picked mon.noname-a con 0x7f488815d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f48880748e0 con 0x7f488815d1e0 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f48880c8680 con 0x7f48880c92b0 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4888074a60 con 0x7f4888153d20 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.311+0000 7f48902a7640 10 monclient(hunting): authenticate will time out at 1272.941911s 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f488815d1e0 0x7f4888072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e01c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f48880c92b0 0x7f488813f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488d81b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4888153d20 0x7f4888072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f488815d1e0 0x7f4888072f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:50158/0 (socket says 10.20.193.45:50158) 2026-02-17T21:11:29.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 1 -- 10.20.193.45:0/2387870288 learned_addr learned my addr 10.20.193.45:0/2387870288 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 10 monclient(hunting): get_auth_request con 0x7f488815d1e0 auth_method 0 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e01c640 10 monclient(hunting): get_auth_request con 0x7f48880c92b0 auth_method 0 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e01c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e01c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e01c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e81d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488d81b640 10 monclient(hunting): get_auth_request con 0x7f4888153d20 auth_method 0 2026-02-17T21:11:29.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488d81b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488d81b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488d81b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e01c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e01c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488e01c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488d81b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488d81b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.312+0000 7f488d81b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 10 monclient(hunting): handle_auth_done global_id 4956 payload 824 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 1 -- 10.20.193.45:0/2387870288 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4888153d20 msgr2=0x7f4888072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4888153d20 0x7f4888072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 1 -- 10.20.193.45:0/2387870288 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f48880c92b0 msgr2=0x7f488813f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:29.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f48880c92b0 0x7f488813f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 10 monclient: _finish_hunting 0 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 1 monclient: found mon.noname-a 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.314+0000 7f488e81d640 1 -- 10.20.193.45:0/2387870288 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48881f7b50 con 0x7f488815d1e0 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.315+0000 7f488e81d640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f488815d1e0 0x7f4888072f90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f488403a040 tx=0x7f4884004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.315+0000 7f4876ffd640 10 client.?.objecter ms_handle_connect 0x7f488815d1e0 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.315+0000 7f4876ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f4876ffd640 1 -- 10.20.193.45:0/2387870288 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488403c050 con 0x7f488815d1e0 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f4876ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f4876ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:29.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f4876ffd640 10 monclient: dump: 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f4876ffd640 10 monclient: _finish_auth 0 2026-02-17T21:11:29.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f4876ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f4876ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 5 monclient: authenticate success, global_id 4956 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 10 monclient: _renew_subs 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48881f6fd0 con 0x7f488815d1e0 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 10 client.4956.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 10 monclient: _renew_subs 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48881f7590 con 0x7f488815d1e0 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 1 librados: init done 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:29.321 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488815d5c0 con 0x7f488815d1e0 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f4876ffd640 1 -- 10.20.193.45:0/2387870288 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4884048070 con 0x7f488815d1e0 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.316+0000 7f4876ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.317+0000 7f4876ffd640 1 -- 10.20.193.45:0/2387870288 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4884041a10 con 0x7f488815d1e0 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.317+0000 7f4876ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.317+0000 7f4876ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.317+0000 7f4876ffd640 10 monclient: dump: 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:29.322 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:29.323 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:29.323 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:29.323 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:29.323 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:29.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.317+0000 7f488c819640 4 set_mon_vals no callback set 2026-02-17T21:11:29.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.427+0000 7f4876ffd640 1 -- 10.20.193.45:0/2387870288 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4884041bb0 con 0x7f488815d1e0 2026-02-17T21:11:29.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.428+0000 7f4876ffd640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4858079280 0x7f485807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:29.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.428+0000 7f488e01c640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4858079280 0x7f485807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:29.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.428+0000 7f488e01c640 10 monclient: get_auth_request con 0x7f4858079280 auth_method 0 2026-02-17T21:11:29.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.428+0000 7f488e01c640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4858079280 0x7f485807b740 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4878005980 tx=0x7f4878007dd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:29.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.428+0000 7f4876ffd640 10 client.4956.objecter ms_handle_connect 0x7f4858079280 2026-02-17T21:11:29.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.436+0000 7f4876ffd640 1 -- 10.20.193.45:0/2387870288 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f48840847e0 con 0x7f488815d1e0 2026-02-17T21:11:29.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.436+0000 7f4876ffd640 10 client.4956.objecter ms_dispatch2 0x7f4888000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:29.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.436+0000 7f4876ffd640 3 client.4956.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:29.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.436+0000 7f4876ffd640 3 client.4956.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:29.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.436+0000 7f4876ffd640 20 client.4956.objecter dump_active .. 0 homeless 2026-02-17T21:11:29.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.436+0000 7f4876ffd640 1 -- 10.20.193.45:0/2387870288 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f48840887a0 con 0x7f488815d1e0 2026-02-17T21:11:29.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.436+0000 7f4876ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:29.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.436+0000 7f4876ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:29.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.538+0000 7f48902a7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:29.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.538+0000 7f48902a7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:29.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.538+0000 7f48902a7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:29.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.538+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f48881573a0 con 0x7f488815d1e0 2026-02-17T21:11:29.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.541+0000 7f4876ffd640 1 -- 10.20.193.45:0/2387870288 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f488408caa0 con 0x7f488815d1e0 2026-02-17T21:11:29.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.541+0000 7f4876ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:29.534 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.541+0000 7f4876ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:29.534 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:29.534 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:29.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 10 librados: watch_flush enter 2026-02-17T21:11:29.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 10 librados: watch_flush exit 2026-02-17T21:11:29.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 20 client.4956.objecter shutdown clearing up homeless session... 2026-02-17T21:11:29.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 10 client.4956.objecter successfully canceled tick 2026-02-17T21:11:29.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4858079280 msgr2=0x7f485807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:29.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4858079280 0x7f485807b740 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4878005980 tx=0x7f4878007dd0 comp rx=0 tx=0).stop 2026-02-17T21:11:29.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 10 monclient: shutdown 2026-02-17T21:11:29.536 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f488815d1e0 msgr2=0x7f4888072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f488815d1e0 0x7f4888072f90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f488403a040 tx=0x7f4884004b40 comp rx=0 tx=0).stop 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 shutdown_connections 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4858079280 0x7f485807b740 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f488815d1e0 0x7f4888072f90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4888153d20 0x7f4888072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 --2- 10.20.193.45:0/2387870288 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f48880c92b0 0x7f488813f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 >> 10.20.193.45:0/2387870288 conn(0x7f48880c9d40 msgr2=0x7f48881510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 shutdown_connections 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 -- 10.20.193.45:0/2387870288 wait complete. 2026-02-17T21:11:29.537 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:29.542+0000 7f48902a7640 1 librados: shutdown 2026-02-17T21:11:30.304 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:37.517 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:30.306 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:37.518 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:30.313 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:37.526 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:30.333 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:06:37.506 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:30.334 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:06:37.544 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:30.334 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:06:37.507 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:30.335 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:06:37.545 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:30.342 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:06:37.515 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:30.343 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:06:37.553 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:32.545 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:32.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.625+0000 7f4f3b1ed640 10 monclient: get_monmap_and_config 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.625+0000 7f4f3b1ed640 10 monclient: build_initial_monmap 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.625+0000 7f4f3b1ed640 10 monclient: monmap: 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:32.626090+0000 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:32.626090+0000 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:32.618 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:32.619 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:32.619 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:32.619 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:32.619 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:32.619 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:32.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.625+0000 7f4f3b1ed640 1 Processor -- start 2026-02-17T21:11:32.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.625+0000 7f4f3b1ed640 1 -- start start 2026-02-17T21:11:32.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.625+0000 7f4f3b1ed640 10 monclient: init 2026-02-17T21:11:32.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:32.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 10 monclient: _add_conns ranks=[4,3,2,5,0,1] 2026-02-17T21:11:32.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f4f3415d1e0 0x7f4f3415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:32.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 10 monclient(hunting): picked mon.noname-b con 0x7f4f3415d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:32.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4f340748e0 0x7f4f340c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:32.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 10 monclient(hunting): picked mon.noname-a con 0x7f4f340748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4f340c90e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f340c9570 con 0x7f4f340c90e0 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f4f340c5860 con 0x7f4f340748e0 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f4f340c5580 con 0x7f4f3415d1e0 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f3b1ed640 10 monclient(hunting): authenticate will time out at 1276.256319s 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f2bfff640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4f340748e0 0x7f4f340c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f38f62640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f4f3415d1e0 0x7f4f3415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:32.623 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f2bfff640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f4f340748e0 0x7f4f340c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:50170/0 (socket says 10.20.193.45:50170) 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f2bfff640 1 -- 10.20.193.45:0/975361529 learned_addr learned my addr 10.20.193.45:0/975361529 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f2bfff640 10 monclient(hunting): get_auth_request con 0x7f4f340748e0 auth_method 0 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f38f62640 10 monclient(hunting): get_auth_request con 0x7f4f3415d1e0 auth_method 0 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f38f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f38f62640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.626+0000 7f4f38f62640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.627+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.627+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.627+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:32.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.627+0000 7f4f38f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.627+0000 7f4f38f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.627+0000 7f4f38f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.628+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_done global_id 4959 payload 274 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.628+0000 7f4f2bfff640 1 -- 10.20.193.45:0/975361529 >> v2:10.20.193.86:3300/0 conn(0x7f4f3415d1e0 msgr2=0x7f4f3415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.628+0000 7f4f2bfff640 1 --2- 10.20.193.45:0/975361529 >> v2:10.20.193.86:3300/0 conn(0x7f4f3415d1e0 0x7f4f3415d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.628+0000 7f4f2bfff640 1 -- 10.20.193.45:0/975361529 >> v1:10.20.193.92:6789/0 conn(0x7f4f340c90e0 legacy=0x7f4f34153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.628+0000 7f4f2bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.628+0000 7f4f2bfff640 1 monclient: found mon.noname-a 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.628+0000 7f4f2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.628+0000 7f4f2bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.628+0000 7f4f2bfff640 1 -- 10.20.193.45:0/975361529 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f340c7de0 con 0x7f4f340748e0 2026-02-17T21:11:32.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.629+0000 7f4f2bfff640 1 --2- 10.20.193.45:0/975361529 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4f340748e0 0x7f4f340c8ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009970 tx=0x7f4f1c02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a11155da6f6e93 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:32.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 1 -- 10.20.193.45:0/975361529 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c03c070 con 0x7f4f340748e0 2026-02-17T21:11:32.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:32.631 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 10 monclient: dump: 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:32.632 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 1 -- 10.20.193.45:0/975361529 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1c02fb20 con 0x7f4f340748e0 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 1 -- 10.20.193.45:0/975361529 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c037440 con 0x7f4f340748e0 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f2b7fe640 10 monclient: dump: 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:32.633 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 5 monclient: authenticate success, global_id 4959 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 4 set_mon_vals no callback set 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 10 monclient: shutdown 2026-02-17T21:11:32.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/975361529 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4f340748e0 msgr2=0x7f4f340c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 1 --2- 10.20.193.45:0/975361529 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4f340748e0 0x7f4f340c8ba0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009970 tx=0x7f4f1c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/975361529 shutdown_connections 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 1 --2- 10.20.193.45:0/975361529 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4f340748e0 0x7f4f340c8ba0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 1 --2- 10.20.193.45:0/975361529 >> v2:10.20.193.86:3300/0 conn(0x7f4f3415d1e0 0x7f4f3415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/975361529 >> 10.20.193.45:0/975361529 conn(0x7f4f340c9d40 msgr2=0x7f4f340ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/975361529 shutdown_connections 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.631+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/975361529 wait complete. 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient: build_initial_monmap 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient: monmap: 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:32.635 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 librados: starting msgr at 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 librados: starting objecter 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 Processor -- start 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 -- start start 2026-02-17T21:11:32.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 librados: setting wanted keys 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 librados: calling monclient init 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient: init 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4f340748e0 0x7f4f3406ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient(hunting): picked mon.noname-b con 0x7f4f340748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4f340c90e0 0x7f4f3406d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient(hunting): picked mon.noname-a con 0x7f4f340c90e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4f3415d1e0 0x7f4f34151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient(hunting): picked mon.noname-c con 0x7f4f3415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:32.637 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4f340c8680 con 0x7f4f340c90e0 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4f340c83a0 con 0x7f4f340748e0 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34074d30 con 0x7f4f3415d1e0 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.632+0000 7f4f3b1ed640 10 monclient(hunting): authenticate will time out at 1276.262991s 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4f340748e0 0x7f4f3406ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4f340748e0 0x7f4f3406ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:46146/0 (socket says 10.20.193.45:46146) 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 1 -- 10.20.193.45:0/1333758986 learned_addr learned my addr 10.20.193.45:0/1333758986 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 10 monclient(hunting): get_auth_request con 0x7f4f340748e0 auth_method 0 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:32.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f2bfff640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4f340c90e0 0x7f4f3406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f38f62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f2bfff640 10 monclient(hunting): get_auth_request con 0x7f4f340c90e0 auth_method 0 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.633+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:32.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 10 monclient(hunting): handle_auth_done global_id 5032 payload 824 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 1 -- 10.20.193.45:0/1333758986 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4f3415d1e0 msgr2=0x7f4f34151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4f3415d1e0 0x7f4f34151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 1 -- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4f340c90e0 msgr2=0x7f4f3406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4f340c90e0 0x7f4f3406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 10 monclient: _finish_hunting 0 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 1 monclient: found mon.noname-b 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.635+0000 7f4f38f62640 1 -- 10.20.193.45:0/1333758986 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f341e4fc0 con 0x7f4f340748e0 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.636+0000 7f4f38f62640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4f340748e0 0x7f4f3406ea80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400e890 tx=0x7f4f2400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.636+0000 7f4f297fa640 10 client.?.objecter ms_handle_connect 0x7f4f340748e0 2026-02-17T21:11:32.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.636+0000 7f4f297fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 1 -- 10.20.193.45:0/1333758986 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24017070 con 0x7f4f340748e0 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 10 monclient: dump: 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:32.641 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 10 monclient: _finish_auth 0 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 10 monclient: _check_auth_tickets 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 1 -- 10.20.193.45:0/1333758986 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2400c940 con 0x7f4f340748e0 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 5 monclient: authenticate success, global_id 5032 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 1 -- 10.20.193.45:0/1333758986 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400cd30 con 0x7f4f340748e0 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f297fa640 10 monclient: dump: 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:32.642 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f2affd640 4 set_mon_vals no callback set 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 10 monclient: _renew_subs 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3406db40 con 0x7f4f340748e0 2026-02-17T21:11:32.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 10 client.5032.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:32.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 10 monclient: _renew_subs 2026-02-17T21:11:32.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:32.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f341e5260 con 0x7f4f340748e0 2026-02-17T21:11:32.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 1 librados: init done 2026-02-17T21:11:32.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:32.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:32.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:32.644 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.638+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f340c8ba0 con 0x7f4f340748e0 2026-02-17T21:11:32.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.649+0000 7f4f297fa640 1 -- 10.20.193.45:0/1333758986 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4f24024060 con 0x7f4f340748e0 2026-02-17T21:11:32.645 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.650+0000 7f4f297fa640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4f040792d0 0x7f4f0407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:32.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.650+0000 7f4f2bfff640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4f040792d0 0x7f4f0407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:32.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.650+0000 7f4f2bfff640 10 monclient: get_auth_request con 0x7f4f040792d0 auth_method 0 2026-02-17T21:11:32.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.650+0000 7f4f297fa640 10 client.5032.objecter ms_handle_connect 0x7f4f040792d0 2026-02-17T21:11:32.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.650+0000 7f4f2bfff640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4f040792d0 0x7f4f0407b790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4f340c6af0 tx=0x7f4f1c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:32.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.651+0000 7f4f297fa640 1 -- 10.20.193.45:0/1333758986 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f4f2405e3c0 con 0x7f4f340748e0 2026-02-17T21:11:32.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.651+0000 7f4f297fa640 10 client.5032.objecter ms_dispatch2 0x7f4f34000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:32.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.651+0000 7f4f297fa640 3 client.5032.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:32.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.651+0000 7f4f297fa640 3 client.5032.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:32.646 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.651+0000 7f4f297fa640 20 client.5032.objecter dump_active .. 0 homeless 2026-02-17T21:11:32.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.756+0000 7f4f297fa640 1 -- 10.20.193.45:0/1333758986 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4f24062380 con 0x7f4f340748e0 2026-02-17T21:11:32.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.756+0000 7f4f297fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:32.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.756+0000 7f4f297fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:32.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.855+0000 7f4f3b1ed640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:32.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.855+0000 7f4f3b1ed640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:32.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.855+0000 7f4f3b1ed640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:32.848 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.855+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4f340c9b20 con 0x7f4f340748e0 2026-02-17T21:11:32.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.859+0000 7f4f297fa640 1 -- 10.20.193.45:0/1333758986 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f4f24066680 con 0x7f4f340748e0 2026-02-17T21:11:32.851 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.859+0000 7f4f297fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:32.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.859+0000 7f4f297fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:32.852 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:32.852 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 10 librados: watch_flush enter 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 10 librados: watch_flush exit 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 20 client.5032.objecter shutdown clearing up homeless session... 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 10 client.5032.objecter successfully canceled tick 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4f040792d0 msgr2=0x7f4f0407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4f040792d0 0x7f4f0407b790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4f340c6af0 tx=0x7f4f1c033000 comp rx=0 tx=0).stop 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 10 monclient: shutdown 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4f340748e0 msgr2=0x7f4f3406ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:32.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4f340748e0 0x7f4f3406ea80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400e890 tx=0x7f4f2400ed60 comp rx=0 tx=0).stop 2026-02-17T21:11:32.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 shutdown_connections 2026-02-17T21:11:32.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4f040792d0 0x7f4f0407b790 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4f3415d1e0 0x7f4f34151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4f340c90e0 0x7f4f3406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 --2- 10.20.193.45:0/1333758986 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4f340748e0 0x7f4f3406ea80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:32.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 >> 10.20.193.45:0/1333758986 conn(0x7f4f340c9d40 msgr2=0x7f4f34152b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:32.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 shutdown_connections 2026-02-17T21:11:32.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 -- 10.20.193.45:0/1333758986 wait complete. 2026-02-17T21:11:32.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:32.860+0000 7f4f3b1ed640 1 librados: shutdown 2026-02-17T21:11:35.863 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:35.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.938+0000 7f1329845640 10 monclient: get_monmap_and_config 2026-02-17T21:11:35.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.938+0000 7f1329845640 10 monclient: build_initial_monmap 2026-02-17T21:11:35.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.938+0000 7f1329845640 10 monclient: monmap: 2026-02-17T21:11:35.931 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:35.931 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:35.939320+0000 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:35.939320+0000 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:35.932 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:35.933 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:35.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.938+0000 7f1329845640 1 Processor -- start 2026-02-17T21:11:35.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.938+0000 7f1329845640 1 -- start start 2026-02-17T21:11:35.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.938+0000 7f1329845640 10 monclient: init 2026-02-17T21:11:35.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:35.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 10 monclient: _add_conns ranks=[0,5,4,2,3,1] 2026-02-17T21:11:35.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1324152620 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:35.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f132415aff0 0x7f13240c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:35.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 10 monclient(hunting): picked mon.noname-c con 0x7f132415aff0 addr v2:10.20.193.92:3300/0 2026-02-17T21:11:35.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f1324152a00 0x7f13240c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:35.936 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 10 monclient(hunting): picked mon.noname-b con 0x7f1324152a00 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13240c71a0 con 0x7f1324152620 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f13240c7760 con 0x7f1324152a00 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f13240c7480 con 0x7f132415aff0 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1329845640 10 monclient(hunting): authenticate will time out at 1279.569427s 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1322ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f1324152620 0x7f132415a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:42634/0 (socket says 10.20.193.45:42634) 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f1322ffd640 1 -- 10.20.193.45:0/4292603914 learned_addr learned my addr 10.20.193.45:0/4292603914 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.939+0000 7f13237fe640 1 --2- 10.20.193.45:0/4292603914 >> v2:10.20.193.86:3300/0 conn(0x7f1324152a00 0x7f13240c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:35.937 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13227fc640 1 --2- 10.20.193.45:0/4292603914 >> v2:10.20.193.92:3300/0 conn(0x7f132415aff0 0x7f13240c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13237fe640 10 monclient(hunting): get_auth_request con 0x7f1324152a00 auth_method 0 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13227fc640 10 monclient(hunting): get_auth_request con 0x7f132415aff0 auth_method 0 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13227fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13227fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:35.938 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13227fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13227fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.940+0000 7f13227fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f1321ffb640 1 -- 10.20.193.45:0/4292603914 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415821307 0 0) 0x7f13240c71a0 con 0x7f1324152620 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f1321ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f1321ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f1321ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f1321ffb640 10 monclient(hunting): my global_id is 4965 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f1321ffb640 1 -- 10.20.193.45:0/4292603914 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1310003620 con 0x7f1324152620 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f13237fe640 10 monclient(hunting): handle_auth_done global_id 5035 payload 274 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f13237fe640 1 -- 10.20.193.45:0/4292603914 >> v2:10.20.193.92:3300/0 conn(0x7f132415aff0 msgr2=0x7f13240c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f13237fe640 1 --2- 10.20.193.45:0/4292603914 >> v2:10.20.193.92:3300/0 conn(0x7f132415aff0 0x7f13240c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:35.939 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f13237fe640 1 -- 10.20.193.45:0/4292603914 >> v1:10.20.193.45:6789/0 conn(0x7f1324152620 legacy=0x7f132415a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:35.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f13237fe640 10 monclient: _finish_hunting 0 2026-02-17T21:11:35.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f13237fe640 1 monclient: found mon.noname-b 2026-02-17T21:11:35.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f13237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:35.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f13237fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:35.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.941+0000 7f13237fe640 1 -- 10.20.193.45:0/4292603914 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1324159e00 con 0x7f1324152a00 2026-02-17T21:11:35.940 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.942+0000 7f13237fe640 1 --2- 10.20.193.45:0/4292603914 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1324152a00 0x7f13240c92d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f13241563b0 tx=0x7f131402f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cd6e997afa961b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:35.947 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 1 -- 10.20.193.45:0/4292603914 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131403c070 con 0x7f1324152a00 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 10 monclient: dump: 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:35.948 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 10 monclient: _finish_auth 0 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 5 monclient: authenticate success, global_id 5035 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 1 -- 10.20.193.45:0/4292603914 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1314037440 con 0x7f1324152a00 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:35.949 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 1 -- 10.20.193.45:0/4292603914 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314037810 con 0x7f1324152a00 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 4 set_mon_vals no callback set 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1321ffb640 10 monclient: dump: 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:35.950 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 10 monclient: shutdown 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 1 -- 10.20.193.45:0/4292603914 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1324152a00 msgr2=0x7f13240c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 1 --2- 10.20.193.45:0/4292603914 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1324152a00 0x7f13240c92d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f13241563b0 tx=0x7f131402f1c0 comp rx=0 tx=0).stop 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 1 -- 10.20.193.45:0/4292603914 shutdown_connections 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 1 --2- 10.20.193.45:0/4292603914 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1324152a00 0x7f13240c92d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 1 --2- 10.20.193.45:0/4292603914 >> v2:10.20.193.92:3300/0 conn(0x7f132415aff0 0x7f13240c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 1 -- 10.20.193.45:0/4292603914 >> 10.20.193.45:0/4292603914 conn(0x7f13240c9d40 msgr2=0x7f13240ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:35.951 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 1 -- 10.20.193.45:0/4292603914 shutdown_connections 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.944+0000 7f1329845640 1 -- 10.20.193.45:0/4292603914 wait complete. 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.945+0000 7f1329845640 10 monclient: build_initial_monmap 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.945+0000 7f1329845640 10 monclient: monmap: 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:35.952 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.945+0000 7f1329845640 1 librados: starting msgr at 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.945+0000 7f1329845640 1 librados: starting objecter 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.945+0000 7f1329845640 1 Processor -- start 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.945+0000 7f1329845640 1 -- start start 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.945+0000 7f1329845640 1 librados: setting wanted keys 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.945+0000 7f1329845640 1 librados: calling monclient init 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.945+0000 7f1329845640 10 monclient: init 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1324152620 0x7f13241f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:35.953 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient(hunting): picked mon.noname-c con 0x7f1324152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1324152a00 0x7f1324151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient(hunting): picked mon.noname-a con 0x7f1324152a00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f132415aff0 0x7f13241f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient(hunting): picked mon.noname-b con 0x7f132415aff0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f13240c5c90 con 0x7f1324152a00 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f132415a3c0 con 0x7f132415aff0 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f13240c5e10 con 0x7f1324152620 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1329845640 10 monclient(hunting): authenticate will time out at 1279.576163s 2026-02-17T21:11:35.954 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f132415aff0 0x7f13241f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13227fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1324152a00 0x7f1324151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1322ffd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1324152620 0x7f13241f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f132415aff0 0x7f13241f70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:46152/0 (socket says 10.20.193.45:46152) 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 1 -- 10.20.193.45:0/2634564590 learned_addr learned my addr 10.20.193.45:0/2634564590 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 10 monclient(hunting): get_auth_request con 0x7f132415aff0 auth_method 0 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1322ffd640 10 monclient(hunting): get_auth_request con 0x7f1324152620 auth_method 0 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1322ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:35.955 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1322ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f1322ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13227fc640 10 monclient(hunting): get_auth_request con 0x7f1324152a00 auth_method 0 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13227fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13227fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.946+0000 7f13237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.947+0000 7f1322ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.947+0000 7f1322ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.947+0000 7f1322ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:35.956 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.947+0000 7f13227fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.947+0000 7f13227fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.947+0000 7f13227fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 10 monclient(hunting): handle_auth_done global_id 5038 payload 824 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 1 -- 10.20.193.45:0/2634564590 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1324152620 msgr2=0x7f13241f45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1324152620 0x7f13241f45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 1 -- 10.20.193.45:0/2634564590 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1324152a00 msgr2=0x7f1324151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1324152a00 0x7f1324151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 10 monclient: _finish_hunting 0 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 1 monclient: found mon.noname-b 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:35.957 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.948+0000 7f13237fe640 1 -- 10.20.193.45:0/2634564590 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13241f7b30 con 0x7f132415aff0 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.949+0000 7f13237fe640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f132415aff0 0x7f13241f70f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f131402f6f0 tx=0x7f1314004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.949+0000 7f12fbfff640 10 client.?.objecter ms_handle_connect 0x7f132415aff0 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.949+0000 7f12fbfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 1 -- 10.20.193.45:0/2634564590 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131403c050 con 0x7f132415aff0 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 10 monclient: dump: 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:35.958 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 10 monclient: _finish_auth 0 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 10 monclient: _check_auth_tickets 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 1 -- 10.20.193.45:0/2634564590 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1314048070 con 0x7f132415aff0 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f1329845640 5 monclient: authenticate success, global_id 5038 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f1329845640 10 monclient: _renew_subs 2026-02-17T21:11:35.959 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f1329845640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13241f7e10 con 0x7f132415aff0 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 1 -- 10.20.193.45:0/2634564590 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314041a50 con 0x7f132415aff0 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f12fbfff640 10 monclient: dump: 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:35.960 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f13217fa640 4 set_mon_vals no callback set 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f1329845640 10 client.5038.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f1329845640 10 monclient: _renew_subs 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f1329845640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132406d420 con 0x7f132415aff0 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.950+0000 7f1329845640 1 librados: init done 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.951+0000 7f1329845640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:35.961 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.951+0000 7f1329845640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:35.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.951+0000 7f1329845640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:35.962 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:35.951+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132406cf60 con 0x7f132415aff0 2026-02-17T21:11:36.049 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.056+0000 7f12fbfff640 1 -- 10.20.193.45:0/2634564590 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f1314041bf0 con 0x7f132415aff0 2026-02-17T21:11:36.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.057+0000 7f12fbfff640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f12f40792d0 0x7f12f407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:36.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.057+0000 7f1322ffd640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f12f40792d0 0x7f12f407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:36.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.057+0000 7f1322ffd640 10 monclient: get_auth_request con 0x7f12f40792d0 auth_method 0 2026-02-17T21:11:36.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.057+0000 7f1322ffd640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f12f40792d0 0x7f12f407b790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1318007b60 tx=0x7f1318007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:36.050 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.057+0000 7f12fbfff640 10 client.5038.objecter ms_handle_connect 0x7f12f40792d0 2026-02-17T21:11:36.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.058+0000 7f12fbfff640 1 -- 10.20.193.45:0/2634564590 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f1314084740 con 0x7f132415aff0 2026-02-17T21:11:36.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.058+0000 7f12fbfff640 10 client.5038.objecter ms_dispatch2 0x7f1324000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:36.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.058+0000 7f12fbfff640 3 client.5038.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:36.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.058+0000 7f12fbfff640 3 client.5038.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:36.051 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.058+0000 7f12fbfff640 20 client.5038.objecter dump_active .. 0 homeless 2026-02-17T21:11:36.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.065+0000 7f12fbfff640 1 -- 10.20.193.45:0/2634564590 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f132406cf60 con 0x7f132415aff0 2026-02-17T21:11:36.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.065+0000 7f12fbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:36.057 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.065+0000 7f12fbfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:36.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.163+0000 7f1329845640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:36.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.163+0000 7f1329845640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:36.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.163+0000 7f1329845640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:36.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.163+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1324070e10 con 0x7f132415aff0 2026-02-17T21:11:36.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.166+0000 7f12fbfff640 1 -- 10.20.193.45:0/2634564590 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f1324070e10 con 0x7f132415aff0 2026-02-17T21:11:36.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.166+0000 7f12fbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:36.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.166+0000 7f12fbfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:36.158 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:36.159 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:36.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 10 librados: watch_flush enter 2026-02-17T21:11:36.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 10 librados: watch_flush exit 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 20 client.5038.objecter shutdown clearing up homeless session... 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 10 client.5038.objecter successfully canceled tick 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f12f40792d0 msgr2=0x7f12f407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f12f40792d0 0x7f12f407b790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1318007b60 tx=0x7f1318007ab0 comp rx=0 tx=0).stop 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 10 monclient: shutdown 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f132415aff0 msgr2=0x7f13241f70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f132415aff0 0x7f13241f70f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f131402f6f0 tx=0x7f1314004b40 comp rx=0 tx=0).stop 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 shutdown_connections 2026-02-17T21:11:36.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f12f40792d0 0x7f12f407b790 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:36.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f132415aff0 0x7f13241f70f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:36.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1324152a00 0x7f1324151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:36.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 --2- 10.20.193.45:0/2634564590 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1324152620 0x7f13241f45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:36.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 >> 10.20.193.45:0/2634564590 conn(0x7f13240c9d40 msgr2=0x7f13240ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:36.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 shutdown_connections 2026-02-17T21:11:36.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 -- 10.20.193.45:0/2634564590 wait complete. 2026-02-17T21:11:36.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:36.167+0000 7f1329845640 1 librados: shutdown 2026-02-17T21:11:39.169 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:39.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.246+0000 7fe710722640 10 monclient: get_monmap_and_config 2026-02-17T21:11:39.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.246+0000 7fe710722640 10 monclient: build_initial_monmap 2026-02-17T21:11:39.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.246+0000 7fe710722640 10 monclient: monmap: 2026-02-17T21:11:39.239 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:39.239 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:39.239 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:39.247323+0000 2026-02-17T21:11:39.239 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:39.247323+0000 2026-02-17T21:11:39.239 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:39.239 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:39.240 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:39.240 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:39.240 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:39.240 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:39.240 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:39.240 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:39.240 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:39.242 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.246+0000 7fe710722640 1 Processor -- start 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.246+0000 7fe710722640 1 -- start start 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.246+0000 7fe710722640 10 monclient: init 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 10 monclient: _add_conns ranks=[5,3,1,0,4,2] 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fe70815d1e0 0x7fe70815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 10 monclient(hunting): picked mon.noname-c con 0x7fe70815d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe7080748e0 0x7fe7080c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 10 monclient(hunting): picked mon.noname-a con 0x7fe7080748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe7080c90e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7080c9570 con 0x7fe7080c90e0 2026-02-17T21:11:39.243 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe7080c5860 con 0x7fe7080748e0 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe7080c5580 con 0x7fe70815d1e0 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe710722640 10 monclient(hunting): authenticate will time out at 1282.877453s 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe70ec98640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fe7080c90e0 0x7fe708153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:40824/0 (socket says 10.20.193.45:40824) 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe70ec98640 1 -- 10.20.193.45:0/3381267119 learned_addr learned my addr 10.20.193.45:0/3381267119 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.247+0000 7fe70e497640 1 --2- 10.20.193.45:0/3381267119 >> v2:10.20.193.92:3300/0 conn(0x7fe70815d1e0 0x7fe70815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70dc96640 1 --2- 10.20.193.45:0/3381267119 >> v2:10.20.193.45:3300/0 conn(0x7fe7080748e0 0x7fe7080c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70dc96640 10 monclient(hunting): get_auth_request con 0x7fe7080748e0 auth_method 0 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70dc96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70dc96640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:39.244 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70dc96640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70e497640 10 monclient(hunting): get_auth_request con 0x7fe70815d1e0 auth_method 0 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70e497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70e497640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70e497640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70dc96640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70dc96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70dc96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70e497640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70e497640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.248+0000 7fe70e497640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.249+0000 7fe70dc96640 10 monclient(hunting): handle_auth_done global_id 4971 payload 274 2026-02-17T21:11:39.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.249+0000 7fe70dc96640 1 -- 10.20.193.45:0/3381267119 >> v2:10.20.193.92:3300/0 conn(0x7fe70815d1e0 msgr2=0x7fe70815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:39.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.249+0000 7fe70dc96640 1 --2- 10.20.193.45:0/3381267119 >> v2:10.20.193.92:3300/0 conn(0x7fe70815d1e0 0x7fe70815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:39.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.249+0000 7fe70dc96640 1 -- 10.20.193.45:0/3381267119 >> v1:10.20.193.86:6789/0 conn(0x7fe7080c90e0 legacy=0x7fe708153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:39.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.249+0000 7fe70dc96640 10 monclient: _finish_hunting 0 2026-02-17T21:11:39.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.249+0000 7fe70dc96640 1 monclient: found mon.noname-a 2026-02-17T21:11:39.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.249+0000 7fe70dc96640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:39.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.249+0000 7fe70dc96640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:39.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.249+0000 7fe70dc96640 1 -- 10.20.193.45:0/3381267119 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7080c7de0 con 0x7fe7080748e0 2026-02-17T21:11:39.246 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.250+0000 7fe70dc96640 1 --2- 10.20.193.45:0/3381267119 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 0x7fe7080c8ba0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0098a0 tx=0x7fe6fc02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd6d2ecae08b02e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:39.252 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 1 -- 10.20.193.45:0/3381267119 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc03c070 con 0x7fe7080748e0 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 10 monclient: dump: 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:39.253 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 10 monclient: _finish_auth 0 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 10 monclient: _check_auth_tickets 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 1 -- 10.20.193.45:0/3381267119 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6fc02fae0 con 0x7fe7080748e0 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 1 -- 10.20.193.45:0/3381267119 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc037440 con 0x7fe7080748e0 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 5 monclient: authenticate success, global_id 4971 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 4 set_mon_vals no callback set 2026-02-17T21:11:39.254 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe70d495640 10 monclient: dump: 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:39.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 10 monclient: shutdown 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 1 -- 10.20.193.45:0/3381267119 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 msgr2=0x7fe7080c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 1 --2- 10.20.193.45:0/3381267119 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 0x7fe7080c8ba0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0098a0 tx=0x7fe6fc02ee10 comp rx=0 tx=0).stop 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 1 -- 10.20.193.45:0/3381267119 shutdown_connections 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 1 --2- 10.20.193.45:0/3381267119 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 0x7fe7080c8ba0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 1 --2- 10.20.193.45:0/3381267119 >> v2:10.20.193.92:3300/0 conn(0x7fe70815d1e0 0x7fe70815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 1 -- 10.20.193.45:0/3381267119 >> 10.20.193.45:0/3381267119 conn(0x7fe7080c9d40 msgr2=0x7fe7080ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 1 -- 10.20.193.45:0/3381267119 shutdown_connections 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 1 -- 10.20.193.45:0/3381267119 wait complete. 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.252+0000 7fe710722640 10 monclient: build_initial_monmap 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient: monmap: 2026-02-17T21:11:39.256 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 librados: starting msgr at 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 librados: starting objecter 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 Processor -- start 2026-02-17T21:11:39.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 -- start start 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 librados: setting wanted keys 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 librados: calling monclient init 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient: init 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 0x7fe7081f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient(hunting): picked mon.noname-a con 0x7fe7080748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7080c90e0 0x7fe708072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient(hunting): picked mon.noname-c con 0x7fe7080c90e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe70815d1e0 0x7fe708145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient(hunting): picked mon.noname-b con 0x7fe70815d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:39.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe7080c8680 con 0x7fe7080748e0 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe7080c83a0 con 0x7fe70815d1e0 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe708074d30 con 0x7fe7080c90e0 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe710722640 10 monclient(hunting): authenticate will time out at 1282.883673s 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.253+0000 7fe70e497640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 0x7fe7081f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70ec98640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe70815d1e0 0x7fe708145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70e497640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 0x7fe7081f3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:58002/0 (socket says 10.20.193.45:58002) 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70e497640 1 -- 10.20.193.45:0/3318693148 learned_addr learned my addr 10.20.193.45:0/3318693148 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70e497640 10 monclient(hunting): get_auth_request con 0x7fe7080748e0 auth_method 0 2026-02-17T21:11:39.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70e497640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70e497640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70e497640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70dc96640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7080c90e0 0x7fe708072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70ec98640 10 monclient(hunting): get_auth_request con 0x7fe70815d1e0 auth_method 0 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70ec98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70ec98640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70ec98640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70e497640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70e497640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70e497640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70dc96640 10 monclient(hunting): get_auth_request con 0x7fe7080c90e0 auth_method 0 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70dc96640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:39.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70dc96640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70dc96640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70ec98640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70ec98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70ec98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70dc96640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70dc96640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.254+0000 7fe70dc96640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 10 monclient(hunting): handle_auth_done global_id 4974 payload 824 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 1 -- 10.20.193.45:0/3318693148 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7080c90e0 msgr2=0x7fe708072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7080c90e0 0x7fe708072ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 1 -- 10.20.193.45:0/3318693148 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe70815d1e0 msgr2=0x7fe708145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:39.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe70815d1e0 0x7fe708145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 10 monclient: _finish_hunting 0 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 1 monclient: found mon.noname-a 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.255+0000 7fe70e497640 1 -- 10.20.193.45:0/3318693148 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7081f3dc0 con 0x7fe7080748e0 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.256+0000 7fe70e497640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 0x7fe7081f3640 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800e890 tx=0x7fe6f800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.256+0000 7fe6eeffd640 10 client.?.objecter ms_handle_connect 0x7fe7080748e0 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.256+0000 7fe6eeffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 1 -- 10.20.193.45:0/3318693148 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8017070 con 0x7fe7080748e0 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:39.262 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 10 monclient: dump: 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:39.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 10 monclient: _finish_auth 0 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 1 -- 10.20.193.45:0/3318693148 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f800c940 con 0x7fe7080748e0 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 5 monclient: authenticate success, global_id 4974 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 1 -- 10.20.193.45:0/3318693148 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f800cd30 con 0x7fe7080748e0 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe70cc94640 4 set_mon_vals no callback set 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe6eeffd640 10 monclient: dump: 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:39.264 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 10 monclient: _renew_subs 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7081f40a0 con 0x7fe7080748e0 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 10 client.4974.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:39.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 10 monclient: _renew_subs 2026-02-17T21:11:39.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:39.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7080726a0 con 0x7fe7080748e0 2026-02-17T21:11:39.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 1 librados: init done 2026-02-17T21:11:39.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:39.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:39.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:39.266 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.258+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe708072490 con 0x7fe7080748e0 2026-02-17T21:11:39.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.270+0000 7fe6eeffd640 1 -- 10.20.193.45:0/3318693148 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fe6f8013470 con 0x7fe7080748e0 2026-02-17T21:11:39.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.271+0000 7fe6eeffd640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe6d80792d0 0x7fe6d807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:39.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.271+0000 7fe70dc96640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe6d80792d0 0x7fe6d807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:39.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.271+0000 7fe70dc96640 10 monclient: get_auth_request con 0x7fe6d80792d0 auth_method 0 2026-02-17T21:11:39.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.271+0000 7fe70dc96640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe6d80792d0 0x7fe6d807b790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc039000 tx=0x7fe6fc033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:39.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.271+0000 7fe6eeffd640 10 client.4974.objecter ms_handle_connect 0x7fe6d80792d0 2026-02-17T21:11:39.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.376+0000 7fe6eeffd640 1 -- 10.20.193.45:0/3318693148 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fe6f805e7f0 con 0x7fe7080748e0 2026-02-17T21:11:39.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.376+0000 7fe6eeffd640 10 client.4974.objecter ms_dispatch2 0x7fe708000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:39.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.376+0000 7fe6eeffd640 3 client.4974.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:39.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.376+0000 7fe6eeffd640 3 client.4974.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:39.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.376+0000 7fe6eeffd640 20 client.4974.objecter dump_active .. 0 homeless 2026-02-17T21:11:39.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.376+0000 7fe6eeffd640 1 -- 10.20.193.45:0/3318693148 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe6f80627b0 con 0x7fe7080748e0 2026-02-17T21:11:39.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.376+0000 7fe6eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:39.369 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.376+0000 7fe6eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:39.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.479+0000 7fe710722640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:39.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.479+0000 7fe710722640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:39.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.479+0000 7fe710722640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:39.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.479+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe7080c8ba0 con 0x7fe7080748e0 2026-02-17T21:11:39.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.501+0000 7fe6eeffd640 1 -- 10.20.193.45:0/3318693148 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fe6f8066ab0 con 0x7fe7080748e0 2026-02-17T21:11:39.493 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.501+0000 7fe6eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:39.494 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.501+0000 7fe6eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:39.494 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:39.494 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:39.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 10 librados: watch_flush enter 2026-02-17T21:11:39.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 10 librados: watch_flush exit 2026-02-17T21:11:39.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 20 client.4974.objecter shutdown clearing up homeless session... 2026-02-17T21:11:39.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 10 client.4974.objecter successfully canceled tick 2026-02-17T21:11:39.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe6d80792d0 msgr2=0x7fe6d807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:39.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe6d80792d0 0x7fe6d807b790 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc039000 tx=0x7fe6fc033000 comp rx=0 tx=0).stop 2026-02-17T21:11:39.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 10 monclient: shutdown 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 msgr2=0x7fe7081f3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 0x7fe7081f3640 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800e890 tx=0x7fe6f800ed60 comp rx=0 tx=0).stop 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 shutdown_connections 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe6d80792d0 0x7fe6d807b790 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe70815d1e0 0x7fe708145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.502+0000 7fe710722640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7080c90e0 0x7fe708072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.503+0000 7fe710722640 1 --2- 10.20.193.45:0/3318693148 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7080748e0 0x7fe7081f3640 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.503+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 >> 10.20.193.45:0/3318693148 conn(0x7fe7080c9d40 msgr2=0x7fe70814de90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.503+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 shutdown_connections 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.503+0000 7fe710722640 1 -- 10.20.193.45:0/3318693148 wait complete. 2026-02-17T21:11:39.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:39.503+0000 7fe710722640 1 librados: shutdown 2026-02-17T21:11:42.505 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:42.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.583+0000 7ff8ecbed640 10 monclient: get_monmap_and_config 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.583+0000 7ff8ecbed640 10 monclient: build_initial_monmap 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.583+0000 7ff8ecbed640 10 monclient: monmap: 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:42.584091+0000 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:42.584091+0000 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:42.576 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:42.577 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:42.577 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:42.577 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:42.577 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:42.577 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:42.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.583+0000 7ff8ecbed640 1 Processor -- start 2026-02-17T21:11:42.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.583+0000 7ff8ecbed640 1 -- start start 2026-02-17T21:11:42.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.583+0000 7ff8ecbed640 10 monclient: init 2026-02-17T21:11:42.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:42.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 10 monclient: _add_conns ranks=[0,5,1,3,4,2] 2026-02-17T21:11:42.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff8e815d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:42.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff8e80c92b0 0x7ff8e815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:42.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 10 monclient(hunting): picked mon.noname-c con 0x7ff8e80c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff8e80748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e80c5860 con 0x7ff8e815d1e0 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8e80c5580 con 0x7ff8e80748e0 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff8e80c7de0 con 0x7ff8e80c92b0 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8ecbed640 10 monclient(hunting): authenticate will time out at 1286.214321s 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8e6575640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7ff8e815d1e0 0x7ff8e80c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:44072/0 (socket says 10.20.193.45:44072) 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8e6575640 1 -- 10.20.193.45:0/1988742077 learned_addr learned my addr 10.20.193.45:0/1988742077 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.584+0000 7ff8e5d74640 1 --2- 10.20.193.45:0/1988742077 >> v2:10.20.193.92:3300/0 conn(0x7ff8e80c92b0 0x7ff8e815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5d74640 10 monclient(hunting): get_auth_request con 0x7ff8e80c92b0 auth_method 0 2026-02-17T21:11:42.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5573640 1 -- 10.20.193.45:0/1988742077 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536358405 0 0) 0x7ff8e80c5860 con 0x7ff8e815d1e0 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5573640 10 monclient(hunting): _negotiate 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5573640 10 monclient(hunting): my global_id is 4977 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.585+0000 7ff8e5573640 1 -- 10.20.193.45:0/1988742077 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8d4003620 con 0x7ff8e815d1e0 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5573640 1 -- 10.20.193.45:0/1988742077 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884741815 0 0) 0x7ff8e80c5580 con 0x7ff8e80748e0 2026-02-17T21:11:42.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5573640 10 monclient(hunting): _negotiate 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5573640 10 monclient(hunting): my global_id is 5047 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5573640 1 -- 10.20.193.45:0/1988742077 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8e80c5860 con 0x7ff8e80748e0 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5d74640 10 monclient(hunting): handle_auth_done global_id 5090 payload 274 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5d74640 1 -- 10.20.193.45:0/1988742077 >> v1:10.20.193.86:6789/0 conn(0x7ff8e80748e0 legacy=0x7ff8e8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5d74640 1 -- 10.20.193.45:0/1988742077 >> v1:10.20.193.45:6789/0 conn(0x7ff8e815d1e0 legacy=0x7ff8e80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5d74640 10 monclient: _finish_hunting 0 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5d74640 1 monclient: found mon.noname-c 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.586+0000 7ff8e5d74640 1 -- 10.20.193.45:0/1988742077 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e80c80c0 con 0x7ff8e80c92b0 2026-02-17T21:11:42.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.587+0000 7ff8e5d74640 1 --2- 10.20.193.45:0/1988742077 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e80c92b0 0x7ff8e815d5c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00098d0 tx=0x7ff8d002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c15e28e494281663 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:42.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 1 -- 10.20.193.45:0/1988742077 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d003c070 con 0x7ff8e80c92b0 2026-02-17T21:11:42.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:42.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:42.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 10 monclient: dump: 2026-02-17T21:11:42.589 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:42.589 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:42.589 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:42.589 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:42.589 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 10 monclient: _finish_auth 0 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 10 monclient: _check_auth_tickets 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 1 -- 10.20.193.45:0/1988742077 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d002fba0 con 0x7ff8e80c92b0 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8ecbed640 5 monclient: authenticate success, global_id 5090 2026-02-17T21:11:42.590 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 1 -- 10.20.193.45:0/1988742077 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0037440 con 0x7ff8e80c92b0 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8ecbed640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8ecbed640 4 set_mon_vals no callback set 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.589+0000 7ff8e5573640 10 monclient: dump: 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:42.591 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 10 monclient: shutdown 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1988742077 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e80c92b0 msgr2=0x7ff8e815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 1 --2- 10.20.193.45:0/1988742077 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e80c92b0 0x7ff8e815d5c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00098d0 tx=0x7ff8d002eed0 comp rx=0 tx=0).stop 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1988742077 shutdown_connections 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 1 --2- 10.20.193.45:0/1988742077 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e80c92b0 0x7ff8e815d5c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1988742077 >> 10.20.193.45:0/1988742077 conn(0x7ff8e80c9d40 msgr2=0x7ff8e80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1988742077 shutdown_connections 2026-02-17T21:11:42.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1988742077 wait complete. 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 10 monclient: build_initial_monmap 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.590+0000 7ff8ecbed640 10 monclient: monmap: 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:42.593 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 librados: starting msgr at 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 librados: starting objecter 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 Processor -- start 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 -- start start 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 librados: setting wanted keys 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 librados: calling monclient init 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient: init 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff8e80748e0 0x7ff8e815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient(hunting): picked mon.noname-a con 0x7ff8e80748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff8e80c92b0 0x7ff8e806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:42.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient(hunting): picked mon.noname-b con 0x7ff8e80c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e815d1e0 0x7ff8e806df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient(hunting): picked mon.noname-c con 0x7ff8e815d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8074d30 con 0x7ff8e80748e0 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e80c8680 con 0x7ff8e80c92b0 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8153d20 con 0x7ff8e815d1e0 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.591+0000 7ff8ecbed640 10 monclient(hunting): authenticate will time out at 1286.221673s 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff8e80748e0 0x7ff8e815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:42.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e815d1e0 0x7ff8e806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e5d74640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff8e80c92b0 0x7ff8e806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e815d1e0 0x7ff8e806df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:43262/0 (socket says 10.20.193.45:43262) 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 1 -- 10.20.193.45:0/1117388890 learned_addr learned my addr 10.20.193.45:0/1117388890 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 10 monclient(hunting): get_auth_request con 0x7ff8e815d1e0 auth_method 0 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6575640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff8e80748e0 0x7ff8e815c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:58014/0 (socket says 10.20.193.45:58014) 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6575640 10 monclient(hunting): get_auth_request con 0x7ff8e80748e0 auth_method 0 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:42.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e5d74640 10 monclient(hunting): get_auth_request con 0x7ff8e80c92b0 auth_method 0 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.592+0000 7ff8e5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:42.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 10 monclient(hunting): handle_auth_done global_id 5093 payload 824 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 1 -- 10.20.193.45:0/1117388890 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff8e80c92b0 msgr2=0x7ff8e806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff8e80c92b0 0x7ff8e806b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 1 -- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff8e80748e0 msgr2=0x7ff8e815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff8e80748e0 0x7ff8e815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 10 monclient: _finish_hunting 0 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 1 monclient: found mon.noname-c 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.593+0000 7ff8e6d76640 1 -- 10.20.193.45:0/1117388890 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e806d170 con 0x7ff8e815d1e0 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.595+0000 7ff8e6d76640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e815d1e0 0x7ff8e806df10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800cc20 tx=0x7ff8d800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.595+0000 7ff8ceffd640 10 client.?.objecter ms_handle_connect 0x7ff8e815d1e0 2026-02-17T21:11:42.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.595+0000 7ff8ceffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:42.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 1 -- 10.20.193.45:0/1117388890 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800ce40 con 0x7ff8e815d1e0 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 10 monclient: dump: 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:42.601 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 10 monclient: _finish_auth 0 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 10 monclient: _check_auth_tickets 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 1 -- 10.20.193.45:0/1117388890 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8d8003a70 con 0x7ff8e815d1e0 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 5 monclient: authenticate success, global_id 5093 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 10 monclient: _renew_subs 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e815b8f0 con 0x7ff8e815d1e0 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:42.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 1 -- 10.20.193.45:0/1117388890 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8003e60 con 0x7ff8e815d1e0 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ceffd640 10 monclient: dump: 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:42.603 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8e4d72640 4 set_mon_vals no callback set 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 10 client.5093.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 10 monclient: _renew_subs 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e806d430 con 0x7ff8e815d1e0 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 1 librados: init done 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:42.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.597+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8e815d5c0 con 0x7ff8e815d1e0 2026-02-17T21:11:42.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.610+0000 7ff8ceffd640 1 -- 10.20.193.45:0/1117388890 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff8d80050d0 con 0x7ff8e815d1e0 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.610+0000 7ff8ceffd640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff8b40792d0 0x7ff8b407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.610+0000 7ff8e6575640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff8b40792d0 0x7ff8b407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.610+0000 7ff8e6575640 10 monclient: get_auth_request con 0x7ff8b40792d0 auth_method 0 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.610+0000 7ff8ceffd640 10 client.5093.objecter ms_handle_connect 0x7ff8b40792d0 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.610+0000 7ff8e6575640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff8b40792d0 0x7ff8b407b790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc005980 tx=0x7ff8dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.612+0000 7ff8ceffd640 1 -- 10.20.193.45:0/1117388890 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ff8d805eab0 con 0x7ff8e815d1e0 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.612+0000 7ff8ceffd640 10 client.5093.objecter ms_dispatch2 0x7ff8e8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.612+0000 7ff8ceffd640 3 client.5093.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.612+0000 7ff8ceffd640 3 client.5093.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:42.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.612+0000 7ff8ceffd640 20 client.5093.objecter dump_active .. 0 homeless 2026-02-17T21:11:42.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.728+0000 7ff8ceffd640 1 -- 10.20.193.45:0/1117388890 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff8d8062a70 con 0x7ff8e815d1e0 2026-02-17T21:11:42.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.728+0000 7ff8ceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:42.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.728+0000 7ff8ceffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:42.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.830+0000 7ff8ecbed640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:42.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.830+0000 7ff8ecbed640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:42.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.830+0000 7ff8ecbed640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:42.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.830+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff8e80c9b20 con 0x7ff8e815d1e0 2026-02-17T21:11:42.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.832+0000 7ff8ceffd640 1 -- 10.20.193.45:0/1117388890 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff8d8066d70 con 0x7ff8e815d1e0 2026-02-17T21:11:42.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.832+0000 7ff8ceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:42.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.832+0000 7ff8ceffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:42.825 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:42.825 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:42.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.833+0000 7ff8ecbed640 10 librados: watch_flush enter 2026-02-17T21:11:42.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.833+0000 7ff8ecbed640 10 librados: watch_flush exit 2026-02-17T21:11:42.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.833+0000 7ff8ecbed640 20 client.5093.objecter shutdown clearing up homeless session... 2026-02-17T21:11:42.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.833+0000 7ff8ecbed640 10 client.5093.objecter successfully canceled tick 2026-02-17T21:11:42.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff8b40792d0 msgr2=0x7ff8b407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff8b40792d0 0x7ff8b407b790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc005980 tx=0x7ff8dc009040 comp rx=0 tx=0).stop 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 10 monclient: shutdown 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e815d1e0 msgr2=0x7ff8e806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e815d1e0 0x7ff8e806df10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800cc20 tx=0x7ff8d800a430 comp rx=0 tx=0).stop 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 shutdown_connections 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff8b40792d0 0x7ff8b407b790 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8e815d1e0 0x7ff8e806df10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff8e80c92b0 0x7ff8e806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 --2- 10.20.193.45:0/1117388890 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff8e80748e0 0x7ff8e815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 >> 10.20.193.45:0/1117388890 conn(0x7ff8e80c9d40 msgr2=0x7ff8e81489f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:42.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 shutdown_connections 2026-02-17T21:11:42.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 -- 10.20.193.45:0/1117388890 wait complete. 2026-02-17T21:11:42.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:42.834+0000 7ff8ecbed640 1 librados: shutdown 2026-02-17T21:11:45.837 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:45.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.913+0000 7fc5b6836640 10 monclient: get_monmap_and_config 2026-02-17T21:11:45.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.913+0000 7fc5b6836640 10 monclient: build_initial_monmap 2026-02-17T21:11:45.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.913+0000 7fc5b6836640 10 monclient: monmap: 2026-02-17T21:11:45.906 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:45.906 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:45.906 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:45.914396+0000 2026-02-17T21:11:45.906 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:45.914396+0000 2026-02-17T21:11:45.907 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:45.907 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:45.907 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:45.907 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:45.907 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:45.907 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:45.907 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:45.907 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:45.907 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:45.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 1 Processor -- start 2026-02-17T21:11:45.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 1 -- start start 2026-02-17T21:11:45.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient: init 2026-02-17T21:11:45.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:45.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient: _add_conns ranks=[0,3,4,5,1,2] 2026-02-17T21:11:45.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc5b015d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:45.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc5b00c92b0 0x7fc5b015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:45.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient(hunting): picked mon.noname-a con 0x7fc5b00c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:45.910 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc5b00748e0 0x7fc5b0153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient(hunting): picked mon.noname-b con 0x7fc5b00748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5b00c5860 con 0x7fc5b015d1e0 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fc5b00c5580 con 0x7fc5b00c92b0 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc5b00c7de0 con 0x7fc5b00748e0 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.914+0000 7fc5b6836640 10 monclient(hunting): authenticate will time out at 1289.544629s 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5af7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc5b00c92b0 0x7fc5b015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc5b00748e0 0x7fc5b0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:45.911 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc5b00748e0 0x7fc5b0153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:48964/0 (socket says 10.20.193.45:48964) 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 1 -- 10.20.193.45:0/3774832389 learned_addr learned my addr 10.20.193.45:0/3774832389 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 10 monclient(hunting): get_auth_request con 0x7fc5b00748e0 auth_method 0 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5af7fe640 10 monclient(hunting): get_auth_request con 0x7fc5b00c92b0 auth_method 0 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5b4dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:45.912 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.915+0000 7fc5af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.916+0000 7fc5b4dac640 10 monclient(hunting): handle_auth_done global_id 5053 payload 274 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.916+0000 7fc5b4dac640 1 -- 10.20.193.45:0/3774832389 >> v2:10.20.193.45:3300/0 conn(0x7fc5b00c92b0 msgr2=0x7fc5b015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.916+0000 7fc5b4dac640 1 --2- 10.20.193.45:0/3774832389 >> v2:10.20.193.45:3300/0 conn(0x7fc5b00c92b0 0x7fc5b015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.916+0000 7fc5b4dac640 1 -- 10.20.193.45:0/3774832389 >> v1:10.20.193.45:6789/0 conn(0x7fc5b015d1e0 legacy=0x7fc5b00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.916+0000 7fc5b4dac640 10 monclient: _finish_hunting 0 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.916+0000 7fc5b4dac640 1 monclient: found mon.noname-b 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.916+0000 7fc5b4dac640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.916+0000 7fc5b4dac640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.916+0000 7fc5b4dac640 1 -- 10.20.193.45:0/3774832389 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b00c80c0 con 0x7fc5b00748e0 2026-02-17T21:11:45.913 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.917+0000 7fc5b4dac640 1 --2- 10.20.193.45:0/3774832389 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc5b00748e0 0x7fc5b0153610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e50 tx=0x7fc5a402f2a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d74944443920369f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:45.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 1 -- 10.20.193.45:0/3774832389 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a402fd60 con 0x7fc5b00748e0 2026-02-17T21:11:45.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:45.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:45.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 10 monclient: dump: 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:45.921 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 10 monclient: _finish_auth 0 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 10 monclient: _check_auth_tickets 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 1 -- 10.20.193.45:0/3774832389 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a40373f0 con 0x7fc5b00748e0 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 5 monclient: authenticate success, global_id 5053 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 1 -- 10.20.193.45:0/3774832389 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a40377c0 con 0x7fc5b00748e0 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 4 set_mon_vals no callback set 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:45.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5aeffd640 10 monclient: dump: 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 10 monclient: shutdown 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:45.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 1 -- 10.20.193.45:0/3774832389 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc5b00748e0 msgr2=0x7fc5b0153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 1 --2- 10.20.193.45:0/3774832389 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc5b00748e0 0x7fc5b0153610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc5a4009e50 tx=0x7fc5a402f2a0 comp rx=0 tx=0).stop 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 1 -- 10.20.193.45:0/3774832389 shutdown_connections 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 1 --2- 10.20.193.45:0/3774832389 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc5b00748e0 0x7fc5b0153610 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 1 --2- 10.20.193.45:0/3774832389 >> v2:10.20.193.45:3300/0 conn(0x7fc5b00c92b0 0x7fc5b015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 1 -- 10.20.193.45:0/3774832389 >> 10.20.193.45:0/3774832389 conn(0x7fc5b00c9d40 msgr2=0x7fc5b00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 1 -- 10.20.193.45:0/3774832389 shutdown_connections 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.919+0000 7fc5b6836640 1 -- 10.20.193.45:0/3774832389 wait complete. 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient: build_initial_monmap 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient: monmap: 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:45.924 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 librados: starting msgr at 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 librados: starting objecter 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 Processor -- start 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 -- start start 2026-02-17T21:11:45.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 librados: setting wanted keys 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 librados: calling monclient init 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient: init 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc5b00748e0 0x7fc5b0142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient(hunting): picked mon.noname-c con 0x7fc5b00748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc5b00c92b0 0x7fc5b013c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient(hunting): picked mon.noname-a con 0x7fc5b00c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc5b015d1e0 0x7fc5b01455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient(hunting): picked mon.noname-b con 0x7fc5b015d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:45.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0074d30 con 0x7fc5b00c92b0 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b00c8680 con 0x7fc5b015d1e0 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b0153b50 con 0x7fc5b00748e0 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.920+0000 7fc5b6836640 10 monclient(hunting): authenticate will time out at 1289.550960s 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc5b00c92b0 0x7fc5b013c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5b4dac640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc5b015d1e0 0x7fc5b01455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc5b00c92b0 0x7fc5b013c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:58042/0 (socket says 10.20.193.45:58042) 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 1 -- 10.20.193.45:0/2552310448 learned_addr learned my addr 10.20.193.45:0/2552310448 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 10 monclient(hunting): get_auth_request con 0x7fc5b00c92b0 auth_method 0 2026-02-17T21:11:45.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5affff640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc5b00748e0 0x7fc5b0142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5b4dac640 10 monclient(hunting): get_auth_request con 0x7fc5b015d1e0 auth_method 0 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5b4dac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5b4dac640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5b4dac640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5b4dac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5b4dac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:45.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5b4dac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5affff640 10 monclient(hunting): get_auth_request con 0x7fc5b00748e0 auth_method 0 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.921+0000 7fc5affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 10 monclient(hunting): handle_auth_done global_id 4989 payload 824 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 1 -- 10.20.193.45:0/2552310448 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc5b00748e0 msgr2=0x7fc5b0142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc5b00748e0 0x7fc5b0142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 1 -- 10.20.193.45:0/2552310448 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc5b015d1e0 msgr2=0x7fc5b01455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc5b015d1e0 0x7fc5b01455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:45.929 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 1 monclient: found mon.noname-a 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.922+0000 7fc5af7fe640 1 -- 10.20.193.45:0/2552310448 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b00cc0b0 con 0x7fc5b00c92b0 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.923+0000 7fc5af7fe640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc5b00c92b0 0x7fc5b013c870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000ebe0 tx=0x7fc5a000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.923+0000 7fc5acff9640 10 client.?.objecter ms_handle_connect 0x7fc5b00c92b0 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.923+0000 7fc5acff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 1 -- 10.20.193.45:0/2552310448 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0017070 con 0x7fc5b00c92b0 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 10 monclient: dump: 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:45.930 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 10 monclient: _finish_auth 0 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 10 monclient: _check_auth_tickets 2026-02-17T21:11:45.931 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 1 -- 10.20.193.45:0/2552310448 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a000cc40 con 0x7fc5b00c92b0 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5b6836640 5 monclient: authenticate success, global_id 4989 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5b6836640 10 monclient: _renew_subs 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5b6836640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b01f28f0 con 0x7fc5b00c92b0 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 1 -- 10.20.193.45:0/2552310448 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0013470 con 0x7fc5b00c92b0 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5acff9640 10 monclient: dump: 2026-02-17T21:11:45.932 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5ae7fc640 4 set_mon_vals no callback set 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5b6836640 10 client.4989.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5b6836640 10 monclient: _renew_subs 2026-02-17T21:11:45.933 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5b6836640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:45.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b00cb5d0 con 0x7fc5b00c92b0 2026-02-17T21:11:45.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.925+0000 7fc5b6836640 1 librados: init done 2026-02-17T21:11:45.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.926+0000 7fc5b6836640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:45.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.926+0000 7fc5b6836640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:45.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.926+0000 7fc5b6836640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:45.934 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:45.926+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b0153ee0 con 0x7fc5b00c92b0 2026-02-17T21:11:46.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.035+0000 7fc5acff9640 1 -- 10.20.193.45:0/2552310448 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc5a0024060 con 0x7fc5b00c92b0 2026-02-17T21:11:46.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.036+0000 7fc5acff9640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc580079280 0x7fc58007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:46.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.036+0000 7fc5affff640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc580079280 0x7fc58007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:46.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.036+0000 7fc5affff640 10 monclient: get_auth_request con 0x7fc580079280 auth_method 0 2026-02-17T21:11:46.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.036+0000 7fc5affff640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc580079280 0x7fc58007b740 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc59c005110 tx=0x7fc59c007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:46.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.036+0000 7fc5acff9640 10 client.4989.objecter ms_handle_connect 0x7fc580079280 2026-02-17T21:11:46.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.044+0000 7fc5acff9640 1 -- 10.20.193.45:0/2552310448 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fc5a005e600 con 0x7fc5b00c92b0 2026-02-17T21:11:46.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.044+0000 7fc5acff9640 10 client.4989.objecter ms_dispatch2 0x7fc5b0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:46.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.044+0000 7fc5acff9640 3 client.4989.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:46.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.044+0000 7fc5acff9640 3 client.4989.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:46.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.044+0000 7fc5acff9640 20 client.4989.objecter dump_active .. 0 homeless 2026-02-17T21:11:46.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.044+0000 7fc5acff9640 1 -- 10.20.193.45:0/2552310448 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc5a00625c0 con 0x7fc5b00c92b0 2026-02-17T21:11:46.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.044+0000 7fc5acff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:46.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.044+0000 7fc5acff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:46.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.146+0000 7fc5b6836640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:46.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.146+0000 7fc5b6836640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:46.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.146+0000 7fc5b6836640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:11:46.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.146+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc5b01573a0 con 0x7fc5b00c92b0 2026-02-17T21:11:46.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.150+0000 7fc5acff9640 1 -- 10.20.193.45:0/2552310448 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc5a00668c0 con 0x7fc5b00c92b0 2026-02-17T21:11:46.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.150+0000 7fc5acff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:46.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.150+0000 7fc5acff9640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:46.143 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:46.143 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:46.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 10 librados: watch_flush enter 2026-02-17T21:11:46.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 10 librados: watch_flush exit 2026-02-17T21:11:46.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 20 client.4989.objecter shutdown clearing up homeless session... 2026-02-17T21:11:46.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 10 client.4989.objecter successfully canceled tick 2026-02-17T21:11:46.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc580079280 msgr2=0x7fc58007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:46.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc580079280 0x7fc58007b740 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc59c005110 tx=0x7fc59c007f30 comp rx=0 tx=0).stop 2026-02-17T21:11:46.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 10 monclient: shutdown 2026-02-17T21:11:46.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:46.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc5b00c92b0 msgr2=0x7fc5b013c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc5b00c92b0 0x7fc5b013c870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5a000ebe0 tx=0x7fc5a000c520 comp rx=0 tx=0).stop 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 shutdown_connections 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc580079280 0x7fc58007b740 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc5b015d1e0 0x7fc5b01455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc5b00c92b0 0x7fc5b013c870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 --2- 10.20.193.45:0/2552310448 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc5b00748e0 0x7fc5b0142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.151+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 >> 10.20.193.45:0/2552310448 conn(0x7fc5b00c9d40 msgr2=0x7fc5b014f560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.152+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 shutdown_connections 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.152+0000 7fc5b6836640 1 -- 10.20.193.45:0/2552310448 wait complete. 2026-02-17T21:11:46.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:46.152+0000 7fc5b6836640 1 librados: shutdown 2026-02-17T21:11:49.154 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.231+0000 7ff208301640 10 monclient: get_monmap_and_config 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.231+0000 7ff208301640 10 monclient: build_initial_monmap 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.231+0000 7ff208301640 10 monclient: monmap: 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:49.232543+0000 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:49.232543+0000 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:49.224 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 1 Processor -- start 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 1 -- start start 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient: init 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient: _add_conns ranks=[4,3,1,2,5,0] 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff20015d1e0 0x7ff20015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient(hunting): picked mon.noname-b con 0x7ff20015d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff2000748e0 0x7ff2000c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient(hunting): picked mon.noname-a con 0x7ff2000748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff2000c90e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2000c9570 con 0x7ff2000c90e0 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7ff2000c5860 con 0x7ff2000748e0 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff2000c5580 con 0x7ff20015d1e0 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.232+0000 7ff208301640 10 monclient(hunting): authenticate will time out at 1292.862777s 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff2000748e0 0x7ff2000c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff206076640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff20015d1e0 0x7ff20015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:49.225 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff2000748e0 0x7ff2000c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:51570/0 (socket says 10.20.193.45:51570) 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 1 -- 10.20.193.45:0/3430415744 learned_addr learned my addr 10.20.193.45:0/3430415744 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 10 monclient(hunting): get_auth_request con 0x7ff2000748e0 auth_method 0 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff206076640 10 monclient(hunting): get_auth_request con 0x7ff20015d1e0 auth_method 0 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff206076640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff206076640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff206076640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff205875640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff206076640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff206076640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:49.226 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.233+0000 7ff206076640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.234+0000 7ff205875640 10 monclient(hunting): handle_auth_done global_id 4992 payload 274 2026-02-17T21:11:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.234+0000 7ff205875640 1 -- 10.20.193.45:0/3430415744 >> v2:10.20.193.86:3300/0 conn(0x7ff20015d1e0 msgr2=0x7ff20015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.234+0000 7ff205875640 1 --2- 10.20.193.45:0/3430415744 >> v2:10.20.193.86:3300/0 conn(0x7ff20015d1e0 0x7ff20015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.234+0000 7ff205875640 1 -- 10.20.193.45:0/3430415744 >> v1:10.20.193.86:6789/0 conn(0x7ff2000c90e0 legacy=0x7ff200153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.234+0000 7ff205875640 10 monclient: _finish_hunting 0 2026-02-17T21:11:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.234+0000 7ff205875640 1 monclient: found mon.noname-a 2026-02-17T21:11:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.234+0000 7ff205875640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.234+0000 7ff205875640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:11:49.227 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.234+0000 7ff205875640 1 -- 10.20.193.45:0/3430415744 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2000c7de0 con 0x7ff2000748e0 2026-02-17T21:11:49.228 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.235+0000 7ff205875640 1 --2- 10.20.193.45:0/3430415744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff2000748e0 0x7ff2000c8ba0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009970 tx=0x7ff1f402eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800566cd452ced1e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 1 -- 10.20.193.45:0/3430415744 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f403c070 con 0x7ff2000748e0 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 10 monclient: dump: 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 10 monclient: _finish_auth 0 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 10 monclient: _check_auth_tickets 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 1 -- 10.20.193.45:0/3430415744 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f402fb20 con 0x7ff2000748e0 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 1 -- 10.20.193.45:0/3430415744 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4037440 con 0x7ff2000748e0 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff205074640 10 monclient: dump: 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:49.230 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:49.231 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:49.231 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:49.231 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:49.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff208301640 5 monclient: authenticate success, global_id 4992 2026-02-17T21:11:49.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff208301640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:49.231 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.237+0000 7ff208301640 4 set_mon_vals no callback set 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 10 monclient: shutdown 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 -- 10.20.193.45:0/3430415744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff2000748e0 msgr2=0x7ff2000c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 --2- 10.20.193.45:0/3430415744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff2000748e0 0x7ff2000c8ba0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4009970 tx=0x7ff1f402eef0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 -- 10.20.193.45:0/3430415744 shutdown_connections 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 --2- 10.20.193.45:0/3430415744 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff2000748e0 0x7ff2000c8ba0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 --2- 10.20.193.45:0/3430415744 >> v2:10.20.193.86:3300/0 conn(0x7ff20015d1e0 0x7ff20015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 -- 10.20.193.45:0/3430415744 >> 10.20.193.45:0/3430415744 conn(0x7ff2000c9d40 msgr2=0x7ff2000ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 -- 10.20.193.45:0/3430415744 shutdown_connections 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 -- 10.20.193.45:0/3430415744 wait complete. 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 10 monclient: build_initial_monmap 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 10 monclient: monmap: 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:49.232 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 librados: starting msgr at 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 librados: starting objecter 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.238+0000 7ff208301640 1 Processor -- start 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 1 -- start start 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 1 librados: setting wanted keys 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 1 librados: calling monclient init 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient: init 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff2000748e0 0x7ff20015c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient(hunting): picked mon.noname-b con 0x7ff2000748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2000c90e0 0x7ff2001f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient(hunting): picked mon.noname-c con 0x7ff2000c90e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff20015d1e0 0x7ff2001f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient(hunting): picked mon.noname-a con 0x7ff20015d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000c8680 con 0x7ff20015d1e0 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000c83a0 con 0x7ff2000748e0 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff200074d30 con 0x7ff2000c90e0 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff208301640 10 monclient(hunting): authenticate will time out at 1292.869442s 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206877640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff20015d1e0 0x7ff2001f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206076640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff2000748e0 0x7ff20015c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206877640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff20015d1e0 0x7ff2001f3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:51580/0 (socket says 10.20.193.45:51580) 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206877640 1 -- 10.20.193.45:0/469863775 learned_addr learned my addr 10.20.193.45:0/469863775 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206877640 10 monclient(hunting): get_auth_request con 0x7ff20015d1e0 auth_method 0 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206877640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206877640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:49.233 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206877640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206076640 10 monclient(hunting): get_auth_request con 0x7ff2000748e0 auth_method 0 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206076640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206076640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff206076640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.239+0000 7ff205875640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2000c90e0 0x7ff2001f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff206877640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff206877640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff206877640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff206076640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff206076640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff206076640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff205875640 10 monclient(hunting): get_auth_request con 0x7ff2000c90e0 auth_method 0 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff205875640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff205875640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff205875640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff205875640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff205875640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.240+0000 7ff205875640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 10 monclient(hunting): handle_auth_done global_id 5062 payload 824 2026-02-17T21:11:49.234 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 1 -- 10.20.193.45:0/469863775 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2000c90e0 msgr2=0x7ff2001f2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2000c90e0 0x7ff2001f2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 1 -- 10.20.193.45:0/469863775 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff20015d1e0 msgr2=0x7ff2001f3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff20015d1e0 0x7ff2001f3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 10 monclient: _finish_hunting 0 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 1 monclient: found mon.noname-b 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.241+0000 7ff206076640 1 -- 10.20.193.45:0/469863775 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2001e4f20 con 0x7ff2000748e0 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.242+0000 7ff206076640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff2000748e0 0x7ff20015c780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000e870 tx=0x7ff1f000ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.242+0000 7ff1e6ffd640 10 client.?.objecter ms_handle_connect 0x7ff2000748e0 2026-02-17T21:11:49.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.242+0000 7ff1e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:49.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 1 -- 10.20.193.45:0/469863775 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0017070 con 0x7ff2000748e0 2026-02-17T21:11:49.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:49.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:49.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 10 monclient: dump: 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 1 -- 10.20.193.45:0/469863775 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f000c940 con 0x7ff2000748e0 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 5 monclient: authenticate success, global_id 5062 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 10 monclient: _renew_subs 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2001f4160 con 0x7ff2000748e0 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 1 -- 10.20.193.45:0/469863775 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000cd10 con 0x7ff2000748e0 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff1e6ffd640 10 monclient: dump: 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:49.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff204873640 4 set_mon_vals no callback set 2026-02-17T21:11:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 10 client.5062.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 10 monclient: _renew_subs 2026-02-17T21:11:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2001e51c0 con 0x7ff2000748e0 2026-02-17T21:11:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 1 librados: init done 2026-02-17T21:11:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:49.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.244+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2000c8ba0 con 0x7ff2000748e0 2026-02-17T21:11:49.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.353+0000 7ff1e6ffd640 1 -- 10.20.193.45:0/469863775 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff1f0024060 con 0x7ff2000748e0 2026-02-17T21:11:49.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.353+0000 7ff1e6ffd640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff1d0079300 0x7ff1d007b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:49.345 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.353+0000 7ff205875640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff1d0079300 0x7ff1d007b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:49.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.353+0000 7ff205875640 10 monclient: get_auth_request con 0x7ff1d0079300 auth_method 0 2026-02-17T21:11:49.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.353+0000 7ff205875640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff1d0079300 0x7ff1d007b7c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff2000c6af0 tx=0x7ff1f4033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:49.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.353+0000 7ff1e6ffd640 10 client.5062.objecter ms_handle_connect 0x7ff1d0079300 2026-02-17T21:11:49.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.355+0000 7ff1e6ffd640 1 -- 10.20.193.45:0/469863775 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ff1f005e300 con 0x7ff2000748e0 2026-02-17T21:11:49.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.355+0000 7ff1e6ffd640 10 client.5062.objecter ms_dispatch2 0x7ff200000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:49.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.355+0000 7ff1e6ffd640 3 client.5062.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:49.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.355+0000 7ff1e6ffd640 3 client.5062.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:49.348 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.355+0000 7ff1e6ffd640 20 client.5062.objecter dump_active .. 0 homeless 2026-02-17T21:11:49.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.363+0000 7ff1e6ffd640 1 -- 10.20.193.45:0/469863775 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff1f00622c0 con 0x7ff2000748e0 2026-02-17T21:11:49.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.363+0000 7ff1e6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:49.354 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.363+0000 7ff1e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:49.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.463+0000 7ff208301640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:49.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.463+0000 7ff208301640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:49.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.463+0000 7ff208301640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:49.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.463+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff2000c9b20 con 0x7ff2000748e0 2026-02-17T21:11:49.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.467+0000 7ff1e6ffd640 1 -- 10.20.193.45:0/469863775 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff1f00665c0 con 0x7ff2000748e0 2026-02-17T21:11:49.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.467+0000 7ff1e6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:49.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.467+0000 7ff1e6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:49.459 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:49.459 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:49.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 10 librados: watch_flush enter 2026-02-17T21:11:49.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 10 librados: watch_flush exit 2026-02-17T21:11:49.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 20 client.5062.objecter shutdown clearing up homeless session... 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 10 client.5062.objecter successfully canceled tick 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff1d0079300 msgr2=0x7ff1d007b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff1d0079300 0x7ff1d007b7c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff2000c6af0 tx=0x7ff1f4033000 comp rx=0 tx=0).stop 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 10 monclient: shutdown 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff2000748e0 msgr2=0x7ff20015c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff2000748e0 0x7ff20015c780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000e870 tx=0x7ff1f000ed40 comp rx=0 tx=0).stop 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 shutdown_connections 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff1d0079300 0x7ff1d007b7c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff20015d1e0 0x7ff2001f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2000c90e0 0x7ff2001f2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 --2- 10.20.193.45:0/469863775 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff2000748e0 0x7ff20015c780 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 >> 10.20.193.45:0/469863775 conn(0x7ff2000c9d40 msgr2=0x7ff200152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 shutdown_connections 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 -- 10.20.193.45:0/469863775 wait complete. 2026-02-17T21:11:49.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:49.468+0000 7ff208301640 1 librados: shutdown 2026-02-17T21:11:50.328 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:57.541 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:50.331 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:57.544 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:50.339 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:06:57.551 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:50.357 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:06:57.530 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:50.359 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:06:57.532 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:50.360 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:06:57.570 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:50.360 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:06:57.571 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:50.367 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:06:57.540 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:50.368 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:06:57.578 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:11:52.470 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:52.540 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.547+0000 7f7d9112c640 10 monclient: get_monmap_and_config 2026-02-17T21:11:52.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.547+0000 7f7d9112c640 10 monclient: build_initial_monmap 2026-02-17T21:11:52.541 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.547+0000 7f7d9112c640 10 monclient: monmap: 2026-02-17T21:11:52.541 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:52.541 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:52.541 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:52.549131+0000 2026-02-17T21:11:52.541 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:52.549131+0000 2026-02-17T21:11:52.541 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:52.541 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:52.541 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:52.542 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:52.542 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:52.542 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:52.542 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:52.542 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:52.542 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:52.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.547+0000 7f7d9112c640 1 Processor -- start 2026-02-17T21:11:52.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.547+0000 7f7d9112c640 1 -- start start 2026-02-17T21:11:52.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.547+0000 7f7d9112c640 10 monclient: init 2026-02-17T21:11:52.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:52.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 10 monclient: _add_conns ranks=[0,5,4,1,3,2] 2026-02-17T21:11:52.545 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7d8c15d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f7d8c0c92b0 0x7f7d8c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 10 monclient(hunting): picked mon.noname-c con 0x7f7d8c0c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f7d8c0748e0 0x7f7d8c153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 10 monclient(hunting): picked mon.noname-b con 0x7f7d8c0748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8c0c5860 con 0x7f7d8c15d1e0 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c0c5580 con 0x7f7d8c0748e0 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f7d8c0c7de0 con 0x7f7d8c0c92b0 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d9112c640 10 monclient(hunting): authenticate will time out at 1296.179348s 2026-02-17T21:11:52.546 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d8ad76640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f7d8c15d1e0 0x7f7d8c0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:57266/0 (socket says 10.20.193.45:57266) 2026-02-17T21:11:52.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d8ad76640 1 -- 10.20.193.45:0/1727441397 learned_addr learned my addr 10.20.193.45:0/1727441397 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:52.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d8a575640 1 --2- 10.20.193.45:0/1727441397 >> v2:10.20.193.92:3300/0 conn(0x7f7d8c0c92b0 0x7f7d8c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:52.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.548+0000 7f7d8b577640 1 --2- 10.20.193.45:0/1727441397 >> v2:10.20.193.86:3300/0 conn(0x7f7d8c0748e0 0x7f7d8c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:52.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8b577640 10 monclient(hunting): get_auth_request con 0x7f7d8c0748e0 auth_method 0 2026-02-17T21:11:52.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:52.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:52.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:52.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8a575640 10 monclient(hunting): get_auth_request con 0x7f7d8c0c92b0 auth_method 0 2026-02-17T21:11:52.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.549+0000 7f7d8b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d89d74640 1 -- 10.20.193.45:0/1727441397 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908065301 0 0) 0x7f7d8c0c5860 con 0x7f7d8c15d1e0 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d89d74640 10 monclient(hunting): _negotiate 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d89d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:52.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d89d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d89d74640 10 monclient(hunting): my global_id is 4998 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d89d74640 1 -- 10.20.193.45:0/1727441397 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d78003620 con 0x7f7d8c15d1e0 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d8a575640 10 monclient(hunting): handle_auth_done global_id 5102 payload 274 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d8a575640 1 -- 10.20.193.45:0/1727441397 >> v2:10.20.193.86:3300/0 conn(0x7f7d8c0748e0 msgr2=0x7f7d8c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d8a575640 1 --2- 10.20.193.45:0/1727441397 >> v2:10.20.193.86:3300/0 conn(0x7f7d8c0748e0 0x7f7d8c153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d8a575640 1 -- 10.20.193.45:0/1727441397 >> v1:10.20.193.45:6789/0 conn(0x7f7d8c15d1e0 legacy=0x7f7d8c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d8a575640 10 monclient: _finish_hunting 0 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d8a575640 1 monclient: found mon.noname-c 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d8a575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d8a575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.550+0000 7f7d8a575640 1 -- 10.20.193.45:0/1727441397 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c0c80c0 con 0x7f7d8c0c92b0 2026-02-17T21:11:52.549 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.551+0000 7f7d8a575640 1 --2- 10.20.193.45:0/1727441397 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8c0c92b0 0x7f7d8c15d5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7d740098a0 tx=0x7f7d7402ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35ebd5ecc4a4d81e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.552+0000 7f7d89d74640 1 -- 10.20.193.45:0/1727441397 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7403c070 con 0x7f7d8c0c92b0 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.552+0000 7f7d89d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 10 monclient: dump: 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:52.556 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 10 monclient: _finish_auth 0 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 10 monclient: _check_auth_tickets 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 1 -- 10.20.193.45:0/1727441397 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d7402fae0 con 0x7f7d8c0c92b0 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 5 monclient: authenticate success, global_id 5102 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:52.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 1 -- 10.20.193.45:0/1727441397 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d74037440 con 0x7f7d8c0c92b0 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d89d74640 10 monclient: dump: 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:52.558 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 4 set_mon_vals no callback set 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 10 monclient: shutdown 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 1 -- 10.20.193.45:0/1727441397 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8c0c92b0 msgr2=0x7f7d8c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 1 --2- 10.20.193.45:0/1727441397 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8c0c92b0 0x7f7d8c15d5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7d740098a0 tx=0x7f7d7402ee10 comp rx=0 tx=0).stop 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 1 -- 10.20.193.45:0/1727441397 shutdown_connections 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 1 --2- 10.20.193.45:0/1727441397 >> v2:10.20.193.86:3300/0 conn(0x7f7d8c0748e0 0x7f7d8c153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 1 --2- 10.20.193.45:0/1727441397 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8c0c92b0 0x7f7d8c15d5c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 1 -- 10.20.193.45:0/1727441397 >> 10.20.193.45:0/1727441397 conn(0x7f7d8c0c9d40 msgr2=0x7f7d8c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 1 -- 10.20.193.45:0/1727441397 shutdown_connections 2026-02-17T21:11:52.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.553+0000 7f7d9112c640 1 -- 10.20.193.45:0/1727441397 wait complete. 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient: build_initial_monmap 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient: monmap: 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:52.560 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 librados: starting msgr at 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 librados: starting objecter 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 Processor -- start 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 -- start start 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 librados: setting wanted keys 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 librados: calling monclient init 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient: init 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7d8c0748e0 0x7f7d8c1f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient(hunting): picked mon.noname-b con 0x7f7d8c0748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7d8c0c92b0 0x7f7d8c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:52.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient(hunting): picked mon.noname-a con 0x7f7d8c0c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8c15d1e0 0x7f7d8c06b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient(hunting): picked mon.noname-c con 0x7f7d8c15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c074d30 con 0x7f7d8c0c92b0 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c0c8680 con 0x7f7d8c0748e0 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7d8c153b50 con 0x7f7d8c15d1e0 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d9112c640 10 monclient(hunting): authenticate will time out at 1296.185697s 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.554+0000 7f7d8a575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7d8c0c92b0 0x7f7d8c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8ad76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7d8c0748e0 0x7f7d8c1f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:52.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8a575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7d8c0c92b0 0x7f7d8c15c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:51586/0 (socket says 10.20.193.45:51586) 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8a575640 1 -- 10.20.193.45:0/1167019694 learned_addr learned my addr 10.20.193.45:0/1167019694 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8a575640 10 monclient(hunting): get_auth_request con 0x7f7d8c0c92b0 auth_method 0 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8a575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8ad76640 10 monclient(hunting): get_auth_request con 0x7f7d8c0748e0 auth_method 0 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8ad76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8b577640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8c15d1e0 0x7f7d8c06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8b577640 10 monclient(hunting): get_auth_request con 0x7f7d8c15d1e0 auth_method 0 2026-02-17T21:11:52.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8b577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.555+0000 7f7d8b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 10 monclient(hunting): handle_auth_done global_id 5068 payload 824 2026-02-17T21:11:52.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 1 -- 10.20.193.45:0/1167019694 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8c15d1e0 msgr2=0x7f7d8c06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8c15d1e0 0x7f7d8c06b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 1 -- 10.20.193.45:0/1167019694 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7d8c0c92b0 msgr2=0x7f7d8c15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7d8c0c92b0 0x7f7d8c15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 10 monclient: _finish_hunting 0 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 1 monclient: found mon.noname-b 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.556+0000 7f7d8ad76640 1 -- 10.20.193.45:0/1167019694 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c154310 con 0x7f7d8c0748e0 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.557+0000 7f7d8ad76640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7d8c0748e0 0x7f7d8c1f5720 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000c480 tx=0x7f7d8000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.557+0000 7f7d6b7fe640 10 client.?.objecter ms_handle_connect 0x7f7d8c0748e0 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.557+0000 7f7d6b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 1 -- 10.20.193.45:0/1167019694 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80017070 con 0x7f7d8c0748e0 2026-02-17T21:11:52.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 10 monclient: dump: 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:52.566 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 1 -- 10.20.193.45:0/1167019694 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d80005de0 con 0x7f7d8c0748e0 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 1 -- 10.20.193.45:0/1167019694 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d80007270 con 0x7f7d8c0748e0 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d9112c640 5 monclient: authenticate success, global_id 5068 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d9112c640 10 monclient: _renew_subs 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d89573640 4 set_mon_vals no callback set 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d9112c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:52.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8c15cc80 con 0x7f7d8c0748e0 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d6b7fe640 10 monclient: dump: 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:52.568 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:52.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d9112c640 10 client.5068.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:52.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d9112c640 10 monclient: _renew_subs 2026-02-17T21:11:52.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d9112c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:52.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d8c1f2090 con 0x7f7d8c0748e0 2026-02-17T21:11:52.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.559+0000 7f7d9112c640 1 librados: init done 2026-02-17T21:11:52.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.560+0000 7f7d9112c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:52.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.560+0000 7f7d9112c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:52.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.560+0000 7f7d9112c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:52.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.560+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8c153f30 con 0x7f7d8c0748e0 2026-02-17T21:11:52.661 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.668+0000 7f7d6b7fe640 1 -- 10.20.193.45:0/1167019694 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f7d80007410 con 0x7f7d8c0748e0 2026-02-17T21:11:52.662 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.668+0000 7f7d6b7fe640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7d580792d0 0x7f7d5807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:52.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.669+0000 7f7d8a575640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7d580792d0 0x7f7d5807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:52.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.669+0000 7f7d8a575640 10 monclient: get_auth_request con 0x7f7d580792d0 auth_method 0 2026-02-17T21:11:52.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.669+0000 7f7d8a575640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7d580792d0 0x7f7d5807b790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7d7402ee50 tx=0x7f7d74033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:52.663 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.669+0000 7f7d6b7fe640 10 client.5068.objecter ms_handle_connect 0x7f7d580792d0 2026-02-17T21:11:52.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.671+0000 7f7d6b7fe640 1 -- 10.20.193.45:0/1167019694 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f7d80007730 con 0x7f7d8c0748e0 2026-02-17T21:11:52.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.671+0000 7f7d6b7fe640 10 client.5068.objecter ms_dispatch2 0x7f7d8c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:52.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.671+0000 7f7d6b7fe640 3 client.5068.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:52.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.671+0000 7f7d6b7fe640 3 client.5068.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:52.665 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.671+0000 7f7d6b7fe640 20 client.5068.objecter dump_active .. 0 homeless 2026-02-17T21:11:52.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.677+0000 7f7d6b7fe640 1 -- 10.20.193.45:0/1167019694 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7d80022080 con 0x7f7d8c0748e0 2026-02-17T21:11:52.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.677+0000 7f7d6b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:52.671 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.677+0000 7f7d6b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:52.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.781+0000 7f7d9112c640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:52.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.781+0000 7f7d9112c640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:52.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.781+0000 7f7d9112c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:52.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.781+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7d8c0c9b20 con 0x7f7d8c0748e0 2026-02-17T21:11:52.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d6b7fe640 1 -- 10.20.193.45:0/1167019694 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f7d800615d0 con 0x7f7d8c0748e0 2026-02-17T21:11:52.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d6b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:52.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d6b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:52.778 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:52.778 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:52.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 10 librados: watch_flush enter 2026-02-17T21:11:52.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 10 librados: watch_flush exit 2026-02-17T21:11:52.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 20 client.5068.objecter shutdown clearing up homeless session... 2026-02-17T21:11:52.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 10 client.5068.objecter successfully canceled tick 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7d580792d0 msgr2=0x7f7d5807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7d580792d0 0x7f7d5807b790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7d7402ee50 tx=0x7f7d74033000 comp rx=0 tx=0).stop 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 10 monclient: shutdown 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7d8c0748e0 msgr2=0x7f7d8c1f5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7d8c0748e0 0x7f7d8c1f5720 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000c480 tx=0x7f7d8000c950 comp rx=0 tx=0).stop 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 shutdown_connections 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7d580792d0 0x7f7d5807b790 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8c15d1e0 0x7f7d8c06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7d8c0c92b0 0x7f7d8c15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 --2- 10.20.193.45:0/1167019694 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7d8c0748e0 0x7f7d8c1f5720 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:52.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 >> 10.20.193.45:0/1167019694 conn(0x7f7d8c0c9d40 msgr2=0x7f7d8c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:52.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 shutdown_connections 2026-02-17T21:11:52.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 -- 10.20.193.45:0/1167019694 wait complete. 2026-02-17T21:11:52.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:52.785+0000 7f7d9112c640 1 librados: shutdown 2026-02-17T21:11:55.789 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:55.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.864+0000 7f84cc37f640 10 monclient: get_monmap_and_config 2026-02-17T21:11:55.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.864+0000 7f84cc37f640 10 monclient: build_initial_monmap 2026-02-17T21:11:55.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.864+0000 7f84cc37f640 10 monclient: monmap: 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:55.865754+0000 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:55.865754+0000 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:55.858 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:55.859 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:55.859 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:55.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.865+0000 7f84cc37f640 1 Processor -- start 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.865+0000 7f84cc37f640 1 -- start start 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.865+0000 7f84cc37f640 10 monclient: init 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.865+0000 7f84cc37f640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.865+0000 7f84cc37f640 10 monclient: _add_conns ranks=[5,2,1,3,4,0] 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.865+0000 7f84cc37f640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f84c415d1e0 0x7f84c415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84cc37f640 10 monclient(hunting): picked mon.noname-c con 0x7f84c415d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84cc37f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f84c40748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84cc37f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f84c40c92b0 addr v1:10.20.193.86:6789/0 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84cc37f640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c40c5860 con 0x7f84c40c92b0 2026-02-17T21:11:55.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84cc37f640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c40c5580 con 0x7f84c40748e0 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84cc37f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84cc37f640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f84c40c7de0 con 0x7f84c415d1e0 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84cc37f640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84cc37f640 10 monclient(hunting): authenticate will time out at 1299.496052s 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84ca8f5640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f84c40c92b0 0x7f84c4153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:34128/0 (socket says 10.20.193.45:34128) 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84ca8f5640 1 -- 10.20.193.45:0/1112196639 learned_addr learned my addr 10.20.193.45:0/1112196639 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.866+0000 7f84ca0f4640 1 --2- 10.20.193.45:0/1112196639 >> v2:10.20.193.92:3300/0 conn(0x7f84c415d1e0 0x7f84c415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84ca0f4640 10 monclient(hunting): get_auth_request con 0x7f84c415d1e0 auth_method 0 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84ca0f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84ca0f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84ca0f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:55.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84ca0f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84ca0f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84ca0f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84c90f2640 1 -- 10.20.193.45:0/1112196639 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2006158744 0 0) 0x7f84c40c5860 con 0x7f84c40c92b0 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84c90f2640 10 monclient(hunting): _negotiate 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84c90f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84c90f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84c90f2640 10 monclient(hunting): my global_id is 5071 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.867+0000 7f84c90f2640 1 -- 10.20.193.45:0/1112196639 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84ac003620 con 0x7f84c40c92b0 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.869+0000 7f84ca0f4640 10 monclient(hunting): handle_auth_done global_id 5108 payload 274 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.869+0000 7f84ca0f4640 1 -- 10.20.193.45:0/1112196639 >> v1:10.20.193.92:6789/0 conn(0x7f84c40748e0 legacy=0x7f84c40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.869+0000 7f84ca0f4640 1 -- 10.20.193.45:0/1112196639 >> v1:10.20.193.86:6789/0 conn(0x7f84c40c92b0 legacy=0x7f84c4153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.869+0000 7f84ca0f4640 10 monclient: _finish_hunting 0 2026-02-17T21:11:55.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.869+0000 7f84ca0f4640 1 monclient: found mon.noname-c 2026-02-17T21:11:55.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.869+0000 7f84ca0f4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:55.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.869+0000 7f84ca0f4640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:55.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.869+0000 7f84ca0f4640 1 -- 10.20.193.45:0/1112196639 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c40c80c0 con 0x7f84c415d1e0 2026-02-17T21:11:55.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.871+0000 7f84ca0f4640 1 --2- 10.20.193.45:0/1112196639 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c415d1e0 0x7f84c415d5c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84b40098d0 tx=0x7f84b402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4291bef752dae347 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:55.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.872+0000 7f84c90f2640 1 -- 10.20.193.45:0/1112196639 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b403c070 con 0x7f84c415d1e0 2026-02-17T21:11:55.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.872+0000 7f84c90f2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:55.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.872+0000 7f84c90f2640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:55.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.872+0000 7f84c90f2640 10 monclient: dump: 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.872+0000 7f84c90f2640 10 monclient: _finish_auth 0 2026-02-17T21:11:55.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.872+0000 7f84c90f2640 10 monclient: _check_auth_tickets 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.872+0000 7f84c90f2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.872+0000 7f84cc37f640 5 monclient: authenticate success, global_id 5108 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.872+0000 7f84cc37f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84c90f2640 1 -- 10.20.193.45:0/1112196639 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b402fba0 con 0x7f84c415d1e0 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84c90f2640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84c90f2640 1 -- 10.20.193.45:0/1112196639 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4037440 con 0x7f84c415d1e0 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84c90f2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84c90f2640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84c90f2640 10 monclient: dump: 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:55.872 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 4 set_mon_vals no callback set 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 10 monclient: shutdown 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:55.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 1 -- 10.20.193.45:0/1112196639 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c415d1e0 msgr2=0x7f84c415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 1 --2- 10.20.193.45:0/1112196639 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c415d1e0 0x7f84c415d5c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84b40098d0 tx=0x7f84b402eed0 comp rx=0 tx=0).stop 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 1 -- 10.20.193.45:0/1112196639 shutdown_connections 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 1 --2- 10.20.193.45:0/1112196639 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c415d1e0 0x7f84c415d5c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 1 -- 10.20.193.45:0/1112196639 >> 10.20.193.45:0/1112196639 conn(0x7f84c40c9d40 msgr2=0x7f84c40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 1 -- 10.20.193.45:0/1112196639 shutdown_connections 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.873+0000 7f84cc37f640 1 -- 10.20.193.45:0/1112196639 wait complete. 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient: build_initial_monmap 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient: monmap: 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:55.874 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 librados: starting msgr at 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 librados: starting objecter 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 Processor -- start 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 -- start start 2026-02-17T21:11:55.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 librados: setting wanted keys 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 librados: calling monclient init 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient: init 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c40748e0 0x7f84c41f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient(hunting): picked mon.noname-c con 0x7f84c40748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f84c40c92b0 0x7f84c41556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient(hunting): picked mon.noname-b con 0x7f84c40c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f84c415d1e0 0x7f84c406b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient(hunting): picked mon.noname-a con 0x7f84c415d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f84c4074d30 con 0x7f84c415d1e0 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:55.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f84c40c8680 con 0x7f84c40c92b0 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84c4153d20 con 0x7f84c40748e0 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.874+0000 7f84cc37f640 10 monclient(hunting): authenticate will time out at 1299.504865s 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c40748e0 0x7f84c41f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84c98f3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f84c40c92b0 0x7f84c41556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca8f5640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f84c415d1e0 0x7f84c406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c40748e0 0x7f84c41f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:41530/0 (socket says 10.20.193.45:41530) 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 1 -- 10.20.193.45:0/477162550 learned_addr learned my addr 10.20.193.45:0/477162550 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 10 monclient(hunting): get_auth_request con 0x7f84c40748e0 auth_method 0 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:55.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84c98f3640 10 monclient(hunting): get_auth_request con 0x7f84c40c92b0 auth_method 0 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84c98f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84c98f3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84c98f3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca0f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca8f5640 10 monclient(hunting): get_auth_request con 0x7f84c415d1e0 auth_method 0 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca8f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca8f5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca8f5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:55.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84c98f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84c98f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84c98f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca8f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca8f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.875+0000 7f84ca8f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 10 monclient(hunting): handle_auth_done global_id 5114 payload 824 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 1 -- 10.20.193.45:0/477162550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f84c40c92b0 msgr2=0x7f84c41556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f84c40c92b0 0x7f84c41556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 1 -- 10.20.193.45:0/477162550 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f84c415d1e0 msgr2=0x7f84c406b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f84c415d1e0 0x7f84c406b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 10 monclient: _finish_hunting 0 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 1 monclient: found mon.noname-c 2026-02-17T21:11:55.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:55.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:11:55.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.876+0000 7f84ca0f4640 1 -- 10.20.193.45:0/477162550 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c4154630 con 0x7f84c40748e0 2026-02-17T21:11:55.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.877+0000 7f84ca0f4640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c40748e0 0x7f84c41f2d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84b403a040 tx=0x7f84b40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:55.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.877+0000 7f84aaffd640 10 client.?.objecter ms_handle_connect 0x7f84c40748e0 2026-02-17T21:11:55.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.877+0000 7f84aaffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:55.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 1 -- 10.20.193.45:0/477162550 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b403c040 con 0x7f84c40748e0 2026-02-17T21:11:55.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:55.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:11:55.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 10 monclient: dump: 2026-02-17T21:11:55.882 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:55.882 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:55.882 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:55.882 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:55.882 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 10 monclient: _finish_auth 0 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 10 monclient: _check_auth_tickets 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 1 -- 10.20.193.45:0/477162550 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b4003ad0 con 0x7f84c40748e0 2026-02-17T21:11:55.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 5 monclient: authenticate success, global_id 5114 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 10 monclient: _renew_subs 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c4154910 con 0x7f84c40748e0 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 1 -- 10.20.193.45:0/477162550 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b4003e80 con 0x7f84c40748e0 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84aaffd640 10 monclient: dump: 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:55.884 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84c88f1640 4 set_mon_vals no callback set 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 10 client.5114.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 10 monclient: _renew_subs 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c4154ed0 con 0x7f84c40748e0 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 1 librados: init done 2026-02-17T21:11:55.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.879+0000 7f84cc37f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:55.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.880+0000 7f84cc37f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:55.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.880+0000 7f84cc37f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:55.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.880+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c415d5c0 con 0x7f84c40748e0 2026-02-17T21:11:55.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.892+0000 7f84aaffd640 1 -- 10.20.193.45:0/477162550 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f84b4042430 con 0x7f84c40748e0 2026-02-17T21:11:55.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.892+0000 7f84aaffd640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f84940792d0 0x7f849407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:55.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.892+0000 7f84c98f3640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f84940792d0 0x7f849407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:55.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.892+0000 7f84c98f3640 10 monclient: get_auth_request con 0x7f84940792d0 auth_method 0 2026-02-17T21:11:55.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.892+0000 7f84c98f3640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f84940792d0 0x7f849407b790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f84c40745f0 tx=0x7f84b8007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:55.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.892+0000 7f84aaffd640 10 client.5114.objecter ms_handle_connect 0x7f84940792d0 2026-02-17T21:11:55.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.987+0000 7f84aaffd640 1 -- 10.20.193.45:0/477162550 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f84b4083840 con 0x7f84c40748e0 2026-02-17T21:11:55.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.987+0000 7f84aaffd640 10 client.5114.objecter ms_dispatch2 0x7f84c4000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:55.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.987+0000 7f84aaffd640 3 client.5114.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:55.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.987+0000 7f84aaffd640 3 client.5114.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:55.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.987+0000 7f84aaffd640 20 client.5114.objecter dump_active .. 0 homeless 2026-02-17T21:11:55.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.993+0000 7f84aaffd640 1 -- 10.20.193.45:0/477162550 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f84b4087800 con 0x7f84c40748e0 2026-02-17T21:11:55.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.993+0000 7f84aaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:55.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:55.993+0000 7f84aaffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.093+0000 7f84cc37f640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.093+0000 7f84cc37f640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.093+0000 7f84cc37f640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:11:56.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.093+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f84c40c9b20 con 0x7f84c40748e0 2026-02-17T21:11:56.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.096+0000 7f84aaffd640 1 -- 10.20.193.45:0/477162550 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f84b408bb00 con 0x7f84c40748e0 2026-02-17T21:11:56.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.096+0000 7f84aaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:56.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.096+0000 7f84aaffd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:56.089 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:56.089 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:56.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 10 librados: watch_flush enter 2026-02-17T21:11:56.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 10 librados: watch_flush exit 2026-02-17T21:11:56.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 20 client.5114.objecter shutdown clearing up homeless session... 2026-02-17T21:11:56.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 10 client.5114.objecter successfully canceled tick 2026-02-17T21:11:56.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f84940792d0 msgr2=0x7f849407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:56.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f84940792d0 0x7f849407b790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f84c40745f0 tx=0x7f84b8007ef0 comp rx=0 tx=0).stop 2026-02-17T21:11:56.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 10 monclient: shutdown 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c40748e0 msgr2=0x7f84c41f2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c40748e0 0x7f84c41f2d10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f84b403a040 tx=0x7f84b40047c0 comp rx=0 tx=0).stop 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 shutdown_connections 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f84940792d0 0x7f849407b790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f84c415d1e0 0x7f84c406b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f84c40c92b0 0x7f84c41556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 --2- 10.20.193.45:0/477162550 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84c40748e0 0x7f84c41f2d10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 >> 10.20.193.45:0/477162550 conn(0x7f84c40c9d40 msgr2=0x7f84c406fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 shutdown_connections 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.097+0000 7f84cc37f640 1 -- 10.20.193.45:0/477162550 wait complete. 2026-02-17T21:11:56.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:56.098+0000 7f84cc37f640 1 librados: shutdown 2026-02-17T21:11:59.100 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:11:59.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.180+0000 7f5539ec9640 10 monclient: get_monmap_and_config 2026-02-17T21:11:59.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.180+0000 7f5539ec9640 10 monclient: build_initial_monmap 2026-02-17T21:11:59.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.180+0000 7f5539ec9640 10 monclient: monmap: 2026-02-17T21:11:59.173 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:59.173 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:59.173 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:11:59.181343+0000 2026-02-17T21:11:59.173 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:11:59.181343+0000 2026-02-17T21:11:59.173 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:59.174 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:59.174 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:11:59.174 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:11:59.174 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:11:59.174 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:11:59.174 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:11:59.174 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:11:59.174 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:59.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.180+0000 7f5539ec9640 1 Processor -- start 2026-02-17T21:11:59.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 1 -- start start 2026-02-17T21:11:59.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient: init 2026-02-17T21:11:59.177 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient: _add_conns ranks=[3,4,0,5,1,2] 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f55341561c0 0x7f55340cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient(hunting): picked mon.noname-a con 0x7f55341561c0 addr v2:10.20.193.45:3300/0 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f553406c890 0x7f55340704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient(hunting): picked mon.noname-b con 0x7f553406c890 addr v2:10.20.193.86:3300/0 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f553406e110 addr v1:10.20.193.45:6789/0 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553415ce80 con 0x7f553406e110 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f553406f490 con 0x7f55341561c0 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:59.178 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5534070010 con 0x7f553406c890 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5539ec9640 10 monclient(hunting): authenticate will time out at 1302.811553s 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f55337fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f55341561c0 0x7f55340cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.181+0000 7f5532ffd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f553406c890 0x7f55340704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f55337fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f55341561c0 0x7f55340cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:40272/0 (socket says 10.20.193.45:40272) 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f55337fe640 1 -- 10.20.193.45:0/582028423 learned_addr learned my addr 10.20.193.45:0/582028423 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f55337fe640 10 monclient(hunting): get_auth_request con 0x7f55341561c0 auth_method 0 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f55337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f55337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f55337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f5532ffd640 10 monclient(hunting): get_auth_request con 0x7f553406c890 auth_method 0 2026-02-17T21:11:59.179 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f5532ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f5532ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f5532ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f5532ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f5532ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f5532ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f55337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f55337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.182+0000 7f55337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.183+0000 7f5532ffd640 10 monclient(hunting): handle_auth_done global_id 5077 payload 274 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.183+0000 7f5532ffd640 1 -- 10.20.193.45:0/582028423 >> v2:10.20.193.45:3300/0 conn(0x7f55341561c0 msgr2=0x7f55340cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.183+0000 7f5532ffd640 1 --2- 10.20.193.45:0/582028423 >> v2:10.20.193.45:3300/0 conn(0x7f55341561c0 0x7f55340cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.183+0000 7f5532ffd640 1 -- 10.20.193.45:0/582028423 >> v1:10.20.193.45:6789/0 conn(0x7f553406e110 legacy=0x7f553415f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:59.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.183+0000 7f5532ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:11:59.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.183+0000 7f5532ffd640 1 monclient: found mon.noname-b 2026-02-17T21:11:59.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.183+0000 7f5532ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:59.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.183+0000 7f5532ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:59.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.183+0000 7f5532ffd640 1 -- 10.20.193.45:0/582028423 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553406f6e0 con 0x7f553406c890 2026-02-17T21:11:59.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.184+0000 7f5532ffd640 1 --2- 10.20.193.45:0/582028423 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 0x7f55340704a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f55240098a0 tx=0x7f552402ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c8a062cc10fe378 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 1 -- 10.20.193.45:0/582028423 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552403c070 con 0x7f553406c890 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 10 monclient: dump: 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:59.188 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 10 monclient: _finish_auth 0 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 10 monclient: _check_auth_tickets 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 5 monclient: authenticate success, global_id 5077 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 1 -- 10.20.193.45:0/582028423 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552402fc10 con 0x7f553406c890 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:59.189 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 10 monclient: get_monmap_and_config success 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 1 -- 10.20.193.45:0/582028423 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524037440 con 0x7f553406c890 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 4 set_mon_vals no callback set 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f55327fc640 10 monclient: dump: 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:59.190 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 10 monclient: shutdown 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 1 -- 10.20.193.45:0/582028423 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 msgr2=0x7f55340704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 1 --2- 10.20.193.45:0/582028423 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 0x7f55340704a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f55240098a0 tx=0x7f552402ef40 comp rx=0 tx=0).stop 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 1 -- 10.20.193.45:0/582028423 shutdown_connections 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 1 --2- 10.20.193.45:0/582028423 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 0x7f55340704a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 1 --2- 10.20.193.45:0/582028423 >> v2:10.20.193.45:3300/0 conn(0x7f55341561c0 0x7f55340cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 1 -- 10.20.193.45:0/582028423 >> 10.20.193.45:0/582028423 conn(0x7f55340cbf10 msgr2=0x7f55340cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 1 -- 10.20.193.45:0/582028423 shutdown_connections 2026-02-17T21:11:59.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 1 -- 10.20.193.45:0/582028423 wait complete. 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 10 monclient: build_initial_monmap 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.186+0000 7f5539ec9640 10 monclient: monmap: 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:59.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 librados: starting msgr at 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 librados: starting objecter 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 Processor -- start 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 -- start start 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 librados: setting wanted keys 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 librados: calling monclient init 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient: init 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient: _reopen_session rank -1 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 0x7f553414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient(hunting): picked mon.noname-b con 0x7f553406c890 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f553406e110 0x7f553414e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:59.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient(hunting): picked mon.noname-c con 0x7f553406e110 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f55341561c0 0x7f55340c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient(hunting): picked mon.noname-a con 0x7f55341561c0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f553406e860 con 0x7f55341561c0 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f553406fca0 con 0x7f553406c890 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f55340709e0 con 0x7f553406e110 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient(hunting): _renew_subs 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.187+0000 7f5539ec9640 10 monclient(hunting): authenticate will time out at 1302.817769s 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5533fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f55341561c0 0x7f55340c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 0x7f553414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:59.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 0x7f553414f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:60350/0 (socket says 10.20.193.45:60350) 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 1 -- 10.20.193.45:0/3385231907 learned_addr learned my addr 10.20.193.45:0/3385231907 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 10 monclient(hunting): get_auth_request con 0x7f553406c890 auth_method 0 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5533fff640 10 monclient(hunting): get_auth_request con 0x7f55341561c0 auth_method 0 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5533fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5533fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5533fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5532ffd640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f553406e110 0x7f553414e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:59.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f55337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5532ffd640 10 monclient(hunting): get_auth_request con 0x7f553406e110 auth_method 0 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5532ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5532ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5532ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5533fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5533fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5533fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5532ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5532ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.188+0000 7f5532ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 10 monclient(hunting): handle_auth_done global_id 5080 payload 824 2026-02-17T21:11:59.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 1 -- 10.20.193.45:0/3385231907 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f553406e110 msgr2=0x7f553414e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f553406e110 0x7f553414e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 1 -- 10.20.193.45:0/3385231907 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f55341561c0 msgr2=0x7f55340c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f55341561c0 0x7f55340c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 10 monclient: _finish_hunting 0 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 1 monclient: found mon.noname-b 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.189+0000 7f55337fe640 1 -- 10.20.193.45:0/3385231907 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553414fe90 con 0x7f553406c890 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.190+0000 7f55337fe640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 0x7f553414f5f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f552000e890 tx=0x7f552000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.190+0000 7f550ffff640 10 client.?.objecter ms_handle_connect 0x7f553406c890 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.190+0000 7f550ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f550ffff640 1 -- 10.20.193.45:0/3385231907 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520017070 con 0x7f553406c890 2026-02-17T21:11:59.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f550ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f550ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f550ffff640 10 monclient: dump: 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:59.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f550ffff640 10 monclient: _finish_auth 0 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f550ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f550ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f5539ec9640 5 monclient: authenticate success, global_id 5080 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f5539ec9640 10 monclient: _renew_subs 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.191+0000 7f5539ec9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5534150170 con 0x7f553406c890 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 10 client.5080.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 10 monclient: _renew_subs 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5534150730 con 0x7f553406c890 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 1 librados: init done 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f550ffff640 1 -- 10.20.193.45:0/3385231907 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5520005a90 con 0x7f553406c890 2026-02-17T21:11:59.199 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f550ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f550ffff640 1 -- 10.20.193.45:0/3385231907 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520021060 con 0x7f553406c890 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f550ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f550ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f550ffff640 10 monclient: dump: 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:11:59.200 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:11:59.201 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:11:59.201 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:11:59.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5531ffb640 4 set_mon_vals no callback set 2026-02-17T21:11:59.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:59.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:59.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:59.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.192+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553415cb00 con 0x7f553406c890 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.204+0000 7f550ffff640 1 -- 10.20.193.45:0/3385231907 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f5520024060 con 0x7f553406c890 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.204+0000 7f550ffff640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5504079280 0x7f550407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.204+0000 7f5532ffd640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5504079280 0x7f550407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.204+0000 7f5532ffd640 10 monclient: get_auth_request con 0x7f5504079280 auth_method 0 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.205+0000 7f550ffff640 10 client.5080.objecter ms_handle_connect 0x7f5504079280 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.205+0000 7f5532ffd640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5504079280 0x7f550407b740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5524039000 tx=0x7f5524033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.205+0000 7f550ffff640 1 -- 10.20.193.45:0/3385231907 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f552005e0f0 con 0x7f553406c890 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.205+0000 7f550ffff640 10 client.5080.objecter ms_dispatch2 0x7f5534000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.205+0000 7f550ffff640 3 client.5080.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.205+0000 7f550ffff640 3 client.5080.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:11:59.203 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.205+0000 7f550ffff640 20 client.5080.objecter dump_active .. 0 homeless 2026-02-17T21:11:59.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.307+0000 7f550ffff640 1 -- 10.20.193.45:0/3385231907 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f55200620b0 con 0x7f553406c890 2026-02-17T21:11:59.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.307+0000 7f550ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:11:59.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.307+0000 7f550ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:11:59.401 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.409+0000 7f5539ec9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:11:59.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.409+0000 7f5539ec9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:59.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.409+0000 7f5539ec9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:11:59.402 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.409+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f55340cf270 con 0x7f553406c890 2026-02-17T21:11:59.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.411+0000 7f550ffff640 1 -- 10.20.193.45:0/3385231907 <== mon.1 v2:10.20.193.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f55200663b0 con 0x7f553406c890 2026-02-17T21:11:59.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.411+0000 7f550ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:11:59.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.411+0000 7f550ffff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:11:59.404 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:11:59.404 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:11:59.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 10 librados: watch_flush enter 2026-02-17T21:11:59.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 10 librados: watch_flush exit 2026-02-17T21:11:59.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 20 client.5080.objecter shutdown clearing up homeless session... 2026-02-17T21:11:59.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 10 client.5080.objecter successfully canceled tick 2026-02-17T21:11:59.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5504079280 msgr2=0x7f550407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:59.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5504079280 0x7f550407b740 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5524039000 tx=0x7f5524033000 comp rx=0 tx=0).stop 2026-02-17T21:11:59.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 10 monclient: shutdown 2026-02-17T21:11:59.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:11:59.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 msgr2=0x7f553414f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 0x7f553414f5f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f552000e890 tx=0x7f552000ed60 comp rx=0 tx=0).stop 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 shutdown_connections 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5504079280 0x7f550407b740 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f55341561c0 0x7f55340c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f553406e110 0x7f553414e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 --2- 10.20.193.45:0/3385231907 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f553406c890 0x7f553414f5f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 >> 10.20.193.45:0/3385231907 conn(0x7f55340cbf10 msgr2=0x7f55340cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 shutdown_connections 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.412+0000 7f5539ec9640 1 -- 10.20.193.45:0/3385231907 wait complete. 2026-02-17T21:11:59.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:11:59.413+0000 7f5539ec9640 1 librados: shutdown 2026-02-17T21:12:02.415 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:12:02.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.489+0000 7ff144b85640 10 monclient: get_monmap_and_config 2026-02-17T21:12:02.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.489+0000 7ff144b85640 10 monclient: build_initial_monmap 2026-02-17T21:12:02.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.489+0000 7ff144b85640 10 monclient: monmap: 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:02.490778+0000 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:02.490778+0000 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:02.483 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:02.484 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:02.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 1 Processor -- start 2026-02-17T21:12:02.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 1 -- start start 2026-02-17T21:12:02.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient: init 2026-02-17T21:12:02.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:02.487 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient: _add_conns ranks=[3,4,5,1,0,2] 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff1401535c0 0x7ff1400c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient(hunting): picked mon.noname-a con 0x7ff1401535c0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff1400ca720 0x7ff1400c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient(hunting): picked mon.noname-b con 0x7ff1400ca720 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff1401539a0 0x7ff1400c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient(hunting): picked mon.noname-c con 0x7ff1401539a0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7ff14015a660 con 0x7ff1401535c0 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ff1400c7a90 con 0x7ff1400ca720 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:02.488 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff1400c7d70 con 0x7ff1401539a0 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.490+0000 7ff144b85640 10 monclient(hunting): authenticate will time out at 1306.120973s 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff1401535c0 0x7ff1400c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13effd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ff1400ca720 0x7ff1400c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13ffff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff1401539a0 0x7ff1400c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff1401535c0 0x7ff1400c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:40282/0 (socket says 10.20.193.45:40282) 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 1 -- 10.20.193.45:0/817634400 learned_addr learned my addr 10.20.193.45:0/817634400 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 10 monclient(hunting): get_auth_request con 0x7ff1401535c0 auth_method 0 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13effd640 10 monclient(hunting): get_auth_request con 0x7ff1400ca720 auth_method 0 2026-02-17T21:12:02.489 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13ffff640 10 monclient(hunting): get_auth_request con 0x7ff1401539a0 auth_method 0 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.491+0000 7ff13f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:02.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 10 monclient(hunting): handle_auth_done global_id 5016 payload 274 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 1 -- 10.20.193.45:0/817634400 >> v2:10.20.193.92:3300/0 conn(0x7ff1401539a0 msgr2=0x7ff1400c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 1 --2- 10.20.193.45:0/817634400 >> v2:10.20.193.92:3300/0 conn(0x7ff1401539a0 0x7ff1400c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 1 -- 10.20.193.45:0/817634400 >> v2:10.20.193.86:3300/0 conn(0x7ff1400ca720 msgr2=0x7ff1400c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 1 --2- 10.20.193.45:0/817634400 >> v2:10.20.193.86:3300/0 conn(0x7ff1400ca720 0x7ff1400c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 1 monclient: found mon.noname-a 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.492+0000 7ff13f7fe640 1 -- 10.20.193.45:0/817634400 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1400c8050 con 0x7ff1401535c0 2026-02-17T21:12:02.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.493+0000 7ff13f7fe640 1 --2- 10.20.193.45:0/817634400 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 0x7ff1400c8e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff14006cbd0 tx=0x7ff12c02ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e54c5116559aecb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:02.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 1 -- 10.20.193.45:0/817634400 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c03c070 con 0x7ff1401535c0 2026-02-17T21:12:02.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:02.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 10 monclient: dump: 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:02.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 10 monclient: _finish_auth 0 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff144b85640 5 monclient: authenticate success, global_id 5016 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff144b85640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 1 -- 10.20.193.45:0/817634400 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff12c02fb50 con 0x7ff1401535c0 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 1 -- 10.20.193.45:0/817634400 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12c037440 con 0x7ff1401535c0 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff13e7fc640 10 monclient: dump: 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:02.500 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff144b85640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.495+0000 7ff144b85640 4 set_mon_vals no callback set 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 10 monclient: shutdown 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:02.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 -- 10.20.193.45:0/817634400 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 msgr2=0x7ff1400c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 --2- 10.20.193.45:0/817634400 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 0x7ff1400c8e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff14006cbd0 tx=0x7ff12c02ee90 comp rx=0 tx=0).stop 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 -- 10.20.193.45:0/817634400 shutdown_connections 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 --2- 10.20.193.45:0/817634400 >> v2:10.20.193.92:3300/0 conn(0x7ff1401539a0 0x7ff1400c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 --2- 10.20.193.45:0/817634400 >> v2:10.20.193.86:3300/0 conn(0x7ff1400ca720 0x7ff1400c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 --2- 10.20.193.45:0/817634400 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 0x7ff1400c8e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 -- 10.20.193.45:0/817634400 >> 10.20.193.45:0/817634400 conn(0x7ff1400c9b90 msgr2=0x7ff1400c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 -- 10.20.193.45:0/817634400 shutdown_connections 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 -- 10.20.193.45:0/817634400 wait complete. 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 10 monclient: build_initial_monmap 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 10 monclient: monmap: 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:02.502 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 librados: starting msgr at 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.496+0000 7ff144b85640 1 librados: starting objecter 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 Processor -- start 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 -- start start 2026-02-17T21:12:02.503 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 librados: setting wanted keys 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 librados: calling monclient init 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient: init 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff1400ca720 0x7ff1401f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient(hunting): picked mon.noname-b con 0x7ff1400ca720 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 0x7ff140073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient(hunting): picked mon.noname-a con 0x7ff1401535c0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff1401539a0 0x7ff14014ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient(hunting): picked mon.noname-c con 0x7ff1401539a0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:02.504 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff1400c88f0 con 0x7ff1401535c0 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff1400c8610 con 0x7ff1400ca720 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff14015acc0 con 0x7ff1401539a0 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff144b85640 10 monclient(hunting): authenticate will time out at 1306.127500s 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13effd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 0x7ff140073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13ffff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff1401539a0 0x7ff14014ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13f7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff1400ca720 0x7ff1401f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13effd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 0x7ff140073550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:40284/0 (socket says 10.20.193.45:40284) 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13effd640 1 -- 10.20.193.45:0/91085974 learned_addr learned my addr 10.20.193.45:0/91085974 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:02.505 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13effd640 10 monclient(hunting): get_auth_request con 0x7ff1401535c0 auth_method 0 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13ffff640 1 -- 10.20.193.45:0/91085974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff1401539a0 msgr2=0x7ff14014ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13ffff640 1 -- 10.20.193.45:0/91085974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff1401539a0 msgr2=0x7ff14014ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13ffff640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff1401539a0 0x7ff14014ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.497+0000 7ff13ffff640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff1401539a0 0x7ff14014ddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13f7fe640 10 monclient(hunting): get_auth_request con 0x7ff1400ca720 auth_method 0 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:02.506 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.498+0000 7ff13f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 10 monclient(hunting): handle_auth_done global_id 5019 payload 824 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 1 -- 10.20.193.45:0/91085974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff1401539a0 msgr2=0x7ff14014ddc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff1401539a0 0x7ff14014ddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 1 -- 10.20.193.45:0/91085974 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff1400ca720 msgr2=0x7ff1401f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff1400ca720 0x7ff1401f1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 1 monclient: found mon.noname-a 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:02.507 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.499+0000 7ff13effd640 1 -- 10.20.193.45:0/91085974 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1401f1710 con 0x7ff1401535c0 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.500+0000 7ff13effd640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 0x7ff140073550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff13000e890 tx=0x7ff13000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.500+0000 7ff11bfff640 10 client.?.objecter ms_handle_connect 0x7ff1401535c0 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.500+0000 7ff11bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 1 -- 10.20.193.45:0/91085974 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff130017070 con 0x7ff1401535c0 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 10 monclient: dump: 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:02.508 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 10 monclient: _finish_auth 0 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 1 -- 10.20.193.45:0/91085974 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13000c940 con 0x7ff1401535c0 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 1 -- 10.20.193.45:0/91085974 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13000cd30 con 0x7ff1401535c0 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:02.509 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff11bfff640 10 monclient: dump: 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff13dffb640 4 set_mon_vals no callback set 2026-02-17T21:12:02.510 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 5 monclient: authenticate success, global_id 5019 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 10 monclient: _renew_subs 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1401f19f0 con 0x7ff1401535c0 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 10 client.5019.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 10 monclient: _renew_subs 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14014d5c0 con 0x7ff1401535c0 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 1 librados: init done 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:02.511 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.502+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1400c8e10 con 0x7ff1401535c0 2026-02-17T21:12:02.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.613+0000 7ff11bfff640 1 -- 10.20.193.45:0/91085974 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff130013470 con 0x7ff1401535c0 2026-02-17T21:12:02.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.614+0000 7ff11bfff640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff110079280 0x7ff11007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:02.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.614+0000 7ff13f7fe640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff110079280 0x7ff11007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:02.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.614+0000 7ff13f7fe640 10 monclient: get_auth_request con 0x7ff110079280 auth_method 0 2026-02-17T21:12:02.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.614+0000 7ff13f7fe640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff110079280 0x7ff11007b740 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff140069240 tx=0x7ff12c039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:02.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.614+0000 7ff11bfff640 10 client.5019.objecter ms_handle_connect 0x7ff110079280 2026-02-17T21:12:02.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.621+0000 7ff11bfff640 1 -- 10.20.193.45:0/91085974 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ff13005e780 con 0x7ff1401535c0 2026-02-17T21:12:02.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.621+0000 7ff11bfff640 10 client.5019.objecter ms_dispatch2 0x7ff140000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:02.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.621+0000 7ff11bfff640 3 client.5019.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:02.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.621+0000 7ff11bfff640 3 client.5019.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:02.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.621+0000 7ff11bfff640 20 client.5019.objecter dump_active .. 0 homeless 2026-02-17T21:12:02.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.621+0000 7ff11bfff640 1 -- 10.20.193.45:0/91085974 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff1300c89f0 con 0x7ff1401535c0 2026-02-17T21:12:02.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.621+0000 7ff11bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:02.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.621+0000 7ff11bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:02.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.724+0000 7ff144b85640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:12:02.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.724+0000 7ff144b85640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:02.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.724+0000 7ff144b85640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:02.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.724+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff14015be80 con 0x7ff1401535c0 2026-02-17T21:12:02.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.727+0000 7ff11bfff640 1 -- 10.20.193.45:0/91085974 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7ff130062740 con 0x7ff1401535c0 2026-02-17T21:12:02.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.727+0000 7ff11bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:02.720 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.727+0000 7ff11bfff640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:12:02.720 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:02.721 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:12:02.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 10 librados: watch_flush enter 2026-02-17T21:12:02.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 10 librados: watch_flush exit 2026-02-17T21:12:02.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 20 client.5019.objecter shutdown clearing up homeless session... 2026-02-17T21:12:02.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 10 client.5019.objecter successfully canceled tick 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff110079280 msgr2=0x7ff11007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff110079280 0x7ff11007b740 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff140069240 tx=0x7ff12c039040 comp rx=0 tx=0).stop 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 10 monclient: shutdown 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 msgr2=0x7ff140073550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 0x7ff140073550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff13000e890 tx=0x7ff13000ed60 comp rx=0 tx=0).stop 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 shutdown_connections 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff110079280 0x7ff11007b740 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff1401539a0 0x7ff14014ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff1401535c0 0x7ff140073550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 --2- 10.20.193.45:0/91085974 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff1400ca720 0x7ff1401f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:02.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 >> 10.20.193.45:0/91085974 conn(0x7ff1400c9b90 msgr2=0x7ff14015afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:02.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 shutdown_connections 2026-02-17T21:12:02.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 -- 10.20.193.45:0/91085974 wait complete. 2026-02-17T21:12:02.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:02.729+0000 7ff144b85640 1 librados: shutdown 2026-02-17T21:12:05.732 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:12:05.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.810+0000 7f8c30719640 10 monclient: get_monmap_and_config 2026-02-17T21:12:05.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.810+0000 7f8c30719640 10 monclient: build_initial_monmap 2026-02-17T21:12:05.803 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.810+0000 7f8c30719640 10 monclient: monmap: 2026-02-17T21:12:05.803 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:05.803 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:05.811499+0000 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:05.811499+0000 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:05.804 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:05.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 1 Processor -- start 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 1 -- start start 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient: init 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient: _add_conns ranks=[3,5,2,0,1,4] 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f8c28152620 0x7f8c2815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient(hunting): picked mon.noname-a con 0x7f8c28152620 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f8c28152a00 0x7f8c2815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient(hunting): picked mon.noname-c con 0x7f8c28152a00 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8c280c8d90 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c280c71a0 con 0x7f8c280c8d90 2026-02-17T21:12:05.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:05.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f8c280c7760 con 0x7f8c28152620 2026-02-17T21:12:05.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:05.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f8c280c7480 con 0x7f8c28152a00 2026-02-17T21:12:05.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:05.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.811+0000 7f8c30719640 10 monclient(hunting): authenticate will time out at 1309.441876s 2026-02-17T21:12:05.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f8c28152620 0x7f8c2815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:05.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f8c28152620 0x7f8c2815a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:40294/0 (socket says 10.20.193.45:40294) 2026-02-17T21:12:05.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 1 -- 10.20.193.45:0/271929586 learned_addr learned my addr 10.20.193.45:0/271929586 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:05.809 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 10 monclient(hunting): get_auth_request con 0x7f8c28152620 auth_method 0 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2dc8d640 1 --2- 10.20.193.45:0/271929586 >> v2:10.20.193.92:3300/0 conn(0x7f8c28152a00 0x7f8c2815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2e48e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2dc8d640 10 monclient(hunting): get_auth_request con 0x7f8c28152a00 auth_method 0 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2dc8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2dc8d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:05.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.812+0000 7f8c2dc8d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2dc8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2dc8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2dc8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2e48e640 10 monclient(hunting): handle_auth_done global_id 5022 payload 274 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2e48e640 1 -- 10.20.193.45:0/271929586 >> v2:10.20.193.92:3300/0 conn(0x7f8c28152a00 msgr2=0x7f8c2815ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2e48e640 1 --2- 10.20.193.45:0/271929586 >> v2:10.20.193.92:3300/0 conn(0x7f8c28152a00 0x7f8c2815ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2e48e640 1 -- 10.20.193.45:0/271929586 >> v1:10.20.193.92:6789/0 conn(0x7f8c280c8d90 legacy=0x7f8c280c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2e48e640 10 monclient: _finish_hunting 0 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2e48e640 1 monclient: found mon.noname-a 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2e48e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:05.811 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2e48e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:05.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.813+0000 7f8c2e48e640 1 -- 10.20.193.45:0/271929586 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c28159e00 con 0x7f8c28152620 2026-02-17T21:12:05.812 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.814+0000 7f8c2e48e640 1 --2- 10.20.193.45:0/271929586 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c28152620 0x7f8c2815a8e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c281563b0 tx=0x7f8c1802eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d252e4ab36fd444e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:05.818 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 1 -- 10.20.193.45:0/271929586 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1803c070 con 0x7f8c28152620 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 10 monclient: dump: 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:05.819 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 10 monclient: _finish_auth 0 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 10 monclient: _check_auth_tickets 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 5 monclient: authenticate success, global_id 5022 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 1 -- 10.20.193.45:0/271929586 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1802fbe0 con 0x7f8c28152620 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 1 -- 10.20.193.45:0/271929586 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c18037440 con 0x7f8c28152620 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:05.820 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 4 set_mon_vals no callback set 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c2d48c640 10 monclient: dump: 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:05.821 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 10 monclient: shutdown 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 1 -- 10.20.193.45:0/271929586 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c28152620 msgr2=0x7f8c2815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 1 --2- 10.20.193.45:0/271929586 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c28152620 0x7f8c2815a8e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c281563b0 tx=0x7f8c1802eed0 comp rx=0 tx=0).stop 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 1 -- 10.20.193.45:0/271929586 shutdown_connections 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 1 --2- 10.20.193.45:0/271929586 >> v2:10.20.193.92:3300/0 conn(0x7f8c28152a00 0x7f8c2815ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 1 --2- 10.20.193.45:0/271929586 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c28152620 0x7f8c2815a8e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.816+0000 7f8c30719640 1 -- 10.20.193.45:0/271929586 >> 10.20.193.45:0/271929586 conn(0x7f8c280c9d40 msgr2=0x7f8c280ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 1 -- 10.20.193.45:0/271929586 shutdown_connections 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 1 -- 10.20.193.45:0/271929586 wait complete. 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 10 monclient: build_initial_monmap 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 10 monclient: monmap: 2026-02-17T21:12:05.822 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 1 librados: starting msgr at 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 1 librados: starting objecter 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 1 Processor -- start 2026-02-17T21:12:05.823 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 1 -- start start 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 1 librados: setting wanted keys 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 1 librados: calling monclient init 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.817+0000 7f8c30719640 10 monclient: init 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c280c8d90 0x7f8c281f3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient(hunting): picked mon.noname-a con 0x7f8c280c8d90 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8c28152620 0x7f8c281f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient(hunting): picked mon.noname-b con 0x7f8c28152620 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c28152a00 0x7f8c280c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient(hunting): picked mon.noname-c con 0x7f8c28152a00 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:05.824 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8c280c5c90 con 0x7f8c280c8d90 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8c2815a3c0 con 0x7f8c28152620 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8c280c5e10 con 0x7f8c28152a00 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c30719640 10 monclient(hunting): authenticate will time out at 1309.448388s 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2e48e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c280c8d90 0x7f8c281f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2ec8f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c28152a00 0x7f8c280c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2e48e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c280c8d90 0x7f8c281f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:40298/0 (socket says 10.20.193.45:40298) 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2e48e640 1 -- 10.20.193.45:0/3577418678 learned_addr learned my addr 10.20.193.45:0/3577418678 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2e48e640 10 monclient(hunting): get_auth_request con 0x7f8c280c8d90 auth_method 0 2026-02-17T21:12:05.825 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2e48e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2e48e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2e48e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2ec8f640 10 monclient(hunting): get_auth_request con 0x7f8c28152a00 auth_method 0 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2ec8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2ec8f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2ec8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.818+0000 7f8c2dc8d640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8c28152620 0x7f8c281f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2e48e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2e48e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2e48e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2ec8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2ec8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:05.826 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2ec8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2dc8d640 10 monclient(hunting): get_auth_request con 0x7f8c28152620 auth_method 0 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2dc8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2dc8d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2dc8d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2dc8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2dc8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.819+0000 7f8c2dc8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 10 monclient(hunting): handle_auth_done global_id 5025 payload 824 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 1 -- 10.20.193.45:0/3577418678 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c28152a00 msgr2=0x7f8c280c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c28152a00 0x7f8c280c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 1 -- 10.20.193.45:0/3577418678 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8c28152620 msgr2=0x7f8c281f72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:05.827 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8c28152620 0x7f8c281f72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 10 monclient: _finish_hunting 0 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 1 monclient: found mon.noname-a 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.820+0000 7f8c2e48e640 1 -- 10.20.193.45:0/3577418678 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c281f3af0 con 0x7f8c280c8d90 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.821+0000 7f8c2e48e640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c280c8d90 0x7f8c281f3400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009a70 tx=0x7f8c180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.821+0000 7f8c0effd640 10 client.?.objecter ms_handle_connect 0x7f8c280c8d90 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.821+0000 7f8c0effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 1 -- 10.20.193.45:0/3577418678 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c1803c040 con 0x7f8c280c8d90 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 10 monclient: dump: 2026-02-17T21:12:05.828 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 10 monclient: _finish_auth 0 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:05.829 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 1 -- 10.20.193.45:0/3577418678 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c18042630 con 0x7f8c280c8d90 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 1 -- 10.20.193.45:0/3577418678 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c18042a20 con 0x7f8c280c8d90 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c0effd640 10 monclient: dump: 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:05.830 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c2cc8b640 4 set_mon_vals no callback set 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 5 monclient: authenticate success, global_id 5025 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 10 monclient: _renew_subs 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c281f3dd0 con 0x7f8c280c8d90 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 10 client.5025.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 10 monclient: _renew_subs 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:05.831 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c28072680 con 0x7f8c280c8d90 2026-02-17T21:12:05.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 1 librados: init done 2026-02-17T21:12:05.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:05.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:05.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:05.832 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.823+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c28072490 con 0x7f8c280c8d90 2026-02-17T21:12:05.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.835+0000 7f8c0effd640 1 -- 10.20.193.45:0/3577418678 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f8c18042bc0 con 0x7f8c280c8d90 2026-02-17T21:12:05.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.835+0000 7f8c0effd640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bf80792d0 0x7f8bf807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:05.833 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.835+0000 7f8c2dc8d640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bf80792d0 0x7f8bf807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.835+0000 7f8c2dc8d640 10 monclient: get_auth_request con 0x7f8bf80792d0 auth_method 0 2026-02-17T21:12:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.836+0000 7f8c0effd640 10 client.5025.objecter ms_handle_connect 0x7f8bf80792d0 2026-02-17T21:12:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.836+0000 7f8c2dc8d640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bf80792d0 0x7f8bf807b790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8c280c8ca0 tx=0x7f8c1c009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.837+0000 7f8c0effd640 1 -- 10.20.193.45:0/3577418678 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f8c1802faa0 con 0x7f8c280c8d90 2026-02-17T21:12:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.837+0000 7f8c0effd640 10 client.5025.objecter ms_dispatch2 0x7f8c28000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.837+0000 7f8c0effd640 3 client.5025.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.837+0000 7f8c0effd640 3 client.5025.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:05.834 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.837+0000 7f8c0effd640 20 client.5025.objecter dump_active .. 0 homeless 2026-02-17T21:12:05.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.942+0000 7f8c0effd640 1 -- 10.20.193.45:0/3577418678 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8c18087a10 con 0x7f8c280c8d90 2026-02-17T21:12:05.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.942+0000 7f8c0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:05.935 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:05.942+0000 7f8c0effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:06.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.043+0000 7f8c30719640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:12:06.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.043+0000 7f8c30719640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:06.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.043+0000 7f8c30719640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:06.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.043+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8c280c9170 con 0x7f8c280c8d90 2026-02-17T21:12:06.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.045+0000 7f8c0effd640 1 -- 10.20.193.45:0/3577418678 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f8c1808bd10 con 0x7f8c280c8d90 2026-02-17T21:12:06.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.045+0000 7f8c0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:06.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.045+0000 7f8c0effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:12:06.039 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:06.039 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:12:06.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 10 librados: watch_flush enter 2026-02-17T21:12:06.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 10 librados: watch_flush exit 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 20 client.5025.objecter shutdown clearing up homeless session... 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 10 client.5025.objecter successfully canceled tick 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bf80792d0 msgr2=0x7f8bf807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bf80792d0 0x7f8bf807b790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8c280c8ca0 tx=0x7f8c1c009290 comp rx=0 tx=0).stop 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 10 monclient: shutdown 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c280c8d90 msgr2=0x7f8c281f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c280c8d90 0x7f8c281f3400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009a70 tx=0x7f8c180047c0 comp rx=0 tx=0).stop 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 shutdown_connections 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8bf80792d0 0x7f8bf807b790 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:06.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c28152a00 0x7f8c280c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:06.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8c28152620 0x7f8c281f72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:06.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 --2- 10.20.193.45:0/3577418678 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8c280c8d90 0x7f8c281f3400 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:06.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 >> 10.20.193.45:0/3577418678 conn(0x7f8c280c9d40 msgr2=0x7f8c2814cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:06.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 shutdown_connections 2026-02-17T21:12:06.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 -- 10.20.193.45:0/3577418678 wait complete. 2026-02-17T21:12:06.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:06.047+0000 7f8c30719640 1 librados: shutdown 2026-02-17T21:12:09.050 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:12:09.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.128+0000 7fc9b2ba7640 10 monclient: get_monmap_and_config 2026-02-17T21:12:09.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.128+0000 7fc9b2ba7640 10 monclient: build_initial_monmap 2026-02-17T21:12:09.121 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.128+0000 7fc9b2ba7640 10 monclient: monmap: 2026-02-17T21:12:09.121 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:09.121 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:09.121 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:09.129477+0000 2026-02-17T21:12:09.121 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:09.129477+0000 2026-02-17T21:12:09.122 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:09.122 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:09.122 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:09.122 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:09.122 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:09.122 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:09.122 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:09.122 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:09.122 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:09.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 1 Processor -- start 2026-02-17T21:12:09.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 1 -- start start 2026-02-17T21:12:09.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 10 monclient: init 2026-02-17T21:12:09.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:09.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 10 monclient: _add_conns ranks=[0,3,1,5,4,2] 2026-02-17T21:12:09.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc9ac15d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:09.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc9ac0c92b0 0x7fc9ac15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:09.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 10 monclient(hunting): picked mon.noname-a con 0x7fc9ac0c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:09.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc9ac0748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:09.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9ac0c5860 con 0x7fc9ac15d1e0 2026-02-17T21:12:09.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9ac0c5580 con 0x7fc9ac0748e0 2026-02-17T21:12:09.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:09.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fc9ac0c7de0 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:09.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9b2ba7640 10 monclient(hunting): authenticate will time out at 1312.759629s 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.129+0000 7fc9a3fff640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc9ac0c92b0 0x7fc9ac15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.130+0000 7fc9b091c640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fc9ac15d1e0 0x7fc9ac0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:59944/0 (socket says 10.20.193.45:59944) 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.130+0000 7fc9b091c640 1 -- 10.20.193.45:0/682225482 learned_addr learned my addr 10.20.193.45:0/682225482 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.130+0000 7fc9a3fff640 10 monclient(hunting): get_auth_request con 0x7fc9ac0c92b0 auth_method 0 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.130+0000 7fc9a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.130+0000 7fc9a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.130+0000 7fc9a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.130+0000 7fc9a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.130+0000 7fc9a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:09.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.130+0000 7fc9a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a3fff640 10 monclient(hunting): handle_auth_done global_id 5028 payload 274 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a37fe640 1 -- 10.20.193.45:0/682225482 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232001001 0 0) 0x7fc9ac0c5580 con 0x7fc9ac0748e0 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a3fff640 1 -- 10.20.193.45:0/682225482 >> v1:10.20.193.86:6789/0 conn(0x7fc9ac0748e0 legacy=0x7fc9ac153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a3fff640 1 -- 10.20.193.45:0/682225482 >> v1:10.20.193.45:6789/0 conn(0x7fc9ac15d1e0 legacy=0x7fc9ac0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a3fff640 1 monclient: found mon.noname-a 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a3fff640 1 -- 10.20.193.45:0/682225482 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac0c80c0 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.131+0000 7fc9a37fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) 2026-02-17T21:12:09.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.134+0000 7fc9a3fff640 1 --2- 10.20.193.45:0/682225482 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 0x7fc9ac15d5c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9940098d0 tx=0x7fc99402eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f0bc5549f9aa7d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:09.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 1 -- 10.20.193.45:0/682225482 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99403c070 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:09.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:09.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 10 monclient: dump: 2026-02-17T21:12:09.138 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:09.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 1 -- 10.20.193.45:0/682225482 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99402fba0 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 5 monclient: authenticate success, global_id 5028 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 1 -- 10.20.193.45:0/682225482 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994037440 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 4 set_mon_vals no callback set 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9a37fe640 10 monclient: dump: 2026-02-17T21:12:09.140 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 10 monclient: shutdown 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/682225482 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 msgr2=0x7fc9ac15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:09.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 1 --2- 10.20.193.45:0/682225482 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 0x7fc9ac15d5c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9940098d0 tx=0x7fc99402eed0 comp rx=0 tx=0).stop 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/682225482 shutdown_connections 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 1 --2- 10.20.193.45:0/682225482 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 0x7fc9ac15d5c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/682225482 >> 10.20.193.45:0/682225482 conn(0x7fc9ac0c9d40 msgr2=0x7fc9ac0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/682225482 shutdown_connections 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.136+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/682225482 wait complete. 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.137+0000 7fc9b2ba7640 10 monclient: build_initial_monmap 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.137+0000 7fc9b2ba7640 10 monclient: monmap: 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:09.142 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.137+0000 7fc9b2ba7640 1 librados: starting msgr at 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.137+0000 7fc9b2ba7640 1 librados: starting objecter 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.137+0000 7fc9b2ba7640 1 Processor -- start 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.137+0000 7fc9b2ba7640 1 -- start start 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.137+0000 7fc9b2ba7640 1 librados: setting wanted keys 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.137+0000 7fc9b2ba7640 1 librados: calling monclient init 2026-02-17T21:12:09.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.137+0000 7fc9b2ba7640 10 monclient: init 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc9ac0748e0 0x7fc9ac14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient(hunting): picked mon.noname-b con 0x7fc9ac0748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 0x7fc9ac1e8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient(hunting): picked mon.noname-a con 0x7fc9ac0c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc9ac15d1e0 0x7fc9ac1e8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient(hunting): picked mon.noname-c con 0x7fc9ac15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac074d30 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac0c8680 con 0x7fc9ac0748e0 2026-02-17T21:12:09.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ac153d20 con 0x7fc9ac15d1e0 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b2ba7640 10 monclient(hunting): authenticate will time out at 1312.768101s 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 0x7fc9ac1e8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 0x7fc9ac1e8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:47026/0 (socket says 10.20.193.45:47026) 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 1 -- 10.20.193.45:0/1197860657 learned_addr learned my addr 10.20.193.45:0/1197860657 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 10 monclient(hunting): get_auth_request con 0x7fc9ac0c92b0 auth_method 0 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:09.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b111d640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc9ac15d1e0 0x7fc9ac1e8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b091c640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc9ac0748e0 0x7fc9ac14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b091c640 10 monclient(hunting): get_auth_request con 0x7fc9ac0748e0 auth_method 0 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b091c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b091c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b091c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b111d640 10 monclient(hunting): get_auth_request con 0x7fc9ac15d1e0 auth_method 0 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b111d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b111d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9b111d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.138+0000 7fc9a3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:09.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.139+0000 7fc9b091c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.139+0000 7fc9b091c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.139+0000 7fc9b091c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.139+0000 7fc9b111d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.139+0000 7fc9b111d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.139+0000 7fc9b111d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 10 monclient(hunting): handle_auth_done global_id 5034 payload 824 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 1 -- 10.20.193.45:0/1197860657 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc9ac15d1e0 msgr2=0x7fc9ac1e8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc9ac15d1e0 0x7fc9ac1e8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 1 -- 10.20.193.45:0/1197860657 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc9ac0748e0 msgr2=0x7fc9ac14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc9ac0748e0 0x7fc9ac14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 1 monclient: found mon.noname-a 2026-02-17T21:12:09.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.140+0000 7fc9a3fff640 1 -- 10.20.193.45:0/1197860657 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ac1f3cf0 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.141+0000 7fc9a3fff640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 0x7fc9ac1e8a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc99402f400 tx=0x7fc9940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.141+0000 7fc9a17fa640 10 client.?.objecter ms_handle_connect 0x7fc9ac0c92b0 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.141+0000 7fc9a17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 1 -- 10.20.193.45:0/1197860657 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99403c040 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 10 monclient: dump: 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:09.148 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 1 -- 10.20.193.45:0/1197860657 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc994004230 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 1 -- 10.20.193.45:0/1197860657 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994004620 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a17fa640 10 monclient: dump: 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:09.150 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9a2ffd640 4 set_mon_vals no callback set 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9b2ba7640 5 monclient: authenticate success, global_id 5034 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.142+0000 7fc9b2ba7640 10 monclient: _renew_subs 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ac1f3fd0 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 10 client.5034.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 10 monclient: _renew_subs 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ac1f4590 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 1 librados: init done 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:09.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:09.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:09.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.143+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ac15d5c0 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.155+0000 7fc9a17fa640 1 -- 10.20.193.45:0/1197860657 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc994003710 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.155+0000 7fc9a17fa640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc97c079280 0x7fc97c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:09.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.155+0000 7fc9b091c640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc97c079280 0x7fc97c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:09.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.155+0000 7fc9b091c640 10 monclient: get_auth_request con 0x7fc97c079280 auth_method 0 2026-02-17T21:12:09.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.155+0000 7fc9b091c640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc97c079280 0x7fc97c07b740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc99c002770 tx=0x7fc99c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:09.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.155+0000 7fc9a17fa640 10 client.5034.objecter ms_handle_connect 0x7fc97c079280 2026-02-17T21:12:09.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.158+0000 7fc9a17fa640 1 -- 10.20.193.45:0/1197860657 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fc99402fb00 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.158+0000 7fc9a17fa640 10 client.5034.objecter ms_dispatch2 0x7fc9ac000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:09.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.158+0000 7fc9a17fa640 3 client.5034.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:09.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.158+0000 7fc9a17fa640 3 client.5034.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:09.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.158+0000 7fc9a17fa640 20 client.5034.objecter dump_active .. 0 homeless 2026-02-17T21:12:09.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.262+0000 7fc9a17fa640 1 -- 10.20.193.45:0/1197860657 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc994087b90 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.262+0000 7fc9a17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:09.255 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.262+0000 7fc9a17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:09.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.367+0000 7fc9b2ba7640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:12:09.359 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.367+0000 7fc9b2ba7640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.367+0000 7fc9b2ba7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:09.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.367+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc9ac15a920 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.369+0000 7fc9a17fa640 1 -- 10.20.193.45:0/1197860657 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7fc99408be90 con 0x7fc9ac0c92b0 2026-02-17T21:12:09.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.369+0000 7fc9a17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:09.362 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.369+0000 7fc9a17fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:12:09.362 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:09.362 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:12:09.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 10 librados: watch_flush enter 2026-02-17T21:12:09.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 10 librados: watch_flush exit 2026-02-17T21:12:09.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 20 client.5034.objecter shutdown clearing up homeless session... 2026-02-17T21:12:09.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 10 client.5034.objecter successfully canceled tick 2026-02-17T21:12:09.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc97c079280 msgr2=0x7fc97c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:09.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc97c079280 0x7fc97c07b740 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc99c002770 tx=0x7fc99c009040 comp rx=0 tx=0).stop 2026-02-17T21:12:09.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 10 monclient: shutdown 2026-02-17T21:12:09.364 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:09.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 msgr2=0x7fc9ac1e8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:09.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 0x7fc9ac1e8a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc99402f400 tx=0x7fc9940047c0 comp rx=0 tx=0).stop 2026-02-17T21:12:09.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 shutdown_connections 2026-02-17T21:12:09.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc97c079280 0x7fc97c07b740 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:09.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc9ac15d1e0 0x7fc9ac1e8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:09.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc9ac0c92b0 0x7fc9ac1e8a20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:09.365 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 --2- 10.20.193.45:0/1197860657 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc9ac0748e0 0x7fc9ac14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:09.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 >> 10.20.193.45:0/1197860657 conn(0x7fc9ac0c9d40 msgr2=0x7fc9ac152320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:09.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 shutdown_connections 2026-02-17T21:12:09.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 -- 10.20.193.45:0/1197860657 wait complete. 2026-02-17T21:12:09.366 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:09.370+0000 7fc9b2ba7640 1 librados: shutdown 2026-02-17T21:12:10.360 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:17.572 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:10.362 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:17.575 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:10.369 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:17.582 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:10.389 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:07:17.600 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:10.390 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:07:17.601 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:10.391 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:07:17.564 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:10.392 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:07:17.565 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:10.398 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:07:17.609 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:10.400 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:07:17.573 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:12.373 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:12:12.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.448+0000 7efc42ba9640 10 monclient: get_monmap_and_config 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.448+0000 7efc42ba9640 10 monclient: build_initial_monmap 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.448+0000 7efc42ba9640 10 monclient: monmap: 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:12.449048+0000 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:12.449048+0000 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:12.441 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:12.442 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:12.442 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:12.442 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:12.442 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:12.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.448+0000 7efc42ba9640 1 Processor -- start 2026-02-17T21:12:12.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.448+0000 7efc42ba9640 1 -- start start 2026-02-17T21:12:12.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.448+0000 7efc42ba9640 10 monclient: init 2026-02-17T21:12:12.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:12.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 10 monclient: _add_conns ranks=[1,5,3,0,4,2] 2026-02-17T21:12:12.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7efc3c15d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:12.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7efc3c0c92b0 0x7efc3c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:12.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 10 monclient(hunting): picked mon.noname-c con 0x7efc3c0c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:12.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7efc3c0748e0 0x7efc3c153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 10 monclient(hunting): picked mon.noname-a con 0x7efc3c0748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3c0c5860 con 0x7efc3c15d1e0 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7efc3c0c5580 con 0x7efc3c0748e0 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7efc3c0c7de0 con 0x7efc3c0c92b0 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc42ba9640 10 monclient(hunting): authenticate will time out at 1316.079281s 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc4091e640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7efc3c15d1e0 0x7efc3c0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:34672/0 (socket says 10.20.193.45:34672) 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc4091e640 1 -- 10.20.193.45:0/1074092323 learned_addr learned my addr 10.20.193.45:0/1074092323 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc4111f640 1 --2- 10.20.193.45:0/1074092323 >> v2:10.20.193.45:3300/0 conn(0x7efc3c0748e0 0x7efc3c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:12.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc33fff640 1 --2- 10.20.193.45:0/1074092323 >> v2:10.20.193.92:3300/0 conn(0x7efc3c0c92b0 0x7efc3c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc33fff640 10 monclient(hunting): get_auth_request con 0x7efc3c0c92b0 auth_method 0 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc33fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.449+0000 7efc33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc4111f640 10 monclient(hunting): get_auth_request con 0x7efc3c0748e0 auth_method 0 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc4111f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc4111f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc4111f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:12.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc4111f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc4111f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.450+0000 7efc4111f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc337fe640 1 -- 10.20.193.45:0/1074092323 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236119203 0 0) 0x7efc3c0c5860 con 0x7efc3c15d1e0 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc337fe640 10 monclient(hunting): _negotiate 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc337fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc337fe640 10 monclient(hunting): my global_id is 5098 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc337fe640 1 -- 10.20.193.45:0/1074092323 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc28003620 con 0x7efc3c15d1e0 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc33fff640 10 monclient(hunting): handle_auth_done global_id 5135 payload 274 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc33fff640 1 -- 10.20.193.45:0/1074092323 >> v2:10.20.193.45:3300/0 conn(0x7efc3c0748e0 msgr2=0x7efc3c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc33fff640 1 --2- 10.20.193.45:0/1074092323 >> v2:10.20.193.45:3300/0 conn(0x7efc3c0748e0 0x7efc3c153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc33fff640 1 -- 10.20.193.45:0/1074092323 >> v1:10.20.193.86:6789/0 conn(0x7efc3c15d1e0 legacy=0x7efc3c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:12.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc33fff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:12.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc33fff640 1 monclient: found mon.noname-c 2026-02-17T21:12:12.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:12.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc33fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:12.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.451+0000 7efc33fff640 1 -- 10.20.193.45:0/1074092323 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c0c80c0 con 0x7efc3c0c92b0 2026-02-17T21:12:12.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.452+0000 7efc33fff640 1 --2- 10.20.193.45:0/1074092323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c0c92b0 0x7efc3c15d5c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efc240098a0 tx=0x7efc2402ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa995af1c9e09a7d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:12.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 1 -- 10.20.193.45:0/1074092323 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2403c070 con 0x7efc3c0c92b0 2026-02-17T21:12:12.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:12.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 10 monclient: dump: 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:12.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 1 -- 10.20.193.45:0/1074092323 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2402fae0 con 0x7efc3c0c92b0 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc42ba9640 5 monclient: authenticate success, global_id 5135 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 1 -- 10.20.193.45:0/1074092323 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24037440 con 0x7efc3c0c92b0 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc42ba9640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc42ba9640 4 set_mon_vals no callback set 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.454+0000 7efc337fe640 10 monclient: dump: 2026-02-17T21:12:12.457 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 10 monclient: shutdown 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:12.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 -- 10.20.193.45:0/1074092323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c0c92b0 msgr2=0x7efc3c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 --2- 10.20.193.45:0/1074092323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c0c92b0 0x7efc3c15d5c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efc240098a0 tx=0x7efc2402ee10 comp rx=0 tx=0).stop 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 -- 10.20.193.45:0/1074092323 shutdown_connections 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 --2- 10.20.193.45:0/1074092323 >> v2:10.20.193.45:3300/0 conn(0x7efc3c0748e0 0x7efc3c153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 --2- 10.20.193.45:0/1074092323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c0c92b0 0x7efc3c15d5c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 -- 10.20.193.45:0/1074092323 >> 10.20.193.45:0/1074092323 conn(0x7efc3c0c9d40 msgr2=0x7efc3c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 -- 10.20.193.45:0/1074092323 shutdown_connections 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 -- 10.20.193.45:0/1074092323 wait complete. 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 10 monclient: build_initial_monmap 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 10 monclient: monmap: 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:12.459 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 librados: starting msgr at 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 librados: starting objecter 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 Processor -- start 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 -- start start 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 librados: setting wanted keys 2026-02-17T21:12:12.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 1 librados: calling monclient init 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.455+0000 7efc42ba9640 10 monclient: init 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efc3c0748e0 0x7efc3c1f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient(hunting): picked mon.noname-a con 0x7efc3c0748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efc3c0c92b0 0x7efc3c1f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient(hunting): picked mon.noname-b con 0x7efc3c0c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c15d1e0 0x7efc3c072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient(hunting): picked mon.noname-c con 0x7efc3c15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c074d30 con 0x7efc3c0748e0 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:12.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c0c8680 con 0x7efc3c0c92b0 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c153b50 con 0x7efc3c15d1e0 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc42ba9640 10 monclient(hunting): authenticate will time out at 1316.086370s 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc4091e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efc3c0748e0 0x7efc3c1f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc33fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efc3c0c92b0 0x7efc3c1f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc4111f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c15d1e0 0x7efc3c072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc4091e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efc3c0748e0 0x7efc3c1f6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:47042/0 (socket says 10.20.193.45:47042) 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc4091e640 1 -- 10.20.193.45:0/2596634555 learned_addr learned my addr 10.20.193.45:0/2596634555 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc4091e640 10 monclient(hunting): get_auth_request con 0x7efc3c0748e0 auth_method 0 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc4091e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:12.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc4091e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.456+0000 7efc4091e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4111f640 10 monclient(hunting): get_auth_request con 0x7efc3c15d1e0 auth_method 0 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4111f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4111f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4111f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc33fff640 10 monclient(hunting): get_auth_request con 0x7efc3c0c92b0 auth_method 0 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc33fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4091e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4091e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4091e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4111f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:12.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4111f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc4111f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.457+0000 7efc33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 10 monclient(hunting): handle_auth_done global_id 5138 payload 824 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 1 -- 10.20.193.45:0/2596634555 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efc3c0c92b0 msgr2=0x7efc3c1f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efc3c0c92b0 0x7efc3c1f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 1 -- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efc3c0748e0 msgr2=0x7efc3c1f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efc3c0748e0 0x7efc3c1f6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 10 monclient: _finish_hunting 0 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 1 monclient: found mon.noname-c 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:12.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4111f640 1 -- 10.20.193.45:0/2596634555 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c1f4990 con 0x7efc3c15d1e0 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.458+0000 7efc4091e640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efc3c0748e0 0x7efc3c1f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.459+0000 7efc4111f640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c15d1e0 0x7efc3c072700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efc3800efc0 tx=0x7efc3800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.459+0000 7efc317fa640 10 client.?.objecter ms_handle_connect 0x7efc3c15d1e0 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.459+0000 7efc317fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc317fa640 1 -- 10.20.193.45:0/2596634555 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38018020 con 0x7efc3c15d1e0 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc317fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc317fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc317fa640 10 monclient: dump: 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:12.465 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc317fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc317fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc317fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc42ba9640 5 monclient: authenticate success, global_id 5138 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc42ba9640 10 monclient: _renew_subs 2026-02-17T21:12:12.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc42ba9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3c1f7660 con 0x7efc3c15d1e0 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc42ba9640 10 client.5138.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc42ba9640 10 monclient: _renew_subs 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc42ba9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3c1f7c20 con 0x7efc3c15d1e0 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.460+0000 7efc42ba9640 1 librados: init done 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc42ba9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc42ba9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc42ba9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3c153f30 con 0x7efc3c15d1e0 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc317fa640 1 -- 10.20.193.45:0/2596634555 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc38014480 con 0x7efc3c15d1e0 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc317fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:12.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc317fa640 1 -- 10.20.193.45:0/2596634555 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38014830 con 0x7efc3c15d1e0 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc317fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc317fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc32ffd640 4 set_mon_vals no callback set 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.461+0000 7efc317fa640 10 monclient: dump: 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:12.468 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:12.469 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:12.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.569+0000 7efc317fa640 1 -- 10.20.193.45:0/2596634555 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7efc380149d0 con 0x7efc3c15d1e0 2026-02-17T21:12:12.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.570+0000 7efc317fa640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efc0c079280 0x7efc0c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:12.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.570+0000 7efc4091e640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efc0c079280 0x7efc0c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:12.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.570+0000 7efc4091e640 10 monclient: get_auth_request con 0x7efc0c079280 auth_method 0 2026-02-17T21:12:12.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.570+0000 7efc4091e640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efc0c079280 0x7efc0c07b740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efc2c005980 tx=0x7efc2c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:12.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.570+0000 7efc317fa640 10 client.5138.objecter ms_handle_connect 0x7efc0c079280 2026-02-17T21:12:12.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.571+0000 7efc317fa640 1 -- 10.20.193.45:0/2596634555 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7efc3805f2e0 con 0x7efc3c15d1e0 2026-02-17T21:12:12.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.571+0000 7efc317fa640 10 client.5138.objecter ms_dispatch2 0x7efc3c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:12.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.571+0000 7efc317fa640 3 client.5138.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:12.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.571+0000 7efc317fa640 3 client.5138.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:12.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.572+0000 7efc317fa640 20 client.5138.objecter dump_active .. 0 homeless 2026-02-17T21:12:12.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.578+0000 7efc317fa640 1 -- 10.20.193.45:0/2596634555 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7efc38098e20 con 0x7efc3c15d1e0 2026-02-17T21:12:12.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.578+0000 7efc317fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:12.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.578+0000 7efc317fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:12.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.681+0000 7efc42ba9640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:12:12.673 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.681+0000 7efc42ba9640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:12.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.681+0000 7efc42ba9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:12.674 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.681+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efc3c1573a0 con 0x7efc3c15d1e0 2026-02-17T21:12:12.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.683+0000 7efc317fa640 1 -- 10.20.193.45:0/2596634555 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7efc38022030 con 0x7efc3c15d1e0 2026-02-17T21:12:12.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.683+0000 7efc317fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:12.676 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.683+0000 7efc317fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:12:12.676 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:12.676 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:12:12.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 10 librados: watch_flush enter 2026-02-17T21:12:12.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 10 librados: watch_flush exit 2026-02-17T21:12:12.678 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 20 client.5138.objecter shutdown clearing up homeless session... 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 10 client.5138.objecter successfully canceled tick 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efc0c079280 msgr2=0x7efc0c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efc0c079280 0x7efc0c07b740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efc2c005980 tx=0x7efc2c009040 comp rx=0 tx=0).stop 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 10 monclient: shutdown 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c15d1e0 msgr2=0x7efc3c072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c15d1e0 0x7efc3c072700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efc3800efc0 tx=0x7efc3800c490 comp rx=0 tx=0).stop 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 shutdown_connections 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efc0c079280 0x7efc0c07b740 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efc3c15d1e0 0x7efc3c072700 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efc3c0c92b0 0x7efc3c1f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:12.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 --2- 10.20.193.45:0/2596634555 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efc3c0748e0 0x7efc3c1f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:12.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 >> 10.20.193.45:0/2596634555 conn(0x7efc3c0c9d40 msgr2=0x7efc3c0ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:12.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 shutdown_connections 2026-02-17T21:12:12.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 -- 10.20.193.45:0/2596634555 wait complete. 2026-02-17T21:12:12.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:12.685+0000 7efc42ba9640 1 librados: shutdown 2026-02-17T21:12:15.688 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:12:15.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.763+0000 7f3e7ab48640 10 monclient: get_monmap_and_config 2026-02-17T21:12:15.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.763+0000 7f3e7ab48640 10 monclient: build_initial_monmap 2026-02-17T21:12:15.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.763+0000 7f3e7ab48640 10 monclient: monmap: 2026-02-17T21:12:15.756 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:15.756 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:15.756 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:15.764454+0000 2026-02-17T21:12:15.756 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:15.764454+0000 2026-02-17T21:12:15.757 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:15.757 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:15.757 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:15.757 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:15.757 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:15.757 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:15.757 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:15.757 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:15.757 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:15.761 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 1 Processor -- start 2026-02-17T21:12:15.761 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 1 -- start start 2026-02-17T21:12:15.761 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient: init 2026-02-17T21:12:15.761 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:15.761 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient: _add_conns ranks=[5,4,0,2,1,3] 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3e7415d1e0 0x7f3e7415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient(hunting): picked mon.noname-c con 0x7f3e7415d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3e740748e0 0x7f3e740c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient(hunting): picked mon.noname-b con 0x7f3e740748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3e740c90e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e740c9570 con 0x7f3e740c90e0 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3e740c5860 con 0x7f3e740748e0 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3e740c5580 con 0x7f3e7415d1e0 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:15.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e7ab48640 10 monclient(hunting): authenticate will time out at 1319.394602s 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e790be640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f3e740c90e0 0x7f3e74153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:59956/0 (socket says 10.20.193.45:59956) 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.764+0000 7f3e790be640 1 -- 10.20.193.45:0/3072276976 learned_addr learned my addr 10.20.193.45:0/3072276976 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e6bfff640 1 --2- 10.20.193.45:0/3072276976 >> v2:10.20.193.86:3300/0 conn(0x7f3e740748e0 0x7f3e740c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e788bd640 1 --2- 10.20.193.45:0/3072276976 >> v2:10.20.193.92:3300/0 conn(0x7f3e7415d1e0 0x7f3e7415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e6bfff640 10 monclient(hunting): get_auth_request con 0x7f3e740748e0 auth_method 0 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e788bd640 10 monclient(hunting): get_auth_request con 0x7f3e7415d1e0 auth_method 0 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e788bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e788bd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e788bd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:15.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e788bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e788bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.765+0000 7f3e788bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6b7fe640 1 -- 10.20.193.45:0/3072276976 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807691346 0 0) 0x7f3e740c9570 con 0x7f3e740c90e0 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6b7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6b7fe640 10 monclient(hunting): my global_id is 5043 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6b7fe640 1 -- 10.20.193.45:0/3072276976 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e60003620 con 0x7f3e740c90e0 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6bfff640 10 monclient(hunting): handle_auth_done global_id 5104 payload 274 2026-02-17T21:12:15.764 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6bfff640 1 -- 10.20.193.45:0/3072276976 >> v2:10.20.193.92:3300/0 conn(0x7f3e7415d1e0 msgr2=0x7f3e7415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:15.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6bfff640 1 --2- 10.20.193.45:0/3072276976 >> v2:10.20.193.92:3300/0 conn(0x7f3e7415d1e0 0x7f3e7415d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:15.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6bfff640 1 -- 10.20.193.45:0/3072276976 >> v1:10.20.193.45:6789/0 conn(0x7f3e740c90e0 legacy=0x7f3e74153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:15.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6bfff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:15.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6bfff640 1 monclient: found mon.noname-b 2026-02-17T21:12:15.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:15.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:15.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.766+0000 7f3e6bfff640 1 -- 10.20.193.45:0/3072276976 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e740c7de0 con 0x7f3e740748e0 2026-02-17T21:12:15.765 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.768+0000 7f3e6bfff640 1 --2- 10.20.193.45:0/3072276976 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e740748e0 0x7f3e740c8ba0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0098a0 tx=0x7f3e5c02ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ee29fca4548278d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:15.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 1 -- 10.20.193.45:0/3072276976 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c03c070 con 0x7f3e740748e0 2026-02-17T21:12:15.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:15.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:15.771 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 10 monclient: dump: 2026-02-17T21:12:15.771 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:15.771 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:15.771 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:15.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 1 -- 10.20.193.45:0/3072276976 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e5c02fae0 con 0x7f3e740748e0 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e7ab48640 5 monclient: authenticate success, global_id 5104 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 1 -- 10.20.193.45:0/3072276976 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c037440 con 0x7f3e740748e0 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e6b7fe640 10 monclient: dump: 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:15.773 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e7ab48640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.769+0000 7f3e7ab48640 4 set_mon_vals no callback set 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 10 monclient: shutdown 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3072276976 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e740748e0 msgr2=0x7f3e740c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 --2- 10.20.193.45:0/3072276976 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e740748e0 0x7f3e740c8ba0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0098a0 tx=0x7f3e5c02ee10 comp rx=0 tx=0).stop 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3072276976 shutdown_connections 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 --2- 10.20.193.45:0/3072276976 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e740748e0 0x7f3e740c8ba0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:15.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 --2- 10.20.193.45:0/3072276976 >> v2:10.20.193.92:3300/0 conn(0x7f3e7415d1e0 0x7f3e7415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3072276976 >> 10.20.193.45:0/3072276976 conn(0x7f3e740c9d40 msgr2=0x7f3e740ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3072276976 shutdown_connections 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3072276976 wait complete. 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 10 monclient: build_initial_monmap 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 10 monclient: monmap: 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:15.775 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 librados: starting msgr at 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 librados: starting objecter 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 Processor -- start 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 -- start start 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 librados: setting wanted keys 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 1 librados: calling monclient init 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.770+0000 7f3e7ab48640 10 monclient: init 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e740748e0 0x7f3e7406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:15.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient(hunting): picked mon.noname-b con 0x7f3e740748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e740c90e0 0x7f3e740cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient(hunting): picked mon.noname-c con 0x7f3e740c90e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e7415d1e0 0x7f3e74145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient(hunting): picked mon.noname-a con 0x7f3e7415d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3e740c8680 con 0x7f3e7415d1e0 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3e740c83a0 con 0x7f3e740748e0 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3e74074d30 con 0x7f3e740c90e0 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e7ab48640 10 monclient(hunting): authenticate will time out at 1319.401290s 2026-02-17T21:12:15.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e7415d1e0 0x7f3e74145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e788bd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e740748e0 0x7f3e7406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e6bfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e740c90e0 0x7f3e740cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e7415d1e0 0x7f3e74145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:47052/0 (socket says 10.20.193.45:47052) 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 1 -- 10.20.193.45:0/3457001996 learned_addr learned my addr 10.20.193.45:0/3457001996 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 10 monclient(hunting): get_auth_request con 0x7f3e7415d1e0 auth_method 0 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e788bd640 10 monclient(hunting): get_auth_request con 0x7f3e740748e0 auth_method 0 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e788bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e788bd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:15.778 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e788bd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e6bfff640 10 monclient(hunting): get_auth_request con 0x7f3e740c90e0 auth_method 0 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e6bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e6bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e6bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.771+0000 7f3e790be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.772+0000 7f3e788bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.772+0000 7f3e788bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.772+0000 7f3e788bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.772+0000 7f3e6bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:15.779 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.772+0000 7f3e6bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.772+0000 7f3e6bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 10 monclient(hunting): handle_auth_done global_id 5046 payload 824 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 1 -- 10.20.193.45:0/3457001996 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e740c90e0 msgr2=0x7f3e740cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e740c90e0 0x7f3e740cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 1 -- 10.20.193.45:0/3457001996 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e740748e0 msgr2=0x7f3e7406ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e740748e0 0x7f3e7406ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 10 monclient: _finish_hunting 0 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 1 monclient: found mon.noname-a 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:15.780 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.773+0000 7f3e790be640 1 -- 10.20.193.45:0/3457001996 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e740cb420 con 0x7f3e7415d1e0 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.774+0000 7f3e790be640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e7415d1e0 0x7f3e74145690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000cb40 tx=0x7f3e7000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.774+0000 7f3e697fa640 10 client.?.objecter ms_handle_connect 0x7f3e7415d1e0 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.774+0000 7f3e697fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 1 -- 10.20.193.45:0/3457001996 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000ad50 con 0x7f3e7415d1e0 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 10 monclient: dump: 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:15.781 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 5 monclient: authenticate success, global_id 5046 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 1 -- 10.20.193.45:0/3457001996 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e70012400 con 0x7f3e7415d1e0 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 10 monclient: _renew_subs 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:15.782 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e740cb700 con 0x7f3e7415d1e0 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 1 -- 10.20.193.45:0/3457001996 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e700127f0 con 0x7f3e7415d1e0 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e697fa640 10 monclient: dump: 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:15.783 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e6affd640 4 set_mon_vals no callback set 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 10 client.5046.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 10 monclient: _renew_subs 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e740cbcc0 con 0x7f3e7415d1e0 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 1 librados: init done 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:15.784 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.776+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e740c8ba0 con 0x7f3e7415d1e0 2026-02-17T21:12:15.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.787+0000 7f3e697fa640 1 -- 10.20.193.45:0/3457001996 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f3e70012990 con 0x7f3e7415d1e0 2026-02-17T21:12:15.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.787+0000 7f3e697fa640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e440792d0 0x7f3e4407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:15.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.787+0000 7f3e788bd640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e440792d0 0x7f3e4407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:15.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.787+0000 7f3e788bd640 10 monclient: get_auth_request con 0x7f3e440792d0 auth_method 0 2026-02-17T21:12:15.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.787+0000 7f3e697fa640 10 client.5046.objecter ms_handle_connect 0x7f3e440792d0 2026-02-17T21:12:15.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.787+0000 7f3e788bd640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e440792d0 0x7f3e4407b790 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009ba0 tx=0x7f3e64009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:15.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.789+0000 7f3e697fa640 1 -- 10.20.193.45:0/3457001996 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f3e7005ecd0 con 0x7f3e7415d1e0 2026-02-17T21:12:15.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.789+0000 7f3e697fa640 10 client.5046.objecter ms_dispatch2 0x7f3e74000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:15.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.789+0000 7f3e697fa640 3 client.5046.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:15.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.789+0000 7f3e697fa640 3 client.5046.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:15.787 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.789+0000 7f3e697fa640 20 client.5046.objecter dump_active .. 0 homeless 2026-02-17T21:12:15.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.890+0000 7f3e697fa640 1 -- 10.20.193.45:0/3457001996 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3e70062c90 con 0x7f3e7415d1e0 2026-02-17T21:12:15.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.890+0000 7f3e697fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:15.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.890+0000 7f3e697fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:15.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.990+0000 7f3e7ab48640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:12:15.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.990+0000 7f3e7ab48640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:15.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.990+0000 7f3e7ab48640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:15.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.990+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3e740c9b20 con 0x7f3e7415d1e0 2026-02-17T21:12:15.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.993+0000 7f3e697fa640 1 -- 10.20.193.45:0/3457001996 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f3e70066f90 con 0x7f3e7415d1e0 2026-02-17T21:12:15.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.993+0000 7f3e697fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:15.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.993+0000 7f3e697fa640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:12:15.987 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:15.987 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:12:15.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.994+0000 7f3e7ab48640 10 librados: watch_flush enter 2026-02-17T21:12:15.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.994+0000 7f3e7ab48640 10 librados: watch_flush exit 2026-02-17T21:12:15.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.994+0000 7f3e7ab48640 20 client.5046.objecter shutdown clearing up homeless session... 2026-02-17T21:12:15.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.994+0000 7f3e7ab48640 10 client.5046.objecter successfully canceled tick 2026-02-17T21:12:15.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e440792d0 msgr2=0x7f3e4407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:15.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e440792d0 0x7f3e4407b790 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009ba0 tx=0x7f3e64009290 comp rx=0 tx=0).stop 2026-02-17T21:12:15.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 10 monclient: shutdown 2026-02-17T21:12:15.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e7415d1e0 msgr2=0x7f3e74145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e7415d1e0 0x7f3e74145690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e7000cb40 tx=0x7f3e7000a430 comp rx=0 tx=0).stop 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 shutdown_connections 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3e440792d0 0x7f3e4407b790 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3e7415d1e0 0x7f3e74145690 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3e740c90e0 0x7f3e740cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 --2- 10.20.193.45:0/3457001996 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3e740748e0 0x7f3e7406ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 >> 10.20.193.45:0/3457001996 conn(0x7f3e740c9d40 msgr2=0x7f3e741510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 shutdown_connections 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 -- 10.20.193.45:0/3457001996 wait complete. 2026-02-17T21:12:15.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:15.995+0000 7f3e7ab48640 1 librados: shutdown 2026-02-17T21:12:18.998 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-17T21:12:19.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 10 monclient: get_monmap_and_config 2026-02-17T21:12:19.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 10 monclient: build_initial_monmap 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 10 monclient: monmap: 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:19.074879+0000 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:19.074879+0000 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:19.067 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:19.068 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:19.068 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 1 Processor -- start 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 1 -- start start 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 10 monclient: init 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 10 monclient: _add_conns ranks=[0,3,4,1,5,2] 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5c0815d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5c080c92b0 0x7f5c0815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 10 monclient(hunting): picked mon.noname-a con 0x7f5c080c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5c080748e0 0x7f5c08153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 10 monclient(hunting): picked mon.noname-b con 0x7f5c080748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.073+0000 7f5c0f37e640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c080c5860 con 0x7f5c0815d1e0 2026-02-17T21:12:19.071 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0f37e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0f37e640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f5c080c5580 con 0x7f5c080c92b0 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0f37e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0f37e640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5c080c7de0 con 0x7f5c080748e0 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0f37e640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0f37e640 10 monclient(hunting): authenticate will time out at 1322.705023s 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0c8f2640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5c080c92b0 0x7f5c0815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0d8f4640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5c080748e0 0x7f5c08153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0c8f2640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5c080c92b0 0x7f5c0815d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:47056/0 (socket says 10.20.193.45:47056) 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0c8f2640 1 -- 10.20.193.45:0/1365490629 learned_addr learned my addr 10.20.193.45:0/1365490629 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0c8f2640 10 monclient(hunting): get_auth_request con 0x7f5c080c92b0 auth_method 0 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0c8f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.072 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0c8f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0c8f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0d8f4640 10 monclient(hunting): get_auth_request con 0x7f5c080748e0 auth_method 0 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0d8f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0d8f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.074+0000 7f5c0d8f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.075+0000 7f5c0c8f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.075+0000 7f5c0c8f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.075+0000 7f5c0c8f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.075+0000 7f5c0d8f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.075+0000 7f5c0d8f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.075+0000 7f5c0d8f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.076+0000 7f5c0c8f2640 10 monclient(hunting): handle_auth_done global_id 5049 payload 274 2026-02-17T21:12:19.073 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.076+0000 7f5c0c8f2640 1 -- 10.20.193.45:0/1365490629 >> v2:10.20.193.86:3300/0 conn(0x7f5c080748e0 msgr2=0x7f5c08153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:19.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.076+0000 7f5c0c8f2640 1 --2- 10.20.193.45:0/1365490629 >> v2:10.20.193.86:3300/0 conn(0x7f5c080748e0 0x7f5c08153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.076+0000 7f5c0c8f2640 1 -- 10.20.193.45:0/1365490629 >> v1:10.20.193.45:6789/0 conn(0x7f5c0815d1e0 legacy=0x7f5c080c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.076+0000 7f5c0c8f2640 10 monclient: _finish_hunting 0 2026-02-17T21:12:19.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.076+0000 7f5c0c8f2640 1 monclient: found mon.noname-a 2026-02-17T21:12:19.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.076+0000 7f5c0c8f2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:19.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.076+0000 7f5c0c8f2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:19.074 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.076+0000 7f5c0c8f2640 1 -- 10.20.193.45:0/1365490629 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c080c80c0 con 0x7f5c080c92b0 2026-02-17T21:12:19.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.078+0000 7f5c0c8f2640 1 --2- 10.20.193.45:0/1365490629 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c080c92b0 0x7f5c0815d5c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009970 tx=0x7f5bfc02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f130ac33a0595ba server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 1 -- 10.20.193.45:0/1365490629 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc03c070 con 0x7f5c080c92b0 2026-02-17T21:12:19.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:19.079 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 10 monclient: dump: 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.080 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 10 monclient: _finish_auth 0 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 1 -- 10.20.193.45:0/1365490629 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc02fbc0 con 0x7f5c080c92b0 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 1 -- 10.20.193.45:0/1365490629 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc037440 con 0x7f5c080c92b0 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 5 monclient: authenticate success, global_id 5049 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 4 set_mon_vals no callback set 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5bf7fff640 10 monclient: dump: 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.081 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 10 monclient: shutdown 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 1 -- 10.20.193.45:0/1365490629 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c080c92b0 msgr2=0x7f5c0815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.082 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 1 --2- 10.20.193.45:0/1365490629 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c080c92b0 0x7f5c0815d5c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009970 tx=0x7f5bfc02eef0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 1 -- 10.20.193.45:0/1365490629 shutdown_connections 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 1 --2- 10.20.193.45:0/1365490629 >> v2:10.20.193.86:3300/0 conn(0x7f5c080748e0 0x7f5c08153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 1 --2- 10.20.193.45:0/1365490629 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c080c92b0 0x7f5c0815d5c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 1 -- 10.20.193.45:0/1365490629 >> 10.20.193.45:0/1365490629 conn(0x7f5c080c9d40 msgr2=0x7f5c080ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 1 -- 10.20.193.45:0/1365490629 shutdown_connections 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.080+0000 7f5c0f37e640 1 -- 10.20.193.45:0/1365490629 wait complete. 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.081+0000 7f5c0f37e640 10 monclient: build_initial_monmap 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.081+0000 7f5c0f37e640 10 monclient: monmap: 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:19.083 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.081+0000 7f5c0f37e640 1 librados: starting msgr at 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.081+0000 7f5c0f37e640 1 librados: starting objecter 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.081+0000 7f5c0f37e640 1 Processor -- start 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.081+0000 7f5c0f37e640 1 -- start start 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.081+0000 7f5c0f37e640 1 librados: setting wanted keys 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.081+0000 7f5c0f37e640 1 librados: calling monclient init 2026-02-17T21:12:19.084 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.081+0000 7f5c0f37e640 10 monclient: init 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5c080748e0 0x7f5c0806b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient(hunting): picked mon.noname-c con 0x7f5c080748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5c080c92b0 0x7f5c08141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient(hunting): picked mon.noname-b con 0x7f5c080c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c0815d1e0 0x7f5c081418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient(hunting): picked mon.noname-a con 0x7f5c0815d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08074d30 con 0x7f5c0815d1e0 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5c080c8680 con 0x7f5c080c92b0 2026-02-17T21:12:19.085 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08153b50 con 0x7f5c080748e0 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0f37e640 10 monclient(hunting): authenticate will time out at 1322.713084s 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c0815d1e0 0x7f5c081418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c0815d1e0 0x7f5c081418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:47058/0 (socket says 10.20.193.45:47058) 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 1 -- 10.20.193.45:0/4132270199 learned_addr learned my addr 10.20.193.45:0/4132270199 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 10 monclient(hunting): get_auth_request con 0x7f5c0815d1e0 auth_method 0 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.086 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0c8f2640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5c080c92b0 0x7f5c08141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0c8f2640 10 monclient(hunting): get_auth_request con 0x7f5c080c92b0 auth_method 0 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0c8f2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0c8f2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d0f3640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5c080748e0 0x7f5c0806b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0c8f2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d8f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d0f3640 10 monclient(hunting): get_auth_request con 0x7f5c080748e0 auth_method 0 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d0f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d0f3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.082+0000 7f5c0d0f3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.087 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.083+0000 7f5c0c8f2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.083+0000 7f5c0c8f2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.083+0000 7f5c0c8f2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.083+0000 7f5c0d0f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.083+0000 7f5c0d0f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.083+0000 7f5c0d0f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 10 monclient(hunting): handle_auth_done global_id 5055 payload 824 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 1 -- 10.20.193.45:0/4132270199 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5c080748e0 msgr2=0x7f5c0806b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5c080748e0 0x7f5c0806b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 1 -- 10.20.193.45:0/4132270199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5c080c92b0 msgr2=0x7f5c08141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5c080c92b0 0x7f5c08141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 10 monclient: _finish_hunting 0 2026-02-17T21:12:19.088 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 1 monclient: found mon.noname-a 2026-02-17T21:12:19.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:19.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:19.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.084+0000 7f5c0d8f4640 1 -- 10.20.193.45:0/4132270199 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c081f3f00 con 0x7f5c0815d1e0 2026-02-17T21:12:19.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.085+0000 7f5c0d8f4640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c0815d1e0 0x7f5c081418b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400efc0 tx=0x7f5c0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.085+0000 7f5bf5ffb640 10 client.?.objecter ms_handle_connect 0x7f5c0815d1e0 2026-02-17T21:12:19.089 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.085+0000 7f5bf5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:19.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 1 -- 10.20.193.45:0/4132270199 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04018020 con 0x7f5c0815d1e0 2026-02-17T21:12:19.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:19.091 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 10 monclient: dump: 2026-02-17T21:12:19.091 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.091 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.091 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 1 -- 10.20.193.45:0/4132270199 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c04014480 con 0x7f5c0815d1e0 2026-02-17T21:12:19.092 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 1 -- 10.20.193.45:0/4132270199 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04014870 con 0x7f5c0815d1e0 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf5ffb640 10 monclient: dump: 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.093 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5bf77fe640 4 set_mon_vals no callback set 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5c0f37e640 5 monclient: authenticate success, global_id 5055 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5c0f37e640 10 monclient: _renew_subs 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5c0f37e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.086+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c081f41e0 con 0x7f5c0815d1e0 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.087+0000 7f5c0f37e640 10 client.5055.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.087+0000 7f5c0f37e640 10 monclient: _renew_subs 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.087+0000 7f5c0f37e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.087+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c081f47a0 con 0x7f5c0815d1e0 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.087+0000 7f5c0f37e640 1 librados: init done 2026-02-17T21:12:19.094 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.087+0000 7f5c0f37e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:19.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.087+0000 7f5c0f37e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:19.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.087+0000 7f5c0f37e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:19.095 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.087+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c08153f30 con 0x7f5c0815d1e0 2026-02-17T21:12:19.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.099+0000 7f5bf5ffb640 1 -- 10.20.193.45:0/4132270199 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f5c04014a10 con 0x7f5c0815d1e0 2026-02-17T21:12:19.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.099+0000 7f5bf5ffb640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5bd80792d0 0x7f5bd807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.099+0000 7f5c0d0f3640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5bd80792d0 0x7f5bd807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.096 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.099+0000 7f5c0d0f3640 10 monclient: get_auth_request con 0x7f5bd80792d0 auth_method 0 2026-02-17T21:12:19.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.100+0000 7f5c0d0f3640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5bd80792d0 0x7f5bd807b790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8005110 tx=0x7f5bf8007f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.100+0000 7f5bf5ffb640 10 client.5055.objecter ms_handle_connect 0x7f5bd80792d0 2026-02-17T21:12:19.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.101+0000 7f5bf5ffb640 1 -- 10.20.193.45:0/4132270199 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f5c0405f300 con 0x7f5c0815d1e0 2026-02-17T21:12:19.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.101+0000 7f5bf5ffb640 10 client.5055.objecter ms_dispatch2 0x7f5c08000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:19.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.101+0000 7f5bf5ffb640 3 client.5055.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:19.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.101+0000 7f5bf5ffb640 3 client.5055.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:19.097 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.101+0000 7f5bf5ffb640 20 client.5055.objecter dump_active .. 0 homeless 2026-02-17T21:12:19.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.207+0000 7f5bf5ffb640 1 -- 10.20.193.45:0/4132270199 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5c04022030 con 0x7f5c0815d1e0 2026-02-17T21:12:19.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.207+0000 7f5bf5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:19.201 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.207+0000 7f5bf5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:19.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.315+0000 7f5c0f37e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-17T21:12:19.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.315+0000 7f5c0f37e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:19.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.315+0000 7f5c0f37e640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:19.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.315+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5c080c9b20 con 0x7f5c0815d1e0 2026-02-17T21:12:19.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.317+0000 7f5bf5ffb640 1 -- 10.20.193.45:0/4132270199 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+201 (secure 0 0 0) 0x7f5c04010040 con 0x7f5c0815d1e0 2026-02-17T21:12:19.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.317+0000 7f5bf5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-17T21:12:19.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.317+0000 7f5bf5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:12:19.311 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:19.312 INFO:teuthology.orchestra.run.trial045.stdout:{"status":"HEALTH_WARN","checks":{"BLUESTORE_SLOW_OP_ALERT":{"severity":"HEALTH_WARN","summary":{"message":"12 OSD(s) experiencing slow operations in BlueStore","count":12},"muted":false}},"mutes":[]} 2026-02-17T21:12:19.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.318+0000 7f5c0f37e640 10 librados: watch_flush enter 2026-02-17T21:12:19.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 10 librados: watch_flush exit 2026-02-17T21:12:19.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 20 client.5055.objecter shutdown clearing up homeless session... 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 10 client.5055.objecter successfully canceled tick 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5bd80792d0 msgr2=0x7f5bd807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5bd80792d0 0x7f5bd807b790 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8005110 tx=0x7f5bf8007f30 comp rx=0 tx=0).stop 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 10 monclient: shutdown 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c0815d1e0 msgr2=0x7f5c081418b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c0815d1e0 0x7f5c081418b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400efc0 tx=0x7f5c0400c490 comp rx=0 tx=0).stop 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 shutdown_connections 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5bd80792d0 0x7f5bd807b790 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5c0815d1e0 0x7f5c081418b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5c080c92b0 0x7f5c08141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 --2- 10.20.193.45:0/4132270199 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5c080748e0 0x7f5c0806b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 >> 10.20.193.45:0/4132270199 conn(0x7f5c080c9d40 msgr2=0x7f5c08152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:19.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 shutdown_connections 2026-02-17T21:12:19.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 -- 10.20.193.45:0/4132270199 wait complete. 2026-02-17T21:12:19.315 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.319+0000 7f5c0f37e640 1 librados: shutdown 2026-02-17T21:12:19.321 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-17T21:12:19.321 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:12:19.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.395+0000 7f5e6ba6d640 10 monclient: get_monmap_and_config 2026-02-17T21:12:19.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.395+0000 7f5e6ba6d640 10 monclient: build_initial_monmap 2026-02-17T21:12:19.389 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.395+0000 7f5e6ba6d640 10 monclient: monmap: 2026-02-17T21:12:19.389 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:19.389 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.389 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:19.397239+0000 2026-02-17T21:12:19.389 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:19.397239+0000 2026-02-17T21:12:19.389 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:19.389 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.389 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:19.390 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:19.390 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:19.390 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:19.390 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:19.390 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:19.390 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.395+0000 7f5e6ba6d640 1 Processor -- start 2026-02-17T21:12:19.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.395+0000 7f5e6ba6d640 1 -- start start 2026-02-17T21:12:19.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.395+0000 7f5e6ba6d640 10 monclient: init 2026-02-17T21:12:19.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:19.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient: _add_conns ranks=[5,3,4,2,0,1] 2026-02-17T21:12:19.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f5e6415d1e0 0x7f5e6415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient(hunting): picked mon.noname-c con 0x7f5e6415d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5e640748e0 0x7f5e640c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient(hunting): picked mon.noname-a con 0x7f5e640748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5e640c90e0 0x7f5e64153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient(hunting): picked mon.noname-b con 0x7f5e640c90e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f5e640c9570 con 0x7f5e640748e0 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f5e640c5860 con 0x7f5e640c90e0 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5e640c5580 con 0x7f5e6415d1e0 2026-02-17T21:12:19.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e6ba6d640 10 monclient(hunting): authenticate will time out at 1323.027350s 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e68fe1640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f5e640748e0 0x7f5e640c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e69fe3640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f5e640c90e0 0x7f5e64153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e697e2640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f5e6415d1e0 0x7f5e6415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e697e2640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f5e6415d1e0 0x7f5e6415d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:34758/0 (socket says 10.20.193.45:34758) 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e697e2640 1 -- 10.20.193.45:0/263870325 learned_addr learned my addr 10.20.193.45:0/263870325 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e697e2640 10 monclient(hunting): get_auth_request con 0x7f5e6415d1e0 auth_method 0 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e697e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e697e2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e697e2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e68fe1640 10 monclient(hunting): get_auth_request con 0x7f5e640748e0 auth_method 0 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e68fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.395 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e68fe1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e68fe1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e69fe3640 10 monclient(hunting): get_auth_request con 0x7f5e640c90e0 auth_method 0 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e69fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e69fe3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.396+0000 7f5e69fe3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.397+0000 7f5e697e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.397+0000 7f5e697e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.397+0000 7f5e697e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.397+0000 7f5e68fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.397+0000 7f5e68fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.397+0000 7f5e68fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.396 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.397+0000 7f5e69fe3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.397+0000 7f5e69fe3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.397+0000 7f5e69fe3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 10 monclient(hunting): handle_auth_done global_id 5150 payload 274 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 1 -- 10.20.193.45:0/263870325 >> v2:10.20.193.86:3300/0 conn(0x7f5e640c90e0 msgr2=0x7f5e64153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 1 --2- 10.20.193.45:0/263870325 >> v2:10.20.193.86:3300/0 conn(0x7f5e640c90e0 0x7f5e64153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 1 -- 10.20.193.45:0/263870325 >> v2:10.20.193.45:3300/0 conn(0x7f5e640748e0 msgr2=0x7f5e640c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 1 --2- 10.20.193.45:0/263870325 >> v2:10.20.193.45:3300/0 conn(0x7f5e640748e0 0x7f5e640c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 10 monclient: _finish_hunting 0 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 1 monclient: found mon.noname-c 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:19.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.398+0000 7f5e697e2640 1 -- 10.20.193.45:0/263870325 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e640c7de0 con 0x7f5e6415d1e0 2026-02-17T21:12:19.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.400+0000 7f5e697e2640 1 --2- 10.20.193.45:0/263870325 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 0x7f5e6415d5c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e64076cd0 tx=0x7f5e5402eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a5047deaffc401b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 1 -- 10.20.193.45:0/263870325 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5403c070 con 0x7f5e6415d1e0 2026-02-17T21:12:19.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:19.404 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 10 monclient: dump: 2026-02-17T21:12:19.404 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.404 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.404 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 10 monclient: _finish_auth 0 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e6ba6d640 5 monclient: authenticate success, global_id 5150 2026-02-17T21:12:19.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e6ba6d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 1 -- 10.20.193.45:0/263870325 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e5402fb50 con 0x7f5e6415d1e0 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 1 -- 10.20.193.45:0/263870325 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e54037440 con 0x7f5e6415d1e0 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e53fff640 10 monclient: dump: 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.406 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e6ba6d640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.402+0000 7f5e6ba6d640 4 set_mon_vals no callback set 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 10 monclient: shutdown 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/263870325 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 msgr2=0x7f5e6415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/263870325 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 0x7f5e6415d5c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5e64076cd0 tx=0x7f5e5402eed0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/263870325 shutdown_connections 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/263870325 >> v2:10.20.193.86:3300/0 conn(0x7f5e640c90e0 0x7f5e64153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.407 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/263870325 >> v2:10.20.193.45:3300/0 conn(0x7f5e640748e0 0x7f5e640c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/263870325 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 0x7f5e6415d5c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/263870325 >> 10.20.193.45:0/263870325 conn(0x7f5e640c9d40 msgr2=0x7f5e640ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/263870325 shutdown_connections 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/263870325 wait complete. 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 10 monclient: build_initial_monmap 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 10 monclient: monmap: 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.408 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 librados: starting msgr at 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.403+0000 7f5e6ba6d640 1 librados: starting objecter 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 Processor -- start 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 -- start start 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 librados: setting wanted keys 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 librados: calling monclient init 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient: init 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:19.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5e640748e0 0x7f5e6406f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient(hunting): picked mon.noname-a con 0x7f5e640748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5e640c90e0 0x7f5e64072830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient(hunting): picked mon.noname-b con 0x7f5e640c90e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 0x7f5e64072d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient(hunting): picked mon.noname-c con 0x7f5e6415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5e640c8680 con 0x7f5e640748e0 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f5e640c83a0 con 0x7f5e640c90e0 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e64074d30 con 0x7f5e6415d1e0 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:19.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e6ba6d640 10 monclient(hunting): authenticate will time out at 1323.035449s 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e697e2640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5e640748e0 0x7f5e6406f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e69fe3640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 0x7f5e64072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e697e2640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5e640748e0 0x7f5e6406f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36314/0 (socket says 10.20.193.45:36314) 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e697e2640 1 -- 10.20.193.45:0/2922421648 learned_addr learned my addr 10.20.193.45:0/2922421648 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e697e2640 10 monclient(hunting): get_auth_request con 0x7f5e640748e0 auth_method 0 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e697e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e697e2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e697e2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e68fe1640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5e640c90e0 0x7f5e64072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e69fe3640 10 monclient(hunting): get_auth_request con 0x7f5e6415d1e0 auth_method 0 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e69fe3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e69fe3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.404+0000 7f5e69fe3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e68fe1640 10 monclient(hunting): get_auth_request con 0x7f5e640c90e0 auth_method 0 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e68fe1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e68fe1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e68fe1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e697e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e697e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e697e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e69fe3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e69fe3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e69fe3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e68fe1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e68fe1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.405+0000 7f5e68fe1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 10 monclient(hunting): handle_auth_done global_id 5153 payload 824 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 1 -- 10.20.193.45:0/2922421648 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5e640c90e0 msgr2=0x7f5e64072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5e640c90e0 0x7f5e64072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 1 -- 10.20.193.45:0/2922421648 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5e640748e0 msgr2=0x7f5e6406f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5e640748e0 0x7f5e6406f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 10 monclient: _finish_hunting 0 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 1 monclient: found mon.noname-c 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.406+0000 7f5e69fe3640 1 -- 10.20.193.45:0/2922421648 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e641f3780 con 0x7f5e6415d1e0 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.407+0000 7f5e69fe3640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 0x7f5e64072d70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009d90 tx=0x7f5e6000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.407+0000 7f5e51ffb640 10 client.?.objecter ms_handle_connect 0x7f5e6415d1e0 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.407+0000 7f5e51ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 1 -- 10.20.193.45:0/2922421648 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60018020 con 0x7f5e6415d1e0 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 10 monclient: dump: 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.414 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 1 -- 10.20.193.45:0/2922421648 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e60014480 con 0x7f5e6415d1e0 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 1 -- 10.20.193.45:0/2922421648 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60014870 con 0x7f5e6415d1e0 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 5 monclient: authenticate success, global_id 5153 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 10 monclient: _renew_subs 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e537fe640 4 set_mon_vals no callback set 2026-02-17T21:12:19.415 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e641f3a60 con 0x7f5e6415d1e0 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e51ffb640 10 monclient: dump: 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.416 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 10 client.5153.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:19.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 10 monclient: _renew_subs 2026-02-17T21:12:19.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:19.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e641f4020 con 0x7f5e6415d1e0 2026-02-17T21:12:19.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 1 librados: init done 2026-02-17T21:12:19.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:19.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:19.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:19.417 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.409+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e640c8ba0 con 0x7f5e6415d1e0 2026-02-17T21:12:19.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.422+0000 7f5e51ffb640 1 -- 10.20.193.45:0/2922421648 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f5e60014a10 con 0x7f5e6415d1e0 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.422+0000 7f5e51ffb640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e340792d0 0x7f5e3407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.423+0000 7f5e697e2640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e340792d0 0x7f5e3407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.423+0000 7f5e697e2640 10 monclient: get_auth_request con 0x7f5e340792d0 auth_method 0 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.423+0000 7f5e697e2640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e340792d0 0x7f5e3407b790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009730 tx=0x7f5e54039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.423+0000 7f5e51ffb640 10 client.5153.objecter ms_handle_connect 0x7f5e340792d0 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.424+0000 7f5e51ffb640 1 -- 10.20.193.45:0/2922421648 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f5e6005f220 con 0x7f5e6415d1e0 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.424+0000 7f5e51ffb640 10 client.5153.objecter ms_dispatch2 0x7f5e64000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.424+0000 7f5e51ffb640 3 client.5153.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.424+0000 7f5e51ffb640 3 client.5153.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:19.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.424+0000 7f5e51ffb640 20 client.5153.objecter dump_active .. 0 homeless 2026-02-17T21:12:19.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.524+0000 7f5e51ffb640 1 -- 10.20.193.45:0/2922421648 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5e60022030 con 0x7f5e6415d1e0 2026-02-17T21:12:19.517 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.524+0000 7f5e51ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:19.518 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.524+0000 7f5e51ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:19.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.606+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e640c9b20 con 0x7f5e340792d0 2026-02-17T21:12:19.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.607+0000 7f5e51ffb640 1 -- 10.20.193.45:0/2922421648 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44764 (secure 0 0 0) 0x7f5e640c9b20 con 0x7f5e340792d0 2026-02-17T21:12:19.601 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 10 librados: watch_flush enter 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 10 librados: watch_flush exit 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 20 client.5153.objecter shutdown clearing up homeless session... 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 10 client.5153.objecter successfully canceled tick 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e340792d0 msgr2=0x7f5e3407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e340792d0 0x7f5e3407b790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009730 tx=0x7f5e54039040 comp rx=0 tx=0).stop 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 10 monclient: shutdown 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:19.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 msgr2=0x7f5e64072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 0x7f5e64072d70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009d90 tx=0x7f5e6000c490 comp rx=0 tx=0).stop 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 shutdown_connections 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f5e340792d0 0x7f5e3407b790 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e6415d1e0 0x7f5e64072d70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5e640c90e0 0x7f5e64072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 --2- 10.20.193.45:0/2922421648 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5e640748e0 0x7f5e6406f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 >> 10.20.193.45:0/2922421648 conn(0x7f5e640c9d40 msgr2=0x7f5e6414df50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 shutdown_connections 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 -- 10.20.193.45:0/2922421648 wait complete. 2026-02-17T21:12:19.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.608+0000 7f5e6ba6d640 1 librados: shutdown 2026-02-17T21:12:19.610 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2026-02-17T21:12:18.713160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":437784,"kb_used_data":6360,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511656,"statfs":{"total":1546188226560,"available":1545739935744,"internally_reserved":0,"allocated":6512640,"data_stored":3263382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25498,"internal_metadata":441424998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001691"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:23.281403+0000","last_change":"2026-02-17T21:07:11.541544+0000","last_active":"2026-02-17T21:09:23.281403+0000","last_peered":"2026-02-17T21:09:23.281403+0000","last_clean":"2026-02-17T21:09:23.281403+0000","last_became_active":"2026-02-17T21:07:09.672479+0000","last_became_peered":"2026-02-17T21:07:09.672479+0000","last_unstale":"2026-02-17T21:09:23.281403+0000","last_undegraded":"2026-02-17T21:09:23.281403+0000","last_fullsized":"2026-02-17T21:09:23.281403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:18:00.047244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048238970999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:22.260632+0000","last_change":"2026-02-17T21:07:11.966086+0000","last_active":"2026-02-17T21:09:22.260632+0000","last_peered":"2026-02-17T21:09:22.260632+0000","last_clean":"2026-02-17T21:09:22.260632+0000","last_became_active":"2026-02-17T21:07:09.634301+0000","last_became_peered":"2026-02-17T21:07:09.634301+0000","last_unstale":"2026-02-17T21:09:22.260632+0000","last_undegraded":"2026-02-17T21:09:22.260632+0000","last_fullsized":"2026-02-17T21:09:22.260632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:14:59.089621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032567963999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:13.756342+0000","last_change":"2026-02-17T21:07:12.020919+0000","last_active":"2026-02-17T21:09:13.756342+0000","last_peered":"2026-02-17T21:09:13.756342+0000","last_clean":"2026-02-17T21:09:13.756342+0000","last_became_active":"2026-02-17T21:07:09.505342+0000","last_became_peered":"2026-02-17T21:07:09.505342+0000","last_unstale":"2026-02-17T21:09:13.756342+0000","last_undegraded":"2026-02-17T21:09:13.756342+0000","last_fullsized":"2026-02-17T21:09:13.756342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:24:24.816438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036804456999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:18.289377+0000","last_change":"2026-02-17T21:07:11.520216+0000","last_active":"2026-02-17T21:09:18.289377+0000","last_peered":"2026-02-17T21:09:18.289377+0000","last_clean":"2026-02-17T21:09:18.289377+0000","last_became_active":"2026-02-17T21:07:09.674257+0000","last_became_peered":"2026-02-17T21:07:09.674257+0000","last_unstale":"2026-02-17T21:09:18.289377+0000","last_undegraded":"2026-02-17T21:09:18.289377+0000","last_fullsized":"2026-02-17T21:09:18.289377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:40:26.586387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033871934999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:18.278369+0000","last_change":"2026-02-17T21:07:11.525598+0000","last_active":"2026-02-17T21:09:18.278369+0000","last_peered":"2026-02-17T21:09:18.278369+0000","last_clean":"2026-02-17T21:09:18.278369+0000","last_became_active":"2026-02-17T21:07:09.679096+0000","last_became_peered":"2026-02-17T21:07:09.679096+0000","last_unstale":"2026-02-17T21:09:18.278369+0000","last_undegraded":"2026-02-17T21:09:18.278369+0000","last_fullsized":"2026-02-17T21:09:18.278369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:24:33.818275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036788098999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:15.792752+0000","last_change":"2026-02-17T21:07:12.033028+0000","last_active":"2026-02-17T21:09:15.792752+0000","last_peered":"2026-02-17T21:09:15.792752+0000","last_clean":"2026-02-17T21:09:15.792752+0000","last_became_active":"2026-02-17T21:07:09.677404+0000","last_became_peered":"2026-02-17T21:07:09.677404+0000","last_unstale":"2026-02-17T21:09:15.792752+0000","last_undegraded":"2026-02-17T21:09:15.792752+0000","last_fullsized":"2026-02-17T21:09:15.792752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:08:16.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047884902999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:08.802367+0000","last_change":"2026-02-17T21:07:11.526917+0000","last_active":"2026-02-17T21:09:08.802367+0000","last_peered":"2026-02-17T21:09:08.802367+0000","last_clean":"2026-02-17T21:09:08.802367+0000","last_became_active":"2026-02-17T21:07:09.663986+0000","last_became_peered":"2026-02-17T21:07:09.663986+0000","last_unstale":"2026-02-17T21:09:08.802367+0000","last_undegraded":"2026-02-17T21:09:08.802367+0000","last_fullsized":"2026-02-17T21:09:08.802367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:14:51.518524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039512685999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:15.792988+0000","last_change":"2026-02-17T21:07:12.029142+0000","last_active":"2026-02-17T21:09:15.792988+0000","last_peered":"2026-02-17T21:09:15.792988+0000","last_clean":"2026-02-17T21:09:15.792988+0000","last_became_active":"2026-02-17T21:07:09.717514+0000","last_became_peered":"2026-02-17T21:07:09.717514+0000","last_unstale":"2026-02-17T21:09:15.792988+0000","last_undegraded":"2026-02-17T21:09:15.792988+0000","last_fullsized":"2026-02-17T21:09:15.792988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T03:32:38.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031434124000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"28'32","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:08:59.591648+0000","last_change":"2026-02-17T21:07:07.293203+0000","last_active":"2026-02-17T21:08:59.591648+0000","last_peered":"2026-02-17T21:08:59.591648+0000","last_clean":"2026-02-17T21:08:59.591648+0000","last_became_active":"2026-02-17T21:07:06.988047+0000","last_became_peered":"2026-02-17T21:07:06.988047+0000","last_unstale":"2026-02-17T21:08:59.591648+0000","last_undegraded":"2026-02-17T21:08:59.591648+0000","last_fullsized":"2026-02-17T21:08:59.591648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_clean_scrub_stamp":"2026-02-17T21:06:59.073039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:10.662342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":27,"seq":115964117062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,9,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":27,"seq":115964117062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":27,"seq":115964117062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280578,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,3,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280578,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149764,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":23,"seq":98784247874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":24,"seq":103079215170,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":26,"seq":111669149766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,2,4,5,6,7,8,9,10,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":26,"seq":111669149763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,4,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":26,"seq":111669149766,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,3,4,6,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149765,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,3,4,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":27,"seq":115964117063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:12:19.612 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:12:19.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.686+0000 7f1c3e0ea640 10 monclient: get_monmap_and_config 2026-02-17T21:12:19.679 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.686+0000 7f1c3e0ea640 10 monclient: build_initial_monmap 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.686+0000 7f1c3e0ea640 10 monclient: monmap: 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:19.688035+0000 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:19.688035+0000 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:19.680 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:19.681 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:19.681 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:19.681 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.686+0000 7f1c3e0ea640 1 Processor -- start 2026-02-17T21:12:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.686+0000 7f1c3e0ea640 1 -- start start 2026-02-17T21:12:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.686+0000 7f1c3e0ea640 10 monclient: init 2026-02-17T21:12:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 10 monclient: _add_conns ranks=[2,4,1,0,3,5] 2026-02-17T21:12:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f1c381561c0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f1c3806c890 0x7f1c380cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.683 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 10 monclient(hunting): picked mon.noname-b con 0x7f1c3806c890 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f1c3806e110 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3815ce80 con 0x7f1c3806e110 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3806f6e0 con 0x7f1c381561c0 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f1c3806f490 con 0x7f1c3806c890 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c3e0ea640 10 monclient(hunting): authenticate will time out at 1323.318264s 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c377fe640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f1c381561c0 0x7f1c380704a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45466/0 (socket says 10.20.193.45:45466) 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c377fe640 1 -- 10.20.193.45:0/1910670374 learned_addr learned my addr 10.20.193.45:0/1910670374 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c36ffd640 1 --2- 10.20.193.45:0/1910670374 >> v2:10.20.193.86:3300/0 conn(0x7f1c3806c890 0x7f1c380cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c36ffd640 10 monclient(hunting): get_auth_request con 0x7f1c3806c890 auth_method 0 2026-02-17T21:12:19.684 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c36ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.687+0000 7f1c36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.688+0000 7f1c36ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.688+0000 7f1c36ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.688+0000 7f1c36ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.689+0000 7f1c36ffd640 10 monclient(hunting): handle_auth_done global_id 5122 payload 274 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.689+0000 7f1c36ffd640 1 -- 10.20.193.45:0/1910670374 >> v1:10.20.193.92:6789/0 conn(0x7f1c381561c0 legacy=0x7f1c380704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.689+0000 7f1c36ffd640 1 -- 10.20.193.45:0/1910670374 >> v1:10.20.193.86:6789/0 conn(0x7f1c3806e110 legacy=0x7f1c380cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.689+0000 7f1c36ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.689+0000 7f1c36ffd640 1 monclient: found mon.noname-b 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.689+0000 7f1c36ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.689+0000 7f1c36ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:19.685 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.689+0000 7f1c36ffd640 1 -- 10.20.193.45:0/1910670374 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3806f9c0 con 0x7f1c3806c890 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.690+0000 7f1c36ffd640 1 --2- 10.20.193.45:0/1910670374 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c3806c890 0x7f1c380cca30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c280098d0 tx=0x7f1c2802ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a23bb03d707779f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 1 -- 10.20.193.45:0/1910670374 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2803c070 con 0x7f1c3806c890 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 10 monclient: dump: 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.691 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 10 monclient: _finish_auth 0 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 10 monclient: _check_auth_tickets 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 1 -- 10.20.193.45:0/1910670374 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2802fbe0 con 0x7f1c3806c890 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 1 -- 10.20.193.45:0/1910670374 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28037440 con 0x7f1c3806c890 2026-02-17T21:12:19.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 5 monclient: authenticate success, global_id 5122 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c367fc640 10 monclient: dump: 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.693 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 4 set_mon_vals no callback set 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 10 monclient: shutdown 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/1910670374 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c3806c890 msgr2=0x7f1c380cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 1 --2- 10.20.193.45:0/1910670374 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c3806c890 0x7f1c380cca30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1c280098d0 tx=0x7f1c2802ef60 comp rx=0 tx=0).stop 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/1910670374 shutdown_connections 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 1 --2- 10.20.193.45:0/1910670374 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c3806c890 0x7f1c380cca30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.692+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/1910670374 >> 10.20.193.45:0/1910670374 conn(0x7f1c380cbf10 msgr2=0x7f1c380cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/1910670374 shutdown_connections 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/1910670374 wait complete. 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 10 monclient: build_initial_monmap 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 10 monclient: monmap: 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:19.695 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 1 librados: starting msgr at 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 1 librados: starting objecter 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 1 Processor -- start 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 1 -- start start 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 1 librados: setting wanted keys 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 1 librados: calling monclient init 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.693+0000 7f1c3e0ea640 10 monclient: init 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c3806c890 0x7f1c3814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.696 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient(hunting): picked mon.noname-c con 0x7f1c3806c890 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c3806e110 0x7f1c380cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient(hunting): picked mon.noname-a con 0x7f1c3806e110 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c381561c0 0x7f1c381f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient(hunting): picked mon.noname-b con 0x7f1c381561c0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3806e860 con 0x7f1c3806e110 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38070010 con 0x7f1c381561c0 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3815cb00 con 0x7f1c3806c890 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c3e0ea640 10 monclient(hunting): authenticate will time out at 1323.325157s 2026-02-17T21:12:19.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c377fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c3806c890 0x7f1c3814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c36ffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c3806e110 0x7f1c380cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c37fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c381561c0 0x7f1c381f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c377fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c3806c890 0x7f1c3814f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:34784/0 (socket says 10.20.193.45:34784) 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c377fe640 1 -- 10.20.193.45:0/2241036620 learned_addr learned my addr 10.20.193.45:0/2241036620 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c377fe640 10 monclient(hunting): get_auth_request con 0x7f1c3806c890 auth_method 0 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c377fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c37fff640 10 monclient(hunting): get_auth_request con 0x7f1c381561c0 auth_method 0 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c37fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.698 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c37fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c36ffd640 10 monclient(hunting): get_auth_request con 0x7f1c3806e110 auth_method 0 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c36ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c36ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c36ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c37fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c37fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c37fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.694+0000 7f1c377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.695+0000 7f1c377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.695+0000 7f1c36ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.699 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.695+0000 7f1c36ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.695+0000 7f1c36ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 10 monclient(hunting): handle_auth_done global_id 5125 payload 824 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 1 -- 10.20.193.45:0/2241036620 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c3806c890 msgr2=0x7f1c3814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c3806c890 0x7f1c3814f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 1 -- 10.20.193.45:0/2241036620 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c3806e110 msgr2=0x7f1c380cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c3806e110 0x7f1c380cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 1 monclient: found mon.noname-b 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.696+0000 7f1c37fff640 1 -- 10.20.193.45:0/2241036620 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c381f5da0 con 0x7f1c381561c0 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c37fff640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c381561c0 0x7f1c381f1c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00be20 tx=0x7f1c2c00bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 client.?.objecter ms_handle_connect 0x7f1c381561c0 2026-02-17T21:12:19.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 1 -- 10.20.193.45:0/2241036620 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c006e60 con 0x7f1c381561c0 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 monclient: dump: 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.703 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 monclient: _finish_auth 0 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 1 -- 10.20.193.45:0/2241036620 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2c010070 con 0x7f1c381561c0 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c3e0ea640 5 monclient: authenticate success, global_id 5125 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c3e0ea640 10 monclient: _renew_subs 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c3e0ea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:19.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c381f6080 con 0x7f1c381561c0 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 1 -- 10.20.193.45:0/2241036620 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c00ccf0 con 0x7f1c381561c0 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c13fff640 10 monclient: dump: 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.705 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c35ffb640 4 set_mon_vals no callback set 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c3e0ea640 10 client.5125.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c3e0ea640 10 monclient: _renew_subs 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c3e0ea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c381f6640 con 0x7f1c381561c0 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.698+0000 7f1c3e0ea640 1 librados: init done 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.699+0000 7f1c3e0ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.699+0000 7f1c3e0ea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.699+0000 7f1c3e0ea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:19.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.699+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c381565a0 con 0x7f1c381561c0 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.710+0000 7f1c13fff640 1 -- 10.20.193.45:0/2241036620 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f1c2c004070 con 0x7f1c381561c0 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.710+0000 7f1c13fff640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c08079300 0x7f1c0807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.710+0000 7f1c377fe640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c08079300 0x7f1c0807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.710+0000 7f1c377fe640 10 monclient: get_auth_request con 0x7f1c08079300 auth_method 0 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.711+0000 7f1c13fff640 10 client.5125.objecter ms_handle_connect 0x7f1c08079300 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.711+0000 7f1c377fe640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c08079300 0x7f1c0807b7c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1c24002770 tx=0x7f1c24009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.713+0000 7f1c13fff640 1 -- 10.20.193.45:0/2241036620 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f1c2c05dfc0 con 0x7f1c381561c0 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.713+0000 7f1c13fff640 10 client.5125.objecter ms_dispatch2 0x7f1c38000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.713+0000 7f1c13fff640 3 client.5125.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:19.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.713+0000 7f1c13fff640 3 client.5125.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:19.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.713+0000 7f1c13fff640 20 client.5125.objecter dump_active .. 0 homeless 2026-02-17T21:12:19.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.817+0000 7f1c13fff640 1 -- 10.20.193.45:0/2241036620 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1c2c061f80 con 0x7f1c381561c0 2026-02-17T21:12:19.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.817+0000 7f1c13fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:19.810 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.817+0000 7f1c13fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:19.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.900+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c380cab50 con 0x7f1c08079300 2026-02-17T21:12:19.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.900+0000 7f1c13fff640 1 -- 10.20.193.45:0/2241036620 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44764 (secure 0 0 0) 0x7f1c380cab50 con 0x7f1c08079300 2026-02-17T21:12:19.894 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:19.896 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-17T21:12:19.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 10 librados: watch_flush enter 2026-02-17T21:12:19.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 10 librados: watch_flush exit 2026-02-17T21:12:19.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 20 client.5125.objecter shutdown clearing up homeless session... 2026-02-17T21:12:19.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 10 client.5125.objecter successfully canceled tick 2026-02-17T21:12:19.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c08079300 msgr2=0x7f1c0807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c08079300 0x7f1c0807b7c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1c24002770 tx=0x7f1c24009040 comp rx=0 tx=0).stop 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 10 monclient: shutdown 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c381561c0 msgr2=0x7f1c381f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c381561c0 0x7f1c381f1c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00be20 tx=0x7f1c2c00bf20 comp rx=0 tx=0).stop 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 shutdown_connections 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f1c08079300 0x7f1c0807b7c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f1c381561c0 0x7f1c381f1c20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f1c3806e110 0x7f1c380cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 --2- 10.20.193.45:0/2241036620 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c3806c890 0x7f1c3814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 >> 10.20.193.45:0/2241036620 conn(0x7f1c380cbf10 msgr2=0x7f1c380c9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:19.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 shutdown_connections 2026-02-17T21:12:19.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 -- 10.20.193.45:0/2241036620 wait complete. 2026-02-17T21:12:19.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.901+0000 7f1c3e0ea640 1 librados: shutdown 2026-02-17T21:12:19.903 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2026-02-17T21:12:18.713160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":437784,"kb_used_data":6360,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511656,"statfs":{"total":1546188226560,"available":1545739935744,"internally_reserved":0,"allocated":6512640,"data_stored":3263382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25498,"internal_metadata":441424998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001691"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:23.281403+0000","last_change":"2026-02-17T21:07:11.541544+0000","last_active":"2026-02-17T21:09:23.281403+0000","last_peered":"2026-02-17T21:09:23.281403+0000","last_clean":"2026-02-17T21:09:23.281403+0000","last_became_active":"2026-02-17T21:07:09.672479+0000","last_became_peered":"2026-02-17T21:07:09.672479+0000","last_unstale":"2026-02-17T21:09:23.281403+0000","last_undegraded":"2026-02-17T21:09:23.281403+0000","last_fullsized":"2026-02-17T21:09:23.281403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:18:00.047244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048238970999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:22.260632+0000","last_change":"2026-02-17T21:07:11.966086+0000","last_active":"2026-02-17T21:09:22.260632+0000","last_peered":"2026-02-17T21:09:22.260632+0000","last_clean":"2026-02-17T21:09:22.260632+0000","last_became_active":"2026-02-17T21:07:09.634301+0000","last_became_peered":"2026-02-17T21:07:09.634301+0000","last_unstale":"2026-02-17T21:09:22.260632+0000","last_undegraded":"2026-02-17T21:09:22.260632+0000","last_fullsized":"2026-02-17T21:09:22.260632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:14:59.089621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032567963999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:13.756342+0000","last_change":"2026-02-17T21:07:12.020919+0000","last_active":"2026-02-17T21:09:13.756342+0000","last_peered":"2026-02-17T21:09:13.756342+0000","last_clean":"2026-02-17T21:09:13.756342+0000","last_became_active":"2026-02-17T21:07:09.505342+0000","last_became_peered":"2026-02-17T21:07:09.505342+0000","last_unstale":"2026-02-17T21:09:13.756342+0000","last_undegraded":"2026-02-17T21:09:13.756342+0000","last_fullsized":"2026-02-17T21:09:13.756342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:24:24.816438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036804456999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:18.289377+0000","last_change":"2026-02-17T21:07:11.520216+0000","last_active":"2026-02-17T21:09:18.289377+0000","last_peered":"2026-02-17T21:09:18.289377+0000","last_clean":"2026-02-17T21:09:18.289377+0000","last_became_active":"2026-02-17T21:07:09.674257+0000","last_became_peered":"2026-02-17T21:07:09.674257+0000","last_unstale":"2026-02-17T21:09:18.289377+0000","last_undegraded":"2026-02-17T21:09:18.289377+0000","last_fullsized":"2026-02-17T21:09:18.289377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:40:26.586387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033871934999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:18.278369+0000","last_change":"2026-02-17T21:07:11.525598+0000","last_active":"2026-02-17T21:09:18.278369+0000","last_peered":"2026-02-17T21:09:18.278369+0000","last_clean":"2026-02-17T21:09:18.278369+0000","last_became_active":"2026-02-17T21:07:09.679096+0000","last_became_peered":"2026-02-17T21:07:09.679096+0000","last_unstale":"2026-02-17T21:09:18.278369+0000","last_undegraded":"2026-02-17T21:09:18.278369+0000","last_fullsized":"2026-02-17T21:09:18.278369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:24:33.818275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036788098999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:15.792752+0000","last_change":"2026-02-17T21:07:12.033028+0000","last_active":"2026-02-17T21:09:15.792752+0000","last_peered":"2026-02-17T21:09:15.792752+0000","last_clean":"2026-02-17T21:09:15.792752+0000","last_became_active":"2026-02-17T21:07:09.677404+0000","last_became_peered":"2026-02-17T21:07:09.677404+0000","last_unstale":"2026-02-17T21:09:15.792752+0000","last_undegraded":"2026-02-17T21:09:15.792752+0000","last_fullsized":"2026-02-17T21:09:15.792752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:08:16.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047884902999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:08.802367+0000","last_change":"2026-02-17T21:07:11.526917+0000","last_active":"2026-02-17T21:09:08.802367+0000","last_peered":"2026-02-17T21:09:08.802367+0000","last_clean":"2026-02-17T21:09:08.802367+0000","last_became_active":"2026-02-17T21:07:09.663986+0000","last_became_peered":"2026-02-17T21:07:09.663986+0000","last_unstale":"2026-02-17T21:09:08.802367+0000","last_undegraded":"2026-02-17T21:09:08.802367+0000","last_fullsized":"2026-02-17T21:09:08.802367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:14:51.518524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039512685999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:15.792988+0000","last_change":"2026-02-17T21:07:12.029142+0000","last_active":"2026-02-17T21:09:15.792988+0000","last_peered":"2026-02-17T21:09:15.792988+0000","last_clean":"2026-02-17T21:09:15.792988+0000","last_became_active":"2026-02-17T21:07:09.717514+0000","last_became_peered":"2026-02-17T21:07:09.717514+0000","last_unstale":"2026-02-17T21:09:15.792988+0000","last_undegraded":"2026-02-17T21:09:15.792988+0000","last_fullsized":"2026-02-17T21:09:15.792988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T03:32:38.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031434124000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"28'32","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:08:59.591648+0000","last_change":"2026-02-17T21:07:07.293203+0000","last_active":"2026-02-17T21:08:59.591648+0000","last_peered":"2026-02-17T21:08:59.591648+0000","last_clean":"2026-02-17T21:08:59.591648+0000","last_became_active":"2026-02-17T21:07:06.988047+0000","last_became_peered":"2026-02-17T21:07:06.988047+0000","last_unstale":"2026-02-17T21:08:59.591648+0000","last_undegraded":"2026-02-17T21:08:59.591648+0000","last_fullsized":"2026-02-17T21:08:59.591648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_clean_scrub_stamp":"2026-02-17T21:06:59.073039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:10.662342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":27,"seq":115964117062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,9,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":27,"seq":115964117062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":27,"seq":115964117062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280578,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,3,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280578,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149764,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":23,"seq":98784247874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":24,"seq":103079215170,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":26,"seq":111669149766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,2,4,5,6,7,8,9,10,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":26,"seq":111669149763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,4,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":26,"seq":111669149766,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,3,4,6,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149765,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,3,4,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":27,"seq":115964117063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:12:19.904 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-17T21:12:19.905 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:12:19.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.980+0000 7f18c6c22640 10 monclient: get_monmap_and_config 2026-02-17T21:12:19.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.980+0000 7f18c6c22640 10 monclient: build_initial_monmap 2026-02-17T21:12:19.973 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.980+0000 7f18c6c22640 10 monclient: monmap: 2026-02-17T21:12:19.973 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:19.981242+0000 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:19.981242+0000 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:19.974 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:19.975 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.980+0000 7f18c6c22640 1 Processor -- start 2026-02-17T21:12:19.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.980+0000 7f18c6c22640 1 -- start start 2026-02-17T21:12:19.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.980+0000 7f18c6c22640 10 monclient: init 2026-02-17T21:12:19.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:19.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 10 monclient: _add_conns ranks=[2,3,4,0,5,1] 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f18c015d1e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f18c00c92b0 0x7f18c015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 10 monclient(hunting): picked mon.noname-a con 0x7f18c00c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f18c00748e0 0x7f18c0153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 10 monclient(hunting): picked mon.noname-b con 0x7f18c00748e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c00c5860 con 0x7f18c015d1e0 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f18c00c5580 con 0x7f18c00c92b0 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f18c00c7de0 con 0x7f18c00748e0 2026-02-17T21:12:19.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.981+0000 7f18c6c22640 10 monclient(hunting): authenticate will time out at 1323.611646s 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c4997640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f18c015d1e0 0x7f18c00c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45474/0 (socket says 10.20.193.45:45474) 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c4997640 1 -- 10.20.193.45:0/1749847702 learned_addr learned my addr 10.20.193.45:0/1749847702 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18b7fff640 1 --2- 10.20.193.45:0/1749847702 >> v2:10.20.193.45:3300/0 conn(0x7f18c00c92b0 0x7f18c015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c5198640 1 --2- 10.20.193.45:0/1749847702 >> v2:10.20.193.86:3300/0 conn(0x7f18c00748e0 0x7f18c0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18b7fff640 10 monclient(hunting): get_auth_request con 0x7f18c00c92b0 auth_method 0 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c5198640 10 monclient(hunting): get_auth_request con 0x7f18c00748e0 auth_method 0 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c5198640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c5198640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c5198640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c5198640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c5198640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.982+0000 7f18c5198640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18b77fe640 1 -- 10.20.193.45:0/1749847702 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197033137 0 0) 0x7f18c00c5860 con 0x7f18c015d1e0 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18b77fe640 10 monclient(hunting): _negotiate 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18b77fe640 10 monclient(hunting): my global_id is 5162 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18b77fe640 1 -- 10.20.193.45:0/1749847702 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18ac003620 con 0x7f18c015d1e0 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18c5198640 10 monclient(hunting): handle_auth_done global_id 5128 payload 274 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18c5198640 1 -- 10.20.193.45:0/1749847702 >> v2:10.20.193.45:3300/0 conn(0x7f18c00c92b0 msgr2=0x7f18c015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18c5198640 1 --2- 10.20.193.45:0/1749847702 >> v2:10.20.193.45:3300/0 conn(0x7f18c00c92b0 0x7f18c015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18c5198640 1 -- 10.20.193.45:0/1749847702 >> v1:10.20.193.92:6789/0 conn(0x7f18c015d1e0 legacy=0x7f18c00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18c5198640 10 monclient: _finish_hunting 0 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18c5198640 1 monclient: found mon.noname-b 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18c5198640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18c5198640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.983+0000 7f18c5198640 1 -- 10.20.193.45:0/1749847702 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c00c80c0 con 0x7f18c00748e0 2026-02-17T21:12:19.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.984+0000 7f18c5198640 1 --2- 10.20.193.45:0/1749847702 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f18c00748e0 0x7f18c0153610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009d90 tx=0x7f18bc02f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58ec70c4b20ec9c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 1 -- 10.20.193.45:0/1749847702 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc03c070 con 0x7f18c00748e0 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 10 monclient: dump: 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.988 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 1 -- 10.20.193.45:0/1749847702 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18bc037440 con 0x7f18c00748e0 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 5 monclient: authenticate success, global_id 5128 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 1 -- 10.20.193.45:0/1749847702 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18bc037810 con 0x7f18c00748e0 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:19.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18b77fe640 10 monclient: dump: 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:19.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 4 set_mon_vals no callback set 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 10 monclient: shutdown 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 1 -- 10.20.193.45:0/1749847702 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f18c00748e0 msgr2=0x7f18c0153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 1 --2- 10.20.193.45:0/1749847702 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f18c00748e0 0x7f18c0153610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009d90 tx=0x7f18bc02f1e0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 1 -- 10.20.193.45:0/1749847702 shutdown_connections 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 1 --2- 10.20.193.45:0/1749847702 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f18c00748e0 0x7f18c0153610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 1 --2- 10.20.193.45:0/1749847702 >> v2:10.20.193.45:3300/0 conn(0x7f18c00c92b0 0x7f18c015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 1 -- 10.20.193.45:0/1749847702 >> 10.20.193.45:0/1749847702 conn(0x7f18c00c9d40 msgr2=0x7f18c00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 1 -- 10.20.193.45:0/1749847702 shutdown_connections 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.986+0000 7f18c6c22640 1 -- 10.20.193.45:0/1749847702 wait complete. 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.987+0000 7f18c6c22640 10 monclient: build_initial_monmap 2026-02-17T21:12:19.991 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.987+0000 7f18c6c22640 10 monclient: monmap: 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.987+0000 7f18c6c22640 1 librados: starting msgr at 2026-02-17T21:12:19.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.987+0000 7f18c6c22640 1 librados: starting objecter 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.987+0000 7f18c6c22640 1 Processor -- start 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.987+0000 7f18c6c22640 1 -- start start 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.987+0000 7f18c6c22640 1 librados: setting wanted keys 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.987+0000 7f18c6c22640 1 librados: calling monclient init 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.987+0000 7f18c6c22640 10 monclient: init 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f18c00748e0 0x7f18c01f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient(hunting): picked mon.noname-a con 0x7f18c00748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f18c00c92b0 0x7f18c0148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient(hunting): picked mon.noname-b con 0x7f18c00c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f18c015d1e0 0x7f18c01f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:19.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient(hunting): picked mon.noname-c con 0x7f18c015d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0074d30 con 0x7f18c00748e0 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f18c00c8680 con 0x7f18c00c92b0 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0153b50 con 0x7f18c015d1e0 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c6c22640 10 monclient(hunting): authenticate will time out at 1323.618228s 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f18c00748e0 0x7f18c01f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18b7fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f18c00c92b0 0x7f18c0148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c5198640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f18c015d1e0 0x7f18c01f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:19.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f18c00748e0 0x7f18c01f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36338/0 (socket says 10.20.193.45:36338) 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 1 -- 10.20.193.45:0/179259004 learned_addr learned my addr 10.20.193.45:0/179259004 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 10 monclient(hunting): get_auth_request con 0x7f18c00748e0 auth_method 0 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18b7fff640 10 monclient(hunting): get_auth_request con 0x7f18c00c92b0 auth_method 0 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c5198640 10 monclient(hunting): get_auth_request con 0x7f18c015d1e0 auth_method 0 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c5198640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c5198640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:19.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c5198640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.988+0000 7f18c4997640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.989+0000 7f18c5198640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.989+0000 7f18c5198640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.989+0000 7f18c5198640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.989+0000 7f18b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.989+0000 7f18b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.989+0000 7f18b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 10 monclient(hunting): handle_auth_done global_id 5070 payload 824 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 1 -- 10.20.193.45:0/179259004 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f18c015d1e0 msgr2=0x7f18c01f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f18c015d1e0 0x7f18c01f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 1 -- 10.20.193.45:0/179259004 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f18c00c92b0 msgr2=0x7f18c0148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f18c00c92b0 0x7f18c0148b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 10 monclient: _finish_hunting 0 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 1 monclient: found mon.noname-a 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.990+0000 7f18c4997640 1 -- 10.20.193.45:0/179259004 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c01f36b0 con 0x7f18c00748e0 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.991+0000 7f18c4997640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f18c00748e0 0x7f18c01f4a30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c520 tx=0x7f18b000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.991+0000 7f18b57fa640 10 client.?.objecter ms_handle_connect 0x7f18c00748e0 2026-02-17T21:12:19.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.991+0000 7f18b57fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:20.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 1 -- 10.20.193.45:0/179259004 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0017070 con 0x7f18c00748e0 2026-02-17T21:12:20.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:20.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:20.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 10 monclient: dump: 2026-02-17T21:12:20.000 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:20.000 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:20.000 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:20.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 1 -- 10.20.193.45:0/179259004 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b0005de0 con 0x7f18c00748e0 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 5 monclient: authenticate success, global_id 5070 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 10 monclient: _renew_subs 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c01f3990 con 0x7f18c00748e0 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 1 -- 10.20.193.45:0/179259004 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0007270 con 0x7f18c00748e0 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b57fa640 10 monclient: dump: 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:20.002 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18b6ffd640 4 set_mon_vals no callback set 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 10 client.5070.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 10 monclient: _renew_subs 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:20.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c01f3f50 con 0x7f18c00748e0 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 1 librados: init done 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:19.993+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c015e0c0 con 0x7f18c00748e0 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.006+0000 7f18b57fa640 1 -- 10.20.193.45:0/179259004 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f18b0007410 con 0x7f18c00748e0 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.006+0000 7f18b57fa640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f18900792b0 0x7f189007b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.006+0000 7f18b7fff640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f18900792b0 0x7f189007b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.006+0000 7f18b7fff640 10 monclient: get_auth_request con 0x7f18900792b0 auth_method 0 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.007+0000 7f18b57fa640 10 client.5070.objecter ms_handle_connect 0x7f18900792b0 2026-02-17T21:12:20.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.007+0000 7f18b7fff640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f18900792b0 0x7f189007b770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f18c0074730 tx=0x7f18a8009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:20.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.009+0000 7f18b57fa640 1 -- 10.20.193.45:0/179259004 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f18b0007730 con 0x7f18c00748e0 2026-02-17T21:12:20.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.009+0000 7f18b57fa640 10 client.5070.objecter ms_dispatch2 0x7f18c0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:20.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.009+0000 7f18b57fa640 3 client.5070.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:20.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.009+0000 7f18b57fa640 3 client.5070.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:20.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.009+0000 7f18b57fa640 20 client.5070.objecter dump_active .. 0 homeless 2026-02-17T21:12:20.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.114+0000 7f18b57fa640 1 -- 10.20.193.45:0/179259004 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f18c015e0c0 con 0x7f18c00748e0 2026-02-17T21:12:20.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.114+0000 7f18b57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:20.106 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.114+0000 7f18b57fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:20.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.194+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18c00698c0 con 0x7f18900792b0 2026-02-17T21:12:20.188 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.195+0000 7f18b57fa640 1 -- 10.20.193.45:0/179259004 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44764 (secure 0 0 0) 0x7f18c00698c0 con 0x7f18900792b0 2026-02-17T21:12:20.189 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 10 librados: watch_flush enter 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 10 librados: watch_flush exit 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 20 client.5070.objecter shutdown clearing up homeless session... 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 10 client.5070.objecter successfully canceled tick 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f18900792b0 msgr2=0x7f189007b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f18900792b0 0x7f189007b770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f18c0074730 tx=0x7f18a8009290 comp rx=0 tx=0).stop 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 10 monclient: shutdown 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:20.191 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f18c00748e0 msgr2=0x7f18c01f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f18c00748e0 0x7f18c01f4a30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c520 tx=0x7f18b000c9f0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 shutdown_connections 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f18900792b0 0x7f189007b770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f18c015d1e0 0x7f18c01f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f18c00c92b0 0x7f18c0148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 --2- 10.20.193.45:0/179259004 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f18c00748e0 0x7f18c01f4a30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 >> 10.20.193.45:0/179259004 conn(0x7f18c00c9d40 msgr2=0x7f18c006b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 shutdown_connections 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 -- 10.20.193.45:0/179259004 wait complete. 2026-02-17T21:12:20.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.196+0000 7f18c6c22640 1 librados: shutdown 2026-02-17T21:12:20.197 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2026-02-17T21:12:18.713160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":437784,"kb_used_data":6360,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511656,"statfs":{"total":1546188226560,"available":1545739935744,"internally_reserved":0,"allocated":6512640,"data_stored":3263382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25498,"internal_metadata":441424998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001691"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:23.281403+0000","last_change":"2026-02-17T21:07:11.541544+0000","last_active":"2026-02-17T21:09:23.281403+0000","last_peered":"2026-02-17T21:09:23.281403+0000","last_clean":"2026-02-17T21:09:23.281403+0000","last_became_active":"2026-02-17T21:07:09.672479+0000","last_became_peered":"2026-02-17T21:07:09.672479+0000","last_unstale":"2026-02-17T21:09:23.281403+0000","last_undegraded":"2026-02-17T21:09:23.281403+0000","last_fullsized":"2026-02-17T21:09:23.281403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:18:00.047244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048238970999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:22.260632+0000","last_change":"2026-02-17T21:07:11.966086+0000","last_active":"2026-02-17T21:09:22.260632+0000","last_peered":"2026-02-17T21:09:22.260632+0000","last_clean":"2026-02-17T21:09:22.260632+0000","last_became_active":"2026-02-17T21:07:09.634301+0000","last_became_peered":"2026-02-17T21:07:09.634301+0000","last_unstale":"2026-02-17T21:09:22.260632+0000","last_undegraded":"2026-02-17T21:09:22.260632+0000","last_fullsized":"2026-02-17T21:09:22.260632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:14:59.089621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032567963999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:13.756342+0000","last_change":"2026-02-17T21:07:12.020919+0000","last_active":"2026-02-17T21:09:13.756342+0000","last_peered":"2026-02-17T21:09:13.756342+0000","last_clean":"2026-02-17T21:09:13.756342+0000","last_became_active":"2026-02-17T21:07:09.505342+0000","last_became_peered":"2026-02-17T21:07:09.505342+0000","last_unstale":"2026-02-17T21:09:13.756342+0000","last_undegraded":"2026-02-17T21:09:13.756342+0000","last_fullsized":"2026-02-17T21:09:13.756342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:24:24.816438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036804456999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:18.289377+0000","last_change":"2026-02-17T21:07:11.520216+0000","last_active":"2026-02-17T21:09:18.289377+0000","last_peered":"2026-02-17T21:09:18.289377+0000","last_clean":"2026-02-17T21:09:18.289377+0000","last_became_active":"2026-02-17T21:07:09.674257+0000","last_became_peered":"2026-02-17T21:07:09.674257+0000","last_unstale":"2026-02-17T21:09:18.289377+0000","last_undegraded":"2026-02-17T21:09:18.289377+0000","last_fullsized":"2026-02-17T21:09:18.289377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T04:40:26.586387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033871934999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:18.278369+0000","last_change":"2026-02-17T21:07:11.525598+0000","last_active":"2026-02-17T21:09:18.278369+0000","last_peered":"2026-02-17T21:09:18.278369+0000","last_clean":"2026-02-17T21:09:18.278369+0000","last_became_active":"2026-02-17T21:07:09.679096+0000","last_became_peered":"2026-02-17T21:07:09.679096+0000","last_unstale":"2026-02-17T21:09:18.278369+0000","last_undegraded":"2026-02-17T21:09:18.278369+0000","last_fullsized":"2026-02-17T21:09:18.278369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:24:33.818275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036788098999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:15.792752+0000","last_change":"2026-02-17T21:07:12.033028+0000","last_active":"2026-02-17T21:09:15.792752+0000","last_peered":"2026-02-17T21:09:15.792752+0000","last_clean":"2026-02-17T21:09:15.792752+0000","last_became_active":"2026-02-17T21:07:09.677404+0000","last_became_peered":"2026-02-17T21:07:09.677404+0000","last_unstale":"2026-02-17T21:09:15.792752+0000","last_undegraded":"2026-02-17T21:09:15.792752+0000","last_fullsized":"2026-02-17T21:09:15.792752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:08:16.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047884902999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:08.802367+0000","last_change":"2026-02-17T21:07:11.526917+0000","last_active":"2026-02-17T21:09:08.802367+0000","last_peered":"2026-02-17T21:09:08.802367+0000","last_clean":"2026-02-17T21:09:08.802367+0000","last_became_active":"2026-02-17T21:07:09.663986+0000","last_became_peered":"2026-02-17T21:07:09.663986+0000","last_unstale":"2026-02-17T21:09:08.802367+0000","last_undegraded":"2026-02-17T21:09:08.802367+0000","last_fullsized":"2026-02-17T21:09:08.802367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:14:51.518524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039512685999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:15.792988+0000","last_change":"2026-02-17T21:07:12.029142+0000","last_active":"2026-02-17T21:09:15.792988+0000","last_peered":"2026-02-17T21:09:15.792988+0000","last_clean":"2026-02-17T21:09:15.792988+0000","last_became_active":"2026-02-17T21:07:09.717514+0000","last_became_peered":"2026-02-17T21:07:09.717514+0000","last_unstale":"2026-02-17T21:09:15.792988+0000","last_undegraded":"2026-02-17T21:09:15.792988+0000","last_fullsized":"2026-02-17T21:09:15.792988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T03:32:38.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031434124000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"28'32","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:08:59.591648+0000","last_change":"2026-02-17T21:07:07.293203+0000","last_active":"2026-02-17T21:08:59.591648+0000","last_peered":"2026-02-17T21:08:59.591648+0000","last_clean":"2026-02-17T21:08:59.591648+0000","last_became_active":"2026-02-17T21:07:06.988047+0000","last_became_peered":"2026-02-17T21:07:06.988047+0000","last_unstale":"2026-02-17T21:08:59.591648+0000","last_undegraded":"2026-02-17T21:08:59.591648+0000","last_fullsized":"2026-02-17T21:08:59.591648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_clean_scrub_stamp":"2026-02-17T21:06:59.073039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:10.662342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":27,"seq":115964117062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,9,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":27,"seq":115964117062,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":27,"seq":115964117062,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280579,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280578,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,3,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280578,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149764,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":23,"seq":98784247874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":24,"seq":103079215170,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":26,"seq":111669149766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,2,4,5,6,7,8,9,10,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":26,"seq":111669149763,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,4,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":26,"seq":111669149766,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,3,4,6,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149765,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,3,4,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":27,"seq":115964117063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:12:20.199 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-17T21:12:20.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.274+0000 7fc2df761640 10 monclient: get_monmap_and_config 2026-02-17T21:12:20.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.274+0000 7fc2df761640 10 monclient: build_initial_monmap 2026-02-17T21:12:20.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.274+0000 7fc2df761640 10 monclient: monmap: 2026-02-17T21:12:20.268 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:20.268 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:20.268 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:20.275620+0000 2026-02-17T21:12:20.268 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:20.275620+0000 2026-02-17T21:12:20.268 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:20.268 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:20.268 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:20.269 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:20.269 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:20.269 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:20.269 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:20.269 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:20.269 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:20.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 1 Processor -- start 2026-02-17T21:12:20.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 1 -- start start 2026-02-17T21:12:20.269 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient: init 2026-02-17T21:12:20.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:20.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient: _add_conns ranks=[3,5,4,0,2,1] 2026-02-17T21:12:20.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc2d815d1e0 0x7fc2d815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:20.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient(hunting): picked mon.noname-a con 0x7fc2d815d1e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fc2d80748e0 0x7fc2d80c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient(hunting): picked mon.noname-c con 0x7fc2d80748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc2d80c90e0 0x7fc2d8153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient(hunting): picked mon.noname-b con 0x7fc2d80c90e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d80c9570 con 0x7fc2d815d1e0 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d80c5860 con 0x7fc2d80c90e0 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d80c5580 con 0x7fc2d80748e0 2026-02-17T21:12:20.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.275+0000 7fc2df761640 10 monclient(hunting): authenticate will time out at 1323.905743s 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dd4d6640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc2d815d1e0 0x7fc2d815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc2d80c90e0 0x7fc2d8153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dccd5640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fc2d80748e0 0x7fc2d80c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fc2d80c90e0 0x7fc2d8153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:37988/0 (socket says 10.20.193.45:37988) 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 1 -- 10.20.193.45:0/1352344684 learned_addr learned my addr 10.20.193.45:0/1352344684 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 10 monclient(hunting): get_auth_request con 0x7fc2d80c90e0 auth_method 0 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:20.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dccd5640 10 monclient(hunting): get_auth_request con 0x7fc2d80748e0 auth_method 0 2026-02-17T21:12:20.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dccd5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:20.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dccd5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:20.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dccd5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:20.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dd4d6640 10 monclient(hunting): get_auth_request con 0x7fc2d815d1e0 auth_method 0 2026-02-17T21:12:20.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dd4d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:20.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dd4d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:20.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dd4d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:20.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dccd5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dccd5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dccd5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2ddcd7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dd4d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dd4d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.276+0000 7fc2dd4d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 10 monclient(hunting): handle_auth_done global_id 5168 payload 274 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 1 -- 10.20.193.45:0/1352344684 >> v2:10.20.193.86:3300/0 conn(0x7fc2d80c90e0 msgr2=0x7fc2d8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:20.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 1 --2- 10.20.193.45:0/1352344684 >> v2:10.20.193.86:3300/0 conn(0x7fc2d80c90e0 0x7fc2d8153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 1 -- 10.20.193.45:0/1352344684 >> v2:10.20.193.45:3300/0 conn(0x7fc2d815d1e0 msgr2=0x7fc2d815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 1 --2- 10.20.193.45:0/1352344684 >> v2:10.20.193.45:3300/0 conn(0x7fc2d815d1e0 0x7fc2d815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 10 monclient: _finish_hunting 0 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 1 monclient: found mon.noname-c 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.277+0000 7fc2dccd5640 1 -- 10.20.193.45:0/1352344684 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d80c7de0 con 0x7fc2d80748e0 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.278+0000 7fc2dccd5640 1 --2- 10.20.193.45:0/1352344684 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d80748e0 0x7fc2d80c8ba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80c6af0 tx=0x7fc2cc02ede0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a792459a4c9c02 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 1 -- 10.20.193.45:0/1352344684 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc03c070 con 0x7fc2d80748e0 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:20.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 10 monclient: dump: 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:20.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 10 monclient: _finish_auth 0 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 1 -- 10.20.193.45:0/1352344684 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc02fa60 con 0x7fc2d80748e0 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2df761640 5 monclient: authenticate success, global_id 5168 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2df761640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2df761640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 1 -- 10.20.193.45:0/1352344684 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc02fe30 con 0x7fc2d80748e0 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2df761640 4 set_mon_vals no callback set 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:20.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2c7fff640 10 monclient: dump: 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2df761640 10 monclient: shutdown 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2df761640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:20.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2df761640 1 -- 10.20.193.45:0/1352344684 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d80748e0 msgr2=0x7fc2d80c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.280+0000 7fc2df761640 1 --2- 10.20.193.45:0/1352344684 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d80748e0 0x7fc2d80c8ba0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80c6af0 tx=0x7fc2cc02ede0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 -- 10.20.193.45:0/1352344684 shutdown_connections 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 --2- 10.20.193.45:0/1352344684 >> v2:10.20.193.86:3300/0 conn(0x7fc2d80c90e0 0x7fc2d8153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 --2- 10.20.193.45:0/1352344684 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d80748e0 0x7fc2d80c8ba0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 --2- 10.20.193.45:0/1352344684 >> v2:10.20.193.45:3300/0 conn(0x7fc2d815d1e0 0x7fc2d815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 -- 10.20.193.45:0/1352344684 >> 10.20.193.45:0/1352344684 conn(0x7fc2d80c9d40 msgr2=0x7fc2d80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 -- 10.20.193.45:0/1352344684 shutdown_connections 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 -- 10.20.193.45:0/1352344684 wait complete. 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 10 monclient: build_initial_monmap 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 10 monclient: monmap: 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:20.287 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 librados: starting msgr at 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 librados: starting objecter 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 Processor -- start 2026-02-17T21:12:20.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 -- start start 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 librados: setting wanted keys 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 1 librados: calling monclient init 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.281+0000 7fc2df761640 10 monclient: init 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc2d80748e0 0x7fc2d80cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient(hunting): picked mon.noname-a con 0x7fc2d80748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc2d80c90e0 0x7fc2d81f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient(hunting): picked mon.noname-b con 0x7fc2d80c90e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d815d1e0 0x7fc2d81f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient(hunting): picked mon.noname-c con 0x7fc2d815d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:20.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d80c8680 con 0x7fc2d80748e0 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d80c83a0 con 0x7fc2d80c90e0 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d8074d30 con 0x7fc2d815d1e0 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2df761640 10 monclient(hunting): authenticate will time out at 1323.912253s 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d815d1e0 0x7fc2d81f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dccd5640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc2d80c90e0 0x7fc2d81f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dd4d6640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc2d80748e0 0x7fc2d80cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d815d1e0 0x7fc2d81f7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:34808/0 (socket says 10.20.193.45:34808) 2026-02-17T21:12:20.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 1 -- 10.20.193.45:0/4116629689 learned_addr learned my addr 10.20.193.45:0/4116629689 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 10 monclient(hunting): get_auth_request con 0x7fc2d815d1e0 auth_method 0 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dccd5640 10 monclient(hunting): get_auth_request con 0x7fc2d80c90e0 auth_method 0 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dccd5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dccd5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dccd5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dd4d6640 10 monclient(hunting): get_auth_request con 0x7fc2d80748e0 auth_method 0 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dd4d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dd4d6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:20.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dd4d6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2ddcd7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dccd5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dccd5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dccd5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dd4d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dd4d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.282+0000 7fc2dd4d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 10 monclient(hunting): handle_auth_done global_id 5171 payload 824 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 1 -- 10.20.193.45:0/4116629689 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc2d80c90e0 msgr2=0x7fc2d81f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:20.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc2d80c90e0 0x7fc2d81f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 1 -- 10.20.193.45:0/4116629689 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc2d80748e0 msgr2=0x7fc2d80cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc2d80748e0 0x7fc2d80cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 10 monclient: _finish_hunting 0 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 1 monclient: found mon.noname-c 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.284+0000 7fc2ddcd7640 1 -- 10.20.193.45:0/4116629689 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d80cb2f0 con 0x7fc2d815d1e0 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.285+0000 7fc2ddcd7640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d815d1e0 0x7fc2d81f7270 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400efc0 tx=0x7fc2d400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.285+0000 7fc2c5ffb640 10 client.?.objecter ms_handle_connect 0x7fc2d815d1e0 2026-02-17T21:12:20.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.285+0000 7fc2c5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:20.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 1 -- 10.20.193.45:0/4116629689 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400cd30 con 0x7fc2d815d1e0 2026-02-17T21:12:20.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:20.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:20.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 10 monclient: dump: 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:20.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 1 -- 10.20.193.45:0/4116629689 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d4003a90 con 0x7fc2d815d1e0 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 1 -- 10.20.193.45:0/4116629689 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4003e60 con 0x7fc2d815d1e0 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c5ffb640 10 monclient: dump: 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.298 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2c77fe640 4 set_mon_vals no callback set 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2df761640 5 monclient: authenticate success, global_id 5171 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2df761640 10 monclient: _renew_subs 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2df761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d80cb5d0 con 0x7fc2d815d1e0 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2df761640 10 client.5171.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:20.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2df761640 10 monclient: _renew_subs 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2df761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d80cbb90 con 0x7fc2d815d1e0 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.286+0000 7fc2df761640 1 librados: init done 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.287+0000 7fc2df761640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.287+0000 7fc2df761640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.287+0000 7fc2df761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.287+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d80c8ba0 con 0x7fc2d815d1e0 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.298+0000 7fc2c5ffb640 1 -- 10.20.193.45:0/4116629689 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc2d4004030 con 0x7fc2d815d1e0 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.298+0000 7fc2c5ffb640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc2a8079280 0x7fc2a807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.298+0000 7fc2dd4d6640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc2a8079280 0x7fc2a807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.298+0000 7fc2dd4d6640 10 monclient: get_auth_request con 0x7fc2a8079280 auth_method 0 2026-02-17T21:12:20.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.299+0000 7fc2dd4d6640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc2a8079280 0x7fc2a807b740 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009b20 tx=0x7fc2c8009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:20.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.299+0000 7fc2c5ffb640 10 client.5171.objecter ms_handle_connect 0x7fc2a8079280 2026-02-17T21:12:20.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.300+0000 7fc2c5ffb640 1 -- 10.20.193.45:0/4116629689 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fc2d405f250 con 0x7fc2d815d1e0 2026-02-17T21:12:20.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.300+0000 7fc2c5ffb640 10 client.5171.objecter ms_dispatch2 0x7fc2d8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:20.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.300+0000 7fc2c5ffb640 3 client.5171.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:20.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.300+0000 7fc2c5ffb640 3 client.5171.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:20.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.300+0000 7fc2c5ffb640 20 client.5171.objecter dump_active .. 0 homeless 2026-02-17T21:12:20.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.400+0000 7fc2c5ffb640 1 -- 10.20.193.45:0/4116629689 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc2d4010040 con 0x7fc2d815d1e0 2026-02-17T21:12:20.392 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.400+0000 7fc2c5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:20.393 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.400+0000 7fc2c5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:20.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.485+0000 7fc2df761640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:12:20.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.485+0000 7fc2df761640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:12:20.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.485+0000 7fc2df761640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:20.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.485+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2d81573a0 con 0x7fc2d815d1e0 2026-02-17T21:12:20.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.503+0000 7fc2c5ffb640 1 -- 10.20.193.45:0/4116629689 <== mon.2 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+24537 (secure 0 0 0) 0x7fc2d4063210 con 0x7fc2d815d1e0 2026-02-17T21:12:20.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.503+0000 7fc2c5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-17T21:12:20.496 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.503+0000 7fc2c5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:12:20.497 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:20.497 INFO:teuthology.orchestra.run.trial045.stdout:{"epoch":33,"fsid":"d3d77e88-f8f0-42ae-9378-6b5f15ec2a21","created":"2026-02-17T21:05:15.899344+0000","modified":"2026-02-17T21:07:19.820412+0000","last_up_change":"2026-02-17T21:07:03.875560+0000","last_in_change":"2026-02-17T21:05:22.298564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T21:06:58.807280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-17T21:07:08.056677+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":32,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"31830c0d-8e16-47bd-b1a6-546e1944d058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6818","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6819","nonce":529906394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6820","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6821","nonce":529906394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6824","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6825","nonce":529906394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6822","nonce":529906394},{"type":"v1","addr":"10.20.193.45:6823","nonce":529906394}]},"public_addr":"10.20.193.45:6819/529906394","cluster_addr":"10.20.193.45:6821/529906394","heartbeat_back_addr":"10.20.193.45:6825/529906394","heartbeat_front_addr":"10.20.193.45:6823/529906394","state":["exists","up"]},{"osd":1,"uuid":"3ea1022b-6b00-44df-afe7-b679d0637204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6801","nonce":37724401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6803","nonce":37724401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6807","nonce":37724401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":37724401},{"type":"v1","addr":"10.20.193.86:6805","nonce":37724401}]},"public_addr":"10.20.193.86:6801/37724401","cluster_addr":"10.20.193.86:6803/37724401","heartbeat_back_addr":"10.20.193.86:6807/37724401","heartbeat_front_addr":"10.20.193.86:6805/37724401","state":["exists","up"]},{"osd":2,"uuid":"e088fe32-7558-495d-9a84-0dcdf57dd758","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6800","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6801","nonce":281465485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6803","nonce":281465485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6807","nonce":281465485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":281465485},{"type":"v1","addr":"10.20.193.92:6805","nonce":281465485}]},"public_addr":"10.20.193.92:6801/281465485","cluster_addr":"10.20.193.92:6803/281465485","heartbeat_back_addr":"10.20.193.92:6807/281465485","heartbeat_front_addr":"10.20.193.92:6805/281465485","state":["exists","up"]},{"osd":3,"uuid":"c0726e30-9389-4c16-b752-b4d98891f033","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6800","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6801","nonce":1535515312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6802","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6803","nonce":1535515312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6806","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6807","nonce":1535515312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6804","nonce":1535515312},{"type":"v1","addr":"10.20.193.138:6805","nonce":1535515312}]},"public_addr":"10.20.193.138:6801/1535515312","cluster_addr":"10.20.193.138:6803/1535515312","heartbeat_back_addr":"10.20.193.138:6807/1535515312","heartbeat_front_addr":"10.20.193.138:6805/1535515312","state":["exists","up"]},{"osd":4,"uuid":"1b94f7f3-20dc-451d-8972-4ae7544aa40e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6826","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6827","nonce":1457283840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6828","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6829","nonce":1457283840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6832","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6833","nonce":1457283840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6830","nonce":1457283840},{"type":"v1","addr":"10.20.193.45:6831","nonce":1457283840}]},"public_addr":"10.20.193.45:6827/1457283840","cluster_addr":"10.20.193.45:6829/1457283840","heartbeat_back_addr":"10.20.193.45:6833/1457283840","heartbeat_front_addr":"10.20.193.45:6831/1457283840","state":["exists","up"]},{"osd":5,"uuid":"c438b338-6996-487e-a503-2da9045e8da3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6824","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6825","nonce":63160539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6826","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6827","nonce":63160539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6830","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6831","nonce":63160539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6828","nonce":63160539},{"type":"v1","addr":"10.20.193.86:6829","nonce":63160539}]},"public_addr":"10.20.193.86:6825/63160539","cluster_addr":"10.20.193.86:6827/63160539","heartbeat_back_addr":"10.20.193.86:6831/63160539","heartbeat_front_addr":"10.20.193.86:6829/63160539","state":["exists","up"]},{"osd":6,"uuid":"e1204a4b-7cb0-4508-ae52-f3058f2b4322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6817","nonce":1142590747}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6819","nonce":1142590747}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6823","nonce":1142590747}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1142590747},{"type":"v1","addr":"10.20.193.92:6821","nonce":1142590747}]},"public_addr":"10.20.193.92:6817/1142590747","cluster_addr":"10.20.193.92:6819/1142590747","heartbeat_back_addr":"10.20.193.92:6823/1142590747","heartbeat_front_addr":"10.20.193.92:6821/1142590747","state":["exists","up"]},{"osd":7,"uuid":"9cb3ad9d-88bb-47b1-a4b4-8614b9804e84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6808","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6809","nonce":1754305677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6810","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6811","nonce":1754305677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6814","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6815","nonce":1754305677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6812","nonce":1754305677},{"type":"v1","addr":"10.20.193.138:6813","nonce":1754305677}]},"public_addr":"10.20.193.138:6809/1754305677","cluster_addr":"10.20.193.138:6811/1754305677","heartbeat_back_addr":"10.20.193.138:6815/1754305677","heartbeat_front_addr":"10.20.193.138:6813/1754305677","state":["exists","up"]},{"osd":8,"uuid":"d62163e3-9a75-4bef-b3df-7e87f1e24cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6810","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6811","nonce":442873512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6812","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6813","nonce":442873512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6816","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6817","nonce":442873512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6814","nonce":442873512},{"type":"v1","addr":"10.20.193.45:6815","nonce":442873512}]},"public_addr":"10.20.193.45:6811/442873512","cluster_addr":"10.20.193.45:6813/442873512","heartbeat_back_addr":"10.20.193.45:6817/442873512","heartbeat_front_addr":"10.20.193.45:6815/442873512","state":["exists","up"]},{"osd":9,"uuid":"16273fd7-3b1b-4112-8e88-b5affbf4bc8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6816","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6817","nonce":1248523526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6818","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6819","nonce":1248523526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6822","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6823","nonce":1248523526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6820","nonce":1248523526},{"type":"v1","addr":"10.20.193.86:6821","nonce":1248523526}]},"public_addr":"10.20.193.86:6817/1248523526","cluster_addr":"10.20.193.86:6819/1248523526","heartbeat_back_addr":"10.20.193.86:6823/1248523526","heartbeat_front_addr":"10.20.193.86:6821/1248523526","state":["exists","up"]},{"osd":10,"uuid":"c758558e-ee89-43fe-9807-a7b36f6b654a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6825","nonce":1170783250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6827","nonce":1170783250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6831","nonce":1170783250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":1170783250},{"type":"v1","addr":"10.20.193.92:6829","nonce":1170783250}]},"public_addr":"10.20.193.92:6825/1170783250","cluster_addr":"10.20.193.92:6827/1170783250","heartbeat_back_addr":"10.20.193.92:6831/1170783250","heartbeat_front_addr":"10.20.193.92:6829/1170783250","state":["exists","up"]},{"osd":11,"uuid":"513dc329-f3f0-4aab-99d6-d527f1ef950d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6824","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6825","nonce":4038031379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6826","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6827","nonce":4038031379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6830","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6831","nonce":4038031379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6828","nonce":4038031379},{"type":"v1","addr":"10.20.193.138:6829","nonce":4038031379}]},"public_addr":"10.20.193.138:6825/4038031379","cluster_addr":"10.20.193.138:6827/4038031379","heartbeat_back_addr":"10.20.193.138:6831/4038031379","heartbeat_front_addr":"10.20.193.138:6829/4038031379","state":["exists","up"]},{"osd":12,"uuid":"142201fe-4459-4101-8a4f-f0de73cef308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6802","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6803","nonce":1807719437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6804","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6805","nonce":1807719437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6808","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6809","nonce":1807719437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.45:6806","nonce":1807719437},{"type":"v1","addr":"10.20.193.45:6807","nonce":1807719437}]},"public_addr":"10.20.193.45:6803/1807719437","cluster_addr":"10.20.193.45:6805/1807719437","heartbeat_back_addr":"10.20.193.45:6809/1807719437","heartbeat_front_addr":"10.20.193.45:6807/1807719437","state":["exists","up"]},{"osd":13,"uuid":"013e64fd-3420-45b4-ba7d-565e30e81cea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6808","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6809","nonce":3260427089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6811","nonce":3260427089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6814","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6815","nonce":3260427089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6812","nonce":3260427089},{"type":"v1","addr":"10.20.193.86:6813","nonce":3260427089}]},"public_addr":"10.20.193.86:6809/3260427089","cluster_addr":"10.20.193.86:6811/3260427089","heartbeat_back_addr":"10.20.193.86:6815/3260427089","heartbeat_front_addr":"10.20.193.86:6813/3260427089","state":["exists","up"]},{"osd":14,"uuid":"0b5448b4-8299-481b-aa32-4912c651ef12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6809","nonce":1799526026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6811","nonce":1799526026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6815","nonce":1799526026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":1799526026},{"type":"v1","addr":"10.20.193.92:6813","nonce":1799526026}]},"public_addr":"10.20.193.92:6809/1799526026","cluster_addr":"10.20.193.92:6811/1799526026","heartbeat_back_addr":"10.20.193.92:6815/1799526026","heartbeat_front_addr":"10.20.193.92:6813/1799526026","state":["exists","up"]},{"osd":15,"uuid":"a57621e5-ccae-4b35-adb6-5f6d8ba3c6ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6816","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6817","nonce":3769626240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6818","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6819","nonce":3769626240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6822","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6823","nonce":3769626240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.138:6820","nonce":3769626240},{"type":"v1","addr":"10.20.193.138:6821","nonce":3769626240}]},"public_addr":"10.20.193.138:6817/3769626240","cluster_addr":"10.20.193.138:6819/3769626240","heartbeat_back_addr":"10.20.193.138:6823/3769626240","heartbeat_front_addr":"10.20.193.138:6821/3769626240","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.146672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.052295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.217450+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.256012+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.980302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.553824+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.474116+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.319384+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.275532+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.578309+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:58.653384+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.279721+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:55.236866+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.035025+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:57.697501+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T21:06:56.942416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T21:12:20.498 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.504+0000 7fc2df761640 10 librados: watch_flush enter 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 10 librados: watch_flush exit 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 20 client.5171.objecter shutdown clearing up homeless session... 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 10 client.5171.objecter successfully canceled tick 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc2a8079280 msgr2=0x7fc2a807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc2a8079280 0x7fc2a807b740 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009b20 tx=0x7fc2c8009290 comp rx=0 tx=0).stop 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 10 monclient: shutdown 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d815d1e0 msgr2=0x7fc2d81f7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d815d1e0 0x7fc2d81f7270 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400efc0 tx=0x7fc2d400c490 comp rx=0 tx=0).stop 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 shutdown_connections 2026-02-17T21:12:20.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc2a8079280 0x7fc2a807b740 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc2d815d1e0 0x7fc2d81f7270 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc2d80c90e0 0x7fc2d81f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 --2- 10.20.193.45:0/4116629689 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc2d80748e0 0x7fc2d80cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:20.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 >> 10.20.193.45:0/4116629689 conn(0x7fc2d80c9d40 msgr2=0x7fc2d8152860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:20.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 shutdown_connections 2026-02-17T21:12:20.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 -- 10.20.193.45:0/4116629689 wait complete. 2026-02-17T21:12:20.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:20.505+0000 7fc2df761640 1 librados: shutdown 2026-02-17T21:12:21.507 INFO:tasks.ceph:Scrubbing osd.0 2026-02-17T21:12:21.508 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:21.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.585+0000 7f3c3f8bd640 10 monclient: get_monmap_and_config 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.585+0000 7f3c3f8bd640 10 monclient: build_initial_monmap 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.585+0000 7f3c3f8bd640 10 monclient: monmap: 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:21.586112+0000 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:21.586112+0000 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:21.578 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:21.579 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:21.579 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:21.579 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:21.579 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:21.579 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.585+0000 7f3c3f8bd640 1 Processor -- start 2026-02-17T21:12:21.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.585+0000 7f3c3f8bd640 1 -- start start 2026-02-17T21:12:21.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.585+0000 7f3c3f8bd640 10 monclient: init 2026-02-17T21:12:21.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:21.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 10 monclient: _add_conns ranks=[5,1,4,0,2,3] 2026-02-17T21:12:21.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3c38156030 0x7f3c3815c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 10 monclient(hunting): picked mon.noname-c con 0x7f3c38156030 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:21.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3c38070870 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:21.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3c3815c850 0x7f3c380cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 10 monclient(hunting): picked mon.noname-b con 0x7f3c3815c850 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c3815ccc0 con 0x7f3c38070870 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3c3815be80 con 0x7f3c3815c850 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3c38156410 con 0x7f3c38156030 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3f8bd640 10 monclient(hunting): authenticate will time out at 1325.216464s 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.586+0000 7f3c3d632640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3c38156030 0x7f3c3815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3de33640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3c3815c850 0x7f3c380cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3d632640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f3c38156030 0x7f3c3815c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:34810/0 (socket says 10.20.193.45:34810) 2026-02-17T21:12:21.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3d632640 1 -- 10.20.193.45:0/2430061293 learned_addr learned my addr 10.20.193.45:0/2430061293 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3d632640 10 monclient(hunting): get_auth_request con 0x7f3c38156030 auth_method 0 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3d632640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3d632640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3d632640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3de33640 10 monclient(hunting): get_auth_request con 0x7f3c3815c850 auth_method 0 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3de33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3de33640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3de33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3d632640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3d632640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3d632640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3de33640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3de33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.587+0000 7f3c3de33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.588+0000 7f3c3d632640 10 monclient(hunting): handle_auth_done global_id 5174 payload 274 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.588+0000 7f3c3d632640 1 -- 10.20.193.45:0/2430061293 >> v2:10.20.193.86:3300/0 conn(0x7f3c3815c850 msgr2=0x7f3c380cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.588+0000 7f3c3d632640 1 --2- 10.20.193.45:0/2430061293 >> v2:10.20.193.86:3300/0 conn(0x7f3c3815c850 0x7f3c380cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.588+0000 7f3c3d632640 1 -- 10.20.193.45:0/2430061293 >> v1:10.20.193.86:6789/0 conn(0x7f3c38070870 legacy=0x7f3c380caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.588+0000 7f3c3d632640 10 monclient: _finish_hunting 0 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.588+0000 7f3c3d632640 1 monclient: found mon.noname-c 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.588+0000 7f3c3d632640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.588+0000 7f3c3d632640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.588+0000 7f3c3d632640 1 -- 10.20.193.45:0/2430061293 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3815f610 con 0x7f3c38156030 2026-02-17T21:12:21.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.589+0000 7f3c3d632640 1 --2- 10.20.193.45:0/2430061293 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38156030 0x7f3c3815c310 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c380cbf60 tx=0x7f3c2802f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2d8721354f46d50 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:21.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 1 -- 10.20.193.45:0/2430061293 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2803c070 con 0x7f3c38156030 2026-02-17T21:12:21.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 10 monclient: dump: 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:21.593 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 10 monclient: _finish_auth 0 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 1 -- 10.20.193.45:0/2430061293 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c2802fc30 con 0x7f3c38156030 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 5 monclient: authenticate success, global_id 5174 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 1 -- 10.20.193.45:0/2430061293 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28037440 con 0x7f3c38156030 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 4 set_mon_vals no callback set 2026-02-17T21:12:21.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c27fff640 10 monclient: dump: 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:21.595 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 10 monclient: shutdown 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/2430061293 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38156030 msgr2=0x7f3c3815c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 1 --2- 10.20.193.45:0/2430061293 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38156030 0x7f3c3815c310 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c380cbf60 tx=0x7f3c2802f000 comp rx=0 tx=0).stop 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/2430061293 shutdown_connections 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 1 --2- 10.20.193.45:0/2430061293 >> v2:10.20.193.86:3300/0 conn(0x7f3c3815c850 0x7f3c380cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 1 --2- 10.20.193.45:0/2430061293 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38156030 0x7f3c3815c310 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/2430061293 >> 10.20.193.45:0/2430061293 conn(0x7f3c380cbfb0 msgr2=0x7f3c380cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/2430061293 shutdown_connections 2026-02-17T21:12:21.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.591+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/2430061293 wait complete. 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient: build_initial_monmap 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient: monmap: 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:21.597 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 librados: starting msgr at 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 librados: starting objecter 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 Processor -- start 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 -- start start 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 librados: setting wanted keys 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 librados: calling monclient init 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient: init 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38070870 0x7f3c381e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient(hunting): picked mon.noname-c con 0x7f3c38070870 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:21.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3c38156030 0x7f3c381f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient(hunting): picked mon.noname-b con 0x7f3c38156030 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3c3815c850 0x7f3c380ce920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient(hunting): picked mon.noname-a con 0x7f3c3815c850 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3815feb0 con 0x7f3c3815c850 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3815fbd0 con 0x7f3c38156030 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c38160190 con 0x7f3c38070870 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.592+0000 7f3c3f8bd640 10 monclient(hunting): authenticate will time out at 1325.222740s 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38070870 0x7f3c381e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3ce31640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3c38156030 0x7f3c381f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3de33640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3c3815c850 0x7f3c380ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38070870 0x7f3c381e74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:34822/0 (socket says 10.20.193.45:34822) 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 1 -- 10.20.193.45:0/1444117333 learned_addr learned my addr 10.20.193.45:0/1444117333 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 10 monclient(hunting): get_auth_request con 0x7f3c38070870 auth_method 0 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3ce31640 10 monclient(hunting): get_auth_request con 0x7f3c38156030 auth_method 0 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3ce31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3ce31640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3ce31640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3de33640 10 monclient(hunting): get_auth_request con 0x7f3c3815c850 auth_method 0 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3de33640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3de33640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3de33640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3d632640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3ce31640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3ce31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3ce31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3de33640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3de33640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.593+0000 7f3c3de33640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 10 monclient(hunting): handle_auth_done global_id 5177 payload 824 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 1 -- 10.20.193.45:0/1444117333 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3c38156030 msgr2=0x7f3c381f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3c38156030 0x7f3c381f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 1 -- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3c3815c850 msgr2=0x7f3c380ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3c3815c850 0x7f3c380ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 10 monclient: _finish_hunting 0 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 1 monclient: found mon.noname-c 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.594+0000 7f3c3d632640 1 -- 10.20.193.45:0/1444117333 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c381e92e0 con 0x7f3c38070870 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.596+0000 7f3c3d632640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38070870 0x7f3c381e74a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3c2802f510 tx=0x7f3c280047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:21.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.596+0000 7f3c25ffb640 10 client.?.objecter ms_handle_connect 0x7f3c38070870 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.596+0000 7f3c25ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c25ffb640 1 -- 10.20.193.45:0/1444117333 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2803c040 con 0x7f3c38070870 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c25ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c25ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c25ffb640 10 monclient: dump: 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:21.603 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c25ffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c25ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c25ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c3f8bd640 5 monclient: authenticate success, global_id 5177 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c3f8bd640 10 monclient: _renew_subs 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c3f8bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c381e95c0 con 0x7f3c38070870 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c3f8bd640 10 client.5177.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c3f8bd640 10 monclient: _renew_subs 2026-02-17T21:12:21.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c3f8bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c381e9b80 con 0x7f3c38070870 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.598+0000 7f3c3f8bd640 1 librados: init done 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c3f8bd640 10 client.5177.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c3f8bd640 15 client.5177.objecter _session_command_op_assign -1 1 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c3f8bd640 20 client.5177.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c3f8bd640 10 client.5177.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c3f8bd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c3815f2d0 con 0x7f3c38070870 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c25ffb640 1 -- 10.20.193.45:0/1444117333 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3815f2d0 con 0x7f3c38070870 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c25ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c25ffb640 1 -- 10.20.193.45:0/1444117333 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c28055630 con 0x7f3c38070870 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c25ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:21.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c25ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c25ffb640 10 monclient: dump: 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.599+0000 7f3c277fe640 4 set_mon_vals no callback set 2026-02-17T21:12:21.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.612+0000 7f3c25ffb640 1 -- 10.20.193.45:0/1444117333 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f3c280557d0 con 0x7f3c38070870 2026-02-17T21:12:21.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.613+0000 7f3c25ffb640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3c08079280 0x7f3c0807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.613+0000 7f3c3ce31640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3c08079280 0x7f3c0807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.613+0000 7f3c3ce31640 10 monclient: get_auth_request con 0x7f3c08079280 auth_method 0 2026-02-17T21:12:21.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.613+0000 7f3c3ce31640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3c08079280 0x7f3c0807b740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3c380cbbf0 tx=0x7f3c2c0091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:21.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.613+0000 7f3c25ffb640 10 client.5177.objecter ms_handle_connect 0x7f3c08079280 2026-02-17T21:12:21.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 1 -- 10.20.193.45:0/1444117333 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f3c280bd390 con 0x7f3c38070870 2026-02-17T21:12:21.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 10 client.5177.objecter ms_dispatch2 0x7f3c38000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:21.609 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 3 client.5177.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 3 client.5177.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 10 client.5177.objecter checking command 1 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7f3c08081760 0x7f3c08083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 20 client.5177.objecter _get_session s=0x7f3c08081090 osd=0 3 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 20 client.5177.objecter put_session s=0x7f3c08081090 osd=0 3 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 15 client.5177.objecter _session_command_op_remove -1 1 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 20 client.5177.objecter _get_session s=0x7f3c08081090 osd=0 3 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 20 client.5177.objecter get_session s=0x7f3c08081090 osd=0 3 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 15 client.5177.objecter _session_command_op_assign 0 1 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 20 client.5177.objecter put_session s=0x7f3c08081090 osd=0 4 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 10 client.5177.objecter _send_command 1 2026-02-17T21:12:21.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 1 -- 10.20.193.45:0/1444117333 --> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c2804ee80 con 0x7f3c08081760 2026-02-17T21:12:21.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 20 client.5177.objecter dump_active .. 0 homeless 2026-02-17T21:12:21.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 1 -- 10.20.193.45:0/1444117333 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3c28083c90 con 0x7f3c38070870 2026-02-17T21:12:21.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c25ffb640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:21.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.614+0000 7f3c3de33640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7f3c08081760 0x7f3c08083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.615+0000 7f3c3de33640 10 monclient: get_auth_request con 0x7f3c08081760 auth_method 0 2026-02-17T21:12:21.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.616+0000 7f3c3de33640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7f3c08081760 0x7f3c08083b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:21.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.616+0000 7f3c25ffb640 10 client.5177.objecter ms_handle_connect 0x7f3c08081760 2026-02-17T21:12:21.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.626+0000 7f3c25ffb640 1 -- 10.20.193.45:0/1444117333 <== osd.0 v2:10.20.193.45:6818/529906394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f3c2804ee80 con 0x7f3c08081760 2026-02-17T21:12:21.618 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.626+0000 7f3c25ffb640 10 client.5177.objecter ms_dispatch2 0x7f3c38000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:21.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.626+0000 7f3c25ffb640 10 client.5177.objecter _finish_command 1 = system:0 2026-02-17T21:12:21.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.626+0000 7f3c25ffb640 20 client.5177.objecter put_session s=0x7f3c08081090 osd=0 4 2026-02-17T21:12:21.619 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.626+0000 7f3c25ffb640 15 client.5177.objecter _session_command_op_remove 0 1 2026-02-17T21:12:21.624 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 10 client.5177.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 15 client.5177.objecter _session_command_op_assign -1 2 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 20 client.5177.objecter _get_session s=0x7f3c08081090 osd=0 3 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 20 client.5177.objecter put_session s=0x7f3c08081090 osd=0 3 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 20 client.5177.objecter _get_session s=0x7f3c08081090 osd=0 3 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 15 client.5177.objecter _session_command_op_remove -1 2 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 20 client.5177.objecter get_session s=0x7f3c08081090 osd=0 3 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 15 client.5177.objecter _session_command_op_assign 0 2 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 20 client.5177.objecter put_session s=0x7f3c08081090 osd=0 4 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 10 client.5177.objecter _send_command 2 2026-02-17T21:12:21.625 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.632+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 --> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3c38159700 con 0x7f3c08081760 2026-02-17T21:12:21.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c25ffb640 1 -- 10.20.193.45:0/1444117333 <== osd.0 v2:10.20.193.45:6818/529906394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3c38159700 con 0x7f3c08081760 2026-02-17T21:12:21.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c25ffb640 10 client.5177.objecter ms_dispatch2 0x7f3c38000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:21.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c25ffb640 10 client.5177.objecter _finish_command 2 = system:0 2026-02-17T21:12:21.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c25ffb640 20 client.5177.objecter put_session s=0x7f3c08081090 osd=0 4 2026-02-17T21:12:21.632 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c25ffb640 15 client.5177.objecter _session_command_op_remove 0 2 2026-02-17T21:12:21.632 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:21.633 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:21.633 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:21.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 10 librados: watch_flush enter 2026-02-17T21:12:21.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 10 librados: watch_flush exit 2026-02-17T21:12:21.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 10 client.5177.objecter close_session for osd.0 2026-02-17T21:12:21.634 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7f3c08081760 msgr2=0x7f3c08083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6818/529906394,v1:10.20.193.45:6819/529906394] conn(0x7f3c08081760 0x7f3c08083b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 20 client.5177.objecter put_session s=0x7f3c08081090 osd=0 1 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 20 client.5177.objecter shutdown clearing up homeless session... 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 10 client.5177.objecter successfully canceled tick 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3c08079280 msgr2=0x7f3c0807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3c08079280 0x7f3c0807b740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3c380cbbf0 tx=0x7f3c2c0091c0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 10 monclient: shutdown 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38070870 msgr2=0x7f3c381e74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 --2- 10.20.193.45:0/1444117333 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3c38070870 0x7f3c381e74a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3c2802f510 tx=0x7f3c280047c0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3de33640 1 -- 10.20.193.45:0/1444117333 reap_dead start 2026-02-17T21:12:21.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 shutdown_connections 2026-02-17T21:12:21.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 >> 10.20.193.45:0/1444117333 conn(0x7f3c380cbfb0 msgr2=0x7f3c380cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:21.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 shutdown_connections 2026-02-17T21:12:21.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 -- 10.20.193.45:0/1444117333 wait complete. 2026-02-17T21:12:21.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.639+0000 7f3c3f8bd640 1 librados: shutdown 2026-02-17T21:12:21.640 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-17T21:12:21.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.716+0000 7f279db7e640 10 monclient: get_monmap_and_config 2026-02-17T21:12:21.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.716+0000 7f279db7e640 10 monclient: build_initial_monmap 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.716+0000 7f279db7e640 10 monclient: monmap: 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:21.716982+0000 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:21.716982+0000 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:21.709 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:21.710 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:21.710 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:21.710 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.716+0000 7f279db7e640 1 Processor -- start 2026-02-17T21:12:21.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.716+0000 7f279db7e640 1 -- start start 2026-02-17T21:12:21.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.716+0000 7f279db7e640 10 monclient: init 2026-02-17T21:12:21.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:21.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 10 monclient: _add_conns ranks=[5,0,4,1,2,3] 2026-02-17T21:12:21.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f279815d1e0 0x7f279815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 10 monclient(hunting): picked mon.noname-c con 0x7f279815d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:21.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f27980748e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:21.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f27980c92b0 0x7f2798153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 10 monclient(hunting): picked mon.noname-b con 0x7f27980c92b0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27980c5860 con 0x7f27980748e0 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f27980c5580 con 0x7f27980c92b0 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f27980c7de0 con 0x7f279815d1e0 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f279db7e640 10 monclient(hunting): authenticate will time out at 1325.347092s 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f2797fff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f27980c92b0 0x7f2798153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f27977fe640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f279815d1e0 0x7f279815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f2796ffd640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f27980748e0 0x7f27980c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:40346/0 (socket says 10.20.193.45:40346) 2026-02-17T21:12:21.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f2796ffd640 1 -- 10.20.193.45:0/3516641021 learned_addr learned my addr 10.20.193.45:0/3516641021 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f2797fff640 10 monclient(hunting): get_auth_request con 0x7f27980c92b0 auth_method 0 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f2797fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f2797fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f2797fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f27977fe640 10 monclient(hunting): get_auth_request con 0x7f279815d1e0 auth_method 0 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f27977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f27977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.717+0000 7f27977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f27977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f27977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f27977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 10 monclient(hunting): handle_auth_done global_id 5146 payload 274 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 1 -- 10.20.193.45:0/3516641021 >> v2:10.20.193.92:3300/0 conn(0x7f279815d1e0 msgr2=0x7f279815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 1 --2- 10.20.193.45:0/3516641021 >> v2:10.20.193.92:3300/0 conn(0x7f279815d1e0 0x7f279815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 1 -- 10.20.193.45:0/3516641021 >> v1:10.20.193.45:6789/0 conn(0x7f27980748e0 legacy=0x7f27980c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 1 monclient: found mon.noname-b 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.718+0000 7f2797fff640 1 -- 10.20.193.45:0/3516641021 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27980c80c0 con 0x7f27980c92b0 2026-02-17T21:12:21.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.719+0000 7f2797fff640 1 --2- 10.20.193.45:0/3516641021 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 0x7f2798153610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f278c009d90 tx=0x7f278c02f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb20a38cab23ef6e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:21.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 1 -- 10.20.193.45:0/3516641021 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c03c070 con 0x7f27980c92b0 2026-02-17T21:12:21.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:21.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:21.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 10 monclient: dump: 2026-02-17T21:12:21.723 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 10 monclient: _finish_auth 0 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 10 monclient: _check_auth_tickets 2026-02-17T21:12:21.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 1 -- 10.20.193.45:0/3516641021 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278c037440 con 0x7f27980c92b0 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 1 -- 10.20.193.45:0/3516641021 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c037810 con 0x7f27980c92b0 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f279db7e640 5 monclient: authenticate success, global_id 5146 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f279db7e640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f279db7e640 4 set_mon_vals no callback set 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.721+0000 7f27967fc640 10 monclient: dump: 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.725 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 10 monclient: shutdown 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 1 -- 10.20.193.45:0/3516641021 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 msgr2=0x7f2798153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 1 --2- 10.20.193.45:0/3516641021 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 0x7f2798153610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f278c009d90 tx=0x7f278c02f1f0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 1 -- 10.20.193.45:0/3516641021 shutdown_connections 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 1 --2- 10.20.193.45:0/3516641021 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 0x7f2798153610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 1 --2- 10.20.193.45:0/3516641021 >> v2:10.20.193.92:3300/0 conn(0x7f279815d1e0 0x7f279815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 1 -- 10.20.193.45:0/3516641021 >> 10.20.193.45:0/3516641021 conn(0x7f27980c9d40 msgr2=0x7f27980ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 1 -- 10.20.193.45:0/3516641021 shutdown_connections 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 1 -- 10.20.193.45:0/3516641021 wait complete. 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 10 monclient: build_initial_monmap 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.722+0000 7f279db7e640 10 monclient: monmap: 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:21.727 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 librados: starting msgr at 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 librados: starting objecter 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 Processor -- start 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 -- start start 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 librados: setting wanted keys 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 librados: calling monclient init 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient: init 2026-02-17T21:12:21.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f27980748e0 0x7f27981e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient(hunting): picked mon.noname-a con 0x7f27980748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 0x7f27981e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient(hunting): picked mon.noname-b con 0x7f27980c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f279815d1e0 0x7f279806db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient(hunting): picked mon.noname-c con 0x7f279815d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2798074d30 con 0x7f27980748e0 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f27980c8680 con 0x7f27980c92b0 2026-02-17T21:12:21.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2798153b50 con 0x7f279815d1e0 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f279db7e640 10 monclient(hunting): authenticate will time out at 1325.353579s 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f27977fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f27980748e0 0x7f27981e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.723+0000 7f2796ffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 0x7f27981e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2796ffd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 0x7f27981e62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38046/0 (socket says 10.20.193.45:38046) 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2796ffd640 1 -- 10.20.193.45:0/870411775 learned_addr learned my addr 10.20.193.45:0/870411775 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2796ffd640 10 monclient(hunting): get_auth_request con 0x7f27980c92b0 auth_method 0 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2796ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2796ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2796ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f27977fe640 10 monclient(hunting): get_auth_request con 0x7f27980748e0 auth_method 0 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f27977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f27977fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f27977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2797fff640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f279815d1e0 0x7f279806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2796ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2796ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2796ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2797fff640 10 monclient(hunting): get_auth_request con 0x7f279815d1e0 auth_method 0 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2797fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2797fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2797fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:21.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f27977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f27977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f27977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2797fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2797fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.724+0000 7f2797fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 10 monclient(hunting): handle_auth_done global_id 5149 payload 824 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 1 -- 10.20.193.45:0/870411775 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f279815d1e0 msgr2=0x7f279806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f279815d1e0 0x7f279806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 1 -- 10.20.193.45:0/870411775 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f27980748e0 msgr2=0x7f27981e5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f27980748e0 0x7f27981e5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:21.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 1 monclient: found mon.noname-b 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.725+0000 7f2796ffd640 1 -- 10.20.193.45:0/870411775 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279806eae0 con 0x7f27980c92b0 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.726+0000 7f2796ffd640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 0x7f27981e62c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f278800c730 tx=0x7f278800cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.726+0000 7f2773fff640 10 client.?.objecter ms_handle_connect 0x7f27980c92b0 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.726+0000 7f2773fff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 1 -- 10.20.193.45:0/870411775 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788017070 con 0x7f27980c92b0 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 10 monclient: dump: 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.733 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 10 monclient: _finish_auth 0 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 1 -- 10.20.193.45:0/870411775 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2788005b90 con 0x7f27980c92b0 2026-02-17T21:12:21.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 1 -- 10.20.193.45:0/870411775 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788007070 con 0x7f27980c92b0 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2773fff640 10 monclient: dump: 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:21.735 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f2795ffb640 4 set_mon_vals no callback set 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f279db7e640 5 monclient: authenticate success, global_id 5149 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f279db7e640 10 monclient: _renew_subs 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f279db7e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279806e800 con 0x7f27980c92b0 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f279db7e640 10 client.5149.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f279db7e640 10 monclient: _renew_subs 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f279db7e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27981e52a0 con 0x7f27980c92b0 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.728+0000 7f279db7e640 1 librados: init done 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.729+0000 7f279db7e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:21.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.729+0000 7f279db7e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:21.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.729+0000 7f279db7e640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:21.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.729+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279814fb60 con 0x7f27980c92b0 2026-02-17T21:12:21.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.740+0000 7f2773fff640 1 -- 10.20.193.45:0/870411775 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f2788007210 con 0x7f27980c92b0 2026-02-17T21:12:21.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.741+0000 7f2773fff640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f27680792d0 0x7f276807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:21.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.741+0000 7f27977fe640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f27680792d0 0x7f276807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:21.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.741+0000 7f27977fe640 10 monclient: get_auth_request con 0x7f27680792d0 auth_method 0 2026-02-17T21:12:21.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.741+0000 7f27977fe640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f27680792d0 0x7f276807b790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2784009ba0 tx=0x7f2784009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:21.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.741+0000 7f2773fff640 10 client.5149.objecter ms_handle_connect 0x7f27680792d0 2026-02-17T21:12:21.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.742+0000 7f2773fff640 1 -- 10.20.193.45:0/870411775 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f278805d840 con 0x7f27980c92b0 2026-02-17T21:12:21.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.742+0000 7f2773fff640 10 client.5149.objecter ms_dispatch2 0x7f2798000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:21.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.742+0000 7f2773fff640 3 client.5149.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:21.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.742+0000 7f2773fff640 3 client.5149.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:21.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.742+0000 7f2773fff640 20 client.5149.objecter dump_active .. 0 homeless 2026-02-17T21:12:21.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.845+0000 7f2773fff640 1 -- 10.20.193.45:0/870411775 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f279814fb60 con 0x7f27980c92b0 2026-02-17T21:12:21.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.845+0000 7f2773fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:21.838 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.845+0000 7f2773fff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:21.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.931+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f2798153f30 con 0x7f27680792d0 2026-02-17T21:12:21.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.931+0000 7f2773fff640 1 -- 10.20.193.45:0/870411775 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2798153f30 con 0x7f27680792d0 2026-02-17T21:12:21.924 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 0 to deep-scrub 2026-02-17T21:12:21.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 10 librados: watch_flush enter 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 10 librados: watch_flush exit 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 20 client.5149.objecter shutdown clearing up homeless session... 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 10 client.5149.objecter successfully canceled tick 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f27680792d0 msgr2=0x7f276807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f27680792d0 0x7f276807b790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2784009ba0 tx=0x7f2784009290 comp rx=0 tx=0).stop 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 10 monclient: shutdown 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 msgr2=0x7f27981e62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 0x7f27981e62c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f278800c730 tx=0x7f278800cc00 comp rx=0 tx=0).stop 2026-02-17T21:12:21.927 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 shutdown_connections 2026-02-17T21:12:21.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f27680792d0 0x7f276807b790 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f279815d1e0 0x7f279806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f27980c92b0 0x7f27981e62c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 --2- 10.20.193.45:0/870411775 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f27980748e0 0x7f27981e5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:21.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 >> 10.20.193.45:0/870411775 conn(0x7f27980c9d40 msgr2=0x7f27981e8160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:21.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 shutdown_connections 2026-02-17T21:12:21.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 -- 10.20.193.45:0/870411775 wait complete. 2026-02-17T21:12:21.928 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:21.933+0000 7f279db7e640 1 librados: shutdown 2026-02-17T21:12:21.935 INFO:tasks.ceph:Scrubbing osd.4 2026-02-17T21:12:21.935 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:22.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.012+0000 7ffa02987640 10 monclient: get_monmap_and_config 2026-02-17T21:12:22.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.012+0000 7ffa02987640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.012+0000 7ffa02987640 10 monclient: monmap: 2026-02-17T21:12:22.005 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.005 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.005 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:22.013557+0000 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:22.013557+0000 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:22.006 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 1 Processor -- start 2026-02-17T21:12:22.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 1 -- start start 2026-02-17T21:12:22.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 10 monclient: init 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 10 monclient: _add_conns ranks=[0,3,1,4,5,2] 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff9fc1503c0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ff9fc15d020 0x7ff9fc15d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 10 monclient(hunting): picked mon.noname-a con 0x7ff9fc15d020 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff9fc0c4740 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9fc0c55a0 con 0x7ff9fc1503c0 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9fc0c52c0 con 0x7ff9fc0c4740 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7ff9fc159c40 con 0x7ff9fc15d020 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.013+0000 7ffa02987640 10 monclient(hunting): authenticate will time out at 1325.643715s 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.014+0000 7ffa00efd640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7ff9fc0c4740 0x7ff9fc0c6a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:46738/0 (socket says 10.20.193.45:46738) 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.014+0000 7ffa00efd640 1 -- 10.20.193.45:0/3302744839 learned_addr learned my addr 10.20.193.45:0/3302744839 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.014+0000 7ff9fb7fe640 1 --2- 10.20.193.45:0/3302744839 >> v2:10.20.193.45:3300/0 conn(0x7ff9fc15d020 0x7ff9fc15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.014+0000 7ff9fb7fe640 10 monclient(hunting): get_auth_request con 0x7ff9fc15d020 auth_method 0 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.014+0000 7ff9fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.014+0000 7ff9fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.014+0000 7ff9fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.015+0000 7ff9fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.015+0000 7ff9fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.015+0000 7ff9fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.015+0000 7ff9faffd640 1 -- 10.20.193.45:0/3302744839 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253474580 0 0) 0x7ff9fc0c52c0 con 0x7ff9fc0c4740 2026-02-17T21:12:22.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.015+0000 7ff9faffd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.015+0000 7ff9faffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.015+0000 7ff9faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.015+0000 7ff9faffd640 10 monclient(hunting): my global_id is 5152 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.015+0000 7ff9faffd640 1 -- 10.20.193.45:0/3302744839 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9e0003620 con 0x7ff9fc0c4740 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.016+0000 7ff9fb7fe640 10 monclient(hunting): handle_auth_done global_id 5088 payload 274 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.016+0000 7ff9fb7fe640 1 -- 10.20.193.45:0/3302744839 >> v1:10.20.193.86:6789/0 conn(0x7ff9fc0c4740 legacy=0x7ff9fc0c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.016+0000 7ff9fb7fe640 1 -- 10.20.193.45:0/3302744839 >> v1:10.20.193.45:6789/0 conn(0x7ff9fc1503c0 legacy=0x7ff9fc06fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.016+0000 7ff9fb7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.016+0000 7ff9fb7fe640 1 monclient: found mon.noname-a 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.016+0000 7ff9fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.016+0000 7ff9fb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:22.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.016+0000 7ff9fb7fe640 1 -- 10.20.193.45:0/3302744839 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc159f20 con 0x7ff9fc15d020 2026-02-17T21:12:22.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.018+0000 7ff9fb7fe640 1 --2- 10.20.193.45:0/3302744839 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 0x7ff9fc15d490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0098a0 tx=0x7ff9ec02ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305f071b1c1b93b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 1 -- 10.20.193.45:0/3302744839 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec03c070 con 0x7ff9fc15d020 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 10 monclient: dump: 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.018 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 1 -- 10.20.193.45:0/3302744839 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec02fc10 con 0x7ff9fc15d020 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 1 -- 10.20.193.45:0/3302744839 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec037440 con 0x7ff9fc15d020 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:22.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ff9faffd640 10 monclient: dump: 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ffa02987640 5 monclient: authenticate success, global_id 5088 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ffa02987640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:22.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ffa02987640 4 set_mon_vals no callback set 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ffa02987640 10 monclient: shutdown 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ffa02987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ffa02987640 1 -- 10.20.193.45:0/3302744839 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 msgr2=0x7ff9fc15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.020+0000 7ffa02987640 1 --2- 10.20.193.45:0/3302744839 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 0x7ff9fc15d490 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0098a0 tx=0x7ff9ec02ef00 comp rx=0 tx=0).stop 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 -- 10.20.193.45:0/3302744839 shutdown_connections 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 --2- 10.20.193.45:0/3302744839 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 0x7ff9fc15d490 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 -- 10.20.193.45:0/3302744839 >> 10.20.193.45:0/3302744839 conn(0x7ff9fc0cd520 msgr2=0x7ff9fc0cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 -- 10.20.193.45:0/3302744839 shutdown_connections 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 -- 10.20.193.45:0/3302744839 wait complete. 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 10 monclient: monmap: 2026-02-17T21:12:22.021 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 librados: starting msgr at 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 librados: starting objecter 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 Processor -- start 2026-02-17T21:12:22.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 -- start start 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 librados: setting wanted keys 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 1 librados: calling monclient init 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.021+0000 7ffa02987640 10 monclient: init 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9fc0c4740 0x7ff9fc1e63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient(hunting): picked mon.noname-c con 0x7ff9fc0c4740 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9fc1503c0 0x7ff9fc158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient(hunting): picked mon.noname-b con 0x7ff9fc1503c0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 0x7ff9fc1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient(hunting): picked mon.noname-a con 0x7ff9fc15d020 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:22.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc0704d0 con 0x7ff9fc15d020 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc15a4e0 con 0x7ff9fc1503c0 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc1507a0 con 0x7ff9fc0c4740 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa02987640 10 monclient(hunting): authenticate will time out at 1325.652320s 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa00efd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 0x7ff9fc1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fb7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9fc1503c0 0x7ff9fc158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fbfff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9fc0c4740 0x7ff9fc1e63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa00efd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 0x7ff9fc1593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36400/0 (socket says 10.20.193.45:36400) 2026-02-17T21:12:22.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa00efd640 1 -- 10.20.193.45:0/1860790964 learned_addr learned my addr 10.20.193.45:0/1860790964 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa00efd640 10 monclient(hunting): get_auth_request con 0x7ff9fc15d020 auth_method 0 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa00efd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa00efd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa00efd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fb7fe640 10 monclient(hunting): get_auth_request con 0x7ff9fc1503c0 auth_method 0 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fbfff640 10 monclient(hunting): get_auth_request con 0x7ff9fc0c4740 auth_method 0 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ff9fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.022+0000 7ffa00efd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.023+0000 7ffa00efd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.023+0000 7ffa00efd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.023+0000 7ff9fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.023+0000 7ff9fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.023+0000 7ff9fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.023+0000 7ff9fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.023+0000 7ff9fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.023+0000 7ff9fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 10 monclient(hunting): handle_auth_done global_id 5094 payload 824 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 1 -- 10.20.193.45:0/1860790964 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9fc0c4740 msgr2=0x7ff9fc1e63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff9fc0c4740 0x7ff9fc1e63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 1 -- 10.20.193.45:0/1860790964 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9fc1503c0 msgr2=0x7ff9fc158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff9fc1503c0 0x7ff9fc158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 1 monclient: found mon.noname-a 2026-02-17T21:12:22.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:22.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.024+0000 7ffa00efd640 1 -- 10.20.193.45:0/1860790964 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc1f4fd0 con 0x7ff9fc15d020 2026-02-17T21:12:22.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.025+0000 7ffa00efd640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 0x7ff9fc1593f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000caa0 tx=0x7ff9f000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.025+0000 7ff9f8ff9640 10 client.?.objecter ms_handle_connect 0x7ff9fc15d020 2026-02-17T21:12:22.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.025+0000 7ff9f8ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:22.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 1 -- 10.20.193.45:0/1860790964 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000ac40 con 0x7ff9fc15d020 2026-02-17T21:12:22.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:22.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 10 monclient: dump: 2026-02-17T21:12:22.029 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.029 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 1 -- 10.20.193.45:0/1860790964 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f000ade0 con 0x7ff9fc15d020 2026-02-17T21:12:22.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 1 -- 10.20.193.45:0/1860790964 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0012600 con 0x7ff9fc15d020 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9f8ff9640 10 monclient: dump: 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.031 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ff9fa7fc640 4 set_mon_vals no callback set 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 5 monclient: authenticate success, global_id 5094 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 10 monclient: _renew_subs 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9fc1f52b0 con 0x7ff9fc15d020 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 10 client.5094.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 10 monclient: _renew_subs 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9fc1f5870 con 0x7ff9fc15d020 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 1 librados: init done 2026-02-17T21:12:22.032 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 10 client.5094.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:22.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 15 client.5094.objecter _session_command_op_assign -1 1 2026-02-17T21:12:22.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 20 client.5094.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:22.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 10 client.5094.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:22.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:22.033 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.027+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff9fc06ec50 con 0x7ff9fc15d020 2026-02-17T21:12:22.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.039+0000 7ff9f8ff9640 1 -- 10.20.193.45:0/1860790964 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff9f00127a0 con 0x7ff9fc15d020 2026-02-17T21:12:22.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.040+0000 7ff9f8ff9640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9cc079300 0x7ff9cc07b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.040+0000 7ff9fbfff640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9cc079300 0x7ff9cc07b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.040+0000 7ff9fbfff640 10 monclient: get_auth_request con 0x7ff9cc079300 auth_method 0 2026-02-17T21:12:22.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.040+0000 7ff9fbfff640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9cc079300 0x7ff9cc07b7c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8002410 tx=0x7ff9e8007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.034 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.040+0000 7ff9f8ff9640 10 client.5094.objecter ms_handle_connect 0x7ff9cc079300 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 1 -- 10.20.193.45:0/1860790964 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ff9f005eb30 con 0x7ff9fc15d020 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 10 client.5094.objecter ms_dispatch2 0x7ff9fc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 3 client.5094.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 3 client.5094.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 10 client.5094.objecter checking command 1 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7ff9cc081840 0x7ff9cc083c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 20 client.5094.objecter _get_session s=0x7ff9cc081170 osd=4 3 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 20 client.5094.objecter put_session s=0x7ff9cc081170 osd=4 3 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 15 client.5094.objecter _session_command_op_remove -1 1 2026-02-17T21:12:22.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 20 client.5094.objecter _get_session s=0x7ff9cc081170 osd=4 3 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 20 client.5094.objecter get_session s=0x7ff9cc081170 osd=4 3 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 15 client.5094.objecter _session_command_op_assign 4 1 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 20 client.5094.objecter put_session s=0x7ff9cc081170 osd=4 4 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 10 client.5094.objecter _send_command 1 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 1 -- 10.20.193.45:0/1860790964 --> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9cc084330 con 0x7ff9cc081840 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 20 client.5094.objecter dump_active .. 0 homeless 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9fb7fe640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7ff9cc081840 0x7ff9cc083c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9fb7fe640 10 monclient: get_auth_request con 0x7ff9cc081840 auth_method 0 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 1 -- 10.20.193.45:0/1860790964 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff9f005eef0 con 0x7ff9fc15d020 2026-02-17T21:12:22.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.042+0000 7ff9f8ff9640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:22.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.044+0000 7ff9f8ff9640 10 client.5094.objecter ms_handle_connect 0x7ff9cc081840 2026-02-17T21:12:22.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.044+0000 7ff9fb7fe640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7ff9cc081840 0x7ff9cc083c60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.054+0000 7ff9f8ff9640 1 -- 10.20.193.45:0/1860790964 <== osd.4 v2:10.20.193.45:6826/1457283840 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7ff9cc084330 con 0x7ff9cc081840 2026-02-17T21:12:22.046 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.054+0000 7ff9f8ff9640 10 client.5094.objecter ms_dispatch2 0x7ff9fc000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:22.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.054+0000 7ff9f8ff9640 10 client.5094.objecter _finish_command 1 = system:0 2026-02-17T21:12:22.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.054+0000 7ff9f8ff9640 20 client.5094.objecter put_session s=0x7ff9cc081170 osd=4 4 2026-02-17T21:12:22.047 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.054+0000 7ff9f8ff9640 15 client.5094.objecter _session_command_op_remove 4 1 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 10 client.5094.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 15 client.5094.objecter _session_command_op_assign -1 2 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 20 client.5094.objecter _get_session s=0x7ff9cc081170 osd=4 3 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 20 client.5094.objecter put_session s=0x7ff9cc081170 osd=4 3 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 20 client.5094.objecter _get_session s=0x7ff9cc081170 osd=4 3 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 15 client.5094.objecter _session_command_op_remove -1 2 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 20 client.5094.objecter get_session s=0x7ff9cc081170 osd=4 3 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 15 client.5094.objecter _session_command_op_assign 4 2 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 20 client.5094.objecter put_session s=0x7ff9cc081170 osd=4 4 2026-02-17T21:12:22.053 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 10 client.5094.objecter _send_command 2 2026-02-17T21:12:22.054 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.060+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 --> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff9fc15d490 con 0x7ff9cc081840 2026-02-17T21:12:22.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ff9f8ff9640 1 -- 10.20.193.45:0/1860790964 <== osd.4 v2:10.20.193.45:6826/1457283840 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff9fc15d490 con 0x7ff9cc081840 2026-02-17T21:12:22.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ff9f8ff9640 10 client.5094.objecter ms_dispatch2 0x7ff9fc000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:22.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ff9f8ff9640 10 client.5094.objecter _finish_command 2 = system:0 2026-02-17T21:12:22.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ff9f8ff9640 20 client.5094.objecter put_session s=0x7ff9cc081170 osd=4 4 2026-02-17T21:12:22.060 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ff9f8ff9640 15 client.5094.objecter _session_command_op_remove 4 2 2026-02-17T21:12:22.060 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:22.060 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:22.061 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:22.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 10 librados: watch_flush enter 2026-02-17T21:12:22.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 10 librados: watch_flush exit 2026-02-17T21:12:22.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 10 client.5094.objecter close_session for osd.4 2026-02-17T21:12:22.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7ff9cc081840 msgr2=0x7ff9cc083c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6826/1457283840,v1:10.20.193.45:6827/1457283840] conn(0x7ff9cc081840 0x7ff9cc083c60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.062 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 20 client.5094.objecter put_session s=0x7ff9cc081170 osd=4 1 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 20 client.5094.objecter shutdown clearing up homeless session... 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 10 client.5094.objecter successfully canceled tick 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9cc079300 msgr2=0x7ff9cc07b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff9cc079300 0x7ff9cc07b7c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8002410 tx=0x7ff9e8007ef0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 10 monclient: shutdown 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 msgr2=0x7ff9fc1593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 --2- 10.20.193.45:0/1860790964 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff9fc15d020 0x7ff9fc1593f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff9f000caa0 tx=0x7ff9f000cf70 comp rx=0 tx=0).stop 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa00efd640 1 -- 10.20.193.45:0/1860790964 reap_dead start 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 shutdown_connections 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 >> 10.20.193.45:0/1860790964 conn(0x7ff9fc0cd520 msgr2=0x7ff9fc1e7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 shutdown_connections 2026-02-17T21:12:22.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 -- 10.20.193.45:0/1860790964 wait complete. 2026-02-17T21:12:22.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.067+0000 7ffa02987640 1 librados: shutdown 2026-02-17T21:12:22.068 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.144+0000 7f95fcded640 10 monclient: get_monmap_and_config 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.144+0000 7f95fcded640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.144+0000 7f95fcded640 10 monclient: monmap: 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:22.145259+0000 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:22.145259+0000 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.137 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:22.138 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:22.138 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:22.138 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:22.138 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:22.138 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:22.138 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.144+0000 7f95fcded640 1 Processor -- start 2026-02-17T21:12:22.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.144+0000 7f95fcded640 1 -- start start 2026-02-17T21:12:22.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.144+0000 7f95fcded640 10 monclient: init 2026-02-17T21:12:22.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 10 monclient: _add_conns ranks=[4,1,2,5,0,3] 2026-02-17T21:12:22.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f95f8152620 0x7f95f815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 10 monclient(hunting): picked mon.noname-b con 0x7f95f8152620 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f95f8152a00 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f95f80c94a0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95f80c71a0 con 0x7f95f8152a00 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95f80c7480 con 0x7f95f80c94a0 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f95f80c7760 con 0x7f95f8152620 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95fcded640 10 monclient(hunting): authenticate will time out at 1325.775466s 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95f6d76640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f95f80c94a0 0x7f95f80c5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45478/0 (socket says 10.20.193.45:45478) 2026-02-17T21:12:22.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.145+0000 7f95f6d76640 1 -- 10.20.193.45:0/846732269 learned_addr learned my addr 10.20.193.45:0/846732269 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f6575640 1 --2- 10.20.193.45:0/846732269 >> v2:10.20.193.86:3300/0 conn(0x7f95f8152620 0x7f95f815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f5573640 1 -- 10.20.193.45:0/846732269 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2021766429 0 0) 0x7f95f80c7480 con 0x7f95f80c94a0 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f5573640 10 monclient(hunting): _negotiate 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f5573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f5573640 10 monclient(hunting): my global_id is 5189 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f5573640 1 -- 10.20.193.45:0/846732269 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95e4003620 con 0x7f95f80c94a0 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f6575640 10 monclient(hunting): get_auth_request con 0x7f95f8152620 auth_method 0 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.147+0000 7f95f6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.148+0000 7f95f6575640 10 monclient(hunting): handle_auth_done global_id 5161 payload 274 2026-02-17T21:12:22.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.148+0000 7f95f6575640 1 -- 10.20.193.45:0/846732269 >> v1:10.20.193.92:6789/0 conn(0x7f95f80c94a0 legacy=0x7f95f80c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.148+0000 7f95f6575640 1 -- 10.20.193.45:0/846732269 >> v1:10.20.193.86:6789/0 conn(0x7f95f8152a00 legacy=0x7f95f80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.148+0000 7f95f6575640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.148+0000 7f95f6575640 1 monclient: found mon.noname-b 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.148+0000 7f95f6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.148+0000 7f95f6575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.148+0000 7f95f6575640 1 -- 10.20.193.45:0/846732269 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f8159e00 con 0x7f95f8152620 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.149+0000 7f95f6575640 1 --2- 10.20.193.45:0/846732269 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 0x7f95f815a8e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0098a0 tx=0x7f95ec02ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c504d4916c2f4124 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 1 -- 10.20.193.45:0/846732269 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec03c070 con 0x7f95f8152620 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 10 monclient: dump: 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.149 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 1 -- 10.20.193.45:0/846732269 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ec02fb70 con 0x7f95f8152620 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 5 monclient: authenticate success, global_id 5161 2026-02-17T21:12:22.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 1 -- 10.20.193.45:0/846732269 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec037440 con 0x7f95f8152620 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 4 set_mon_vals no callback set 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95f5573640 10 monclient: dump: 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.151 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 10 monclient: shutdown 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 1 -- 10.20.193.45:0/846732269 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 msgr2=0x7f95f815a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 1 --2- 10.20.193.45:0/846732269 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 0x7f95f815a8e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0098a0 tx=0x7f95ec02ee60 comp rx=0 tx=0).stop 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 1 -- 10.20.193.45:0/846732269 shutdown_connections 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 1 --2- 10.20.193.45:0/846732269 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 0x7f95f815a8e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 1 -- 10.20.193.45:0/846732269 >> 10.20.193.45:0/846732269 conn(0x7f95f80c9d40 msgr2=0x7f95f80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 1 -- 10.20.193.45:0/846732269 shutdown_connections 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.151+0000 7f95fcded640 1 -- 10.20.193.45:0/846732269 wait complete. 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.152+0000 7f95fcded640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.152+0000 7f95fcded640 10 monclient: monmap: 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:22.153 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.152+0000 7f95fcded640 1 librados: starting msgr at 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.152+0000 7f95fcded640 1 librados: starting objecter 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.152+0000 7f95fcded640 1 Processor -- start 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.152+0000 7f95fcded640 1 -- start start 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.152+0000 7f95fcded640 1 librados: setting wanted keys 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.152+0000 7f95fcded640 1 librados: calling monclient init 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.152+0000 7f95fcded640 10 monclient: init 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95f80c94a0 0x7f95f8141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient(hunting): picked mon.noname-a con 0x7f95f80c94a0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 0x7f95f81540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient(hunting): picked mon.noname-b con 0x7f95f8152620 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95f8152a00 0x7f95f8154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient(hunting): picked mon.noname-c con 0x7f95f8152a00 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f95f815ae20 con 0x7f95f80c94a0 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f95f815a3c0 con 0x7f95f8152620 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95f815afa0 con 0x7f95f8152a00 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95fcded640 10 monclient(hunting): authenticate will time out at 1325.783097s 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 0x7f95f81540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6575640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95f80c94a0 0x7f95f8141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6d76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95f8152a00 0x7f95f8154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 0x7f95f81540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38082/0 (socket says 10.20.193.45:38082) 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 1 -- 10.20.193.45:0/3573113386 learned_addr learned my addr 10.20.193.45:0/3573113386 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 10 monclient(hunting): get_auth_request con 0x7f95f8152620 auth_method 0 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6575640 10 monclient(hunting): get_auth_request con 0x7f95f80c94a0 auth_method 0 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6d76640 10 monclient(hunting): get_auth_request con 0x7f95f8152a00 auth_method 0 2026-02-17T21:12:22.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.153+0000 7f95f6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 10 monclient(hunting): handle_auth_done global_id 5164 payload 824 2026-02-17T21:12:22.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 1 -- 10.20.193.45:0/3573113386 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95f8152a00 msgr2=0x7f95f8154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95f8152a00 0x7f95f8154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 1 -- 10.20.193.45:0/3573113386 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95f80c94a0 msgr2=0x7f95f8141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95f80c94a0 0x7f95f8141d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 1 monclient: found mon.noname-b 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.154+0000 7f95f5d74640 1 -- 10.20.193.45:0/3573113386 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81f2230 con 0x7f95f8152620 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.155+0000 7f95f5d74640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 0x7f95f81540e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c4d0 tx=0x7f95e000c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.155+0000 7f95deffd640 10 client.?.objecter ms_handle_connect 0x7f95f8152620 2026-02-17T21:12:22.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.155+0000 7f95deffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:22.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95deffd640 1 -- 10.20.193.45:0/3573113386 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e00052d0 con 0x7f95f8152620 2026-02-17T21:12:22.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95deffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:22.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95deffd640 10 monclient: dump: 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95deffd640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95deffd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95fcded640 5 monclient: authenticate success, global_id 5164 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95fcded640 10 monclient: _renew_subs 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95fcded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f8153320 con 0x7f95f8152620 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95fcded640 10 client.5164.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95fcded640 10 monclient: _renew_subs 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95fcded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f81538e0 con 0x7f95f8152620 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.156+0000 7f95fcded640 1 librados: init done 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95fcded640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95fcded640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:22.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95fcded640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f815a8e0 con 0x7f95f8152620 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95deffd640 1 -- 10.20.193.45:0/3573113386 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e0005470 con 0x7f95f8152620 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95deffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95deffd640 1 -- 10.20.193.45:0/3573113386 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e00038d0 con 0x7f95f8152620 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95deffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95f4d72640 4 set_mon_vals no callback set 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.157+0000 7f95deffd640 10 monclient: dump: 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.163 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.164 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.164 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.164 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.164 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.164 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.257 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.264+0000 7f95deffd640 1 -- 10.20.193.45:0/3573113386 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f95e0003a70 con 0x7f95f8152620 2026-02-17T21:12:22.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.265+0000 7f95deffd640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f95c40792b0 0x7f95c407b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.265+0000 7f95f6575640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f95c40792b0 0x7f95c407b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.265+0000 7f95f6575640 10 monclient: get_auth_request con 0x7f95c40792b0 auth_method 0 2026-02-17T21:12:22.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.265+0000 7f95f6575640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f95c40792b0 0x7f95c407b770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f95ec039000 tx=0x7f95ec033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.258 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.265+0000 7f95deffd640 10 client.5164.objecter ms_handle_connect 0x7f95c40792b0 2026-02-17T21:12:22.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.266+0000 7f95deffd640 1 -- 10.20.193.45:0/3573113386 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f95e0097d00 con 0x7f95f8152620 2026-02-17T21:12:22.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.266+0000 7f95deffd640 10 client.5164.objecter ms_dispatch2 0x7f95f8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:22.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.266+0000 7f95deffd640 3 client.5164.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:22.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.266+0000 7f95deffd640 3 client.5164.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:22.259 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.266+0000 7f95deffd640 20 client.5164.objecter dump_active .. 0 homeless 2026-02-17T21:12:22.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.272+0000 7f95deffd640 1 -- 10.20.193.45:0/3573113386 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f95e0062290 con 0x7f95f8152620 2026-02-17T21:12:22.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.273+0000 7f95deffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:22.265 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.273+0000 7f95deffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:22.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.356+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f95f80c82e0 con 0x7f95c40792b0 2026-02-17T21:12:22.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.357+0000 7f95deffd640 1 -- 10.20.193.45:0/3573113386 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f95f80c82e0 con 0x7f95c40792b0 2026-02-17T21:12:22.350 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 4 to deep-scrub 2026-02-17T21:12:22.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 10 librados: watch_flush enter 2026-02-17T21:12:22.351 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 10 librados: watch_flush exit 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 20 client.5164.objecter shutdown clearing up homeless session... 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 10 client.5164.objecter successfully canceled tick 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f95c40792b0 msgr2=0x7f95c407b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f95c40792b0 0x7f95c407b770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f95ec039000 tx=0x7f95ec033000 comp rx=0 tx=0).stop 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 10 monclient: shutdown 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 msgr2=0x7f95f81540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 0x7f95f81540e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f95e000c4d0 tx=0x7f95e000c9a0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 shutdown_connections 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f95c40792b0 0x7f95c407b770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.352 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95f8152a00 0x7f95f8154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f95f8152620 0x7f95f81540e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 --2- 10.20.193.45:0/3573113386 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f95f80c94a0 0x7f95f8141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 >> 10.20.193.45:0/3573113386 conn(0x7f95f80c9d40 msgr2=0x7f95f80c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 shutdown_connections 2026-02-17T21:12:22.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 -- 10.20.193.45:0/3573113386 wait complete. 2026-02-17T21:12:22.353 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.358+0000 7f95fcded640 1 librados: shutdown 2026-02-17T21:12:22.360 INFO:tasks.ceph:Scrubbing osd.8 2026-02-17T21:12:22.360 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:22.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.436+0000 7f9a9a6b2640 10 monclient: get_monmap_and_config 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.436+0000 7f9a9a6b2640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.436+0000 7f9a9a6b2640 10 monclient: monmap: 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:22.437204+0000 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:22.437204+0000 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:22.429 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:22.430 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:22.430 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:22.430 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:22.430 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:22.430 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.436+0000 7f9a9a6b2640 1 Processor -- start 2026-02-17T21:12:22.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.436+0000 7f9a9a6b2640 1 -- start start 2026-02-17T21:12:22.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.436+0000 7f9a9a6b2640 10 monclient: init 2026-02-17T21:12:22.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 10 monclient: _add_conns ranks=[0,2,3,4,1,5] 2026-02-17T21:12:22.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9a94155a80 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:22.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9a94155e60 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:22.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f9a9415df10 0x7f9a9415f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 10 monclient(hunting): picked mon.noname-a con 0x7f9a9415df10 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a940c9ba0 con 0x7f9a94155a80 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a940c9e80 con 0x7f9a94155e60 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f9a9415d090 con 0x7f9a9415df10 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a9a6b2640 10 monclient(hunting): authenticate will time out at 1326.067431s 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a937fe640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f9a94155e60 0x7f9a9415f190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45486/0 (socket says 10.20.193.45:45486) 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a93fff640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f9a94155a80 0x7f9a9415d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:40368/0 (socket says 10.20.193.45:40368) 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.437+0000 7f9a937fe640 1 -- 10.20.193.45:0/3561886018 learned_addr learned my addr 10.20.193.45:0/3561886018 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.438+0000 7f9a98c28640 1 --2- 10.20.193.45:0/3561886018 >> v2:10.20.193.45:3300/0 conn(0x7f9a9415df10 0x7f9a9415f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.438+0000 7f9a98c28640 10 monclient(hunting): get_auth_request con 0x7f9a9415df10 auth_method 0 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.438+0000 7f9a98c28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.438+0000 7f9a98c28640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.438+0000 7f9a98c28640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1877210624 0 0) 0x7f9a940c9e80 con 0x7f9a94155e60 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 10 monclient(hunting): my global_id is 5195 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a78003620 con 0x7f9a94155e60 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a98c28640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a98c28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a98c28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432226122 0 0) 0x7f9a940c9ba0 con 0x7f9a94155a80 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 10 monclient(hunting): my global_id is 5103 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.439+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a940c9e80 con 0x7f9a94155a80 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 <== mon.2 v1:10.20.193.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 16996032 0 0) 0x7f9a78003620 con 0x7f9a94155e60 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 >> v2:10.20.193.45:3300/0 conn(0x7f9a9415df10 msgr2=0x7f9a9415f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 --2- 10.20.193.45:0/3561886018 >> v2:10.20.193.45:3300/0 conn(0x7f9a9415df10 0x7f9a9415f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 >> v1:10.20.193.45:6789/0 conn(0x7f9a94155a80 legacy=0x7f9a9415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:12:22.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.92:6789/0 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 --> v1:10.20.193.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a940ca160 con 0x7f9a94155e60 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 <== mon.2 v1:10.20.193.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f9a84002f00 con 0x7f9a94155e60 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient: dump: 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.440 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] but i'm connected to v1:10.20.193.92:6789/0, reconnecting 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 >> v1:10.20.193.92:6789/0 conn(0x7f9a94155e60 legacy=0x7f9a9415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a78003dd0 0x7f9a780041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient(hunting): picked mon.b con 0x7f9a78003dd0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9a78004900 0x7f9a78004d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient(hunting): picked mon.a con 0x7f9a78004900 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a78005380 0x7f9a7800bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient(hunting): picked mon.c con 0x7f9a78005380 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9415d090 con 0x7f9a78004900 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7800c2c0 con 0x7f9a78003dd0 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7800c4c0 con 0x7f9a78005380 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.440+0000 7f9a92ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:12:22.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.441+0000 7f9a93fff640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a78003dd0 0x7f9a780041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.441+0000 7f9a93fff640 10 monclient(hunting): get_auth_request con 0x7f9a78003dd0 auth_method 0 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.441+0000 7f9a93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.441+0000 7f9a93fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.441+0000 7f9a93fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.441+0000 7f9a93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.441+0000 7f9a93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.441+0000 7f9a93fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a98c28640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a78005380 0x7f9a7800bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a98c28640 10 monclient(hunting): get_auth_request con 0x7f9a78005380 auth_method 0 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a98c28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a98c28640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a98c28640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 10 monclient(hunting): handle_auth_done global_id 5195 payload 293 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 1 -- 10.20.193.45:0/3561886018 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a78005380 msgr2=0x7f9a7800bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a78005380 0x7f9a7800bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 1 -- 10.20.193.45:0/3561886018 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9a78004900 msgr2=0x7f9a78004d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9a78004900 0x7f9a78004d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 1 monclient: found mon.b 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 1 -- 10.20.193.45:0/3561886018 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a78003620 con 0x7f9a78003dd0 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a98c28640 1 -- 10.20.193.45:0/3561886018 reap_dead start 2026-02-17T21:12:22.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a9a6b2640 5 monclient: authenticate success, global_id 5195 2026-02-17T21:12:22.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.442+0000 7f9a9a6b2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:22.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.443+0000 7f9a93fff640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a78003dd0 0x7f9a780041d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a80003210 tx=0x7f9a8002ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b36489e04da24d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80002e60 con 0x7f9a78003dd0 2026-02-17T21:12:22.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:22.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 10 monclient: dump: 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a9a6b2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:22.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a80033070 con 0x7f9a78003dd0 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a9a6b2640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a9a6b2640 4 set_mon_vals no callback set 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 1 -- 10.20.193.45:0/3561886018 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80004d20 con 0x7f9a78003dd0 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a92ffd640 10 monclient: dump: 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.453 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a9a6b2640 10 monclient: shutdown 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a9a6b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3561886018 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a78003dd0 msgr2=0x7f9a780041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.445+0000 7f9a9a6b2640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a78003dd0 0x7f9a780041d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a80003210 tx=0x7f9a8002ef20 comp rx=0 tx=0).stop 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3561886018 shutdown_connections 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 --2- 10.20.193.45:0/3561886018 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a78003dd0 0x7f9a780041d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3561886018 >> 10.20.193.45:0/3561886018 conn(0x7f9a94073030 msgr2=0x7f9a94073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3561886018 shutdown_connections 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3561886018 wait complete. 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 10 monclient: monmap: 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:22.455 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 librados: starting msgr at 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 librados: starting objecter 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 Processor -- start 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 -- start start 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 librados: setting wanted keys 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 1 librados: calling monclient init 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.446+0000 7f9a9a6b2640 10 monclient: init 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a78003dd0 0x7f9a940cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient(hunting): picked mon.noname-c con 0x7f9a78003dd0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:22.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a941461d0 0x7f9a94157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient(hunting): picked mon.noname-b con 0x7f9a941461d0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9a94146650 0x7f9a94158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient(hunting): picked mon.noname-a con 0x7f9a94146650 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9a94074ed0 con 0x7f9a94146650 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9415d370 con 0x7f9a941461d0 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9408f830 con 0x7f9a78003dd0 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a9a6b2640 10 monclient(hunting): authenticate will time out at 1326.077160s 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a98c28640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9a94146650 0x7f9a94158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a941461d0 0x7f9a94157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a93fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a78003dd0 0x7f9a940cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a941461d0 0x7f9a94157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38090/0 (socket says 10.20.193.45:38090) 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 1 -- 10.20.193.45:0/3595745359 learned_addr learned my addr 10.20.193.45:0/3595745359 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 10 monclient(hunting): get_auth_request con 0x7f9a941461d0 auth_method 0 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a98c28640 10 monclient(hunting): get_auth_request con 0x7f9a94146650 auth_method 0 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a98c28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a98c28640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a98c28640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a93fff640 10 monclient(hunting): get_auth_request con 0x7f9a78003dd0 auth_method 0 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a93fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a93fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a93fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a93fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a93fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a93fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a98c28640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a98c28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.447+0000 7f9a98c28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 10 monclient(hunting): handle_auth_done global_id 5167 payload 824 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 1 -- 10.20.193.45:0/3595745359 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a78003dd0 msgr2=0x7f9a940cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a78003dd0 0x7f9a940cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 1 -- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9a94146650 msgr2=0x7f9a94158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f9a94146650 0x7f9a94158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 1 monclient: found mon.noname-b 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.449+0000 7f9a937fe640 1 -- 10.20.193.45:0/3595745359 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a940ce4f0 con 0x7f9a941461d0 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.450+0000 7f9a937fe640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a941461d0 0x7f9a94157ed0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c730 tx=0x7f9a8400cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.450+0000 7f9a90ff9640 10 client.?.objecter ms_handle_connect 0x7f9a941461d0 2026-02-17T21:12:22.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.450+0000 7f9a90ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 1 -- 10.20.193.45:0/3595745359 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84004af0 con 0x7f9a941461d0 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 10 monclient: dump: 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.461 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 1 -- 10.20.193.45:0/3595745359 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a84004c90 con 0x7f9a941461d0 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 1 -- 10.20.193.45:0/3595745359 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84007330 con 0x7f9a941461d0 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a927fc640 4 set_mon_vals no callback set 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a90ff9640 10 monclient: dump: 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.462 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 5 monclient: authenticate success, global_id 5167 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 10 monclient: _renew_subs 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a940ce7d0 con 0x7f9a941461d0 2026-02-17T21:12:22.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 10 client.5167.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 10 monclient: _renew_subs 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a940ced90 con 0x7f9a941461d0 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 1 librados: init done 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 10 client.5167.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 15 client.5167.objecter _session_command_op_assign -1 1 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 20 client.5167.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 10 client.5167.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.452+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a94069d70 con 0x7f9a941461d0 2026-02-17T21:12:22.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.463+0000 7f9a90ff9640 1 -- 10.20.193.45:0/3595745359 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f9a840074d0 con 0x7f9a941461d0 2026-02-17T21:12:22.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.463+0000 7f9a90ff9640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a64079280 0x7f9a6407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.463+0000 7f9a93fff640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a64079280 0x7f9a6407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.463+0000 7f9a93fff640 10 monclient: get_auth_request con 0x7f9a64079280 auth_method 0 2026-02-17T21:12:22.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.464+0000 7f9a93fff640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a64079280 0x7f9a6407b740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9a80036000 tx=0x7f9a8003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.464+0000 7f9a90ff9640 10 client.5167.objecter ms_handle_connect 0x7f9a64079280 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 1 -- 10.20.193.45:0/3595745359 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f9a84098090 con 0x7f9a941461d0 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 10 client.5167.objecter ms_dispatch2 0x7f9a94000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 3 client.5167.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 3 client.5167.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 10 client.5167.objecter checking command 1 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7f9a64081760 0x7f9a64083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 20 client.5167.objecter _get_session s=0x7f9a64081090 osd=8 3 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 20 client.5167.objecter put_session s=0x7f9a64081090 osd=8 3 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 15 client.5167.objecter _session_command_op_remove -1 1 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 20 client.5167.objecter _get_session s=0x7f9a64081090 osd=8 3 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 20 client.5167.objecter get_session s=0x7f9a64081090 osd=8 3 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 15 client.5167.objecter _session_command_op_assign 8 1 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 20 client.5167.objecter put_session s=0x7f9a64081090 osd=8 4 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 10 client.5167.objecter _send_command 1 2026-02-17T21:12:22.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 1 -- 10.20.193.45:0/3595745359 --> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a84006e50 con 0x7f9a64081760 2026-02-17T21:12:22.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a90ff9640 20 client.5167.objecter dump_active .. 0 homeless 2026-02-17T21:12:22.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.465+0000 7f9a98c28640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7f9a64081760 0x7f9a64083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.466+0000 7f9a98c28640 10 monclient: get_auth_request con 0x7f9a64081760 auth_method 0 2026-02-17T21:12:22.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.466+0000 7f9a90ff9640 1 -- 10.20.193.45:0/3595745359 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9a8405e910 con 0x7f9a941461d0 2026-02-17T21:12:22.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.466+0000 7f9a90ff9640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:22.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.467+0000 7f9a90ff9640 10 client.5167.objecter ms_handle_connect 0x7f9a64081760 2026-02-17T21:12:22.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.467+0000 7f9a98c28640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7f9a64081760 0x7f9a64083b80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.477+0000 7f9a90ff9640 1 -- 10.20.193.45:0/3595745359 <== osd.8 v2:10.20.193.45:6810/442873512 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f9a84006e50 con 0x7f9a64081760 2026-02-17T21:12:22.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.477+0000 7f9a90ff9640 10 client.5167.objecter ms_dispatch2 0x7f9a94000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:22.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.477+0000 7f9a90ff9640 10 client.5167.objecter _finish_command 1 = system:0 2026-02-17T21:12:22.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.477+0000 7f9a90ff9640 20 client.5167.objecter put_session s=0x7f9a64081090 osd=8 4 2026-02-17T21:12:22.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.477+0000 7f9a90ff9640 15 client.5167.objecter _session_command_op_remove 8 1 2026-02-17T21:12:22.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 10 client.5167.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:22.475 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 15 client.5167.objecter _session_command_op_assign -1 2 2026-02-17T21:12:22.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 20 client.5167.objecter _get_session s=0x7f9a64081090 osd=8 3 2026-02-17T21:12:22.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 20 client.5167.objecter put_session s=0x7f9a64081090 osd=8 3 2026-02-17T21:12:22.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 20 client.5167.objecter _get_session s=0x7f9a64081090 osd=8 3 2026-02-17T21:12:22.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 15 client.5167.objecter _session_command_op_remove -1 2 2026-02-17T21:12:22.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 20 client.5167.objecter get_session s=0x7f9a64081090 osd=8 3 2026-02-17T21:12:22.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 15 client.5167.objecter _session_command_op_assign 8 2 2026-02-17T21:12:22.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 20 client.5167.objecter put_session s=0x7f9a64081090 osd=8 4 2026-02-17T21:12:22.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 10 client.5167.objecter _send_command 2 2026-02-17T21:12:22.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.483+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 --> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9a94147980 con 0x7f9a64081760 2026-02-17T21:12:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a90ff9640 1 -- 10.20.193.45:0/3595745359 <== osd.8 v2:10.20.193.45:6810/442873512 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9a94147980 con 0x7f9a64081760 2026-02-17T21:12:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a90ff9640 10 client.5167.objecter ms_dispatch2 0x7f9a94000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a90ff9640 10 client.5167.objecter _finish_command 2 = system:0 2026-02-17T21:12:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a90ff9640 20 client.5167.objecter put_session s=0x7f9a64081090 osd=8 4 2026-02-17T21:12:22.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a90ff9640 15 client.5167.objecter _session_command_op_remove 8 2 2026-02-17T21:12:22.482 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:22.483 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:22.483 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 10 librados: watch_flush enter 2026-02-17T21:12:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 10 librados: watch_flush exit 2026-02-17T21:12:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 10 client.5167.objecter close_session for osd.8 2026-02-17T21:12:22.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7f9a64081760 msgr2=0x7f9a64083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6810/442873512,v1:10.20.193.45:6811/442873512] conn(0x7f9a64081760 0x7f9a64083b80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 20 client.5167.objecter put_session s=0x7f9a64081090 osd=8 1 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 20 client.5167.objecter shutdown clearing up homeless session... 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 10 client.5167.objecter successfully canceled tick 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a64079280 msgr2=0x7f9a6407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9a64079280 0x7f9a6407b740 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9a80036000 tx=0x7f9a8003c040 comp rx=0 tx=0).stop 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 10 monclient: shutdown 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a941461d0 msgr2=0x7f9a94157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 --2- 10.20.193.45:0/3595745359 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f9a941461d0 0x7f9a94157ed0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400c730 tx=0x7f9a8400cc00 comp rx=0 tx=0).stop 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a98c28640 1 -- 10.20.193.45:0/3595745359 reap_dead start 2026-02-17T21:12:22.485 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 shutdown_connections 2026-02-17T21:12:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 >> 10.20.193.45:0/3595745359 conn(0x7f9a94073030 msgr2=0x7f9a94152370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 shutdown_connections 2026-02-17T21:12:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.489+0000 7f9a9a6b2640 1 -- 10.20.193.45:0/3595745359 wait complete. 2026-02-17T21:12:22.486 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.490+0000 7f9a9a6b2640 1 librados: shutdown 2026-02-17T21:12:22.490 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-17T21:12:22.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.565+0000 7f94bef01640 10 monclient: get_monmap_and_config 2026-02-17T21:12:22.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.565+0000 7f94bef01640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.565+0000 7f94bef01640 10 monclient: monmap: 2026-02-17T21:12:22.558 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:22.566677+0000 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:22.566677+0000 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:22.559 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 1 Processor -- start 2026-02-17T21:12:22.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 1 -- start start 2026-02-17T21:12:22.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 10 monclient: init 2026-02-17T21:12:22.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 10 monclient: _add_conns ranks=[1,2,4,0,3,5] 2026-02-17T21:12:22.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f94b815d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:22.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f94b80c92b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f94b8153d20 0x7f94b815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 10 monclient(hunting): picked mon.noname-b con 0x7f94b8153d20 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94b80c5860 con 0x7f94b815d1e0 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94b80c5580 con 0x7f94b80c92b0 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f94b80c7de0 con 0x7f94b8153d20 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.566+0000 7f94bef01640 10 monclient(hunting): authenticate will time out at 1326.196816s 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94affff640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f94b80c92b0 0x7f94b8153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45494/0 (socket says 10.20.193.45:45494) 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94affff640 1 -- 10.20.193.45:0/1125385867 learned_addr learned my addr 10.20.193.45:0/1125385867 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:22.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94bd477640 1 --2- 10.20.193.45:0/1125385867 >> v2:10.20.193.86:3300/0 conn(0x7f94b8153d20 0x7f94b815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94bd477640 10 monclient(hunting): get_auth_request con 0x7f94b8153d20 auth_method 0 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94bd477640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94bd477640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94bd477640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94bd477640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94bd477640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.567+0000 7f94bd477640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94af7fe640 1 -- 10.20.193.45:0/1125385867 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680945932 0 0) 0x7f94b80c5580 con 0x7f94b80c92b0 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94af7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94af7fe640 10 monclient(hunting): my global_id is 5201 2026-02-17T21:12:22.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94af7fe640 1 -- 10.20.193.45:0/1125385867 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94a4003620 con 0x7f94b80c92b0 2026-02-17T21:12:22.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94bd477640 10 monclient(hunting): handle_auth_done global_id 5170 payload 274 2026-02-17T21:12:22.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94bd477640 1 -- 10.20.193.45:0/1125385867 >> v1:10.20.193.92:6789/0 conn(0x7f94b80c92b0 legacy=0x7f94b8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94bd477640 1 -- 10.20.193.45:0/1125385867 >> v1:10.20.193.86:6789/0 conn(0x7f94b815d1e0 legacy=0x7f94b80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:22.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94bd477640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94bd477640 1 monclient: found mon.noname-b 2026-02-17T21:12:22.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94bd477640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94bd477640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.565 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.568+0000 7f94bd477640 1 -- 10.20.193.45:0/1125385867 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b80c80c0 con 0x7f94b8153d20 2026-02-17T21:12:22.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.570+0000 7f94bd477640 1 --2- 10.20.193.45:0/1125385867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 0x7f94b815d5c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009dc0 tx=0x7f94b402f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=710bc09030f115d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 1 -- 10.20.193.45:0/1125385867 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b403c070 con 0x7f94b8153d20 2026-02-17T21:12:22.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:22.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 10 monclient: dump: 2026-02-17T21:12:22.572 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.572 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 1 -- 10.20.193.45:0/1125385867 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b4037440 con 0x7f94b8153d20 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 1 -- 10.20.193.45:0/1125385867 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4037810 con 0x7f94b8153d20 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 5 monclient: authenticate success, global_id 5170 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 4 set_mon_vals no callback set 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94af7fe640 10 monclient: dump: 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.574 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 10 monclient: shutdown 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 1 -- 10.20.193.45:0/1125385867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 msgr2=0x7f94b815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 1 --2- 10.20.193.45:0/1125385867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 0x7f94b815d5c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009dc0 tx=0x7f94b402f230 comp rx=0 tx=0).stop 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 1 -- 10.20.193.45:0/1125385867 shutdown_connections 2026-02-17T21:12:22.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 1 --2- 10.20.193.45:0/1125385867 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 0x7f94b815d5c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 1 -- 10.20.193.45:0/1125385867 >> 10.20.193.45:0/1125385867 conn(0x7f94b80c9d40 msgr2=0x7f94b80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 1 -- 10.20.193.45:0/1125385867 shutdown_connections 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.572+0000 7f94bef01640 1 -- 10.20.193.45:0/1125385867 wait complete. 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.573+0000 7f94bef01640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.573+0000 7f94bef01640 10 monclient: monmap: 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:22.576 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.573+0000 7f94bef01640 1 librados: starting msgr at 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.573+0000 7f94bef01640 1 librados: starting objecter 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.573+0000 7f94bef01640 1 Processor -- start 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.573+0000 7f94bef01640 1 -- start start 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.573+0000 7f94bef01640 1 librados: setting wanted keys 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.573+0000 7f94bef01640 1 librados: calling monclient init 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.573+0000 7f94bef01640 10 monclient: init 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94b80c92b0 0x7f94b815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient(hunting): picked mon.noname-c con 0x7f94b80c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 0x7f94b81f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient(hunting): picked mon.noname-b con 0x7f94b8153d20 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f94b815d1e0 0x7f94b8142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient(hunting): picked mon.noname-a con 0x7f94b815d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80748e0 con 0x7f94b815d1e0 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80c8680 con 0x7f94b8153d20 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8074a60 con 0x7f94b80c92b0 2026-02-17T21:12:22.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bef01640 10 monclient(hunting): authenticate will time out at 1326.204108s 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 0x7f94b81f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bcc76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94b80c92b0 0x7f94b815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 0x7f94b81f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38098/0 (socket says 10.20.193.45:38098) 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 1 -- 10.20.193.45:0/3925221964 learned_addr learned my addr 10.20.193.45:0/3925221964 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 10 monclient(hunting): get_auth_request con 0x7f94b8153d20 auth_method 0 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bd477640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f94b815d1e0 0x7f94b8142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bcc76640 10 monclient(hunting): get_auth_request con 0x7f94b80c92b0 auth_method 0 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bcc76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bcc76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bcc76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bd477640 10 monclient(hunting): get_auth_request con 0x7f94b815d1e0 auth_method 0 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bd477640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bd477640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bd477640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bcc76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bcc76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.574+0000 7f94bcc76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.575+0000 7f94bd477640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.575+0000 7f94bd477640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.575+0000 7f94bd477640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 10 monclient(hunting): handle_auth_done global_id 5173 payload 824 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 1 -- 10.20.193.45:0/3925221964 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94b80c92b0 msgr2=0x7f94b815c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94b80c92b0 0x7f94b815c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 1 -- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f94b815d1e0 msgr2=0x7f94b8142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f94b815d1e0 0x7f94b8142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 1 monclient: found mon.noname-b 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.576+0000 7f94affff640 1 -- 10.20.193.45:0/3925221964 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b815ad70 con 0x7f94b8153d20 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.577+0000 7f94affff640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 0x7f94b81f4ea0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c730 tx=0x7f94a000cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.577+0000 7f94ad7fa640 10 client.?.objecter ms_handle_connect 0x7f94b8153d20 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.577+0000 7f94ad7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 1 -- 10.20.193.45:0/3925221964 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a0017070 con 0x7f94b8153d20 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 10 monclient: dump: 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.582 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 5 monclient: authenticate success, global_id 5173 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 10 monclient: _renew_subs 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b815b050 con 0x7f94b8153d20 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 10 client.5173.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 10 monclient: _renew_subs 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b815b610 con 0x7f94b8153d20 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 1 librados: init done 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 1 -- 10.20.193.45:0/3925221964 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94a0005bb0 con 0x7f94b8153d20 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 1 -- 10.20.193.45:0/3925221964 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a0021060 con 0x7f94b8153d20 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94ad7fa640 10 monclient: dump: 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.584 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94aeffd640 4 set_mon_vals no callback set 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.578+0000 7f94bef01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.579+0000 7f94bef01640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.579+0000 7f94bef01640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.579+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b814db20 con 0x7f94b8153d20 2026-02-17T21:12:22.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.590+0000 7f94ad7fa640 1 -- 10.20.193.45:0/3925221964 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f94a0024080 con 0x7f94b8153d20 2026-02-17T21:12:22.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.590+0000 7f94ad7fa640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9488079280 0x7f948807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.590+0000 7f94bcc76640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9488079280 0x7f948807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.590+0000 7f94bcc76640 10 monclient: get_auth_request con 0x7f9488079280 auth_method 0 2026-02-17T21:12:22.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.590+0000 7f94bcc76640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9488079280 0x7f948807b740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f94a8004660 tx=0x7f94a8009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.590+0000 7f94ad7fa640 10 client.5173.objecter ms_handle_connect 0x7f9488079280 2026-02-17T21:12:22.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.592+0000 7f94ad7fa640 1 -- 10.20.193.45:0/3925221964 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f94a005d930 con 0x7f94b8153d20 2026-02-17T21:12:22.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.592+0000 7f94ad7fa640 10 client.5173.objecter ms_dispatch2 0x7f94b8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:22.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.592+0000 7f94ad7fa640 3 client.5173.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:22.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.592+0000 7f94ad7fa640 3 client.5173.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:22.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.592+0000 7f94ad7fa640 20 client.5173.objecter dump_active .. 0 homeless 2026-02-17T21:12:22.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.694+0000 7f94ad7fa640 1 -- 10.20.193.45:0/3925221964 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f94b814db20 con 0x7f94b8153d20 2026-02-17T21:12:22.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.694+0000 7f94ad7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:22.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.694+0000 7f94ad7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:22.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.777+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7f94b815d5c0 con 0x7f9488079280 2026-02-17T21:12:22.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.777+0000 7f94ad7fa640 1 -- 10.20.193.45:0/3925221964 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f94b815d5c0 con 0x7f9488079280 2026-02-17T21:12:22.770 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 8 to deep-scrub 2026-02-17T21:12:22.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 10 librados: watch_flush enter 2026-02-17T21:12:22.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 10 librados: watch_flush exit 2026-02-17T21:12:22.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 20 client.5173.objecter shutdown clearing up homeless session... 2026-02-17T21:12:22.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 10 client.5173.objecter successfully canceled tick 2026-02-17T21:12:22.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9488079280 msgr2=0x7f948807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9488079280 0x7f948807b740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f94a8004660 tx=0x7f94a8009110 comp rx=0 tx=0).stop 2026-02-17T21:12:22.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 10 monclient: shutdown 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 msgr2=0x7f94b81f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 0x7f94b81f4ea0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f94a000c730 tx=0x7f94a000cc00 comp rx=0 tx=0).stop 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 shutdown_connections 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9488079280 0x7f948807b740 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f94b815d1e0 0x7f94b8142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f94b8153d20 0x7f94b81f4ea0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 --2- 10.20.193.45:0/3925221964 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94b80c92b0 0x7f94b815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 >> 10.20.193.45:0/3925221964 conn(0x7f94b80c9d40 msgr2=0x7f94b81510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 shutdown_connections 2026-02-17T21:12:22.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.778+0000 7f94bef01640 1 -- 10.20.193.45:0/3925221964 wait complete. 2026-02-17T21:12:22.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.779+0000 7f94bef01640 1 librados: shutdown 2026-02-17T21:12:22.780 INFO:tasks.ceph:Scrubbing osd.12 2026-02-17T21:12:22.780 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:22.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.859+0000 7f4cb3348640 10 monclient: get_monmap_and_config 2026-02-17T21:12:22.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.859+0000 7f4cb3348640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.852 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.859+0000 7f4cb3348640 10 monclient: monmap: 2026-02-17T21:12:22.852 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.852 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:22.860267+0000 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:22.860267+0000 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.859+0000 7f4cb3348640 1 Processor -- start 2026-02-17T21:12:22.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.859+0000 7f4cb3348640 1 -- start start 2026-02-17T21:12:22.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.859+0000 7f4cb3348640 10 monclient: init 2026-02-17T21:12:22.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 10 monclient: _add_conns ranks=[1,5,0,2,3,4] 2026-02-17T21:12:22.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f4cac1503c0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:22.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f4cac15d020 0x7f4cac15d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 10 monclient(hunting): picked mon.noname-c con 0x7f4cac15d020 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:22.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4cac0c4740 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:22.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac0c55a0 con 0x7f4cac0c4740 2026-02-17T21:12:22.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac0c52c0 con 0x7f4cac1503c0 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4cac159c40 con 0x7f4cac15d020 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb3348640 10 monclient(hunting): authenticate will time out at 1326.490411s 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb18be640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7f4cac0c4740 0x7f4cac0c6a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:40378/0 (socket says 10.20.193.45:40378) 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb18be640 1 -- 10.20.193.45:0/417205063 learned_addr learned my addr 10.20.193.45:0/417205063 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.860+0000 7f4cb08bc640 1 --2- 10.20.193.45:0/417205063 >> v2:10.20.193.92:3300/0 conn(0x7f4cac15d020 0x7f4cac15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.861+0000 7f4cb08bc640 10 monclient(hunting): get_auth_request con 0x7f4cac15d020 auth_method 0 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.861+0000 7f4cb08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.861+0000 7f4cb08bc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.861+0000 7f4cb08bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.861+0000 7f4cb08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.861+0000 7f4cb08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.861+0000 7f4cb08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4c9bfff640 1 -- 10.20.193.45:0/417205063 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388192170 0 0) 0x7f4ca8002ca0 con 0x7f4cac0c4740 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4c9bfff640 10 monclient(hunting): _negotiate 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4c9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4c9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4c9bfff640 10 monclient(hunting): my global_id is 5112 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4c9bfff640 1 -- 10.20.193.45:0/417205063 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c94003620 con 0x7f4cac0c4740 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4cb08bc640 10 monclient(hunting): handle_auth_done global_id 5207 payload 274 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4cb08bc640 1 -- 10.20.193.45:0/417205063 >> v1:10.20.193.86:6789/0 conn(0x7f4cac1503c0 legacy=0x7f4cac06fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4cb08bc640 1 -- 10.20.193.45:0/417205063 >> v1:10.20.193.45:6789/0 conn(0x7f4cac0c4740 legacy=0x7f4cac0c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4cb08bc640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4cb08bc640 1 monclient: found mon.noname-c 2026-02-17T21:12:22.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4cb08bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4cb08bc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:22.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.862+0000 7f4cb08bc640 1 -- 10.20.193.45:0/417205063 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac159f20 con 0x7f4cac15d020 2026-02-17T21:12:22.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.863+0000 7f4cb08bc640 1 --2- 10.20.193.45:0/417205063 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cac15d020 0x7f4cac15d490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00098a0 tx=0x7f4ca002ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9baf5fc83eb7b4b2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 1 -- 10.20.193.45:0/417205063 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca003c070 con 0x7f4cac15d020 2026-02-17T21:12:22.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 10 monclient: dump: 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.865 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 5 monclient: authenticate success, global_id 5207 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 1 -- 10.20.193.45:0/417205063 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca002fc10 con 0x7f4cac15d020 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 1 -- 10.20.193.45:0/417205063 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0037440 con 0x7f4cac15d020 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 4 set_mon_vals no callback set 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4c9bfff640 10 monclient: dump: 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 10 monclient: shutdown 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 1 -- 10.20.193.45:0/417205063 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cac15d020 msgr2=0x7f4cac15d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 1 --2- 10.20.193.45:0/417205063 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cac15d020 0x7f4cac15d490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00098a0 tx=0x7f4ca002ef00 comp rx=0 tx=0).stop 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 1 -- 10.20.193.45:0/417205063 shutdown_connections 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 1 --2- 10.20.193.45:0/417205063 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cac15d020 0x7f4cac15d490 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 1 -- 10.20.193.45:0/417205063 >> 10.20.193.45:0/417205063 conn(0x7f4cac0cd520 msgr2=0x7f4cac0cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 1 -- 10.20.193.45:0/417205063 shutdown_connections 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 1 -- 10.20.193.45:0/417205063 wait complete. 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.865+0000 7f4cb3348640 10 monclient: monmap: 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:22.868 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 librados: starting msgr at 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 librados: starting objecter 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 Processor -- start 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 -- start start 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 librados: setting wanted keys 2026-02-17T21:12:22.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 librados: calling monclient init 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient: init 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cac0c4740 0x7f4cac144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient(hunting): picked mon.noname-c con 0x7f4cac0c4740 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4cac1503c0 0x7f4cac1f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient(hunting): picked mon.noname-b con 0x7f4cac1503c0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4cac15d020 0x7f4cac1f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient(hunting): picked mon.noname-a con 0x7f4cac15d020 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac0704d0 con 0x7f4cac15d020 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac15a4e0 con 0x7f4cac1503c0 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac1507a0 con 0x7f4cac0c4740 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb3348640 10 monclient(hunting): authenticate will time out at 1326.496692s 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.866+0000 7f4cb18be640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4cac15d020 0x7f4cac1f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cac0c4740 0x7f4cac144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb08bc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4cac1503c0 0x7f4cac1f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cac0c4740 0x7f4cac144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:34928/0 (socket says 10.20.193.45:34928) 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 1 -- 10.20.193.45:0/1011549894 learned_addr learned my addr 10.20.193.45:0/1011549894 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 10 monclient(hunting): get_auth_request con 0x7f4cac0c4740 auth_method 0 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb08bc640 10 monclient(hunting): get_auth_request con 0x7f4cac1503c0 auth_method 0 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb08bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb08bc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb08bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb18be640 10 monclient(hunting): get_auth_request con 0x7f4cac15d020 auth_method 0 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb18be640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb18be640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb18be640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb10bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb08bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb08bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb08bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb18be640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb18be640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.867+0000 7f4cb18be640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 10 monclient(hunting): handle_auth_done global_id 5179 payload 824 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 1 -- 10.20.193.45:0/1011549894 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cac0c4740 msgr2=0x7f4cac144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cac0c4740 0x7f4cac144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 1 -- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4cac15d020 msgr2=0x7f4cac1f63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f4cac15d020 0x7f4cac1f63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 1 monclient: found mon.noname-b 2026-02-17T21:12:22.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.868+0000 7f4cb08bc640 1 -- 10.20.193.45:0/1011549894 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac1f5700 con 0x7f4cac1503c0 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.869+0000 7f4cb08bc640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4cac1503c0 0x7f4cac1f5e90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cac06cea0 tx=0x7f4ca00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.869+0000 7f4c99ffb640 10 client.?.objecter ms_handle_connect 0x7f4cac1503c0 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.869+0000 7f4c99ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 1 -- 10.20.193.45:0/1011549894 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca003c040 con 0x7f4cac1503c0 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 10 monclient: dump: 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.874 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 5 monclient: authenticate success, global_id 5179 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 10 monclient: _renew_subs 2026-02-17T21:12:22.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cac1f7d20 con 0x7f4cac1503c0 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 10 client.5179.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 10 monclient: _renew_subs 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cac1f82e0 con 0x7f4cac1503c0 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 1 librados: init done 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 1 -- 10.20.193.45:0/1011549894 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca002fb50 con 0x7f4cac1503c0 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 1 -- 10.20.193.45:0/1011549894 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0042810 con 0x7f4cac1503c0 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c99ffb640 10 monclient: dump: 2026-02-17T21:12:22.876 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 10 client.5179.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4c9b7fe640 4 set_mon_vals no callback set 2026-02-17T21:12:22.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 15 client.5179.objecter _session_command_op_assign -1 1 2026-02-17T21:12:22.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 20 client.5179.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:22.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 10 client.5179.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:22.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:22.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.871+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4cac0c65e0 con 0x7f4cac1503c0 2026-02-17T21:12:22.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.883+0000 7f4c99ffb640 1 -- 10.20.193.45:0/1011549894 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4ca00429b0 con 0x7f4cac1503c0 2026-02-17T21:12:22.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.883+0000 7f4c99ffb640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c7c079280 0x7f4c7c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.884+0000 7f4cb10bd640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c7c079280 0x7f4c7c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.884+0000 7f4cb10bd640 10 monclient: get_auth_request con 0x7f4c7c079280 auth_method 0 2026-02-17T21:12:22.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.884+0000 7f4cb10bd640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c7c079280 0x7f4c7c07b740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c002770 tx=0x7f4c9c002a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.884+0000 7f4c99ffb640 10 client.5179.objecter ms_handle_connect 0x7f4c7c079280 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.884+0000 7f4c99ffb640 1 -- 10.20.193.45:0/1011549894 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f4ca00bc820 con 0x7f4cac1503c0 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.884+0000 7f4c99ffb640 10 client.5179.objecter ms_dispatch2 0x7f4cac000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.884+0000 7f4c99ffb640 3 client.5179.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.884+0000 7f4c99ffb640 3 client.5179.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 10 client.5179.objecter checking command 1 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f4c7c0817c0 0x7f4c7c083be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 20 client.5179.objecter _get_session s=0x7f4c7c0810f0 osd=12 3 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 20 client.5179.objecter put_session s=0x7f4c7c0810f0 osd=12 3 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 15 client.5179.objecter _session_command_op_remove -1 1 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 20 client.5179.objecter _get_session s=0x7f4c7c0810f0 osd=12 3 2026-02-17T21:12:22.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 20 client.5179.objecter get_session s=0x7f4c7c0810f0 osd=12 3 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 15 client.5179.objecter _session_command_op_assign 12 1 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 20 client.5179.objecter put_session s=0x7f4c7c0810f0 osd=12 4 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 10 client.5179.objecter _send_command 1 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 1 -- 10.20.193.45:0/1011549894 --> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c7c0842b0 con 0x7f4c7c0817c0 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 20 client.5179.objecter dump_active .. 0 homeless 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 1 -- 10.20.193.45:0/1011549894 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4ca0083240 con 0x7f4cac1503c0 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4c99ffb640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4cb18be640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f4c7c0817c0 0x7f4c7c083be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.885+0000 7f4cb18be640 10 monclient: get_auth_request con 0x7f4c7c0817c0 auth_method 0 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.887+0000 7f4cb18be640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f4c7c0817c0 0x7f4c7c083be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.12 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.887+0000 7f4c99ffb640 10 client.5179.objecter ms_handle_connect 0x7f4c7c0817c0 2026-02-17T21:12:22.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.897+0000 7f4c99ffb640 1 -- 10.20.193.45:0/1011549894 <== osd.12 v2:10.20.193.45:6802/1807719437 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f4c7c0842b0 con 0x7f4c7c0817c0 2026-02-17T21:12:22.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.897+0000 7f4c99ffb640 10 client.5179.objecter ms_dispatch2 0x7f4cac000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:22.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.897+0000 7f4c99ffb640 10 client.5179.objecter _finish_command 1 = system:0 2026-02-17T21:12:22.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.897+0000 7f4c99ffb640 20 client.5179.objecter put_session s=0x7f4c7c0810f0 osd=12 4 2026-02-17T21:12:22.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.897+0000 7f4c99ffb640 15 client.5179.objecter _session_command_op_remove 12 1 2026-02-17T21:12:22.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 10 client.5179.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:22.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 15 client.5179.objecter _session_command_op_assign -1 2 2026-02-17T21:12:22.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 20 client.5179.objecter _get_session s=0x7f4c7c0810f0 osd=12 3 2026-02-17T21:12:22.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 20 client.5179.objecter put_session s=0x7f4c7c0810f0 osd=12 3 2026-02-17T21:12:22.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 20 client.5179.objecter _get_session s=0x7f4c7c0810f0 osd=12 3 2026-02-17T21:12:22.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 15 client.5179.objecter _session_command_op_remove -1 2 2026-02-17T21:12:22.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 20 client.5179.objecter get_session s=0x7f4c7c0810f0 osd=12 3 2026-02-17T21:12:22.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 15 client.5179.objecter _session_command_op_assign 12 2 2026-02-17T21:12:22.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 20 client.5179.objecter put_session s=0x7f4c7c0810f0 osd=12 4 2026-02-17T21:12:22.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 10 client.5179.objecter _send_command 2 2026-02-17T21:12:22.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.903+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 --> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4cac15d490 con 0x7f4c7c0817c0 2026-02-17T21:12:22.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4c99ffb640 1 -- 10.20.193.45:0/1011549894 <== osd.12 v2:10.20.193.45:6802/1807719437 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4cac15d490 con 0x7f4c7c0817c0 2026-02-17T21:12:22.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4c99ffb640 10 client.5179.objecter ms_dispatch2 0x7f4cac000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4c99ffb640 10 client.5179.objecter _finish_command 2 = system:0 2026-02-17T21:12:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4c99ffb640 20 client.5179.objecter put_session s=0x7f4c7c0810f0 osd=12 4 2026-02-17T21:12:22.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4c99ffb640 15 client.5179.objecter _session_command_op_remove 12 2 2026-02-17T21:12:22.904 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:22.904 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:22.904 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:22.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 10 librados: watch_flush enter 2026-02-17T21:12:22.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 10 librados: watch_flush exit 2026-02-17T21:12:22.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 10 client.5179.objecter close_session for osd.12 2026-02-17T21:12:22.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f4c7c0817c0 msgr2=0x7f4c7c083be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6802/1807719437,v1:10.20.193.45:6803/1807719437] conn(0x7f4c7c0817c0 0x7f4c7c083be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 20 client.5179.objecter put_session s=0x7f4c7c0810f0 osd=12 1 2026-02-17T21:12:22.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 20 client.5179.objecter shutdown clearing up homeless session... 2026-02-17T21:12:22.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 10 client.5179.objecter successfully canceled tick 2026-02-17T21:12:22.906 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c7c079280 msgr2=0x7f4c7c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4c7c079280 0x7f4c7c07b740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c002770 tx=0x7f4c9c002a30 comp rx=0 tx=0).stop 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 10 monclient: shutdown 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4cac1503c0 msgr2=0x7f4cac1f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 --2- 10.20.193.45:0/1011549894 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f4cac1503c0 0x7f4cac1f5e90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cac06cea0 tx=0x7f4ca00047c0 comp rx=0 tx=0).stop 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb18be640 1 -- 10.20.193.45:0/1011549894 reap_dead start 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 shutdown_connections 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 >> 10.20.193.45:0/1011549894 conn(0x7f4cac0cd520 msgr2=0x7f4cac0cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 shutdown_connections 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 -- 10.20.193.45:0/1011549894 wait complete. 2026-02-17T21:12:22.907 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.911+0000 7f4cb3348640 1 librados: shutdown 2026-02-17T21:12:22.913 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-17T21:12:22.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.988+0000 7f708425f640 10 monclient: get_monmap_and_config 2026-02-17T21:12:22.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.988+0000 7f708425f640 10 monclient: build_initial_monmap 2026-02-17T21:12:22.981 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.988+0000 7f708425f640 10 monclient: monmap: 2026-02-17T21:12:22.981 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:22.981 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:22.989725+0000 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:22.989725+0000 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:22.982 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 1 Processor -- start 2026-02-17T21:12:22.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 1 -- start start 2026-02-17T21:12:22.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 10 monclient: init 2026-02-17T21:12:22.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:22.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 10 monclient: _add_conns ranks=[3,0,1,5,2,4] 2026-02-17T21:12:22.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f707c15d1e0 0x7f707c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:22.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 10 monclient(hunting): picked mon.noname-a con 0x7f707c15d1e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:22.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f707c0748e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:22.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f707c0c92b0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:22.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c0c5860 con 0x7f707c0748e0 2026-02-17T21:12:22.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f707c0c5580 con 0x7f707c0c92b0 2026-02-17T21:12:22.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:22.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f707c0c7de0 con 0x7f707c15d1e0 2026-02-17T21:12:22.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:22.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.989+0000 7f708425f640 10 monclient(hunting): authenticate will time out at 1326.619826s 2026-02-17T21:12:22.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.992+0000 7f70827d5640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f707c0c92b0 0x7f707c153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:46772/0 (socket says 10.20.193.45:46772) 2026-02-17T21:12:22.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.992+0000 7f70827d5640 1 -- 10.20.193.45:0/2964273805 learned_addr learned my addr 10.20.193.45:0/2964273805 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:22.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.993+0000 7f7081fd4640 1 --2- 10.20.193.45:0/2964273805 >> v2:10.20.193.45:3300/0 conn(0x7f707c15d1e0 0x7f707c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:22.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.993+0000 7f7081fd4640 10 monclient(hunting): get_auth_request con 0x7f707c15d1e0 auth_method 0 2026-02-17T21:12:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.993+0000 7f7081fd4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.993+0000 7f7081fd4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.993+0000 7f7081fd4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.994+0000 7f7081fd4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.994+0000 7f7081fd4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:22.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.994+0000 7f7081fd4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.994+0000 7f7080fd2640 1 -- 10.20.193.45:0/2964273805 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992148431 0 0) 0x7f707c0c5580 con 0x7f707c0c92b0 2026-02-17T21:12:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.994+0000 7f7080fd2640 10 monclient(hunting): _negotiate 2026-02-17T21:12:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.994+0000 7f7080fd2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:22.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.994+0000 7f7080fd2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.994+0000 7f7080fd2640 10 monclient(hunting): my global_id is 5182 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.994+0000 7f7080fd2640 1 -- 10.20.193.45:0/2964273805 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7064003620 con 0x7f707c0c92b0 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.995+0000 7f7081fd4640 10 monclient(hunting): handle_auth_done global_id 5118 payload 274 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.995+0000 7f7081fd4640 1 -- 10.20.193.45:0/2964273805 >> v1:10.20.193.86:6789/0 conn(0x7f707c0c92b0 legacy=0x7f707c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.995+0000 7f7081fd4640 1 -- 10.20.193.45:0/2964273805 >> v1:10.20.193.45:6789/0 conn(0x7f707c0748e0 legacy=0x7f707c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.995+0000 7f7081fd4640 10 monclient: _finish_hunting 0 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.995+0000 7f7081fd4640 1 monclient: found mon.noname-a 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.995+0000 7f7081fd4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.995+0000 7f7081fd4640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:22.989 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.995+0000 7f7081fd4640 1 -- 10.20.193.45:0/2964273805 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c0c80c0 con 0x7f707c15d1e0 2026-02-17T21:12:22.990 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:22.997+0000 7f7081fd4640 1 --2- 10.20.193.45:0/2964273805 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c15d1e0 0x7f707c15d5c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f706c0098d0 tx=0x7f706c02eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d58774c40a10e8e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:22.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 1 -- 10.20.193.45:0/2964273805 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c03c070 con 0x7f707c15d1e0 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 10 monclient: dump: 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.997 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 10 monclient: _finish_auth 0 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 10 monclient: _check_auth_tickets 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 5 monclient: authenticate success, global_id 5118 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 1 -- 10.20.193.45:0/2964273805 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f706c02fba0 con 0x7f707c15d1e0 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:22.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 1 -- 10.20.193.45:0/2964273805 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c037440 con 0x7f707c15d1e0 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 4 set_mon_vals no callback set 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f7080fd2640 10 monclient: dump: 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:22.999 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 10 monclient: shutdown 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 1 -- 10.20.193.45:0/2964273805 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c15d1e0 msgr2=0x7f707c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 1 --2- 10.20.193.45:0/2964273805 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c15d1e0 0x7f707c15d5c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f706c0098d0 tx=0x7f706c02eed0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 1 -- 10.20.193.45:0/2964273805 shutdown_connections 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 1 --2- 10.20.193.45:0/2964273805 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c15d1e0 0x7f707c15d5c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 1 -- 10.20.193.45:0/2964273805 >> 10.20.193.45:0/2964273805 conn(0x7f707c0c9d40 msgr2=0x7f707c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 1 -- 10.20.193.45:0/2964273805 shutdown_connections 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.000+0000 7f708425f640 1 -- 10.20.193.45:0/2964273805 wait complete. 2026-02-17T21:12:23.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient: build_initial_monmap 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient: monmap: 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:23.001 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 librados: starting msgr at 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 librados: starting objecter 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 Processor -- start 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 -- start start 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 librados: setting wanted keys 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 librados: calling monclient init 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient: init 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f707c0748e0 0x7f707c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient(hunting): picked mon.noname-c con 0x7f707c0748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c0c92b0 0x7f707c151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient(hunting): picked mon.noname-a con 0x7f707c0c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f707c15d1e0 0x7f707c1f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient(hunting): picked mon.noname-b con 0x7f707c15d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f707c074d30 con 0x7f707c0c92b0 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f707c0c8680 con 0x7f707c15d1e0 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f707c153d20 con 0x7f707c0748e0 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.001+0000 7f708425f640 10 monclient(hunting): authenticate will time out at 1326.631915s 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c0c92b0 0x7f707c151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f7081fd4640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f707c0748e0 0x7f707c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c0c92b0 0x7f707c151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36466/0 (socket says 10.20.193.45:36466) 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 1 -- 10.20.193.45:0/1028431655 learned_addr learned my addr 10.20.193.45:0/1028431655 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 10 monclient(hunting): get_auth_request con 0x7f707c0c92b0 auth_method 0 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70827d5640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f707c15d1e0 0x7f707c1f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f7081fd4640 10 monclient(hunting): get_auth_request con 0x7f707c0748e0 auth_method 0 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f7081fd4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f7081fd4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f7081fd4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70827d5640 10 monclient(hunting): get_auth_request con 0x7f707c15d1e0 auth_method 0 2026-02-17T21:12:23.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70827d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70827d5640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70827d5640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70817d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f7081fd4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f7081fd4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f7081fd4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70827d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70827d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.002+0000 7f70827d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 10 monclient(hunting): handle_auth_done global_id 5124 payload 824 2026-02-17T21:12:23.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 1 -- 10.20.193.45:0/1028431655 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f707c0748e0 msgr2=0x7f707c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f707c0748e0 0x7f707c0ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 1 -- 10.20.193.45:0/1028431655 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f707c15d1e0 msgr2=0x7f707c1f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f707c15d1e0 0x7f707c1f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 1 monclient: found mon.noname-a 2026-02-17T21:12:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:23.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.003+0000 7f70817d3640 1 -- 10.20.193.45:0/1028431655 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c072490 con 0x7f707c0c92b0 2026-02-17T21:12:23.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.005+0000 7f70817d3640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c0c92b0 0x7f707c151650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f707000c730 tx=0x7f707000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.005+0000 7f706a7fc640 10 client.?.objecter ms_handle_connect 0x7f707c0c92b0 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.005+0000 7f706a7fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 1 -- 10.20.193.45:0/1028431655 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70700052d0 con 0x7f707c0c92b0 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 10 monclient: dump: 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.009 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 1 -- 10.20.193.45:0/1028431655 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7070005470 con 0x7f707c0c92b0 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f708425f640 5 monclient: authenticate success, global_id 5124 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f708425f640 10 monclient: _renew_subs 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f708425f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:23.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707c1f4590 con 0x7f707c0c92b0 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 1 -- 10.20.193.45:0/1028431655 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70700038d0 con 0x7f707c0c92b0 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706bfff640 4 set_mon_vals no callback set 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f706a7fc640 10 monclient: dump: 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.011 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f708425f640 10 client.5124.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f708425f640 10 monclient: _renew_subs 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f708425f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707c072730 con 0x7f707c0c92b0 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.006+0000 7f708425f640 1 librados: init done 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.007+0000 7f708425f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.007+0000 7f708425f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.007+0000 7f708425f640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:23.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.007+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f707c15d5c0 con 0x7f707c0c92b0 2026-02-17T21:12:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.019+0000 7f706a7fc640 1 -- 10.20.193.45:0/1028431655 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f7070003a70 con 0x7f707c0c92b0 2026-02-17T21:12:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.019+0000 7f706a7fc640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f704c0792d0 0x7f704c07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.019+0000 7f7081fd4640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f704c0792d0 0x7f704c07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.019+0000 7f7081fd4640 10 monclient: get_auth_request con 0x7f704c0792d0 auth_method 0 2026-02-17T21:12:23.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.019+0000 7f706a7fc640 10 client.5124.objecter ms_handle_connect 0x7f704c0792d0 2026-02-17T21:12:23.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.019+0000 7f7081fd4640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f704c0792d0 0x7f704c07b790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f706c039000 tx=0x7f706c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.124+0000 7f706a7fc640 1 -- 10.20.193.45:0/1028431655 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f707005e440 con 0x7f707c0c92b0 2026-02-17T21:12:23.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.124+0000 7f706a7fc640 10 client.5124.objecter ms_dispatch2 0x7f707c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:23.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.124+0000 7f706a7fc640 3 client.5124.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:23.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.124+0000 7f706a7fc640 3 client.5124.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:23.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.125+0000 7f706a7fc640 20 client.5124.objecter dump_active .. 0 homeless 2026-02-17T21:12:23.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.125+0000 7f706a7fc640 1 -- 10.20.193.45:0/1028431655 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7070062400 con 0x7f707c0c92b0 2026-02-17T21:12:23.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.125+0000 7f706a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.125+0000 7f706a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:23.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.211+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7f707c0c9b20 con 0x7f704c0792d0 2026-02-17T21:12:23.204 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.212+0000 7f706a7fc640 1 -- 10.20.193.45:0/1028431655 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f707c0c9b20 con 0x7f704c0792d0 2026-02-17T21:12:23.204 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 12 to deep-scrub 2026-02-17T21:12:23.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.213+0000 7f708425f640 10 librados: watch_flush enter 2026-02-17T21:12:23.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.213+0000 7f708425f640 10 librados: watch_flush exit 2026-02-17T21:12:23.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.213+0000 7f708425f640 20 client.5124.objecter shutdown clearing up homeless session... 2026-02-17T21:12:23.207 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.213+0000 7f708425f640 10 client.5124.objecter successfully canceled tick 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f704c0792d0 msgr2=0x7f704c07b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f704c0792d0 0x7f704c07b790 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f706c039000 tx=0x7f706c033000 comp rx=0 tx=0).stop 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 10 monclient: shutdown 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c0c92b0 msgr2=0x7f707c151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c0c92b0 0x7f707c151650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f707000c730 tx=0x7f707000cc00 comp rx=0 tx=0).stop 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 shutdown_connections 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f704c0792d0 0x7f704c07b790 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f707c15d1e0 0x7f707c1f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f707c0c92b0 0x7f707c151650 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 --2- 10.20.193.45:0/1028431655 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f707c0748e0 0x7f707c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.208 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 >> 10.20.193.45:0/1028431655 conn(0x7f707c0c9d40 msgr2=0x7f707c152b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:23.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 shutdown_connections 2026-02-17T21:12:23.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 -- 10.20.193.45:0/1028431655 wait complete. 2026-02-17T21:12:23.209 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.214+0000 7f708425f640 1 librados: shutdown 2026-02-17T21:12:23.215 INFO:tasks.ceph:Scrubbing osd.1 2026-02-17T21:12:23.216 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:23.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.293+0000 7f19d912a640 10 monclient: get_monmap_and_config 2026-02-17T21:12:23.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.293+0000 7f19d912a640 10 monclient: build_initial_monmap 2026-02-17T21:12:23.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.293+0000 7f19d912a640 10 monclient: monmap: 2026-02-17T21:12:23.286 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:23.286 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:23.294670+0000 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:23.294670+0000 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:23.287 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.294+0000 7f19d912a640 1 Processor -- start 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.294+0000 7f19d912a640 1 -- start start 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.294+0000 7f19d912a640 10 monclient: init 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 10 monclient: _add_conns ranks=[2,3,1,4,0,5] 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f19d4155a80 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f19d4155e60 0x7f19d415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 10 monclient(hunting): picked mon.noname-a con 0x7f19d4155e60 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f19d415df10 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d40c9ba0 con 0x7f19d415df10 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d40c9e80 con 0x7f19d4155a80 2026-02-17T21:12:23.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f19d415d090 con 0x7f19d4155e60 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d912a640 10 monclient(hunting): authenticate will time out at 1326.925206s 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d2575640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f19d4155e60 0x7f19d415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d2d76640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f19d4155a80 0x7f19d415d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45504/0 (socket says 10.20.193.45:45504) 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d2d76640 1 -- 10.20.193.45:0/145369112 learned_addr learned my addr 10.20.193.45:0/145369112 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d2575640 10 monclient(hunting): get_auth_request con 0x7f19d4155e60 auth_method 0 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.295+0000 7f19d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.296+0000 7f19d2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.296+0000 7f19d2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.296+0000 7f19d2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 1 -- 10.20.193.45:0/145369112 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786305053 0 0) 0x7f19d40c9e80 con 0x7f19d4155a80 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 10 monclient(hunting): _negotiate 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 10 monclient(hunting): my global_id is 5216 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 1 -- 10.20.193.45:0/145369112 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19c0003620 con 0x7f19d4155a80 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 1 -- 10.20.193.45:0/145369112 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320327082 0 0) 0x7f19d40c9ba0 con 0x7f19d415df10 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 10 monclient(hunting): _negotiate 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 10 monclient(hunting): my global_id is 5188 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d1d74640 1 -- 10.20.193.45:0/145369112 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19d40c9e80 con 0x7f19d415df10 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d2575640 10 monclient(hunting): handle_auth_done global_id 5127 payload 274 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d2575640 1 -- 10.20.193.45:0/145369112 >> v1:10.20.193.92:6789/0 conn(0x7f19d4155a80 legacy=0x7f19d415d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d2575640 1 -- 10.20.193.45:0/145369112 >> v1:10.20.193.86:6789/0 conn(0x7f19d415df10 legacy=0x7f19d415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d2575640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d2575640 1 monclient: found mon.noname-a 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d2575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.297+0000 7f19d2575640 1 -- 10.20.193.45:0/145369112 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d40ca160 con 0x7f19d4155e60 2026-02-17T21:12:23.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.298+0000 7f19d2575640 1 --2- 10.20.193.45:0/145369112 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f19d4155e60 0x7f19d415f190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0098d0 tx=0x7f19bc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d059820e877069e5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 1 -- 10.20.193.45:0/145369112 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc03c070 con 0x7f19d4155e60 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 10 monclient: dump: 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.301 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d912a640 5 monclient: authenticate success, global_id 5127 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 1 -- 10.20.193.45:0/145369112 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc02fbf0 con 0x7f19d4155e60 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:23.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 1 -- 10.20.193.45:0/145369112 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc037440 con 0x7f19d4155e60 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d912a640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d912a640 4 set_mon_vals no callback set 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d1d74640 10 monclient: dump: 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.303 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d912a640 10 monclient: shutdown 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d912a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d912a640 1 -- 10.20.193.45:0/145369112 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f19d4155e60 msgr2=0x7f19d415f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d912a640 1 --2- 10.20.193.45:0/145369112 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f19d4155e60 0x7f19d415f190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0098d0 tx=0x7f19bc02ef20 comp rx=0 tx=0).stop 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d912a640 1 -- 10.20.193.45:0/145369112 shutdown_connections 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.300+0000 7f19d912a640 1 --2- 10.20.193.45:0/145369112 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f19d4155e60 0x7f19d415f190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 1 -- 10.20.193.45:0/145369112 >> 10.20.193.45:0/145369112 conn(0x7f19d4073030 msgr2=0x7f19d4073440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 1 -- 10.20.193.45:0/145369112 shutdown_connections 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 1 -- 10.20.193.45:0/145369112 wait complete. 2026-02-17T21:12:23.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 10 monclient: build_initial_monmap 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 10 monclient: monmap: 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 1 librados: starting msgr at 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 1 librados: starting objecter 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 1 Processor -- start 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 1 -- start start 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 1 librados: setting wanted keys 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 1 librados: calling monclient init 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.301+0000 7f19d912a640 10 monclient: init 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f19d4155a80 0x7f19d4158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient(hunting): picked mon.noname-b con 0x7f19d4155a80 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f19d4155e60 0x7f19d414fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient(hunting): picked mon.noname-c con 0x7f19d4155e60 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:23.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f19d415df10 0x7f19d41545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient(hunting): picked mon.noname-a con 0x7f19d415df10 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f19d4074ed0 con 0x7f19d415df10 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f19d415d370 con 0x7f19d4155a80 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f19d408f830 con 0x7f19d4155e60 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d912a640 10 monclient(hunting): authenticate will time out at 1326.932358s 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f19d4155e60 0x7f19d414fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d3577640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f19d415df10 0x7f19d41545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2d76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f19d4155a80 0x7f19d4158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f19d4155e60 0x7f19d414fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:34954/0 (socket says 10.20.193.45:34954) 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2575640 1 -- 10.20.193.45:0/1884691445 learned_addr learned my addr 10.20.193.45:0/1884691445 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2575640 10 monclient(hunting): get_auth_request con 0x7f19d4155e60 auth_method 0 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2d76640 10 monclient(hunting): get_auth_request con 0x7f19d4155a80 auth_method 0 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d3577640 10 monclient(hunting): get_auth_request con 0x7f19d415df10 auth_method 0 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d3577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d3577640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.302+0000 7f19d3577640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.303+0000 7f19d2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.303+0000 7f19d2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.303+0000 7f19d2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.303+0000 7f19d3577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.303+0000 7f19d3577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.303+0000 7f19d3577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.303+0000 7f19d2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.303+0000 7f19d2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.303+0000 7f19d2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 10 monclient(hunting): handle_auth_done global_id 5219 payload 824 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 1 -- 10.20.193.45:0/1884691445 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f19d4155a80 msgr2=0x7f19d4158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f19d4155a80 0x7f19d4158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 1 -- 10.20.193.45:0/1884691445 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f19d415df10 msgr2=0x7f19d41545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f19d415df10 0x7f19d41545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 1 monclient: found mon.noname-c 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.304+0000 7f19d2575640 1 -- 10.20.193.45:0/1884691445 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d4159390 con 0x7f19d4155e60 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.305+0000 7f19d2575640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f19d4155e60 0x7f19d414fc20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f19bc03a040 tx=0x7f19bc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.305+0000 7f19b37fe640 10 client.?.objecter ms_handle_connect 0x7f19d4155e60 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.305+0000 7f19b37fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19b37fe640 1 -- 10.20.193.45:0/1884691445 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc046020 con 0x7f19d4155e60 2026-02-17T21:12:23.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19b37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19b37fe640 10 monclient: dump: 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19b37fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19b37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19d912a640 5 monclient: authenticate success, global_id 5219 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19d912a640 10 monclient: _renew_subs 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19d912a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d4157ad0 con 0x7f19d4155e60 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19d912a640 10 client.5219.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19d912a640 10 monclient: _renew_subs 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19d912a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d4158090 con 0x7f19d4155e60 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.306+0000 7f19d912a640 1 librados: init done 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19b37fe640 1 -- 10.20.193.45:0/1884691445 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19bc02fab0 con 0x7f19d4155e60 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19b37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:23.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19b37fe640 1 -- 10.20.193.45:0/1884691445 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19bc03c040 con 0x7f19d4155e60 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19b37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19d1573640 4 set_mon_vals no callback set 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19b37fe640 10 monclient: dump: 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.313 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.314 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19d912a640 10 client.5219.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19d912a640 15 client.5219.objecter _session_command_op_assign -1 1 2026-02-17T21:12:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19d912a640 20 client.5219.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19d912a640 10 client.5219.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19d912a640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:23.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.307+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19d4069d70 con 0x7f19d4155e60 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.318+0000 7f19b37fe640 1 -- 10.20.193.45:0/1884691445 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f19bc042850 con 0x7f19d4155e60 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.319+0000 7f19b37fe640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f19a0079280 0x7f19a007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.319+0000 7f19d2d76640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f19a0079280 0x7f19a007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.319+0000 7f19d2d76640 10 monclient: get_auth_request con 0x7f19a0079280 auth_method 0 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.319+0000 7f19b37fe640 10 client.5219.objecter ms_handle_connect 0x7f19a0079280 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.319+0000 7f19d2d76640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f19a0079280 0x7f19a007b740 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f19c8005980 tx=0x7f19c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.320+0000 7f19b37fe640 1 -- 10.20.193.45:0/1884691445 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f19bc0bca30 con 0x7f19d4155e60 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.320+0000 7f19b37fe640 10 client.5219.objecter ms_dispatch2 0x7f19d4000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.320+0000 7f19b37fe640 3 client.5219.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.320+0000 7f19b37fe640 3 client.5219.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:23.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 10 client.5219.objecter checking command 1 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f19a0081760 0x7f19a0083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 20 client.5219.objecter _get_session s=0x7f19a0081090 osd=1 3 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 20 client.5219.objecter put_session s=0x7f19a0081090 osd=1 3 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 15 client.5219.objecter _session_command_op_remove -1 1 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 20 client.5219.objecter _get_session s=0x7f19a0081090 osd=1 3 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 20 client.5219.objecter get_session s=0x7f19a0081090 osd=1 3 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 15 client.5219.objecter _session_command_op_assign 1 1 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 20 client.5219.objecter put_session s=0x7f19a0081090 osd=1 4 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 10 client.5219.objecter _send_command 1 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 1 -- 10.20.193.45:0/1884691445 --> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19bc038e50 con 0x7f19a0081760 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 20 client.5219.objecter dump_active .. 0 homeless 2026-02-17T21:12:23.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 1 -- 10.20.193.45:0/1884691445 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f19bc0833c0 con 0x7f19d4155e60 2026-02-17T21:12:23.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19b37fe640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:23.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19d3577640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f19a0081760 0x7f19a0083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.321+0000 7f19d3577640 10 monclient: get_auth_request con 0x7f19a0081760 auth_method 0 2026-02-17T21:12:23.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.323+0000 7f19b37fe640 10 client.5219.objecter ms_handle_connect 0x7f19a0081760 2026-02-17T21:12:23.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.323+0000 7f19d3577640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f19a0081760 0x7f19a0083b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.333+0000 7f19b37fe640 1 -- 10.20.193.45:0/1884691445 <== osd.1 v2:10.20.193.86:6800/37724401 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f19bc038e50 con 0x7f19a0081760 2026-02-17T21:12:23.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.333+0000 7f19b37fe640 10 client.5219.objecter ms_dispatch2 0x7f19d4000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:23.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.333+0000 7f19b37fe640 10 client.5219.objecter _finish_command 1 = system:0 2026-02-17T21:12:23.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.333+0000 7f19b37fe640 20 client.5219.objecter put_session s=0x7f19a0081090 osd=1 4 2026-02-17T21:12:23.326 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.333+0000 7f19b37fe640 15 client.5219.objecter _session_command_op_remove 1 1 2026-02-17T21:12:23.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 10 client.5219.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:23.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 15 client.5219.objecter _session_command_op_assign -1 2 2026-02-17T21:12:23.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 20 client.5219.objecter _get_session s=0x7f19a0081090 osd=1 3 2026-02-17T21:12:23.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 20 client.5219.objecter put_session s=0x7f19a0081090 osd=1 3 2026-02-17T21:12:23.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 20 client.5219.objecter _get_session s=0x7f19a0081090 osd=1 3 2026-02-17T21:12:23.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 15 client.5219.objecter _session_command_op_remove -1 2 2026-02-17T21:12:23.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 20 client.5219.objecter get_session s=0x7f19a0081090 osd=1 3 2026-02-17T21:12:23.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 15 client.5219.objecter _session_command_op_assign 1 2 2026-02-17T21:12:23.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 20 client.5219.objecter put_session s=0x7f19a0081090 osd=1 4 2026-02-17T21:12:23.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 10 client.5219.objecter _send_command 2 2026-02-17T21:12:23.333 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.340+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 --> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f19d4074bf0 con 0x7f19a0081760 2026-02-17T21:12:23.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19b37fe640 1 -- 10.20.193.45:0/1884691445 <== osd.1 v2:10.20.193.86:6800/37724401 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f19d4074bf0 con 0x7f19a0081760 2026-02-17T21:12:23.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19b37fe640 10 client.5219.objecter ms_dispatch2 0x7f19d4000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:23.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19b37fe640 10 client.5219.objecter _finish_command 2 = system:0 2026-02-17T21:12:23.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19b37fe640 20 client.5219.objecter put_session s=0x7f19a0081090 osd=1 4 2026-02-17T21:12:23.340 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19b37fe640 15 client.5219.objecter _session_command_op_remove 1 2 2026-02-17T21:12:23.341 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:23.341 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:23.341 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:23.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 10 librados: watch_flush enter 2026-02-17T21:12:23.342 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 10 librados: watch_flush exit 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 10 client.5219.objecter close_session for osd.1 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f19a0081760 msgr2=0x7f19a0083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.86:6800/37724401,v1:10.20.193.86:6801/37724401] conn(0x7f19a0081760 0x7f19a0083b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 20 client.5219.objecter put_session s=0x7f19a0081090 osd=1 1 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 20 client.5219.objecter shutdown clearing up homeless session... 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 10 client.5219.objecter successfully canceled tick 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f19a0079280 msgr2=0x7f19a007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f19a0079280 0x7f19a007b740 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f19c8005980 tx=0x7f19c8009040 comp rx=0 tx=0).stop 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 10 monclient: shutdown 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f19d4155e60 msgr2=0x7f19d414fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.343 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d912a640 1 --2- 10.20.193.45:0/1884691445 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f19d4155e60 0x7f19d414fc20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f19bc03a040 tx=0x7f19bc0047c0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.347+0000 7f19d3577640 1 -- 10.20.193.45:0/1884691445 reap_dead start 2026-02-17T21:12:23.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.348+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 shutdown_connections 2026-02-17T21:12:23.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.348+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 >> 10.20.193.45:0/1884691445 conn(0x7f19d4073030 msgr2=0x7f19d4153240 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:23.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.348+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 shutdown_connections 2026-02-17T21:12:23.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.348+0000 7f19d912a640 1 -- 10.20.193.45:0/1884691445 wait complete. 2026-02-17T21:12:23.344 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.348+0000 7f19d912a640 1 librados: shutdown 2026-02-17T21:12:23.347 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-17T21:12:23.418 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.426+0000 7fe77983b640 10 monclient: get_monmap_and_config 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.426+0000 7fe77983b640 10 monclient: build_initial_monmap 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.426+0000 7fe77983b640 10 monclient: monmap: 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:23.427169+0000 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:23.427169+0000 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:23.419 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:23.420 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:23.420 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:23.420 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:23.420 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:23.420 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.426+0000 7fe77983b640 1 Processor -- start 2026-02-17T21:12:23.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.426+0000 7fe77983b640 1 -- start start 2026-02-17T21:12:23.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.426+0000 7fe77983b640 10 monclient: init 2026-02-17T21:12:23.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 10 monclient: _add_conns ranks=[4,0,1,2,5,3] 2026-02-17T21:12:23.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fe77415d1e0 0x7fe77415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 10 monclient(hunting): picked mon.noname-b con 0x7fe77415d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:23.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe7740748e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:23.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe7740c92b0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7740c5860 con 0x7fe7740748e0 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7740c5580 con 0x7fe7740c92b0 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fe7740c7de0 con 0x7fe77415d1e0 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe77983b640 10 monclient(hunting): authenticate will time out at 1327.057278s 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe7727fc640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fe7740748e0 0x7fe7740c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:40406/0 (socket says 10.20.193.45:40406) 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe7727fc640 1 -- 10.20.193.45:0/3700848136 learned_addr learned my addr 10.20.193.45:0/3700848136 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.427+0000 7fe772ffd640 1 --2- 10.20.193.45:0/3700848136 >> v2:10.20.193.86:3300/0 conn(0x7fe77415d1e0 0x7fe77415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.428+0000 7fe772ffd640 10 monclient(hunting): get_auth_request con 0x7fe77415d1e0 auth_method 0 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.428+0000 7fe772ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.428+0000 7fe772ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.428+0000 7fe772ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.428+0000 7fe772ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.428+0000 7fe772ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.428+0000 7fe772ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe771ffb640 1 -- 10.20.193.45:0/3700848136 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9479576 0 0) 0x7fe7740c5860 con 0x7fe7740748e0 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe771ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe771ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe771ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe771ffb640 10 monclient(hunting): my global_id is 5133 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe771ffb640 1 -- 10.20.193.45:0/3700848136 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe760003620 con 0x7fe7740748e0 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe772ffd640 10 monclient(hunting): handle_auth_done global_id 5194 payload 274 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe772ffd640 1 -- 10.20.193.45:0/3700848136 >> v1:10.20.193.86:6789/0 conn(0x7fe7740c92b0 legacy=0x7fe774153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:23.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe772ffd640 1 -- 10.20.193.45:0/3700848136 >> v1:10.20.193.45:6789/0 conn(0x7fe7740748e0 legacy=0x7fe7740c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe772ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe772ffd640 1 monclient: found mon.noname-b 2026-02-17T21:12:23.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe772ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe772ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.429+0000 7fe772ffd640 1 -- 10.20.193.45:0/3700848136 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7740c80c0 con 0x7fe77415d1e0 2026-02-17T21:12:23.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.431+0000 7fe772ffd640 1 --2- 10.20.193.45:0/3700848136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 0x7fe77415d5c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe7680098d0 tx=0x7fe76802ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9229c0691d89bad2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.432+0000 7fe771ffb640 1 -- 10.20.193.45:0/3700848136 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76803c070 con 0x7fe77415d1e0 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.432+0000 7fe771ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.432+0000 7fe771ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.432+0000 7fe771ffb640 10 monclient: dump: 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.431 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.432+0000 7fe771ffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.432+0000 7fe771ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.432+0000 7fe771ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.432+0000 7fe77983b640 5 monclient: authenticate success, global_id 5194 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.432+0000 7fe77983b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe771ffb640 1 -- 10.20.193.45:0/3700848136 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76802fb00 con 0x7fe77415d1e0 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe771ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe771ffb640 1 -- 10.20.193.45:0/3700848136 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768037440 con 0x7fe77415d1e0 2026-02-17T21:12:23.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe771ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe771ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe771ffb640 10 monclient: dump: 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 4 set_mon_vals no callback set 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 10 monclient: shutdown 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 1 -- 10.20.193.45:0/3700848136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 msgr2=0x7fe77415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 1 --2- 10.20.193.45:0/3700848136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 0x7fe77415d5c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe7680098d0 tx=0x7fe76802ee80 comp rx=0 tx=0).stop 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 1 -- 10.20.193.45:0/3700848136 shutdown_connections 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 1 --2- 10.20.193.45:0/3700848136 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 0x7fe77415d5c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 1 -- 10.20.193.45:0/3700848136 >> 10.20.193.45:0/3700848136 conn(0x7fe7740c9d40 msgr2=0x7fe7740ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 1 -- 10.20.193.45:0/3700848136 shutdown_connections 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.433+0000 7fe77983b640 1 -- 10.20.193.45:0/3700848136 wait complete. 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 10 monclient: build_initial_monmap 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 10 monclient: monmap: 2026-02-17T21:12:23.434 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 1 librados: starting msgr at 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 1 librados: starting objecter 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 1 Processor -- start 2026-02-17T21:12:23.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 1 -- start start 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 1 librados: setting wanted keys 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 1 librados: calling monclient init 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 10 monclient: init 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7740748e0 0x7fe7741f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 10 monclient(hunting): picked mon.noname-c con 0x7fe7740748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7740c92b0 0x7fe7741f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 10 monclient(hunting): picked mon.noname-a con 0x7fe7740c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.434+0000 7fe77983b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 0x7fe77415c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe77983b640 10 monclient(hunting): picked mon.noname-b con 0x7fe77415d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:23.436 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe77983b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe77983b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe774074d30 con 0x7fe7740c92b0 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe77983b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe77983b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe7740c8680 con 0x7fe77415d1e0 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe77983b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe77983b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe774153d20 con 0x7fe7740748e0 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe77983b640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe77983b640 10 monclient(hunting): authenticate will time out at 1327.065013s 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 0x7fe77415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7727fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7740c92b0 0x7fe7741f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe772ffd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7740748e0 0x7fe7741f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 0x7fe77415c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38138/0 (socket says 10.20.193.45:38138) 2026-02-17T21:12:23.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 1 -- 10.20.193.45:0/1901617402 learned_addr learned my addr 10.20.193.45:0/1901617402 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 10 monclient(hunting): get_auth_request con 0x7fe77415d1e0 auth_method 0 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7727fc640 10 monclient(hunting): get_auth_request con 0x7fe7740c92b0 auth_method 0 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7727fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe772ffd640 10 monclient(hunting): get_auth_request con 0x7fe7740748e0 auth_method 0 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe772ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe772ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe772ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe772ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe772ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe772ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.435+0000 7fe7727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 10 monclient(hunting): handle_auth_done global_id 5197 payload 824 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 1 -- 10.20.193.45:0/1901617402 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7740748e0 msgr2=0x7fe7741f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7740748e0 0x7fe7741f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 1 -- 10.20.193.45:0/1901617402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7740c92b0 msgr2=0x7fe7741f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7740c92b0 0x7fe7741f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 1 monclient: found mon.noname-b 2026-02-17T21:12:23.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.437+0000 7fe7737fe640 1 -- 10.20.193.45:0/1901617402 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7741f1d10 con 0x7fe77415d1e0 2026-02-17T21:12:23.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.438+0000 7fe7737fe640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 0x7fe77415c160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe76400cc10 tx=0x7fe76400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.438+0000 7fe74bfff640 10 client.?.objecter ms_handle_connect 0x7fe77415d1e0 2026-02-17T21:12:23.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.438+0000 7fe74bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:23.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 1 -- 10.20.193.45:0/1901617402 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764016020 con 0x7fe77415d1e0 2026-02-17T21:12:23.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:23.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 10 monclient: dump: 2026-02-17T21:12:23.442 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.442 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.442 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 5 monclient: authenticate success, global_id 5197 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 10 monclient: _renew_subs 2026-02-17T21:12:23.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7741f1ff0 con 0x7fe77415d1e0 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 10 client.5197.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 10 monclient: _renew_subs 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7740cbe70 con 0x7fe77415d1e0 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 1 librados: init done 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 1 -- 10.20.193.45:0/1901617402 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76400ce30 con 0x7fe77415d1e0 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 1 -- 10.20.193.45:0/1901617402 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764012620 con 0x7fe77415d1e0 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:23.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe74bfff640 10 monclient: dump: 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe7717fa640 4 set_mon_vals no callback set 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.439+0000 7fe77983b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.440+0000 7fe77983b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.440+0000 7fe77983b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.440+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7740cbc60 con 0x7fe77415d1e0 2026-02-17T21:12:23.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.451+0000 7fe74bfff640 1 -- 10.20.193.45:0/1901617402 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fe7640127c0 con 0x7fe77415d1e0 2026-02-17T21:12:23.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.451+0000 7fe74bfff640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe744079280 0x7fe74407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.451+0000 7fe772ffd640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe744079280 0x7fe74407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.451+0000 7fe772ffd640 10 monclient: get_auth_request con 0x7fe744079280 auth_method 0 2026-02-17T21:12:23.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.452+0000 7fe74bfff640 10 client.5197.objecter ms_handle_connect 0x7fe744079280 2026-02-17T21:12:23.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.452+0000 7fe772ffd640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe744079280 0x7fe74407b740 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe768039000 tx=0x7fe768033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.453+0000 7fe74bfff640 1 -- 10.20.193.45:0/1901617402 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fe7640986c0 con 0x7fe77415d1e0 2026-02-17T21:12:23.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.453+0000 7fe74bfff640 10 client.5197.objecter ms_dispatch2 0x7fe774000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:23.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.453+0000 7fe74bfff640 3 client.5197.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:23.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.453+0000 7fe74bfff640 3 client.5197.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:23.448 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.454+0000 7fe74bfff640 20 client.5197.objecter dump_active .. 0 homeless 2026-02-17T21:12:23.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.558+0000 7fe74bfff640 1 -- 10.20.193.45:0/1901617402 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe764020020 con 0x7fe77415d1e0 2026-02-17T21:12:23.550 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.558+0000 7fe74bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.551 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.558+0000 7fe74bfff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:23.635 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.643+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe7741f1ab0 con 0x7fe744079280 2026-02-17T21:12:23.636 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.643+0000 7fe74bfff640 1 -- 10.20.193.45:0/1901617402 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe76803d040 con 0x7fe744079280 2026-02-17T21:12:23.636 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 1 to deep-scrub 2026-02-17T21:12:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 10 librados: watch_flush enter 2026-02-17T21:12:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 10 librados: watch_flush exit 2026-02-17T21:12:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 20 client.5197.objecter shutdown clearing up homeless session... 2026-02-17T21:12:23.638 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 10 client.5197.objecter successfully canceled tick 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe744079280 msgr2=0x7fe74407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe744079280 0x7fe74407b740 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe768039000 tx=0x7fe768033000 comp rx=0 tx=0).stop 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 10 monclient: shutdown 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 msgr2=0x7fe77415c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 0x7fe77415c160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe76400cc10 tx=0x7fe76400a430 comp rx=0 tx=0).stop 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 shutdown_connections 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe744079280 0x7fe74407b740 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe77415d1e0 0x7fe77415c160 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7740c92b0 0x7fe7741f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 --2- 10.20.193.45:0/1901617402 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7740748e0 0x7fe7741f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 >> 10.20.193.45:0/1901617402 conn(0x7fe7740c9d40 msgr2=0x7fe7740ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:23.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 shutdown_connections 2026-02-17T21:12:23.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 -- 10.20.193.45:0/1901617402 wait complete. 2026-02-17T21:12:23.640 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.645+0000 7fe77983b640 1 librados: shutdown 2026-02-17T21:12:23.647 INFO:tasks.ceph:Scrubbing osd.5 2026-02-17T21:12:23.647 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.725+0000 7f66b172c640 10 monclient: get_monmap_and_config 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.725+0000 7f66b172c640 10 monclient: build_initial_monmap 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.725+0000 7f66b172c640 10 monclient: monmap: 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:23.726185+0000 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:23.726185+0000 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.718 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:23.719 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:23.719 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:23.719 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:23.719 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:23.719 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:23.719 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.725+0000 7f66b172c640 1 Processor -- start 2026-02-17T21:12:23.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.725+0000 7f66b172c640 1 -- start start 2026-02-17T21:12:23.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.725+0000 7f66b172c640 10 monclient: init 2026-02-17T21:12:23.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 10 monclient: _add_conns ranks=[1,2,3,5,0,4] 2026-02-17T21:12:23.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f66ac152830 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:23.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f66ac159e00 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:23.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f66ac15f480 0x7f66ac15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 10 monclient(hunting): picked mon.noname-a con 0x7f66ac15f480 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac15e000 con 0x7f66ac152830 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac15e2e0 con 0x7f66ac159e00 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f66ac15eef0 con 0x7f66ac15f480 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66b172c640 10 monclient(hunting): authenticate will time out at 1327.356552s 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66aa7fc640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f66ac159e00 0x7f66ac15a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45512/0 (socket says 10.20.193.45:45512) 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66aa7fc640 1 -- 10.20.193.45:0/1058669144 learned_addr learned my addr 10.20.193.45:0/1058669144 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.726+0000 7f66ab7fe640 1 --2- 10.20.193.45:0/1058669144 >> v2:10.20.193.45:3300/0 conn(0x7f66ac15f480 0x7f66ac15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.727+0000 7f66ab7fe640 10 monclient(hunting): get_auth_request con 0x7f66ac15f480 auth_method 0 2026-02-17T21:12:23.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.727+0000 7f66ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.727+0000 7f66ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.727+0000 7f66ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.727+0000 7f66ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.727+0000 7f66ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.727+0000 7f66ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66a9ffb640 1 -- 10.20.193.45:0/1058669144 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098667325 0 0) 0x7f66ac15e2e0 con 0x7f66ac159e00 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66a9ffb640 10 monclient(hunting): _negotiate 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66a9ffb640 10 monclient(hunting): my global_id is 5225 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66a9ffb640 1 -- 10.20.193.45:0/1058669144 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6698003620 con 0x7f66ac159e00 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66ab7fe640 10 monclient(hunting): handle_auth_done global_id 5139 payload 274 2026-02-17T21:12:23.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66ab7fe640 1 -- 10.20.193.45:0/1058669144 >> v1:10.20.193.92:6789/0 conn(0x7f66ac159e00 legacy=0x7f66ac15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66ab7fe640 1 -- 10.20.193.45:0/1058669144 >> v1:10.20.193.86:6789/0 conn(0x7f66ac152830 legacy=0x7f66ac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66ab7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66ab7fe640 1 monclient: found mon.noname-a 2026-02-17T21:12:23.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66ab7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:23.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.728+0000 7f66ab7fe640 1 -- 10.20.193.45:0/1058669144 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac15e5c0 con 0x7f66ac15f480 2026-02-17T21:12:23.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.729+0000 7f66ab7fe640 1 --2- 10.20.193.45:0/1058669144 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f66ac15f480 0x7f66ac15f930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f669c009d90 tx=0x7f669c02f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef62395b75c22ea2 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 1 -- 10.20.193.45:0/1058669144 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c03c070 con 0x7f66ac15f480 2026-02-17T21:12:23.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:23.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 10 monclient: dump: 2026-02-17T21:12:23.731 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.731 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 1 -- 10.20.193.45:0/1058669144 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c037440 con 0x7f66ac15f480 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 1 -- 10.20.193.45:0/1058669144 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c037810 con 0x7f66ac15f480 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 5 monclient: authenticate success, global_id 5139 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 4 set_mon_vals no callback set 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66a9ffb640 10 monclient: dump: 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.733 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 10 monclient: shutdown 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 1 -- 10.20.193.45:0/1058669144 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f66ac15f480 msgr2=0x7f66ac15f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 1 --2- 10.20.193.45:0/1058669144 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f66ac15f480 0x7f66ac15f930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f669c009d90 tx=0x7f669c02f230 comp rx=0 tx=0).stop 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 1 -- 10.20.193.45:0/1058669144 shutdown_connections 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 1 --2- 10.20.193.45:0/1058669144 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f66ac15f480 0x7f66ac15f930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 1 -- 10.20.193.45:0/1058669144 >> 10.20.193.45:0/1058669144 conn(0x7f66ac0ce250 msgr2=0x7f66ac0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 1 -- 10.20.193.45:0/1058669144 shutdown_connections 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.731+0000 7f66b172c640 1 -- 10.20.193.45:0/1058669144 wait complete. 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.732+0000 7f66b172c640 10 monclient: build_initial_monmap 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.732+0000 7f66b172c640 10 monclient: monmap: 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:23.735 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.732+0000 7f66b172c640 1 librados: starting msgr at 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.732+0000 7f66b172c640 1 librados: starting objecter 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.732+0000 7f66b172c640 1 Processor -- start 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.732+0000 7f66b172c640 1 -- start start 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.732+0000 7f66b172c640 1 librados: setting wanted keys 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.732+0000 7f66b172c640 1 librados: calling monclient init 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.732+0000 7f66b172c640 10 monclient: init 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f66ac152830 0x7f66ac153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient(hunting): picked mon.noname-b con 0x7f66ac152830 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f66ac159e00 0x7f66ac1f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient(hunting): picked mon.noname-a con 0x7f66ac159e00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac15f480 0x7f66ac15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient(hunting): picked mon.noname-c con 0x7f66ac15f480 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac15eb80 con 0x7f66ac159e00 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac15fe70 con 0x7f66ac152830 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac152c10 con 0x7f66ac15f480 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66b172c640 10 monclient(hunting): authenticate will time out at 1327.363307s 2026-02-17T21:12:23.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66aa7fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f66ac159e00 0x7f66ac1f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66ab7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac15f480 0x7f66ac15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66ab7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac15f480 0x7f66ac15bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:34974/0 (socket says 10.20.193.45:34974) 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66ab7fe640 1 -- 10.20.193.45:0/4120965129 learned_addr learned my addr 10.20.193.45:0/4120965129 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66ab7fe640 10 monclient(hunting): get_auth_request con 0x7f66ac15f480 auth_method 0 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66aa7fc640 10 monclient(hunting): get_auth_request con 0x7f66ac159e00 auth_method 0 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66aa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66aa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66aa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66aaffd640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f66ac152830 0x7f66ac153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.733+0000 7f66aaffd640 10 monclient(hunting): get_auth_request con 0x7f66ac152830 auth_method 0 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66aaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66aa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66aa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66aa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66aaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66aaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.734+0000 7f66aaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 10 monclient(hunting): handle_auth_done global_id 5228 payload 824 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 1 -- 10.20.193.45:0/4120965129 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f66ac152830 msgr2=0x7f66ac153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f66ac152830 0x7f66ac153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 1 -- 10.20.193.45:0/4120965129 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f66ac159e00 msgr2=0x7f66ac1f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f66ac159e00 0x7f66ac1f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 1 monclient: found mon.noname-c 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.735+0000 7f66ab7fe640 1 -- 10.20.193.45:0/4120965129 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac1f51e0 con 0x7f66ac15f480 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.736+0000 7f66ab7fe640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac15f480 0x7f66ac15bc60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f669c03a040 tx=0x7f669c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.736+0000 7f668b7fe640 10 client.?.objecter ms_handle_connect 0x7f66ac15f480 2026-02-17T21:12:23.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.736+0000 7f668b7fe640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f668b7fe640 1 -- 10.20.193.45:0/4120965129 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c03c050 con 0x7f66ac15f480 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f668b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f668b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f668b7fe640 10 monclient: dump: 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.741 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f668b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f668b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f668b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f66b172c640 5 monclient: authenticate success, global_id 5228 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f66b172c640 10 monclient: _renew_subs 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f66b172c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac1f4310 con 0x7f66ac15f480 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f66b172c640 10 client.5228.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f66b172c640 10 monclient: _renew_subs 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f66b172c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:23.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac1531d0 con 0x7f66ac15f480 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.737+0000 7f66b172c640 1 librados: init done 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f668b7fe640 1 -- 10.20.193.45:0/4120965129 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f669c048070 con 0x7f66ac15f480 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f668b7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f66a97fa640 4 set_mon_vals no callback set 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f668b7fe640 1 -- 10.20.193.45:0/4120965129 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669c041a10 con 0x7f66ac15f480 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f668b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f668b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f668b7fe640 10 monclient: dump: 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.743 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f66b172c640 10 client.5228.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f66b172c640 15 client.5228.objecter _session_command_op_assign -1 1 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f66b172c640 20 client.5228.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f66b172c640 10 client.5228.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f66b172c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:23.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.738+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66ac15e2e0 con 0x7f66ac15f480 2026-02-17T21:12:23.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.749+0000 7f668b7fe640 1 -- 10.20.193.45:0/4120965129 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f669c041bb0 con 0x7f66ac15f480 2026-02-17T21:12:23.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.750+0000 7f668b7fe640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6678079280 0x7f667807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.750+0000 7f66aaffd640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6678079280 0x7f667807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.750+0000 7f66aaffd640 10 monclient: get_auth_request con 0x7f6678079280 auth_method 0 2026-02-17T21:12:23.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.750+0000 7f668b7fe640 10 client.5228.objecter ms_handle_connect 0x7f6678079280 2026-02-17T21:12:23.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.750+0000 7f66aaffd640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6678079280 0x7f667807b740 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f66a0002770 tx=0x7f66a0007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 1 -- 10.20.193.45:0/4120965129 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f669c0be370 con 0x7f66ac15f480 2026-02-17T21:12:23.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 10 client.5228.objecter ms_dispatch2 0x7f66ac000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:23.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 3 client.5228.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 3 client.5228.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 10 client.5228.objecter checking command 1 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f6678081760 0x7f6678083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 20 client.5228.objecter _get_session s=0x7f6678081090 osd=5 3 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 20 client.5228.objecter put_session s=0x7f6678081090 osd=5 3 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 15 client.5228.objecter _session_command_op_remove -1 1 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 20 client.5228.objecter _get_session s=0x7f6678081090 osd=5 3 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 20 client.5228.objecter get_session s=0x7f6678081090 osd=5 3 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 15 client.5228.objecter _session_command_op_assign 5 1 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 20 client.5228.objecter put_session s=0x7f6678081090 osd=5 4 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 10 client.5228.objecter _send_command 1 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 1 -- 10.20.193.45:0/4120965129 --> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f669c037440 con 0x7f6678081760 2026-02-17T21:12:23.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 20 client.5228.objecter dump_active .. 0 homeless 2026-02-17T21:12:23.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 1 -- 10.20.193.45:0/4120965129 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f669c084c00 con 0x7f66ac15f480 2026-02-17T21:12:23.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f668b7fe640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:23.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.751+0000 7f66aa7fc640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f6678081760 0x7f6678083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.752+0000 7f66aa7fc640 10 monclient: get_auth_request con 0x7f6678081760 auth_method 0 2026-02-17T21:12:23.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.753+0000 7f668b7fe640 10 client.5228.objecter ms_handle_connect 0x7f6678081760 2026-02-17T21:12:23.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.753+0000 7f66aa7fc640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f6678081760 0x7f6678083b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.763+0000 7f668b7fe640 1 -- 10.20.193.45:0/4120965129 <== osd.5 v2:10.20.193.86:6824/63160539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f669c037440 con 0x7f6678081760 2026-02-17T21:12:23.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.763+0000 7f668b7fe640 10 client.5228.objecter ms_dispatch2 0x7f66ac000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:23.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.763+0000 7f668b7fe640 10 client.5228.objecter _finish_command 1 = system:0 2026-02-17T21:12:23.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.763+0000 7f668b7fe640 20 client.5228.objecter put_session s=0x7f6678081090 osd=5 4 2026-02-17T21:12:23.756 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.763+0000 7f668b7fe640 15 client.5228.objecter _session_command_op_remove 5 1 2026-02-17T21:12:23.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 10 client.5228.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:23.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 15 client.5228.objecter _session_command_op_assign -1 2 2026-02-17T21:12:23.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 20 client.5228.objecter _get_session s=0x7f6678081090 osd=5 3 2026-02-17T21:12:23.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 20 client.5228.objecter put_session s=0x7f6678081090 osd=5 3 2026-02-17T21:12:23.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 20 client.5228.objecter _get_session s=0x7f6678081090 osd=5 3 2026-02-17T21:12:23.762 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 15 client.5228.objecter _session_command_op_remove -1 2 2026-02-17T21:12:23.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 20 client.5228.objecter get_session s=0x7f6678081090 osd=5 3 2026-02-17T21:12:23.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 15 client.5228.objecter _session_command_op_assign 5 2 2026-02-17T21:12:23.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 20 client.5228.objecter put_session s=0x7f6678081090 osd=5 4 2026-02-17T21:12:23.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 10 client.5228.objecter _send_command 2 2026-02-17T21:12:23.763 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.769+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 --> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f66ac1598b0 con 0x7f6678081760 2026-02-17T21:12:23.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f668b7fe640 1 -- 10.20.193.45:0/4120965129 <== osd.5 v2:10.20.193.86:6824/63160539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f66ac1598b0 con 0x7f6678081760 2026-02-17T21:12:23.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f668b7fe640 10 client.5228.objecter ms_dispatch2 0x7f66ac000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:23.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f668b7fe640 10 client.5228.objecter _finish_command 2 = system:0 2026-02-17T21:12:23.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f668b7fe640 20 client.5228.objecter put_session s=0x7f6678081090 osd=5 4 2026-02-17T21:12:23.770 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f668b7fe640 15 client.5228.objecter _session_command_op_remove 5 2 2026-02-17T21:12:23.770 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:23.770 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:23.770 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:23.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 10 librados: watch_flush enter 2026-02-17T21:12:23.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 10 librados: watch_flush exit 2026-02-17T21:12:23.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 10 client.5228.objecter close_session for osd.5 2026-02-17T21:12:23.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f6678081760 msgr2=0x7f6678083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.86:6824/63160539,v1:10.20.193.86:6825/63160539] conn(0x7f6678081760 0x7f6678083b80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 20 client.5228.objecter put_session s=0x7f6678081090 osd=5 1 2026-02-17T21:12:23.772 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 20 client.5228.objecter shutdown clearing up homeless session... 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 10 client.5228.objecter successfully canceled tick 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6678079280 msgr2=0x7f667807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f6678079280 0x7f667807b740 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f66a0002770 tx=0x7f66a0007ef0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 10 monclient: shutdown 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac15f480 msgr2=0x7f66ac15bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 --2- 10.20.193.45:0/4120965129 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac15f480 0x7f66ac15bc60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f669c03a040 tx=0x7f669c004b40 comp rx=0 tx=0).stop 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66ab7fe640 1 -- 10.20.193.45:0/4120965129 reap_dead start 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 shutdown_connections 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 >> 10.20.193.45:0/4120965129 conn(0x7f66ac0ce250 msgr2=0x7f66ac151750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 shutdown_connections 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 -- 10.20.193.45:0/4120965129 wait complete. 2026-02-17T21:12:23.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.777+0000 7f66b172c640 1 librados: shutdown 2026-02-17T21:12:23.778 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-17T21:12:23.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.854+0000 7f52822ea640 10 monclient: get_monmap_and_config 2026-02-17T21:12:23.846 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.854+0000 7f52822ea640 10 monclient: build_initial_monmap 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.854+0000 7f52822ea640 10 monclient: monmap: 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:23.854970+0000 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:23.854970+0000 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:23.847 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:23.848 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:23.848 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.854+0000 7f52822ea640 1 Processor -- start 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.854+0000 7f52822ea640 1 -- start start 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.854+0000 7f52822ea640 10 monclient: init 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 10 monclient: _add_conns ranks=[2,0,1,5,4,3] 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f527c15d1e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f527c0c92b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f527c153d20 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c0c5860 con 0x7f527c0c92b0 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c0c5580 con 0x7f527c153d20 2026-02-17T21:12:23.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c0c7de0 con 0x7f527c15d1e0 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f52822ea640 10 monclient(hunting): authenticate will time out at 1327.485173s 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f527bfff640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f527c15d1e0 0x7f527c0c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45518/0 (socket says 10.20.193.45:45518) 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.855+0000 7f527bfff640 1 -- 10.20.193.45:0/987909840 learned_addr learned my addr 10.20.193.45:0/987909840 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223764603 0 0) 0x7f527c0c7de0 con 0x7f527c15d1e0 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 10 monclient(hunting): my global_id is 5231 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5260003620 con 0x7f527c15d1e0 2026-02-17T21:12:23.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738093932 0 0) 0x7f527c0c5860 con 0x7f527c0c92b0 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 10 monclient(hunting): my global_id is 5145 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.856+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f527c0c7de0 con 0x7f527c0c92b0 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.857+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467941946 0 0) 0x7f527c0c5580 con 0x7f527c153d20 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.857+0000 7f527affd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.857+0000 7f527affd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.857+0000 7f527affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.857+0000 7f527affd640 10 monclient(hunting): my global_id is 5206 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.857+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f527c0c5860 con 0x7f527c153d20 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 <== mon.2 v1:10.20.193.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2065211144 0 0) 0x7f5260003620 con 0x7f527c15d1e0 2026-02-17T21:12:23.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 >> v1:10.20.193.86:6789/0 conn(0x7f527c153d20 legacy=0x7f527c0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 >> v1:10.20.193.45:6789/0 conn(0x7f527c0c92b0 legacy=0x7f527c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.92:6789/0 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 --> v1:10.20.193.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c0c80c0 con 0x7f527c15d1e0 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 <== mon.2 v1:10.20.193.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f5268002f00 con 0x7f527c15d1e0 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:12:23.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient: dump: 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] but i'm connected to v1:10.20.193.92:6789/0, reconnecting 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.858 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 >> v1:10.20.193.92:6789/0 conn(0x7f527c15d1e0 legacy=0x7f527c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5260003fe0 0x7f5260004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient(hunting): picked mon.a con 0x7f5260003fe0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5260004e40 0x7f52600052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient(hunting): picked mon.b con 0x7f5260004e40 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5260009ab0 0x7f526000bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient(hunting): picked mon.c con 0x7f5260009ab0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f526000c570 con 0x7f5260003fe0 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f526000c6f0 con 0x7f5260004e40 2026-02-17T21:12:23.859 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f526000c8f0 con 0x7f5260009ab0 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.858+0000 7f527affd640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527b7fe640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5260004e40 0x7f52600052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527bfff640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5260003fe0 0x7f5260004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527b7fe640 10 monclient(hunting): get_auth_request con 0x7f5260004e40 auth_method 0 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527b7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:12:23.860 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f5280860640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5260009ab0 0x7f526000bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527bfff640 10 monclient(hunting): get_auth_request con 0x7f5260003fe0 auth_method 0 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f527bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f5280860640 10 monclient(hunting): get_auth_request con 0x7f5260009ab0 auth_method 0 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f5280860640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f5280860640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.859+0000 7f5280860640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f5280860640 1 -- 10.20.193.45:0/987909840 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5260009ab0 msgr2=0x7f526000bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f5280860640 1 -- 10.20.193.45:0/987909840 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5260009ab0 msgr2=0x7f526000bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f5280860640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5260009ab0 0x7f526000bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T21:12:23.861 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f5280860640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5260009ab0 0x7f526000bea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527bfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 10 monclient(hunting): handle_auth_done global_id 5231 payload 293 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 1 -- 10.20.193.45:0/987909840 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5260009ab0 msgr2=0x7f526000bea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5260009ab0 0x7f526000bea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 1 -- 10.20.193.45:0/987909840 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5260003fe0 msgr2=0x7f5260004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5260003fe0 0x7f5260004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 1 monclient: found mon.b 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f5280860640 1 -- 10.20.193.45:0/987909840 reap_dead start 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.862 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 1 -- 10.20.193.45:0/987909840 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5260003620 con 0x7f5260004e40 2026-02-17T21:12:23.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f527b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f52822ea640 5 monclient: authenticate success, global_id 5231 2026-02-17T21:12:23.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.860+0000 7f52822ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:23.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.861+0000 7f527b7fe640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5260004e40 0x7f52600052c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f526c003210 tx=0x7f526c02eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbbd2e06333fc135 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.862+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c002e30 con 0x7f5260004e40 2026-02-17T21:12:23.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.862+0000 7f527affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.862+0000 7f527affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.862+0000 7f527affd640 10 monclient: dump: 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.870 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.862+0000 7f52822ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c0052d0 con 0x7f5260004e40 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f527affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f527affd640 1 -- 10.20.193.45:0/987909840 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c02f750 con 0x7f5260004e40 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f527affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f527affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f527affd640 10 monclient: dump: 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.871 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 4 set_mon_vals no callback set 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 10 monclient: shutdown 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 1 -- 10.20.193.45:0/987909840 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5260004e40 msgr2=0x7f52600052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5260004e40 0x7f52600052c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f526c003210 tx=0x7f526c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 1 -- 10.20.193.45:0/987909840 shutdown_connections 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 1 --2- 10.20.193.45:0/987909840 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f5260004e40 0x7f52600052c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 1 -- 10.20.193.45:0/987909840 >> 10.20.193.45:0/987909840 conn(0x7f527c0c9d40 msgr2=0x7f527c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 1 -- 10.20.193.45:0/987909840 shutdown_connections 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.863+0000 7f52822ea640 1 -- 10.20.193.45:0/987909840 wait complete. 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient: build_initial_monmap 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient: monmap: 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:23.873 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 librados: starting msgr at 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 librados: starting objecter 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 Processor -- start 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 -- start start 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 librados: setting wanted keys 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 librados: calling monclient init 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient: init 2026-02-17T21:12:23.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5260004e40 0x7f527c1491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient(hunting): picked mon.noname-a con 0x7f5260004e40 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f527c1f7320 0x7f527c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient(hunting): picked mon.noname-c con 0x7f527c1f7320 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f527c1f77a0 0x7f527c06e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient(hunting): picked mon.noname-b con 0x7f527c1f77a0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f527c15d5c0 con 0x7f5260004e40 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f527c0c8680 con 0x7f527c1f77a0 2026-02-17T21:12:23.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f527c15d740 con 0x7f527c1f7320 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.864+0000 7f52822ea640 10 monclient(hunting): authenticate will time out at 1327.494833s 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527bfff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5260004e40 0x7f527c1491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f527c1f77a0 0x7f527c06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527b7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f527c1f7320 0x7f527c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f527c1f77a0 0x7f527c06e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38164/0 (socket says 10.20.193.45:38164) 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 1 -- 10.20.193.45:0/327267555 learned_addr learned my addr 10.20.193.45:0/327267555 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 10 monclient(hunting): get_auth_request con 0x7f527c1f77a0 auth_method 0 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527bfff640 10 monclient(hunting): get_auth_request con 0x7f5260004e40 auth_method 0 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527bfff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527b7fe640 10 monclient(hunting): get_auth_request con 0x7f527c1f7320 auth_method 0 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f5280860640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:23.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.865+0000 7f527b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 10 monclient(hunting): handle_auth_done global_id 5209 payload 824 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 1 -- 10.20.193.45:0/327267555 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f527c1f7320 msgr2=0x7f527c06e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f527c1f7320 0x7f527c06e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 1 -- 10.20.193.45:0/327267555 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5260004e40 msgr2=0x7f527c1491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5260004e40 0x7f527c1491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 10 monclient: _finish_hunting 0 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 1 monclient: found mon.noname-b 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.866+0000 7f5280860640 1 -- 10.20.193.45:0/327267555 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c1f7f90 con 0x7f527c1f77a0 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.867+0000 7f5280860640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f527c1f77a0 0x7f527c06e730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f527c070d80 tx=0x7f527000c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.867+0000 7f5278ff9640 10 client.?.objecter ms_handle_connect 0x7f527c1f77a0 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.867+0000 7f5278ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:23.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 1 -- 10.20.193.45:0/327267555 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527001a070 con 0x7f527c1f77a0 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 10 monclient: dump: 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 10 monclient: _finish_auth 0 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:12:23.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 1 -- 10.20.193.45:0/327267555 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527000ee90 con 0x7f527c1f77a0 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 1 -- 10.20.193.45:0/327267555 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270013420 con 0x7f527c1f77a0 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f52822ea640 5 monclient: authenticate success, global_id 5209 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f52822ea640 10 monclient: _renew_subs 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f52822ea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f527a7fc640 4 set_mon_vals no callback set 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527c06d170 con 0x7f527c1f77a0 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f5278ff9640 10 monclient: dump: 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:23.880 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f52822ea640 10 client.5209.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f52822ea640 10 monclient: _renew_subs 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f52822ea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f527c06d430 con 0x7f527c1f77a0 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.869+0000 7f52822ea640 1 librados: init done 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.870+0000 7f52822ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.870+0000 7f52822ea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.870+0000 7f52822ea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:23.881 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.870+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f527c0748e0 con 0x7f527c1f77a0 2026-02-17T21:12:23.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.881+0000 7f5278ff9640 1 -- 10.20.193.45:0/327267555 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f52700135c0 con 0x7f527c1f77a0 2026-02-17T21:12:23.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.882+0000 7f5278ff9640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f524c0792b0 0x7f524c07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:23.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.882+0000 7f527bfff640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f524c0792b0 0x7f524c07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:23.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.882+0000 7f527bfff640 10 monclient: get_auth_request con 0x7f524c0792b0 auth_method 0 2026-02-17T21:12:23.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.882+0000 7f527bfff640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f524c0792b0 0x7f524c07b770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f52680028f0 tx=0x7f52680035a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:23.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.882+0000 7f5278ff9640 10 client.5209.objecter ms_handle_connect 0x7f524c0792b0 2026-02-17T21:12:23.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.883+0000 7f5278ff9640 1 -- 10.20.193.45:0/327267555 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f527005e360 con 0x7f527c1f77a0 2026-02-17T21:12:23.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.883+0000 7f5278ff9640 10 client.5209.objecter ms_dispatch2 0x7f527c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:23.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.883+0000 7f5278ff9640 3 client.5209.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:23.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.883+0000 7f5278ff9640 3 client.5209.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:23.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.883+0000 7f5278ff9640 20 client.5209.objecter dump_active .. 0 homeless 2026-02-17T21:12:23.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.985+0000 7f5278ff9640 1 -- 10.20.193.45:0/327267555 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5270024020 con 0x7f527c1f77a0 2026-02-17T21:12:23.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.985+0000 7f5278ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:23.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:23.985+0000 7f5278ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:24.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.068+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f527c1573a0 con 0x7f524c0792b0 2026-02-17T21:12:24.061 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.068+0000 7f5278ff9640 1 -- 10.20.193.45:0/327267555 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f527c1573a0 con 0x7f524c0792b0 2026-02-17T21:12:24.061 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 5 to deep-scrub 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 10 librados: watch_flush enter 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 10 librados: watch_flush exit 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 20 client.5209.objecter shutdown clearing up homeless session... 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 10 client.5209.objecter successfully canceled tick 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f524c0792b0 msgr2=0x7f524c07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f524c0792b0 0x7f524c07b770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f52680028f0 tx=0x7f52680035a0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 10 monclient: shutdown 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f527c1f77a0 msgr2=0x7f527c06e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.063 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f527c1f77a0 0x7f527c06e730 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f527c070d80 tx=0x7f527000c4b0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 shutdown_connections 2026-02-17T21:12:24.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f524c0792b0 0x7f524c07b770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f527c1f77a0 0x7f527c06e730 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f527c1f7320 0x7f527c06e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 --2- 10.20.193.45:0/327267555 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f5260004e40 0x7f527c1491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 >> 10.20.193.45:0/327267555 conn(0x7f527c0c9d40 msgr2=0x7f527c06b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 shutdown_connections 2026-02-17T21:12:24.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 -- 10.20.193.45:0/327267555 wait complete. 2026-02-17T21:12:24.064 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.069+0000 7f52822ea640 1 librados: shutdown 2026-02-17T21:12:24.070 INFO:tasks.ceph:Scrubbing osd.9 2026-02-17T21:12:24.070 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:24.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.148+0000 7efd66396640 10 monclient: get_monmap_and_config 2026-02-17T21:12:24.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.148+0000 7efd66396640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.148+0000 7efd66396640 10 monclient: monmap: 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:24.149010+0000 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:24.149010+0000 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:24.141 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:24.142 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:24.142 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.148+0000 7efd66396640 1 Processor -- start 2026-02-17T21:12:24.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.148+0000 7efd66396640 1 -- start start 2026-02-17T21:12:24.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.148+0000 7efd66396640 10 monclient: init 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 10 monclient: _add_conns ranks=[5,2,0,4,3,1] 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7efd601503c0 0x7efd6006fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 10 monclient(hunting): picked mon.noname-c con 0x7efd601503c0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7efd60070300 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efd600c4740 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd600c55a0 con 0x7efd600c4740 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd600c52c0 con 0x7efd60070300 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7efd60159c40 con 0x7efd601503c0 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:24.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd66396640 10 monclient(hunting): authenticate will time out at 1327.779213s 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd6490c640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7efd600c4740 0x7efd600c6a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:40418/0 (socket says 10.20.193.45:40418) 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd6490c640 1 -- 10.20.193.45:0/2851342280 learned_addr learned my addr 10.20.193.45:0/2851342280 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd5ffff640 1 --2- 10.20.193.45:0/2851342280 >> v2:10.20.193.92:3300/0 conn(0x7efd601503c0 0x7efd6006fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd5ffff640 10 monclient(hunting): get_auth_request con 0x7efd601503c0 auth_method 0 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.149+0000 7efd5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.150+0000 7efd5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.150+0000 7efd5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.150+0000 7efd5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.150+0000 7efd5effd640 1 -- 10.20.193.45:0/2851342280 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891138100 0 0) 0x7efd54002ca0 con 0x7efd600c4740 2026-02-17T21:12:24.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.150+0000 7efd5effd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.150+0000 7efd5effd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.150+0000 7efd5effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.150+0000 7efd5effd640 10 monclient(hunting): my global_id is 5151 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.150+0000 7efd5effd640 1 -- 10.20.193.45:0/2851342280 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd44003620 con 0x7efd600c4740 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.152+0000 7efd5ffff640 10 monclient(hunting): handle_auth_done global_id 5237 payload 274 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.152+0000 7efd5ffff640 1 -- 10.20.193.45:0/2851342280 >> v1:10.20.193.92:6789/0 conn(0x7efd60070300 legacy=0x7efd6015d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.152+0000 7efd5ffff640 1 -- 10.20.193.45:0/2851342280 >> v1:10.20.193.45:6789/0 conn(0x7efd600c4740 legacy=0x7efd600c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.152+0000 7efd5ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.152+0000 7efd5ffff640 1 monclient: found mon.noname-c 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.152+0000 7efd5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.152+0000 7efd5ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.152+0000 7efd5ffff640 1 -- 10.20.193.45:0/2851342280 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd60159f20 con 0x7efd601503c0 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.153+0000 7efd5ffff640 1 --2- 10.20.193.45:0/2851342280 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd601503c0 0x7efd6006fdc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0098a0 tx=0x7efd4c02ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b80f14a0ec21f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 1 -- 10.20.193.45:0/2851342280 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c03c070 con 0x7efd601503c0 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 10 monclient: dump: 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.153 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 10 monclient: _finish_auth 0 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 1 -- 10.20.193.45:0/2851342280 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4c02fc10 con 0x7efd601503c0 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 5 monclient: authenticate success, global_id 5237 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:24.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 1 -- 10.20.193.45:0/2851342280 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c037440 con 0x7efd601503c0 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 4 set_mon_vals no callback set 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd5effd640 10 monclient: dump: 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.155 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 10 monclient: shutdown 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 1 -- 10.20.193.45:0/2851342280 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd601503c0 msgr2=0x7efd6006fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 1 --2- 10.20.193.45:0/2851342280 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd601503c0 0x7efd6006fdc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0098a0 tx=0x7efd4c02ef00 comp rx=0 tx=0).stop 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 1 -- 10.20.193.45:0/2851342280 shutdown_connections 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 1 --2- 10.20.193.45:0/2851342280 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd601503c0 0x7efd6006fdc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 1 -- 10.20.193.45:0/2851342280 >> 10.20.193.45:0/2851342280 conn(0x7efd600cd520 msgr2=0x7efd600cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 1 -- 10.20.193.45:0/2851342280 shutdown_connections 2026-02-17T21:12:24.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.155+0000 7efd66396640 1 -- 10.20.193.45:0/2851342280 wait complete. 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient: monmap: 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 librados: starting msgr at 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 librados: starting objecter 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 Processor -- start 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 -- start start 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 librados: setting wanted keys 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 librados: calling monclient init 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient: init 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efd60070300 0x7efd6015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient(hunting): picked mon.noname-b con 0x7efd60070300 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd600c4740 0x7efd6015bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient(hunting): picked mon.noname-a con 0x7efd600c4740 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd601503c0 0x7efd601f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient(hunting): picked mon.noname-c con 0x7efd601503c0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7efd6015d730 con 0x7efd600c4740 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7efd6015a4e0 con 0x7efd60070300 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd6015d8b0 con 0x7efd601503c0 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.156+0000 7efd66396640 10 monclient(hunting): authenticate will time out at 1327.786772s 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd600c4740 0x7efd6015bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd6490c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd601503c0 0x7efd601f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd600c4740 0x7efd6015bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36536/0 (socket says 10.20.193.45:36536) 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 1 -- 10.20.193.45:0/4034012368 learned_addr learned my addr 10.20.193.45:0/4034012368 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 10 monclient(hunting): get_auth_request con 0x7efd600c4740 auth_method 0 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd6490c640 10 monclient(hunting): get_auth_request con 0x7efd601503c0 auth_method 0 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd6490c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd6490c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd6490c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5ffff640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efd60070300 0x7efd6015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5ffff640 10 monclient(hunting): get_auth_request con 0x7efd60070300 auth_method 0 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd6490c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd6490c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd6490c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.157+0000 7efd5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 10 monclient(hunting): handle_auth_done global_id 5154 payload 824 2026-02-17T21:12:24.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 1 -- 10.20.193.45:0/4034012368 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd601503c0 msgr2=0x7efd601f2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd601503c0 0x7efd601f2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 1 -- 10.20.193.45:0/4034012368 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efd60070300 msgr2=0x7efd6015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7efd60070300 0x7efd6015b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 1 monclient: found mon.noname-a 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.158+0000 7efd5f7fe640 1 -- 10.20.193.45:0/4034012368 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd601f3400 con 0x7efd600c4740 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.159+0000 7efd5f7fe640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd600c4740 0x7efd6015bb20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c700 tx=0x7efd5000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.159+0000 7efd5cff9640 10 client.?.objecter ms_handle_connect 0x7efd600c4740 2026-02-17T21:12:24.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.159+0000 7efd5cff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:24.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 1 -- 10.20.193.45:0/4034012368 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500052d0 con 0x7efd600c4740 2026-02-17T21:12:24.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 10 monclient: dump: 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 10 monclient: _finish_auth 0 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 10 monclient: _check_auth_tickets 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 1 -- 10.20.193.45:0/4034012368 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd50005470 con 0x7efd600c4740 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 1 -- 10.20.193.45:0/4034012368 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5000a860 con 0x7efd600c4740 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 5 monclient: authenticate success, global_id 5154 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 10 monclient: _renew_subs 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5e7fc640 4 set_mon_vals no callback set 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd601f36e0 con 0x7efd600c4740 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:24.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd5cff9640 10 monclient: dump: 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 10 client.5154.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 10 monclient: _renew_subs 2026-02-17T21:12:24.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:24.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd601f3ca0 con 0x7efd600c4740 2026-02-17T21:12:24.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 1 librados: init done 2026-02-17T21:12:24.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.161+0000 7efd66396640 10 client.5154.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:24.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.162+0000 7efd66396640 15 client.5154.objecter _session_command_op_assign -1 1 2026-02-17T21:12:24.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.162+0000 7efd66396640 20 client.5154.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:24.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.162+0000 7efd66396640 10 client.5154.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:24.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.162+0000 7efd66396640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:24.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.162+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd601507a0 con 0x7efd600c4740 2026-02-17T21:12:24.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.173+0000 7efd5cff9640 1 -- 10.20.193.45:0/4034012368 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7efd5000aa00 con 0x7efd600c4740 2026-02-17T21:12:24.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.174+0000 7efd5cff9640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd30079280 0x7efd3007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.174+0000 7efd5ffff640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd30079280 0x7efd3007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.174+0000 7efd5ffff640 10 monclient: get_auth_request con 0x7efd30079280 auth_method 0 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.174+0000 7efd5ffff640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd30079280 0x7efd3007b740 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efd4c039000 tx=0x7efd4c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.174+0000 7efd5cff9640 10 client.5154.objecter ms_handle_connect 0x7efd30079280 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.175+0000 7efd5cff9640 1 -- 10.20.193.45:0/4034012368 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7efd5000ad20 con 0x7efd600c4740 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.175+0000 7efd5cff9640 10 client.5154.objecter ms_dispatch2 0x7efd60000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.175+0000 7efd5cff9640 3 client.5154.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.175+0000 7efd5cff9640 3 client.5154.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 10 client.5154.objecter checking command 1 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7efd300817c0 0x7efd30083be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 20 client.5154.objecter _get_session s=0x7efd300810f0 osd=9 3 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 20 client.5154.objecter put_session s=0x7efd300810f0 osd=9 3 2026-02-17T21:12:24.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 15 client.5154.objecter _session_command_op_remove -1 1 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 20 client.5154.objecter _get_session s=0x7efd300810f0 osd=9 3 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 20 client.5154.objecter get_session s=0x7efd300810f0 osd=9 3 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 15 client.5154.objecter _session_command_op_assign 9 1 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 20 client.5154.objecter put_session s=0x7efd300810f0 osd=9 4 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 10 client.5154.objecter _send_command 1 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 1 -- 10.20.193.45:0/4034012368 --> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd300842b0 con 0x7efd300817c0 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 20 client.5154.objecter dump_active .. 0 homeless 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 1 -- 10.20.193.45:0/4034012368 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7efd5005e6a0 con 0x7efd600c4740 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd5cff9640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd6490c640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7efd300817c0 0x7efd30083be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.176+0000 7efd6490c640 10 monclient: get_auth_request con 0x7efd300817c0 auth_method 0 2026-02-17T21:12:24.172 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.178+0000 7efd6490c640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7efd300817c0 0x7efd30083be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.178+0000 7efd5cff9640 10 client.5154.objecter ms_handle_connect 0x7efd300817c0 2026-02-17T21:12:24.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.188+0000 7efd5cff9640 1 -- 10.20.193.45:0/4034012368 <== osd.9 v2:10.20.193.86:6816/1248523526 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7efd300842b0 con 0x7efd300817c0 2026-02-17T21:12:24.180 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.188+0000 7efd5cff9640 10 client.5154.objecter ms_dispatch2 0x7efd60000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:24.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.188+0000 7efd5cff9640 10 client.5154.objecter _finish_command 1 = system:0 2026-02-17T21:12:24.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.188+0000 7efd5cff9640 20 client.5154.objecter put_session s=0x7efd300810f0 osd=9 4 2026-02-17T21:12:24.181 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.188+0000 7efd5cff9640 15 client.5154.objecter _session_command_op_remove 9 1 2026-02-17T21:12:24.186 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 10 client.5154.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 15 client.5154.objecter _session_command_op_assign -1 2 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 20 client.5154.objecter _get_session s=0x7efd300810f0 osd=9 3 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 20 client.5154.objecter put_session s=0x7efd300810f0 osd=9 3 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 20 client.5154.objecter _get_session s=0x7efd300810f0 osd=9 3 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 15 client.5154.objecter _session_command_op_remove -1 2 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 20 client.5154.objecter get_session s=0x7efd300810f0 osd=9 3 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 15 client.5154.objecter _session_command_op_assign 9 2 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 20 client.5154.objecter put_session s=0x7efd300810f0 osd=9 4 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 10 client.5154.objecter _send_command 2 2026-02-17T21:12:24.187 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.194+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 --> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efd600c9b30 con 0x7efd300817c0 2026-02-17T21:12:24.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.201+0000 7efd5cff9640 1 -- 10.20.193.45:0/4034012368 <== osd.9 v2:10.20.193.86:6816/1248523526 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efd600c9b30 con 0x7efd300817c0 2026-02-17T21:12:24.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.201+0000 7efd5cff9640 10 client.5154.objecter ms_dispatch2 0x7efd60000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:24.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.201+0000 7efd5cff9640 10 client.5154.objecter _finish_command 2 = system:0 2026-02-17T21:12:24.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.201+0000 7efd5cff9640 20 client.5154.objecter put_session s=0x7efd300810f0 osd=9 4 2026-02-17T21:12:24.195 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.201+0000 7efd5cff9640 15 client.5154.objecter _session_command_op_remove 9 2 2026-02-17T21:12:24.195 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:24.195 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:24.195 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:24.196 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 10 librados: watch_flush enter 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 10 librados: watch_flush exit 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 10 client.5154.objecter close_session for osd.9 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7efd300817c0 msgr2=0x7efd30083be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.86:6816/1248523526,v1:10.20.193.86:6817/1248523526] conn(0x7efd300817c0 0x7efd30083be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 20 client.5154.objecter put_session s=0x7efd300810f0 osd=9 1 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 20 client.5154.objecter shutdown clearing up homeless session... 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 10 client.5154.objecter successfully canceled tick 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd30079280 msgr2=0x7efd3007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7efd30079280 0x7efd3007b740 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efd4c039000 tx=0x7efd4c033000 comp rx=0 tx=0).stop 2026-02-17T21:12:24.197 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 10 monclient: shutdown 2026-02-17T21:12:24.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd600c4740 msgr2=0x7efd6015bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 --2- 10.20.193.45:0/4034012368 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7efd600c4740 0x7efd6015bb20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c700 tx=0x7efd5000cbd0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd6490c640 1 -- 10.20.193.45:0/4034012368 reap_dead start 2026-02-17T21:12:24.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 shutdown_connections 2026-02-17T21:12:24.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 >> 10.20.193.45:0/4034012368 conn(0x7efd600cd520 msgr2=0x7efd600c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 shutdown_connections 2026-02-17T21:12:24.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 -- 10.20.193.45:0/4034012368 wait complete. 2026-02-17T21:12:24.198 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.202+0000 7efd66396640 1 librados: shutdown 2026-02-17T21:12:24.203 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-17T21:12:24.271 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.279+0000 7f40b8e0e640 10 monclient: get_monmap_and_config 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.279+0000 7f40b8e0e640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.279+0000 7f40b8e0e640 10 monclient: monmap: 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:24.280251+0000 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:24.280251+0000 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:24.272 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:24.273 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:24.273 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:24.273 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:24.273 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:24.273 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.279+0000 7f40b8e0e640 1 Processor -- start 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.279+0000 7f40b8e0e640 1 -- start start 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.279+0000 7f40b8e0e640 10 monclient: init 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 10 monclient: _add_conns ranks=[1,5,3,4,0,2] 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f40b415d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f40b40c92b0 0x7f40b415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 10 monclient(hunting): picked mon.noname-c con 0x7f40b40c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f40b40748e0 0x7f40b4153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 10 monclient(hunting): picked mon.noname-a con 0x7f40b40748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b40c5860 con 0x7f40b415d1e0 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.276 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f40b40c5580 con 0x7f40b40748e0 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f40b40c7de0 con 0x7f40b40c92b0 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b8e0e640 10 monclient(hunting): authenticate will time out at 1327.910377s 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b2575640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f40b415d1e0 0x7f40b40c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:46812/0 (socket says 10.20.193.45:46812) 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b2575640 1 -- 10.20.193.45:0/4069103715 learned_addr learned my addr 10.20.193.45:0/4069103715 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b1d74640 1 --2- 10.20.193.45:0/4069103715 >> v2:10.20.193.92:3300/0 conn(0x7f40b40c92b0 0x7f40b415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.280+0000 7f40b2d76640 1 --2- 10.20.193.45:0/4069103715 >> v2:10.20.193.45:3300/0 conn(0x7f40b40748e0 0x7f40b4153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b1d74640 10 monclient(hunting): get_auth_request con 0x7f40b40c92b0 auth_method 0 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.277 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b2d76640 10 monclient(hunting): get_auth_request con 0x7f40b40748e0 auth_method 0 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.281+0000 7f40b2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1573640 1 -- 10.20.193.45:0/4069103715 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 729936026 0 0) 0x7f40b40c5860 con 0x7f40b415d1e0 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1573640 10 monclient(hunting): _negotiate 2026-02-17T21:12:24.278 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1573640 10 monclient(hunting): my global_id is 5215 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1573640 1 -- 10.20.193.45:0/4069103715 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40a0003620 con 0x7f40b415d1e0 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1d74640 10 monclient(hunting): handle_auth_done global_id 5246 payload 274 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1d74640 1 -- 10.20.193.45:0/4069103715 >> v2:10.20.193.45:3300/0 conn(0x7f40b40748e0 msgr2=0x7f40b4153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1d74640 1 --2- 10.20.193.45:0/4069103715 >> v2:10.20.193.45:3300/0 conn(0x7f40b40748e0 0x7f40b4153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1d74640 1 -- 10.20.193.45:0/4069103715 >> v1:10.20.193.86:6789/0 conn(0x7f40b415d1e0 legacy=0x7f40b40c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1d74640 10 monclient: _finish_hunting 0 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1d74640 1 monclient: found mon.noname-c 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.282+0000 7f40b1d74640 1 -- 10.20.193.45:0/4069103715 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b40c80c0 con 0x7f40b40c92b0 2026-02-17T21:12:24.279 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.283+0000 7f40b1d74640 1 --2- 10.20.193.45:0/4069103715 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b40c92b0 0x7f40b415d5c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f409c0098a0 tx=0x7f409c02ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7b2779e4cd02d78 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 1 -- 10.20.193.45:0/4069103715 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c03c070 con 0x7f40b40c92b0 2026-02-17T21:12:24.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:24.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 10 monclient: dump: 2026-02-17T21:12:24.286 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 10 monclient: _finish_auth 0 2026-02-17T21:12:24.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 10 monclient: _check_auth_tickets 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 1 -- 10.20.193.45:0/4069103715 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f409c02faf0 con 0x7f40b40c92b0 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 1 -- 10.20.193.45:0/4069103715 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c037440 con 0x7f40b40c92b0 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 5 monclient: authenticate success, global_id 5246 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 4 set_mon_vals no callback set 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b1573640 10 monclient: dump: 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.288 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 10 monclient: shutdown 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 1 -- 10.20.193.45:0/4069103715 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b40c92b0 msgr2=0x7f40b415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 1 --2- 10.20.193.45:0/4069103715 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b40c92b0 0x7f40b415d5c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f409c0098a0 tx=0x7f409c02ee20 comp rx=0 tx=0).stop 2026-02-17T21:12:24.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 1 -- 10.20.193.45:0/4069103715 shutdown_connections 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 1 --2- 10.20.193.45:0/4069103715 >> v2:10.20.193.45:3300/0 conn(0x7f40b40748e0 0x7f40b4153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 1 --2- 10.20.193.45:0/4069103715 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b40c92b0 0x7f40b415d5c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 1 -- 10.20.193.45:0/4069103715 >> 10.20.193.45:0/4069103715 conn(0x7f40b40c9d40 msgr2=0x7f40b40ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 1 -- 10.20.193.45:0/4069103715 shutdown_connections 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.285+0000 7f40b8e0e640 1 -- 10.20.193.45:0/4069103715 wait complete. 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient: monmap: 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:24.290 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 librados: starting msgr at 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 librados: starting objecter 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 Processor -- start 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 -- start start 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 librados: setting wanted keys 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 librados: calling monclient init 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient: init 2026-02-17T21:12:24.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40b40748e0 0x7f40b41f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient(hunting): picked mon.noname-b con 0x7f40b40748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40b40c92b0 0x7f40b4073890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient(hunting): picked mon.noname-a con 0x7f40b40c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b415d1e0 0x7f40b406b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient(hunting): picked mon.noname-c con 0x7f40b415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4074d30 con 0x7f40b40c92b0 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f40b40c8680 con 0x7f40b40748e0 2026-02-17T21:12:24.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f40b4153b50 con 0x7f40b415d1e0 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.286+0000 7f40b8e0e640 10 monclient(hunting): authenticate will time out at 1327.916783s 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b1d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40b40c92b0 0x7f40b4073890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b415d1e0 0x7f40b406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2575640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40b40748e0 0x7f40b41f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b415d1e0 0x7f40b406b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35034/0 (socket says 10.20.193.45:35034) 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 1 -- 10.20.193.45:0/2756299194 learned_addr learned my addr 10.20.193.45:0/2756299194 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 10 monclient(hunting): get_auth_request con 0x7f40b415d1e0 auth_method 0 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2575640 10 monclient(hunting): get_auth_request con 0x7f40b40748e0 auth_method 0 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b1d74640 10 monclient(hunting): get_auth_request con 0x7f40b40c92b0 auth_method 0 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b1d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.287+0000 7f40b1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 10 monclient(hunting): handle_auth_done global_id 5249 payload 824 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 1 -- 10.20.193.45:0/2756299194 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40b40748e0 msgr2=0x7f40b41f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40b40748e0 0x7f40b41f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 1 -- 10.20.193.45:0/2756299194 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40b40c92b0 msgr2=0x7f40b4073890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40b40c92b0 0x7f40b4073890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 10 monclient: _finish_hunting 0 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 1 monclient: found mon.noname-c 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:24.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.288+0000 7f40b2d76640 1 -- 10.20.193.45:0/2756299194 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b4072530 con 0x7f40b415d1e0 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.289+0000 7f40b2d76640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b415d1e0 0x7f40b406b870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009dd0 tx=0x7f40a400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.289+0000 7f409affd640 10 client.?.objecter ms_handle_connect 0x7f40b415d1e0 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.289+0000 7f409affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 1 -- 10.20.193.45:0/2756299194 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4018020 con 0x7f40b415d1e0 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 10 monclient: dump: 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.296 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 10 monclient: _finish_auth 0 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 5 monclient: authenticate success, global_id 5249 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 10 monclient: _renew_subs 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b40727f0 con 0x7f40b415d1e0 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 10 client.5249.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 10 monclient: _renew_subs 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b4072db0 con 0x7f40b415d1e0 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 1 librados: init done 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 1 -- 10.20.193.45:0/2756299194 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a4014480 con 0x7f40b415d1e0 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 1 -- 10.20.193.45:0/2756299194 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a4014830 con 0x7f40b415d1e0 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b0d72640 4 set_mon_vals no callback set 2026-02-17T21:12:24.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f409affd640 10 monclient: dump: 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:24.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.300 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.291+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b40746e0 con 0x7f40b415d1e0 2026-02-17T21:12:24.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.302+0000 7f409affd640 1 -- 10.20.193.45:0/2756299194 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f40a40149d0 con 0x7f40b415d1e0 2026-02-17T21:12:24.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.303+0000 7f409affd640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4080079280 0x7f408007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.303+0000 7f40b2575640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4080079280 0x7f408007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.303+0000 7f40b2575640 10 monclient: get_auth_request con 0x7f4080079280 auth_method 0 2026-02-17T21:12:24.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.303+0000 7f40b2575640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4080079280 0x7f408007b740 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f40a8007b60 tx=0x7f40a8007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.303+0000 7f409affd640 10 client.5249.objecter ms_handle_connect 0x7f4080079280 2026-02-17T21:12:24.301 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.304+0000 7f409affd640 1 -- 10.20.193.45:0/2756299194 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f40a405f370 con 0x7f40b415d1e0 2026-02-17T21:12:24.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.304+0000 7f409affd640 10 client.5249.objecter ms_dispatch2 0x7f40b4000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:24.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.304+0000 7f409affd640 3 client.5249.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:24.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.304+0000 7f409affd640 3 client.5249.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:24.302 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.304+0000 7f409affd640 20 client.5249.objecter dump_active .. 0 homeless 2026-02-17T21:12:24.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.404+0000 7f409affd640 1 -- 10.20.193.45:0/2756299194 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f40a4022030 con 0x7f40b415d1e0 2026-02-17T21:12:24.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.404+0000 7f409affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:24.397 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.404+0000 7f409affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:24.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.487+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7f40b4153f30 con 0x7f4080079280 2026-02-17T21:12:24.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.487+0000 7f409affd640 1 -- 10.20.193.45:0/2756299194 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f40b4153f30 con 0x7f4080079280 2026-02-17T21:12:24.480 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 9 to deep-scrub 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 10 librados: watch_flush enter 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 10 librados: watch_flush exit 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 20 client.5249.objecter shutdown clearing up homeless session... 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 10 client.5249.objecter successfully canceled tick 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4080079280 msgr2=0x7f408007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4080079280 0x7f408007b740 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f40a8007b60 tx=0x7f40a8007ab0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 10 monclient: shutdown 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b415d1e0 msgr2=0x7f40b406b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.482 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b415d1e0 0x7f40b406b870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f40a4009dd0 tx=0x7f40a400c490 comp rx=0 tx=0).stop 2026-02-17T21:12:24.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 shutdown_connections 2026-02-17T21:12:24.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f4080079280 0x7f408007b740 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f40b415d1e0 0x7f40b406b870 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f40b40c92b0 0x7f40b4073890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 --2- 10.20.193.45:0/2756299194 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f40b40748e0 0x7f40b41f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 >> 10.20.193.45:0/2756299194 conn(0x7f40b40c9d40 msgr2=0x7f40b40ca120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 shutdown_connections 2026-02-17T21:12:24.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 -- 10.20.193.45:0/2756299194 wait complete. 2026-02-17T21:12:24.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.488+0000 7f40b8e0e640 1 librados: shutdown 2026-02-17T21:12:24.489 INFO:tasks.ceph:Scrubbing osd.13 2026-02-17T21:12:24.489 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:24.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.565+0000 7f422f9ff640 10 monclient: get_monmap_and_config 2026-02-17T21:12:24.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.565+0000 7f422f9ff640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.558 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.565+0000 7f422f9ff640 10 monclient: monmap: 2026-02-17T21:12:24.558 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.558 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:24.566680+0000 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:24.566680+0000 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:24.559 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 1 Processor -- start 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 1 -- start start 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 10 monclient: init 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 10 monclient: _add_conns ranks=[0,4,2,1,5,3] 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f42281503c0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f422815d020 0x7f422815d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 10 monclient(hunting): picked mon.noname-b con 0x7f422815d020 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f42280c4740 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:24.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42280c55a0 con 0x7f42281503c0 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42280c52c0 con 0x7f42280c4740 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f4228159c40 con 0x7f422815d020 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.566+0000 7f422f9ff640 10 monclient(hunting): authenticate will time out at 1328.196892s 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422df75640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f42280c4740 0x7f42280c6a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45532/0 (socket says 10.20.193.45:45532) 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422df75640 1 -- 10.20.193.45:0/1396824855 learned_addr learned my addr 10.20.193.45:0/1396824855 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422cf73640 1 --2- 10.20.193.45:0/1396824855 >> v2:10.20.193.86:3300/0 conn(0x7f422815d020 0x7f422815d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422cf73640 10 monclient(hunting): get_auth_request con 0x7f422815d020 auth_method 0 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422cf73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422cf73640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422cf73640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.563 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422cf73640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422cf73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.567+0000 7f422cf73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.568+0000 7f422cf73640 10 monclient(hunting): handle_auth_done global_id 5221 payload 274 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.568+0000 7f422cf73640 1 -- 10.20.193.45:0/1396824855 >> v1:10.20.193.92:6789/0 conn(0x7f42280c4740 legacy=0x7f42280c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.568+0000 7f422cf73640 1 -- 10.20.193.45:0/1396824855 >> v1:10.20.193.45:6789/0 conn(0x7f42281503c0 legacy=0x7f422806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.568+0000 7f422cf73640 10 monclient: _finish_hunting 0 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.568+0000 7f422cf73640 1 monclient: found mon.noname-b 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.568+0000 7f422cf73640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.568+0000 7f422cf73640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.568+0000 7f422cf73640 1 -- 10.20.193.45:0/1396824855 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4228159f20 con 0x7f422815d020 2026-02-17T21:12:24.564 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.569+0000 7f422cf73640 1 --2- 10.20.193.45:0/1396824855 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f422815d020 0x7f422815d490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f421c0098a0 tx=0x7f421c02ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=183419fda85cd7e7 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 1 -- 10.20.193.45:0/1396824855 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c03c070 con 0x7f422815d020 2026-02-17T21:12:24.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:24.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 10 monclient: dump: 2026-02-17T21:12:24.569 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.569 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 10 monclient: _finish_auth 0 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:24.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 1 -- 10.20.193.45:0/1396824855 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f421c02fc10 con 0x7f422815d020 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 1 -- 10.20.193.45:0/1396824855 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c037440 con 0x7f422815d020 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f4217fff640 10 monclient: dump: 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.571 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 5 monclient: authenticate success, global_id 5221 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 4 set_mon_vals no callback set 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 10 monclient: shutdown 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 1 -- 10.20.193.45:0/1396824855 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f422815d020 msgr2=0x7f422815d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 1 --2- 10.20.193.45:0/1396824855 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f422815d020 0x7f422815d490 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f421c0098a0 tx=0x7f421c02ef00 comp rx=0 tx=0).stop 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 1 -- 10.20.193.45:0/1396824855 shutdown_connections 2026-02-17T21:12:24.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 1 --2- 10.20.193.45:0/1396824855 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f422815d020 0x7f422815d490 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 1 -- 10.20.193.45:0/1396824855 >> 10.20.193.45:0/1396824855 conn(0x7f42280cd520 msgr2=0x7f42280cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 1 -- 10.20.193.45:0/1396824855 shutdown_connections 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.571+0000 7f422f9ff640 1 -- 10.20.193.45:0/1396824855 wait complete. 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient: monmap: 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:24.573 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 librados: starting msgr at 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 librados: starting objecter 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 Processor -- start 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 -- start start 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 librados: setting wanted keys 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 librados: calling monclient init 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient: init 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:12:24.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f42280c4740 0x7f42280ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient(hunting): picked mon.noname-b con 0x7f42280c4740 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42281503c0 0x7f42280cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient(hunting): picked mon.noname-c con 0x7f42281503c0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f422815d020 0x7f42280cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient(hunting): picked mon.noname-a con 0x7f422815d020 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f42280704d0 con 0x7f422815d020 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f422815a4e0 con 0x7f42280c4740 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42281507a0 con 0x7f42281503c0 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:24.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.572+0000 7f422f9ff640 10 monclient(hunting): authenticate will time out at 1328.202994s 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422df75640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f422815d020 0x7f42280cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f42280c4740 0x7f42280ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422cf73640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42281503c0 0x7f42280cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f42280c4740 0x7f42280ca400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38200/0 (socket says 10.20.193.45:38200) 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 1 -- 10.20.193.45:0/2481407244 learned_addr learned my addr 10.20.193.45:0/2481407244 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 10 monclient(hunting): get_auth_request con 0x7f42280c4740 auth_method 0 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422df75640 10 monclient(hunting): get_auth_request con 0x7f422815d020 auth_method 0 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422df75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422df75640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422df75640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422cf73640 10 monclient(hunting): get_auth_request con 0x7f42281503c0 auth_method 0 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422cf73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422cf73640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422cf73640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422d774640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422df75640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422df75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422df75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422cf73640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422cf73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.577 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.573+0000 7f422cf73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.574+0000 7f422d774640 10 monclient(hunting): handle_auth_done global_id 5224 payload 824 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.575+0000 7f422d774640 1 -- 10.20.193.45:0/2481407244 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42281503c0 msgr2=0x7f42280cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.575+0000 7f422d774640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42281503c0 0x7f42280cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.575+0000 7f422d774640 1 -- 10.20.193.45:0/2481407244 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f422815d020 msgr2=0x7f42280cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.575+0000 7f422d774640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f422815d020 0x7f42280cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.575+0000 7f422d774640 10 monclient: _finish_hunting 0 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.575+0000 7f422d774640 1 monclient: found mon.noname-b 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.575+0000 7f422d774640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.575+0000 7f422d774640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.575+0000 7f422d774640 1 -- 10.20.193.45:0/2481407244 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42281f3e90 con 0x7f42280c4740 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.576+0000 7f422d774640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f42280c4740 0x7f42280ca400 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f421800c5b0 tx=0x7f421800ca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.576+0000 7f4215ffb640 10 client.?.objecter ms_handle_connect 0x7f42280c4740 2026-02-17T21:12:24.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.576+0000 7f4215ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:24.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 1 -- 10.20.193.45:0/2481407244 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42180052d0 con 0x7f42280c4740 2026-02-17T21:12:24.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:24.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 10 monclient: dump: 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:24.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 1 -- 10.20.193.45:0/2481407244 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4218005470 con 0x7f42280c4740 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f422f9ff640 5 monclient: authenticate success, global_id 5224 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f422f9ff640 10 monclient: _renew_subs 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f422f9ff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42281f4170 con 0x7f42280c4740 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 1 -- 10.20.193.45:0/2481407244 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42180038f0 con 0x7f42280c4740 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f4215ffb640 10 monclient: dump: 2026-02-17T21:12:24.582 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f42177fe640 4 set_mon_vals no callback set 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f422f9ff640 10 client.5224.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f422f9ff640 10 monclient: _renew_subs 2026-02-17T21:12:24.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f422f9ff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:24.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42281f4730 con 0x7f42280c4740 2026-02-17T21:12:24.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.578+0000 7f422f9ff640 1 librados: init done 2026-02-17T21:12:24.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.579+0000 7f422f9ff640 10 client.5224.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:24.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.579+0000 7f422f9ff640 15 client.5224.objecter _session_command_op_assign -1 1 2026-02-17T21:12:24.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.579+0000 7f422f9ff640 20 client.5224.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:24.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.579+0000 7f422f9ff640 10 client.5224.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:24.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.579+0000 7f422f9ff640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:24.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.579+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f422815d490 con 0x7f42280c4740 2026-02-17T21:12:24.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.590+0000 7f4215ffb640 1 -- 10.20.193.45:0/2481407244 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f4218003a90 con 0x7f42280c4740 2026-02-17T21:12:24.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.591+0000 7f4215ffb640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f41f80792d0 0x7f41f807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.591+0000 7f422cf73640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f41f80792d0 0x7f41f807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.591+0000 7f422cf73640 10 monclient: get_auth_request con 0x7f41f80792d0 auth_method 0 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.591+0000 7f4215ffb640 10 client.5224.objecter ms_handle_connect 0x7f41f80792d0 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.591+0000 7f422cf73640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f41f80792d0 0x7f41f807b790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f421c039000 tx=0x7f421c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.592+0000 7f4215ffb640 1 -- 10.20.193.45:0/2481407244 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f421805e2e0 con 0x7f42280c4740 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.592+0000 7f4215ffb640 10 client.5224.objecter ms_dispatch2 0x7f4228000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.592+0000 7f4215ffb640 3 client.5224.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.592+0000 7f4215ffb640 3 client.5224.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.592+0000 7f4215ffb640 10 client.5224.objecter checking command 1 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f41f8081810 0x7f41f8083c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 20 client.5224.objecter _get_session s=0x7f41f8081140 osd=13 3 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 20 client.5224.objecter put_session s=0x7f41f8081140 osd=13 3 2026-02-17T21:12:24.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 15 client.5224.objecter _session_command_op_remove -1 1 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 20 client.5224.objecter _get_session s=0x7f41f8081140 osd=13 3 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 20 client.5224.objecter get_session s=0x7f41f8081140 osd=13 3 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 15 client.5224.objecter _session_command_op_assign 13 1 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 20 client.5224.objecter put_session s=0x7f41f8081140 osd=13 4 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 10 client.5224.objecter _send_command 1 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 1 -- 10.20.193.45:0/2481407244 --> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41f8084300 con 0x7f41f8081810 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 20 client.5224.objecter dump_active .. 0 homeless 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 1 -- 10.20.193.45:0/2481407244 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f421805e6a0 con 0x7f42280c4740 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f4215ffb640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f422df75640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f41f8081810 0x7f41f8083c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.588 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.593+0000 7f422df75640 10 monclient: get_auth_request con 0x7f41f8081810 auth_method 0 2026-02-17T21:12:24.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.595+0000 7f422df75640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f41f8081810 0x7f41f8083c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.13 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.589 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.595+0000 7f4215ffb640 10 client.5224.objecter ms_handle_connect 0x7f41f8081810 2026-02-17T21:12:24.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.605+0000 7f4215ffb640 1 -- 10.20.193.45:0/2481407244 <== osd.13 v2:10.20.193.86:6808/3260427089 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f41f8084300 con 0x7f41f8081810 2026-02-17T21:12:24.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.605+0000 7f4215ffb640 10 client.5224.objecter ms_dispatch2 0x7f4228000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:24.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.605+0000 7f4215ffb640 10 client.5224.objecter _finish_command 1 = system:0 2026-02-17T21:12:24.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.605+0000 7f4215ffb640 20 client.5224.objecter put_session s=0x7f41f8081140 osd=13 4 2026-02-17T21:12:24.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.605+0000 7f4215ffb640 15 client.5224.objecter _session_command_op_remove 13 1 2026-02-17T21:12:24.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 10 client.5224.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:24.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 15 client.5224.objecter _session_command_op_assign -1 2 2026-02-17T21:12:24.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 20 client.5224.objecter _get_session s=0x7f41f8081140 osd=13 3 2026-02-17T21:12:24.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 20 client.5224.objecter put_session s=0x7f41f8081140 osd=13 3 2026-02-17T21:12:24.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 20 client.5224.objecter _get_session s=0x7f41f8081140 osd=13 3 2026-02-17T21:12:24.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 15 client.5224.objecter _session_command_op_remove -1 2 2026-02-17T21:12:24.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 20 client.5224.objecter get_session s=0x7f41f8081140 osd=13 3 2026-02-17T21:12:24.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 15 client.5224.objecter _session_command_op_assign 13 2 2026-02-17T21:12:24.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 20 client.5224.objecter put_session s=0x7f41f8081140 osd=13 4 2026-02-17T21:12:24.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 10 client.5224.objecter _send_command 2 2026-02-17T21:12:24.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.611+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 --> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f42280cab90 con 0x7f41f8081810 2026-02-17T21:12:24.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f4215ffb640 1 -- 10.20.193.45:0/2481407244 <== osd.13 v2:10.20.193.86:6808/3260427089 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f42280cab90 con 0x7f41f8081810 2026-02-17T21:12:24.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f4215ffb640 10 client.5224.objecter ms_dispatch2 0x7f4228000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:24.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f4215ffb640 10 client.5224.objecter _finish_command 2 = system:0 2026-02-17T21:12:24.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f4215ffb640 20 client.5224.objecter put_session s=0x7f41f8081140 osd=13 4 2026-02-17T21:12:24.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f4215ffb640 15 client.5224.objecter _session_command_op_remove 13 2 2026-02-17T21:12:24.611 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:24.611 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:24.612 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:24.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 10 librados: watch_flush enter 2026-02-17T21:12:24.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 10 librados: watch_flush exit 2026-02-17T21:12:24.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 10 client.5224.objecter close_session for osd.13 2026-02-17T21:12:24.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f41f8081810 msgr2=0x7f41f8083c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.86:6808/3260427089,v1:10.20.193.86:6809/3260427089] conn(0x7f41f8081810 0x7f41f8083c30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 20 client.5224.objecter put_session s=0x7f41f8081140 osd=13 1 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 20 client.5224.objecter shutdown clearing up homeless session... 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 10 client.5224.objecter successfully canceled tick 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f41f80792d0 msgr2=0x7f41f807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f41f80792d0 0x7f41f807b790 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f421c039000 tx=0x7f421c033000 comp rx=0 tx=0).stop 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 10 monclient: shutdown 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f42280c4740 msgr2=0x7f42280ca400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 --2- 10.20.193.45:0/2481407244 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f42280c4740 0x7f42280ca400 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f421800c5b0 tx=0x7f421800ca80 comp rx=0 tx=0).stop 2026-02-17T21:12:24.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422df75640 1 -- 10.20.193.45:0/2481407244 reap_dead start 2026-02-17T21:12:24.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 shutdown_connections 2026-02-17T21:12:24.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 >> 10.20.193.45:0/2481407244 conn(0x7f42280cd520 msgr2=0x7f422806e390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 shutdown_connections 2026-02-17T21:12:24.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 -- 10.20.193.45:0/2481407244 wait complete. 2026-02-17T21:12:24.615 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.618+0000 7f422f9ff640 1 librados: shutdown 2026-02-17T21:12:24.619 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-17T21:12:24.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.693+0000 7f595472c640 10 monclient: get_monmap_and_config 2026-02-17T21:12:24.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.693+0000 7f595472c640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.686 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.693+0000 7f595472c640 10 monclient: monmap: 2026-02-17T21:12:24.686 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.686 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:24.694680+0000 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:24.694680+0000 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:24.687 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 1 Processor -- start 2026-02-17T21:12:24.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 1 -- start start 2026-02-17T21:12:24.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient: init 2026-02-17T21:12:24.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient: _add_conns ranks=[3,2,5,1,0,4] 2026-02-17T21:12:24.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f594c15d1e0 0x7f594c15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.690 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient(hunting): picked mon.noname-a con 0x7f594c15d1e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f594c0748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f594c0c92b0 0x7f594c153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient(hunting): picked mon.noname-c con 0x7f594c0c92b0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c0c5860 con 0x7f594c0748e0 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f594c0c5580 con 0x7f594c15d1e0 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f594c0c7de0 con 0x7f594c0c92b0 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.694+0000 7f595472c640 10 monclient(hunting): authenticate will time out at 1328.324884s 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f594c15d1e0 0x7f594c15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.691 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f5952ca2640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f594c0c92b0 0x7f594c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f594c15d1e0 0x7f594c15d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36586/0 (socket says 10.20.193.45:36586) 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 1 -- 10.20.193.45:0/612146552 learned_addr learned my addr 10.20.193.45:0/612146552 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 10 monclient(hunting): get_auth_request con 0x7f594c15d1e0 auth_method 0 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f5952ca2640 10 monclient(hunting): get_auth_request con 0x7f594c0c92b0 auth_method 0 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f5952ca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f5952ca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f5952ca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.695+0000 7f59524a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f5952ca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f5952ca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f5952ca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f59524a1640 10 monclient(hunting): handle_auth_done global_id 5169 payload 274 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f59524a1640 1 -- 10.20.193.45:0/612146552 >> v2:10.20.193.92:3300/0 conn(0x7f594c0c92b0 msgr2=0x7f594c153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f59524a1640 1 --2- 10.20.193.45:0/612146552 >> v2:10.20.193.92:3300/0 conn(0x7f594c0c92b0 0x7f594c153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f59524a1640 1 -- 10.20.193.45:0/612146552 >> v1:10.20.193.92:6789/0 conn(0x7f594c0748e0 legacy=0x7f594c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f59524a1640 10 monclient: _finish_hunting 0 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f59524a1640 1 monclient: found mon.noname-a 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f59524a1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f59524a1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.696+0000 7f59524a1640 1 -- 10.20.193.45:0/612146552 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c0c80c0 con 0x7f594c15d1e0 2026-02-17T21:12:24.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.697+0000 7f59524a1640 1 --2- 10.20.193.45:0/612146552 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c15d1e0 0x7f594c15d5c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f593c009970 tx=0x7f593c02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2a4c2d53360fb1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 1 -- 10.20.193.45:0/612146552 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c03c070 con 0x7f594c15d1e0 2026-02-17T21:12:24.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:24.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 10 monclient: dump: 2026-02-17T21:12:24.700 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 10 monclient: _finish_auth 0 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 10 monclient: _check_auth_tickets 2026-02-17T21:12:24.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 5 monclient: authenticate success, global_id 5169 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 1 -- 10.20.193.45:0/612146552 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593c02fbc0 con 0x7f594c15d1e0 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 1 -- 10.20.193.45:0/612146552 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c037440 con 0x7f594c15d1e0 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595149f640 10 monclient: dump: 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.702 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 4 set_mon_vals no callback set 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 10 monclient: shutdown 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 1 -- 10.20.193.45:0/612146552 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c15d1e0 msgr2=0x7f594c15d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 1 --2- 10.20.193.45:0/612146552 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c15d1e0 0x7f594c15d5c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f593c009970 tx=0x7f593c02eef0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 1 -- 10.20.193.45:0/612146552 shutdown_connections 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 1 --2- 10.20.193.45:0/612146552 >> v2:10.20.193.92:3300/0 conn(0x7f594c0c92b0 0x7f594c153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 1 --2- 10.20.193.45:0/612146552 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c15d1e0 0x7f594c15d5c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 1 -- 10.20.193.45:0/612146552 >> 10.20.193.45:0/612146552 conn(0x7f594c0c9d40 msgr2=0x7f594c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 1 -- 10.20.193.45:0/612146552 shutdown_connections 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.699+0000 7f595472c640 1 -- 10.20.193.45:0/612146552 wait complete. 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.700+0000 7f595472c640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.700+0000 7f595472c640 10 monclient: monmap: 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.704 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.700+0000 7f595472c640 1 librados: starting msgr at 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.700+0000 7f595472c640 1 librados: starting objecter 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.700+0000 7f595472c640 1 Processor -- start 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.700+0000 7f595472c640 1 -- start start 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.700+0000 7f595472c640 1 librados: setting wanted keys 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.700+0000 7f595472c640 1 librados: calling monclient init 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.700+0000 7f595472c640 10 monclient: init 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f594c0748e0 0x7f594c147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient(hunting): picked mon.noname-b con 0x7f594c0748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c0c92b0 0x7f594c0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient(hunting): picked mon.noname-a con 0x7f594c0c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f594c15d1e0 0x7f594c0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient(hunting): picked mon.noname-c con 0x7f594c15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f594c074d30 con 0x7f594c0c92b0 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f594c0c8680 con 0x7f594c0748e0 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f594c153b50 con 0x7f594c15d1e0 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f595472c640 10 monclient(hunting): authenticate will time out at 1328.331190s 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c0c92b0 0x7f594c0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5952ca2640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f594c15d1e0 0x7f594c0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f59524a1640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f594c0748e0 0x7f594c147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c0c92b0 0x7f594c0cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36594/0 (socket says 10.20.193.45:36594) 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 1 -- 10.20.193.45:0/307794587 learned_addr learned my addr 10.20.193.45:0/307794587 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 10 monclient(hunting): get_auth_request con 0x7f594c0c92b0 auth_method 0 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5952ca2640 10 monclient(hunting): get_auth_request con 0x7f594c15d1e0 auth_method 0 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5952ca2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5952ca2640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5952ca2640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f59524a1640 10 monclient(hunting): get_auth_request con 0x7f594c0748e0 auth_method 0 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f59524a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f59524a1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f59524a1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5951ca0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5952ca2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5952ca2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.701+0000 7f5952ca2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.702+0000 7f59524a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.702+0000 7f59524a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.702+0000 7f59524a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 10 monclient(hunting): handle_auth_done global_id 5264 payload 824 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 1 -- 10.20.193.45:0/307794587 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f594c0748e0 msgr2=0x7f594c147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f594c0748e0 0x7f594c147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 1 -- 10.20.193.45:0/307794587 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c0c92b0 msgr2=0x7f594c0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c0c92b0 0x7f594c0cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 10 monclient: _finish_hunting 0 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 1 monclient: found mon.noname-c 2026-02-17T21:12:24.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.703+0000 7f5952ca2640 1 -- 10.20.193.45:0/307794587 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c1f36a0 con 0x7f594c15d1e0 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.704+0000 7f5952ca2640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f594c15d1e0 0x7f594c0cc640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f594800efc0 tx=0x7f594800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.704+0000 7f5932ffd640 10 client.?.objecter ms_handle_connect 0x7f594c15d1e0 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.704+0000 7f5932ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 1 -- 10.20.193.45:0/307794587 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948018020 con 0x7f594c15d1e0 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 10 monclient: dump: 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.710 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 10 monclient: _finish_auth 0 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 5 monclient: authenticate success, global_id 5264 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 10 monclient: _renew_subs 2026-02-17T21:12:24.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594c1f3980 con 0x7f594c15d1e0 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 10 client.5264.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 10 monclient: _renew_subs 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594c1f3f40 con 0x7f594c15d1e0 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 1 librados: init done 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f594c153f30 con 0x7f594c15d1e0 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 1 -- 10.20.193.45:0/307794587 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5948014480 con 0x7f594c15d1e0 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:24.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 1 -- 10.20.193.45:0/307794587 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948014830 con 0x7f594c15d1e0 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5950c9e640 4 set_mon_vals no callback set 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.705+0000 7f5932ffd640 10 monclient: dump: 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.713 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.714 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.805 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.812+0000 7f5932ffd640 1 -- 10.20.193.45:0/307794587 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f59480149d0 con 0x7f594c15d1e0 2026-02-17T21:12:24.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.813+0000 7f5932ffd640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f591c079280 0x7f591c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.813+0000 7f59524a1640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f591c079280 0x7f591c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.813+0000 7f59524a1640 10 monclient: get_auth_request con 0x7f591c079280 auth_method 0 2026-02-17T21:12:24.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.813+0000 7f59524a1640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f591c079280 0x7f591c07b740 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f594c0c6af0 tx=0x7f593c033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.806 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.813+0000 7f5932ffd640 10 client.5264.objecter ms_handle_connect 0x7f591c079280 2026-02-17T21:12:24.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.814+0000 7f5932ffd640 1 -- 10.20.193.45:0/307794587 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f594805f200 con 0x7f594c15d1e0 2026-02-17T21:12:24.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.814+0000 7f5932ffd640 10 client.5264.objecter ms_dispatch2 0x7f594c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:24.807 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.814+0000 7f5932ffd640 3 client.5264.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:24.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.814+0000 7f5932ffd640 3 client.5264.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:24.808 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.815+0000 7f5932ffd640 20 client.5264.objecter dump_active .. 0 homeless 2026-02-17T21:12:24.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.820+0000 7f5932ffd640 1 -- 10.20.193.45:0/307794587 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5948022030 con 0x7f594c15d1e0 2026-02-17T21:12:24.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.821+0000 7f5932ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:24.813 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.821+0000 7f5932ffd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:24.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.904+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7f594c0c9b20 con 0x7f591c079280 2026-02-17T21:12:24.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.904+0000 7f5932ffd640 1 -- 10.20.193.45:0/307794587 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f594c0c9b20 con 0x7f591c079280 2026-02-17T21:12:24.897 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 13 to deep-scrub 2026-02-17T21:12:24.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 10 librados: watch_flush enter 2026-02-17T21:12:24.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 10 librados: watch_flush exit 2026-02-17T21:12:24.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 20 client.5264.objecter shutdown clearing up homeless session... 2026-02-17T21:12:24.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 10 client.5264.objecter successfully canceled tick 2026-02-17T21:12:24.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f591c079280 msgr2=0x7f591c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f591c079280 0x7f591c07b740 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f594c0c6af0 tx=0x7f593c033000 comp rx=0 tx=0).stop 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 10 monclient: shutdown 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f594c15d1e0 msgr2=0x7f594c0cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f594c15d1e0 0x7f594c0cc640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f594800efc0 tx=0x7f594800c490 comp rx=0 tx=0).stop 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 shutdown_connections 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f591c079280 0x7f591c07b740 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f594c15d1e0 0x7f594c0cc640 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f594c0c92b0 0x7f594c0cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 --2- 10.20.193.45:0/307794587 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f594c0748e0 0x7f594c147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 >> 10.20.193.45:0/307794587 conn(0x7f594c0c9d40 msgr2=0x7f594c148a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 shutdown_connections 2026-02-17T21:12:24.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 -- 10.20.193.45:0/307794587 wait complete. 2026-02-17T21:12:24.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.905+0000 7f595472c640 1 librados: shutdown 2026-02-17T21:12:24.906 INFO:tasks.ceph:Scrubbing osd.2 2026-02-17T21:12:24.906 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:24.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.985+0000 7f762ed2a640 10 monclient: get_monmap_and_config 2026-02-17T21:12:24.977 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.985+0000 7f762ed2a640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.985+0000 7f762ed2a640 10 monclient: monmap: 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:24.986025+0000 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:24.986025+0000 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:24.978 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:24.979 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:24.979 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:24.979 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.985+0000 7f762ed2a640 1 Processor -- start 2026-02-17T21:12:24.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.985+0000 7f762ed2a640 1 -- start start 2026-02-17T21:12:24.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.985+0000 7f762ed2a640 10 monclient: init 2026-02-17T21:12:24.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient: _add_conns ranks=[3,4,5,1,0,2] 2026-02-17T21:12:24.982 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f76281503c0 0x7f762806fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient(hunting): picked mon.noname-a con 0x7f76281503c0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f7628070300 0x7f762815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient(hunting): picked mon.noname-b con 0x7f7628070300 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f762815d560 0x7f76280c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient(hunting): picked mon.noname-c con 0x7f762815d560 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f76280c55a0 con 0x7f76281503c0 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f76280c52c0 con 0x7f7628070300 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f7628159c40 con 0x7f762815d560 2026-02-17T21:12:24.983 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ed2a640 10 monclient(hunting): authenticate will time out at 1328.616196s 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f761ffff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f7628070300 0x7f762815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762d2a0640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f762815d560 0x7f76280c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ca9f640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f76281503c0 0x7f762806fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f761ffff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f7628070300 0x7f762815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38216/0 (socket says 10.20.193.45:38216) 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ca9f640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f76281503c0 0x7f762806fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36596/0 (socket says 10.20.193.45:36596) 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f761ffff640 1 -- 10.20.193.45:0/2712554675 learned_addr learned my addr 10.20.193.45:0/2712554675 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f761ffff640 10 monclient(hunting): get_auth_request con 0x7f7628070300 auth_method 0 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f761ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f761ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f761ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762d2a0640 10 monclient(hunting): get_auth_request con 0x7f762815d560 auth_method 0 2026-02-17T21:12:24.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762d2a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762d2a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762d2a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ca9f640 10 monclient(hunting): get_auth_request con 0x7f76281503c0 auth_method 0 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ca9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ca9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.986+0000 7f762ca9f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.987+0000 7f762ca9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.987+0000 7f762ca9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.987+0000 7f762ca9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.987+0000 7f761ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.987+0000 7f761ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.987+0000 7f761ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.987+0000 7f762d2a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.987+0000 7f762d2a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.987+0000 7f762d2a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 10 monclient(hunting): handle_auth_done global_id 5230 payload 274 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 1 -- 10.20.193.45:0/2712554675 >> v2:10.20.193.92:3300/0 conn(0x7f762815d560 msgr2=0x7f76280c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 1 --2- 10.20.193.45:0/2712554675 >> v2:10.20.193.92:3300/0 conn(0x7f762815d560 0x7f76280c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 1 -- 10.20.193.45:0/2712554675 >> v2:10.20.193.45:3300/0 conn(0x7f76281503c0 msgr2=0x7f762806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 1 --2- 10.20.193.45:0/2712554675 >> v2:10.20.193.45:3300/0 conn(0x7f76281503c0 0x7f762806fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 1 monclient: found mon.noname-b 2026-02-17T21:12:24.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:24.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:24.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.988+0000 7f761ffff640 1 -- 10.20.193.45:0/2712554675 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7628159f20 con 0x7f7628070300 2026-02-17T21:12:24.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.989+0000 7f761ffff640 1 --2- 10.20.193.45:0/2712554675 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7628070300 0x7f762815d020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f76280c0e40 tx=0x7f761002ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434701f84889c54b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:24.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 1 -- 10.20.193.45:0/2712554675 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761003c070 con 0x7f7628070300 2026-02-17T21:12:24.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:24.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 10 monclient: dump: 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:24.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 1 -- 10.20.193.45:0/2712554675 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761002fbd0 con 0x7f7628070300 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f762ed2a640 5 monclient: authenticate success, global_id 5230 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f762ed2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 1 -- 10.20.193.45:0/2712554675 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610037440 con 0x7f7628070300 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f762ed2a640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f762ed2a640 4 set_mon_vals no callback set 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.990+0000 7f761f7fe640 10 monclient: dump: 2026-02-17T21:12:24.995 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 10 monclient: shutdown 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:24.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 1 -- 10.20.193.45:0/2712554675 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7628070300 msgr2=0x7f762815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 1 --2- 10.20.193.45:0/2712554675 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7628070300 0x7f762815d020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f76280c0e40 tx=0x7f761002ef50 comp rx=0 tx=0).stop 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 1 -- 10.20.193.45:0/2712554675 shutdown_connections 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 1 --2- 10.20.193.45:0/2712554675 >> v2:10.20.193.92:3300/0 conn(0x7f762815d560 0x7f76280c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 1 --2- 10.20.193.45:0/2712554675 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7628070300 0x7f762815d020 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 1 --2- 10.20.193.45:0/2712554675 >> v2:10.20.193.45:3300/0 conn(0x7f76281503c0 0x7f762806fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 1 -- 10.20.193.45:0/2712554675 >> 10.20.193.45:0/2712554675 conn(0x7f76280cd520 msgr2=0x7f76280cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 1 -- 10.20.193.45:0/2712554675 shutdown_connections 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 1 -- 10.20.193.45:0/2712554675 wait complete. 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 10 monclient: build_initial_monmap 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.991+0000 7f762ed2a640 10 monclient: monmap: 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:24.997 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 librados: starting msgr at 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 librados: starting objecter 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 Processor -- start 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 -- start start 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 librados: setting wanted keys 2026-02-17T21:12:24.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 librados: calling monclient init 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient: init 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7628070300 0x7f7628159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient(hunting): picked mon.noname-c con 0x7f7628070300 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f76281503c0 0x7f76280bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient(hunting): picked mon.noname-a con 0x7f76281503c0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f762815d560 0x7f76280c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient(hunting): picked mon.noname-b con 0x7f762815d560 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f76281507a0 con 0x7f76281503c0 2026-02-17T21:12:24.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f762815a4e0 con 0x7f762815d560 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7628150920 con 0x7f7628070300 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.992+0000 7f762ed2a640 10 monclient(hunting): authenticate will time out at 1328.622736s 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f76281503c0 0x7f76280bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f76281503c0 0x7f76280bfc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36608/0 (socket says 10.20.193.45:36608) 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 1 -- 10.20.193.45:0/1902201046 learned_addr learned my addr 10.20.193.45:0/1902201046 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 10 monclient(hunting): get_auth_request con 0x7f76281503c0 auth_method 0 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f762d2a0640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f762815d560 0x7f76280c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f761ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f762d2a0640 10 monclient(hunting): get_auth_request con 0x7f762815d560 auth_method 0 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f762d2a0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f762d2a0640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f762d2a0640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f762d2a0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f762d2a0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.993+0000 7f762d2a0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f762ca9f640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7628070300 0x7f7628159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f762ca9f640 10 monclient(hunting): get_auth_request con 0x7f7628070300 auth_method 0 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f762ca9f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f762ca9f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f762ca9f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f762ca9f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f762ca9f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f762ca9f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 10 monclient(hunting): handle_auth_done global_id 5178 payload 824 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 1 -- 10.20.193.45:0/1902201046 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7628070300 msgr2=0x7f7628159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7628070300 0x7f7628159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 1 -- 10.20.193.45:0/1902201046 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f762815d560 msgr2=0x7f76280c0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f762815d560 0x7f76280c0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 1 monclient: found mon.noname-a 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.994+0000 7f761ffff640 1 -- 10.20.193.45:0/1902201046 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76281f3c20 con 0x7f76281503c0 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.996+0000 7f761ffff640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f76281503c0 0x7f76280bfc30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f761002f4b0 tx=0x7f76100047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.996+0000 7f761d7fa640 10 client.?.objecter ms_handle_connect 0x7f76281503c0 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.996+0000 7f761d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.998+0000 7f761d7fa640 1 -- 10.20.193.45:0/1902201046 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761003c040 con 0x7f76281503c0 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.998+0000 7f761d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 10 monclient: dump: 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.003 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 5 monclient: authenticate success, global_id 5178 2026-02-17T21:12:25.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 1 -- 10.20.193.45:0/1902201046 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7610042430 con 0x7f76281503c0 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 1 -- 10.20.193.45:0/1902201046 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610042800 con 0x7f76281503c0 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761effd640 4 set_mon_vals no callback set 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f761d7fa640 10 monclient: dump: 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.005 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 10 monclient: _renew_subs 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76281f3f00 con 0x7f76281503c0 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 10 client.5178.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 10 monclient: _renew_subs 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76281f44c0 con 0x7f76281503c0 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 1 librados: init done 2026-02-17T21:12:25.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 10 client.5178.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:25.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 15 client.5178.objecter _session_command_op_assign -1 1 2026-02-17T21:12:25.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 20 client.5178.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:25.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 10 client.5178.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:25.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:24.999+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76280c9b30 con 0x7f76281503c0 2026-02-17T21:12:25.036 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.044+0000 7f761d7fa640 1 -- 10.20.193.45:0/1902201046 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f76100429a0 con 0x7f76281503c0 2026-02-17T21:12:25.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.044+0000 7f761d7fa640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f75f80792d0 0x7f75f807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.044+0000 7f762ca9f640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f75f80792d0 0x7f75f807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.044+0000 7f762ca9f640 10 monclient: get_auth_request con 0x7f75f80792d0 auth_method 0 2026-02-17T21:12:25.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.045+0000 7f761d7fa640 10 client.5178.objecter ms_handle_connect 0x7f75f80792d0 2026-02-17T21:12:25.038 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.045+0000 7f762ca9f640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f75f80792d0 0x7f75f807b790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7618009b20 tx=0x7f7618009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 1 -- 10.20.193.45:0/1902201046 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f7610083970 con 0x7f76281503c0 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 10 client.5178.objecter ms_dispatch2 0x7f7628000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 3 client.5178.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 3 client.5178.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 10 client.5178.objecter checking command 1 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7f75f80817b0 0x7f75f8083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 20 client.5178.objecter _get_session s=0x7f75f80810e0 osd=2 3 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 20 client.5178.objecter put_session s=0x7f75f80810e0 osd=2 3 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 15 client.5178.objecter _session_command_op_remove -1 1 2026-02-17T21:12:25.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 20 client.5178.objecter _get_session s=0x7f75f80810e0 osd=2 3 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 20 client.5178.objecter get_session s=0x7f75f80810e0 osd=2 3 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 15 client.5178.objecter _session_command_op_assign 2 1 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 20 client.5178.objecter put_session s=0x7f75f80810e0 osd=2 4 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 10 client.5178.objecter _send_command 1 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 1 -- 10.20.193.45:0/1902201046 --> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f761004ee80 con 0x7f75f80817b0 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 20 client.5178.objecter dump_active .. 0 homeless 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 1 -- 10.20.193.45:0/1902201046 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7610083d30 con 0x7f76281503c0 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.046+0000 7f761d7fa640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.047+0000 7f762d2a0640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7f75f80817b0 0x7f75f8083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.047+0000 7f762d2a0640 10 monclient: get_auth_request con 0x7f75f80817b0 auth_method 0 2026-02-17T21:12:25.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.049+0000 7f762d2a0640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7f75f80817b0 0x7f75f8083bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.042 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.049+0000 7f761d7fa640 10 client.5178.objecter ms_handle_connect 0x7f75f80817b0 2026-02-17T21:12:25.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.059+0000 7f761d7fa640 1 -- 10.20.193.45:0/1902201046 <== osd.2 v2:10.20.193.92:6800/281465485 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f761004ee80 con 0x7f75f80817b0 2026-02-17T21:12:25.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.059+0000 7f761d7fa640 10 client.5178.objecter ms_dispatch2 0x7f7628000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:25.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.059+0000 7f761d7fa640 10 client.5178.objecter _finish_command 1 = system:0 2026-02-17T21:12:25.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.059+0000 7f761d7fa640 20 client.5178.objecter put_session s=0x7f75f80810e0 osd=2 4 2026-02-17T21:12:25.052 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.059+0000 7f761d7fa640 15 client.5178.objecter _session_command_op_remove 2 1 2026-02-17T21:12:25.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 10 client.5178.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:25.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 15 client.5178.objecter _session_command_op_assign -1 2 2026-02-17T21:12:25.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 20 client.5178.objecter _get_session s=0x7f75f80810e0 osd=2 3 2026-02-17T21:12:25.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 20 client.5178.objecter put_session s=0x7f75f80810e0 osd=2 3 2026-02-17T21:12:25.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 20 client.5178.objecter _get_session s=0x7f75f80810e0 osd=2 3 2026-02-17T21:12:25.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 15 client.5178.objecter _session_command_op_remove -1 2 2026-02-17T21:12:25.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 20 client.5178.objecter get_session s=0x7f75f80810e0 osd=2 3 2026-02-17T21:12:25.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 15 client.5178.objecter _session_command_op_assign 2 2 2026-02-17T21:12:25.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 20 client.5178.objecter put_session s=0x7f75f80810e0 osd=2 4 2026-02-17T21:12:25.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 10 client.5178.objecter _send_command 2 2026-02-17T21:12:25.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.065+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 --> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f76280c8bb0 con 0x7f75f80817b0 2026-02-17T21:12:25.066 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f761d7fa640 1 -- 10.20.193.45:0/1902201046 <== osd.2 v2:10.20.193.92:6800/281465485 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f76280c8bb0 con 0x7f75f80817b0 2026-02-17T21:12:25.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f761d7fa640 10 client.5178.objecter ms_dispatch2 0x7f7628000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:25.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f761d7fa640 10 client.5178.objecter _finish_command 2 = system:0 2026-02-17T21:12:25.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f761d7fa640 20 client.5178.objecter put_session s=0x7f75f80810e0 osd=2 4 2026-02-17T21:12:25.067 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f761d7fa640 15 client.5178.objecter _session_command_op_remove 2 2 2026-02-17T21:12:25.067 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:25.067 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:25.067 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:25.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 10 librados: watch_flush enter 2026-02-17T21:12:25.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 10 librados: watch_flush exit 2026-02-17T21:12:25.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 10 client.5178.objecter close_session for osd.2 2026-02-17T21:12:25.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7f75f80817b0 msgr2=0x7f75f8083bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.92:6800/281465485,v1:10.20.193.92:6801/281465485] conn(0x7f75f80817b0 0x7f75f8083bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 20 client.5178.objecter put_session s=0x7f75f80810e0 osd=2 1 2026-02-17T21:12:25.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 20 client.5178.objecter shutdown clearing up homeless session... 2026-02-17T21:12:25.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 10 client.5178.objecter successfully canceled tick 2026-02-17T21:12:25.069 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f75f80792d0 msgr2=0x7f75f807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f75f80792d0 0x7f75f807b790 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7618009b20 tx=0x7f7618009290 comp rx=0 tx=0).stop 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 10 monclient: shutdown 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f76281503c0 msgr2=0x7f76280bfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 --2- 10.20.193.45:0/1902201046 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f76281503c0 0x7f76280bfc30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f761002f4b0 tx=0x7f76100047c0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762d2a0640 1 -- 10.20.193.45:0/1902201046 reap_dead start 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 shutdown_connections 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 >> 10.20.193.45:0/1902201046 conn(0x7f76280cd520 msgr2=0x7f76280cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 shutdown_connections 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 -- 10.20.193.45:0/1902201046 wait complete. 2026-02-17T21:12:25.070 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.074+0000 7f762ed2a640 1 librados: shutdown 2026-02-17T21:12:25.076 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-17T21:12:25.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.152+0000 7fc159b14640 10 monclient: get_monmap_and_config 2026-02-17T21:12:25.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.152+0000 7fc159b14640 10 monclient: build_initial_monmap 2026-02-17T21:12:25.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.152+0000 7fc159b14640 10 monclient: monmap: 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:25.152907+0000 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:25.152907+0000 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:25.145 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:25.146 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.152+0000 7fc159b14640 1 Processor -- start 2026-02-17T21:12:25.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.152+0000 7fc159b14640 1 -- start start 2026-02-17T21:12:25.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.152+0000 7fc159b14640 10 monclient: init 2026-02-17T21:12:25.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.152+0000 7fc159b14640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:25.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.152+0000 7fc159b14640 10 monclient: _add_conns ranks=[1,0,3,4,5,2] 2026-02-17T21:12:25.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fc15415d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:25.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc1540c92b0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc154153d20 0x7fc15415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 10 monclient(hunting): picked mon.noname-a con 0x7fc154153d20 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1540c5860 con 0x7fc1540c92b0 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1540c5580 con 0x7fc15415d1e0 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fc1540c7de0 con 0x7fc154153d20 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc159b14640 10 monclient(hunting): authenticate will time out at 1328.783050s 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc1537fe640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fc15415d1e0 0x7fc1540c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:46818/0 (socket says 10.20.193.45:46818) 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc153fff640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fc154153d20 0x7fc15415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc1537fe640 1 -- 10.20.193.45:0/854817338 learned_addr learned my addr 10.20.193.45:0/854817338 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:25.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc153fff640 10 monclient(hunting): get_auth_request con 0x7fc154153d20 auth_method 0 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc153fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc153fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.153+0000 7fc153fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.154+0000 7fc153fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.154+0000 7fc153fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.154+0000 7fc153fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.154+0000 7fc1527fc640 1 -- 10.20.193.45:0/854817338 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630737856 0 0) 0x7fc1540c5580 con 0x7fc15415d1e0 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.154+0000 7fc1527fc640 10 monclient(hunting): _negotiate 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.154+0000 7fc1527fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.154+0000 7fc1527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.154+0000 7fc1527fc640 10 monclient(hunting): my global_id is 5236 2026-02-17T21:12:25.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.154+0000 7fc1527fc640 1 -- 10.20.193.45:0/854817338 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc138003620 con 0x7fc15415d1e0 2026-02-17T21:12:25.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.155+0000 7fc153fff640 10 monclient(hunting): handle_auth_done global_id 5181 payload 274 2026-02-17T21:12:25.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.155+0000 7fc153fff640 1 -- 10.20.193.45:0/854817338 >> v1:10.20.193.86:6789/0 conn(0x7fc15415d1e0 legacy=0x7fc1540c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.155+0000 7fc153fff640 1 -- 10.20.193.45:0/854817338 >> v1:10.20.193.45:6789/0 conn(0x7fc1540c92b0 legacy=0x7fc154153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.155+0000 7fc153fff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.155+0000 7fc153fff640 1 monclient: found mon.noname-a 2026-02-17T21:12:25.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.155+0000 7fc153fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.155+0000 7fc153fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.155+0000 7fc153fff640 1 -- 10.20.193.45:0/854817338 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1540c80c0 con 0x7fc154153d20 2026-02-17T21:12:25.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.157+0000 7fc153fff640 1 --2- 10.20.193.45:0/854817338 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc154153d20 0x7fc15415d5c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc148009dc0 tx=0x7fc14802f280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150af84e323c496e server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 1 -- 10.20.193.45:0/854817338 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14803c070 con 0x7fc154153d20 2026-02-17T21:12:25.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 10 monclient: dump: 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.157 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 1 -- 10.20.193.45:0/854817338 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc148037440 con 0x7fc154153d20 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 5 monclient: authenticate success, global_id 5181 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 1 -- 10.20.193.45:0/854817338 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148037810 con 0x7fc154153d20 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc1527fc640 10 monclient: dump: 2026-02-17T21:12:25.158 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 4 set_mon_vals no callback set 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 10 monclient: shutdown 2026-02-17T21:12:25.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 1 -- 10.20.193.45:0/854817338 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc154153d20 msgr2=0x7fc15415d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 1 --2- 10.20.193.45:0/854817338 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc154153d20 0x7fc15415d5c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc148009dc0 tx=0x7fc14802f280 comp rx=0 tx=0).stop 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 1 -- 10.20.193.45:0/854817338 shutdown_connections 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 1 --2- 10.20.193.45:0/854817338 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc154153d20 0x7fc15415d5c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 1 -- 10.20.193.45:0/854817338 >> 10.20.193.45:0/854817338 conn(0x7fc1540c9d40 msgr2=0x7fc1540ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 1 -- 10.20.193.45:0/854817338 shutdown_connections 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.159+0000 7fc159b14640 1 -- 10.20.193.45:0/854817338 wait complete. 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient: build_initial_monmap 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient: monmap: 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:25.160 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 librados: starting msgr at 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 librados: starting objecter 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 Processor -- start 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 -- start start 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 librados: setting wanted keys 2026-02-17T21:12:25.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 librados: calling monclient init 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient: init 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc1540c92b0 0x7fc15413f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient(hunting): picked mon.noname-a con 0x7fc1540c92b0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc154153d20 0x7fc154072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient(hunting): picked mon.noname-c con 0x7fc154153d20 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc15415d1e0 0x7fc154072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient(hunting): picked mon.noname-b con 0x7fc15415d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540748e0 con 0x7fc1540c92b0 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fc1540c8680 con 0x7fc15415d1e0 2026-02-17T21:12:25.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc154074a60 con 0x7fc154153d20 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.160+0000 7fc159b14640 10 monclient(hunting): authenticate will time out at 1328.790934s 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc1540c92b0 0x7fc15413f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc153fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc15415d1e0 0x7fc154072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc152ffd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc154153d20 0x7fc154072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc1540c92b0 0x7fc15413f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36632/0 (socket says 10.20.193.45:36632) 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 1 -- 10.20.193.45:0/3309996861 learned_addr learned my addr 10.20.193.45:0/3309996861 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 10 monclient(hunting): get_auth_request con 0x7fc1540c92b0 auth_method 0 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.163 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc153fff640 10 monclient(hunting): get_auth_request con 0x7fc15415d1e0 auth_method 0 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc153fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc153fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc153fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc152ffd640 10 monclient(hunting): get_auth_request con 0x7fc154153d20 auth_method 0 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc152ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc152ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc152ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc1537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc153fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc153fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc153fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc152ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc152ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.161+0000 7fc152ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 10 monclient(hunting): handle_auth_done global_id 5187 payload 824 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 1 -- 10.20.193.45:0/3309996861 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc154153d20 msgr2=0x7fc154072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc154153d20 0x7fc154072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 1 -- 10.20.193.45:0/3309996861 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc15415d1e0 msgr2=0x7fc154072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc15415d1e0 0x7fc154072f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 1 monclient: found mon.noname-a 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.163+0000 7fc1537fe640 1 -- 10.20.193.45:0/3309996861 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1541f7b50 con 0x7fc1540c92b0 2026-02-17T21:12:25.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.164+0000 7fc1537fe640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc1540c92b0 0x7fc15413f630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c4d0 tx=0x7fc14000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.164+0000 7fc12ffff640 10 client.?.objecter ms_handle_connect 0x7fc1540c92b0 2026-02-17T21:12:25.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.164+0000 7fc12ffff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 1 -- 10.20.193.45:0/3309996861 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140017070 con 0x7fc1540c92b0 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 10 monclient: dump: 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.168 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 1 -- 10.20.193.45:0/3309996861 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc140005e00 con 0x7fc1540c92b0 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc159b14640 5 monclient: authenticate success, global_id 5187 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc159b14640 10 monclient: _renew_subs 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc159b14640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.169 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1541f6fd0 con 0x7fc1540c92b0 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 1 -- 10.20.193.45:0/3309996861 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1400072b0 con 0x7fc1540c92b0 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc151ffb640 4 set_mon_vals no callback set 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc12ffff640 10 monclient: dump: 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.170 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc159b14640 10 client.5187.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc159b14640 10 monclient: _renew_subs 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc159b14640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1541f7590 con 0x7fc1540c92b0 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.165+0000 7fc159b14640 1 librados: init done 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.166+0000 7fc159b14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.166+0000 7fc159b14640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.166+0000 7fc159b14640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.171 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.166+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc15415d5c0 con 0x7fc1540c92b0 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.176+0000 7fc12ffff640 1 -- 10.20.193.45:0/3309996861 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fc140007450 con 0x7fc1540c92b0 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.177+0000 7fc12ffff640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc124079280 0x7fc12407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.177+0000 7fc152ffd640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc124079280 0x7fc12407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.177+0000 7fc152ffd640 10 monclient: get_auth_request con 0x7fc124079280 auth_method 0 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.177+0000 7fc12ffff640 10 client.5187.objecter ms_handle_connect 0x7fc124079280 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.177+0000 7fc152ffd640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc124079280 0x7fc12407b740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc144002410 tx=0x7fc144007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.179+0000 7fc12ffff640 1 -- 10.20.193.45:0/3309996861 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fc140007770 con 0x7fc1540c92b0 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.179+0000 7fc12ffff640 10 client.5187.objecter ms_dispatch2 0x7fc154000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.179+0000 7fc12ffff640 3 client.5187.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.179+0000 7fc12ffff640 3 client.5187.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:25.173 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.179+0000 7fc12ffff640 20 client.5187.objecter dump_active .. 0 homeless 2026-02-17T21:12:25.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.282+0000 7fc12ffff640 1 -- 10.20.193.45:0/3309996861 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc140021020 con 0x7fc1540c92b0 2026-02-17T21:12:25.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.282+0000 7fc12ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:25.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.282+0000 7fc12ffff640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:25.357 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.365+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc1541573a0 con 0x7fc124079280 2026-02-17T21:12:25.358 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.365+0000 7fc12ffff640 1 -- 10.20.193.45:0/3309996861 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc1541573a0 con 0x7fc124079280 2026-02-17T21:12:25.358 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 2 to deep-scrub 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 10 librados: watch_flush enter 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 10 librados: watch_flush exit 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 20 client.5187.objecter shutdown clearing up homeless session... 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 10 client.5187.objecter successfully canceled tick 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc124079280 msgr2=0x7fc12407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc124079280 0x7fc12407b740 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc144002410 tx=0x7fc144007ef0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 10 monclient: shutdown 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc1540c92b0 msgr2=0x7fc15413f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.360 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc1540c92b0 0x7fc15413f630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc14000c4d0 tx=0x7fc14000c9a0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 shutdown_connections 2026-02-17T21:12:25.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fc124079280 0x7fc12407b740 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fc15415d1e0 0x7fc154072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc154153d20 0x7fc154072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 --2- 10.20.193.45:0/3309996861 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fc1540c92b0 0x7fc15413f630 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 >> 10.20.193.45:0/3309996861 conn(0x7fc1540c9d40 msgr2=0x7fc1541510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:25.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 shutdown_connections 2026-02-17T21:12:25.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 -- 10.20.193.45:0/3309996861 wait complete. 2026-02-17T21:12:25.361 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.366+0000 7fc159b14640 1 librados: shutdown 2026-02-17T21:12:25.367 INFO:tasks.ceph:Scrubbing osd.6 2026-02-17T21:12:25.367 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:25.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.445+0000 7f00abbd5640 10 monclient: get_monmap_and_config 2026-02-17T21:12:25.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.445+0000 7f00abbd5640 10 monclient: build_initial_monmap 2026-02-17T21:12:25.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.445+0000 7f00abbd5640 10 monclient: monmap: 2026-02-17T21:12:25.438 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:25.438 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.438 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:25.446438+0000 2026-02-17T21:12:25.438 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:25.446438+0000 2026-02-17T21:12:25.439 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:25.439 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.439 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:25.439 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:25.439 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:25.439 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:25.439 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:25.439 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:25.439 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 1 Processor -- start 2026-02-17T21:12:25.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 1 -- start start 2026-02-17T21:12:25.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient: init 2026-02-17T21:12:25.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:25.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient: _add_conns ranks=[0,3,4,5,1,2] 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f00a4155d00 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f00a40bf620 0x7f00a40bfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient(hunting): picked mon.noname-a con 0x7f00a40bf620 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f00a415bca0 0x7f00a415c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient(hunting): picked mon.noname-b con 0x7f00a415bca0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00a415c650 con 0x7f00a4155d00 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f00a415cbc0 con 0x7f00a40bf620 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f00a41560e0 con 0x7f00a415bca0 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00abbd5640 10 monclient(hunting): authenticate will time out at 1329.076642s 2026-02-17T21:12:25.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.446+0000 7f00a9149640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f00a40bf620 0x7f00a40bfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00aa14b640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f00a415bca0 0x7f00a415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00a9149640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f00a40bf620 0x7f00a40bfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36638/0 (socket says 10.20.193.45:36638) 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00a9149640 1 -- 10.20.193.45:0/2385861308 learned_addr learned my addr 10.20.193.45:0/2385861308 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00a9149640 10 monclient(hunting): get_auth_request con 0x7f00a40bf620 auth_method 0 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00a9149640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00a9149640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00a9149640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00aa14b640 10 monclient(hunting): get_auth_request con 0x7f00a415bca0 auth_method 0 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00aa14b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00aa14b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00aa14b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00aa14b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00aa14b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00aa14b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00a9149640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00a9149640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.447+0000 7f00a9149640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.448+0000 7f00a9149640 10 monclient(hunting): handle_auth_done global_id 5190 payload 274 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.448+0000 7f00a9149640 1 -- 10.20.193.45:0/2385861308 >> v2:10.20.193.86:3300/0 conn(0x7f00a415bca0 msgr2=0x7f00a415c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.448+0000 7f00a9149640 1 --2- 10.20.193.45:0/2385861308 >> v2:10.20.193.86:3300/0 conn(0x7f00a415bca0 0x7f00a415c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.448+0000 7f00a9149640 1 -- 10.20.193.45:0/2385861308 >> v1:10.20.193.45:6789/0 conn(0x7f00a4155d00 legacy=0x7f00a415fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.448+0000 7f00a9149640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.448+0000 7f00a9149640 1 monclient: found mon.noname-a 2026-02-17T21:12:25.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.448+0000 7f00a9149640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.448+0000 7f00a9149640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.448+0000 7f00a9149640 1 -- 10.20.193.45:0/2385861308 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a40c9590 con 0x7f00a40bf620 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.450+0000 7f00a9149640 1 --2- 10.20.193.45:0/2385861308 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 0x7f00a40bfa90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f00a40c8d60 tx=0x7f009802eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b539df0f0185fb server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 1 -- 10.20.193.45:0/2385861308 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009803c070 con 0x7f00a40bf620 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 10 monclient: dump: 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.451 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 1 -- 10.20.193.45:0/2385861308 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f009802fbe0 con 0x7f00a40bf620 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 1 -- 10.20.193.45:0/2385861308 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098037440 con 0x7f00a40bf620 2026-02-17T21:12:25.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 5 monclient: authenticate success, global_id 5190 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 4 set_mon_vals no callback set 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00a8948640 10 monclient: dump: 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.453 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 10 monclient: shutdown 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 1 -- 10.20.193.45:0/2385861308 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 msgr2=0x7f00a40bfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 1 --2- 10.20.193.45:0/2385861308 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 0x7f00a40bfa90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f00a40c8d60 tx=0x7f009802eed0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 1 -- 10.20.193.45:0/2385861308 shutdown_connections 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 1 --2- 10.20.193.45:0/2385861308 >> v2:10.20.193.86:3300/0 conn(0x7f00a415bca0 0x7f00a415c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 1 --2- 10.20.193.45:0/2385861308 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 0x7f00a40bfa90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 1 -- 10.20.193.45:0/2385861308 >> 10.20.193.45:0/2385861308 conn(0x7f00a40cd520 msgr2=0x7f00a40cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 1 -- 10.20.193.45:0/2385861308 shutdown_connections 2026-02-17T21:12:25.454 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.453+0000 7f00abbd5640 1 -- 10.20.193.45:0/2385861308 wait complete. 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient: build_initial_monmap 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient: monmap: 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:25.455 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 librados: starting msgr at 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 librados: starting objecter 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 Processor -- start 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 -- start start 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 librados: setting wanted keys 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 librados: calling monclient init 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient: init 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 0x7f00a414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient(hunting): picked mon.noname-a con 0x7f00a40bf620 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00a4155d00 0x7f00a4142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.456 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient(hunting): picked mon.noname-b con 0x7f00a4155d00 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00a415bca0 0x7f00a4145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient(hunting): picked mon.noname-c con 0x7f00a415bca0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f00a40beb40 con 0x7f00a40bf620 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f00a40be860 con 0x7f00a4155d00 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00a40bee20 con 0x7f00a415bca0 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00abbd5640 10 monclient(hunting): authenticate will time out at 1329.084739s 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.454+0000 7f00a994a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 0x7f00a414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a994a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 0x7f00a414ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36640/0 (socket says 10.20.193.45:36640) 2026-02-17T21:12:25.457 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a994a640 1 -- 10.20.193.45:0/1692110138 learned_addr learned my addr 10.20.193.45:0/1692110138 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a994a640 10 monclient(hunting): get_auth_request con 0x7f00a40bf620 auth_method 0 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a994a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a994a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a994a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a9149640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00a4155d00 0x7f00a4142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00aa14b640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00a415bca0 0x7f00a4145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a9149640 10 monclient(hunting): get_auth_request con 0x7f00a4155d00 auth_method 0 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a9149640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a9149640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a9149640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00aa14b640 10 monclient(hunting): get_auth_request con 0x7f00a415bca0 auth_method 0 2026-02-17T21:12:25.458 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00aa14b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00aa14b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00aa14b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a994a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a994a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a994a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00aa14b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00aa14b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00aa14b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a9149640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a9149640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.455+0000 7f00a9149640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 10 monclient(hunting): handle_auth_done global_id 5196 payload 824 2026-02-17T21:12:25.459 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 1 -- 10.20.193.45:0/1692110138 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00a415bca0 msgr2=0x7f00a4145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00a415bca0 0x7f00a4145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 1 -- 10.20.193.45:0/1692110138 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00a4155d00 msgr2=0x7f00a4142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f00a4155d00 0x7f00a4142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 1 monclient: found mon.noname-a 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.456+0000 7f00a994a640 1 -- 10.20.193.45:0/1692110138 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a41f40e0 con 0x7f00a40bf620 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.457+0000 7f00a994a640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 0x7f00a414ffa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f009400c480 tx=0x7f009400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.457+0000 7f00927fc640 10 client.?.objecter ms_handle_connect 0x7f00a40bf620 2026-02-17T21:12:25.460 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.457+0000 7f00927fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:25.462 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 1 -- 10.20.193.45:0/1692110138 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094017070 con 0x7f00a40bf620 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 10 monclient: dump: 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.463 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 1 -- 10.20.193.45:0/1692110138 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00940052f0 con 0x7f00a40bf620 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 1 -- 10.20.193.45:0/1692110138 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00940036f0 con 0x7f00a40bf620 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00927fc640 10 monclient: dump: 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.464 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f0093fff640 4 set_mon_vals no callback set 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 5 monclient: authenticate success, global_id 5196 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 10 monclient: _renew_subs 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.465 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a41f43c0 con 0x7f00a40bf620 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 10 client.5196.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 10 monclient: _renew_subs 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a41f4980 con 0x7f00a40bf620 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 1 librados: init done 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 10 client.5196.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 15 client.5196.objecter _session_command_op_assign -1 1 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 20 client.5196.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 10 client.5196.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:25.466 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.459+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00a40bf100 con 0x7f00a40bf620 2026-02-17T21:12:25.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.472+0000 7f00927fc640 1 -- 10.20.193.45:0/1692110138 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f0094003890 con 0x7f00a40bf620 2026-02-17T21:12:25.467 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.473+0000 7f00927fc640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f00740792d0 0x7f007407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.473+0000 7f00a9149640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f00740792d0 0x7f007407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.473+0000 7f00a9149640 10 monclient: get_auth_request con 0x7f00740792d0 auth_method 0 2026-02-17T21:12:25.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.473+0000 7f00a9149640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f00740792d0 0x7f007407b790 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f00a40707b0 tx=0x7f0098039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.468 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.473+0000 7f00927fc640 10 client.5196.objecter ms_handle_connect 0x7f00740792d0 2026-02-17T21:12:25.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 1 -- 10.20.193.45:0/1692110138 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f009405d6c0 con 0x7f00a40bf620 2026-02-17T21:12:25.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 10 client.5196.objecter ms_dispatch2 0x7f00a4000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:25.469 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 3 client.5196.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 3 client.5196.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 10 client.5196.objecter checking command 1 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f00740817b0 0x7f0074083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 20 client.5196.objecter _get_session s=0x7f00740810e0 osd=6 3 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 20 client.5196.objecter put_session s=0x7f00740810e0 osd=6 3 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 15 client.5196.objecter _session_command_op_remove -1 1 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 20 client.5196.objecter _get_session s=0x7f00740810e0 osd=6 3 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 20 client.5196.objecter get_session s=0x7f00740810e0 osd=6 3 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 15 client.5196.objecter _session_command_op_assign 6 1 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 20 client.5196.objecter put_session s=0x7f00740810e0 osd=6 4 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 10 client.5196.objecter _send_command 1 2026-02-17T21:12:25.470 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 1 -- 10.20.193.45:0/1692110138 --> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0094015e70 con 0x7f00740817b0 2026-02-17T21:12:25.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 20 client.5196.objecter dump_active .. 0 homeless 2026-02-17T21:12:25.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 1 -- 10.20.193.45:0/1692110138 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f009405da80 con 0x7f00a40bf620 2026-02-17T21:12:25.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00927fc640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:25.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00aa14b640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f00740817b0 0x7f0074083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.476+0000 7f00aa14b640 10 monclient: get_auth_request con 0x7f00740817b0 auth_method 0 2026-02-17T21:12:25.471 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.478+0000 7f00aa14b640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f00740817b0 0x7f0074083bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.472 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.478+0000 7f00927fc640 10 client.5196.objecter ms_handle_connect 0x7f00740817b0 2026-02-17T21:12:25.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.491+0000 7f00927fc640 1 -- 10.20.193.45:0/1692110138 <== osd.6 v2:10.20.193.92:6816/1142590747 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f0094015e70 con 0x7f00740817b0 2026-02-17T21:12:25.483 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.491+0000 7f00927fc640 10 client.5196.objecter ms_dispatch2 0x7f00a4000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:25.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.491+0000 7f00927fc640 10 client.5196.objecter _finish_command 1 = system:0 2026-02-17T21:12:25.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.491+0000 7f00927fc640 20 client.5196.objecter put_session s=0x7f00740810e0 osd=6 4 2026-02-17T21:12:25.484 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.491+0000 7f00927fc640 15 client.5196.objecter _session_command_op_remove 6 1 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 10 client.5196.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 15 client.5196.objecter _session_command_op_assign -1 2 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 20 client.5196.objecter _get_session s=0x7f00740810e0 osd=6 3 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 20 client.5196.objecter put_session s=0x7f00740810e0 osd=6 3 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 20 client.5196.objecter _get_session s=0x7f00740810e0 osd=6 3 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 15 client.5196.objecter _session_command_op_remove -1 2 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 20 client.5196.objecter get_session s=0x7f00740810e0 osd=6 3 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 15 client.5196.objecter _session_command_op_assign 6 2 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 20 client.5196.objecter put_session s=0x7f00740810e0 osd=6 4 2026-02-17T21:12:25.490 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 10 client.5196.objecter _send_command 2 2026-02-17T21:12:25.491 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.497+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 --> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f00a4159650 con 0x7f00740817b0 2026-02-17T21:12:25.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00927fc640 1 -- 10.20.193.45:0/1692110138 <== osd.6 v2:10.20.193.92:6816/1142590747 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f00a4159650 con 0x7f00740817b0 2026-02-17T21:12:25.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00927fc640 10 client.5196.objecter ms_dispatch2 0x7f00a4000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:25.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00927fc640 10 client.5196.objecter _finish_command 2 = system:0 2026-02-17T21:12:25.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00927fc640 20 client.5196.objecter put_session s=0x7f00740810e0 osd=6 4 2026-02-17T21:12:25.497 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00927fc640 15 client.5196.objecter _session_command_op_remove 6 2 2026-02-17T21:12:25.497 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:25.497 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:25.498 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:25.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 10 librados: watch_flush enter 2026-02-17T21:12:25.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 10 librados: watch_flush exit 2026-02-17T21:12:25.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 10 client.5196.objecter close_session for osd.6 2026-02-17T21:12:25.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f00740817b0 msgr2=0x7f0074083bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.92:6816/1142590747,v1:10.20.193.92:6817/1142590747] conn(0x7f00740817b0 0x7f0074083bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 20 client.5196.objecter put_session s=0x7f00740810e0 osd=6 1 2026-02-17T21:12:25.499 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 20 client.5196.objecter shutdown clearing up homeless session... 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 10 client.5196.objecter successfully canceled tick 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f00740792d0 msgr2=0x7f007407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f00740792d0 0x7f007407b790 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f00a40707b0 tx=0x7f0098039040 comp rx=0 tx=0).stop 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 10 monclient: shutdown 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 msgr2=0x7f00a414ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 --2- 10.20.193.45:0/1692110138 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f00a40bf620 0x7f00a414ffa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f009400c480 tx=0x7f009400c950 comp rx=0 tx=0).stop 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00aa14b640 1 -- 10.20.193.45:0/1692110138 reap_dead start 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 shutdown_connections 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 >> 10.20.193.45:0/1692110138 conn(0x7f00a40cd520 msgr2=0x7f00a40cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 shutdown_connections 2026-02-17T21:12:25.500 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 -- 10.20.193.45:0/1692110138 wait complete. 2026-02-17T21:12:25.501 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.504+0000 7f00abbd5640 1 librados: shutdown 2026-02-17T21:12:25.506 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-17T21:12:25.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.583+0000 7ffbc30fc640 10 monclient: get_monmap_and_config 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.583+0000 7ffbc30fc640 10 monclient: build_initial_monmap 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.583+0000 7ffbc30fc640 10 monclient: monmap: 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:25.584204+0000 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:25.584204+0000 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:25.576 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:25.577 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:25.577 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:25.577 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:25.577 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:25.577 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.583+0000 7ffbc30fc640 1 Processor -- start 2026-02-17T21:12:25.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.583+0000 7ffbc30fc640 1 -- start start 2026-02-17T21:12:25.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.583+0000 7ffbc30fc640 10 monclient: init 2026-02-17T21:12:25.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:25.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient: _add_conns ranks=[3,5,4,1,0,2] 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ffbbc15d1e0 0x7ffbbc15d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient(hunting): picked mon.noname-a con 0x7ffbbc15d1e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ffbbc0748e0 0x7ffbbc0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient(hunting): picked mon.noname-c con 0x7ffbbc0748e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ffbbc0c90e0 0x7ffbbc153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient(hunting): picked mon.noname-b con 0x7ffbbc0c90e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7ffbbc0c9570 con 0x7ffbbc15d1e0 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7ffbbc0c5860 con 0x7ffbbc0c90e0 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7ffbbc0c5580 con 0x7ffbbc0748e0 2026-02-17T21:12:25.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc30fc640 10 monclient(hunting): authenticate will time out at 1329.214337s 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc0e71640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ffbbc15d1e0 0x7ffbbc15d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbb3fff640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ffbbc0748e0 0x7ffbbc0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.584+0000 7ffbc1672640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ffbbc0c90e0 0x7ffbbc153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc0e71640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7ffbbc15d1e0 0x7ffbbc15d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36654/0 (socket says 10.20.193.45:36654) 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc1672640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7ffbbc0c90e0 0x7ffbbc153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38248/0 (socket says 10.20.193.45:38248) 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc0e71640 1 -- 10.20.193.45:0/4048877539 learned_addr learned my addr 10.20.193.45:0/4048877539 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc0e71640 10 monclient(hunting): get_auth_request con 0x7ffbbc15d1e0 auth_method 0 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc0e71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc0e71640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc0e71640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc1672640 10 monclient(hunting): get_auth_request con 0x7ffbbc0c90e0 auth_method 0 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc1672640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc1672640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc1672640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbb3fff640 10 monclient(hunting): get_auth_request con 0x7ffbbc0748e0 auth_method 0 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc1672640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc1672640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc1672640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc0e71640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc0e71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbc0e71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.585+0000 7ffbb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 10 monclient(hunting): handle_auth_done global_id 5248 payload 274 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 1 -- 10.20.193.45:0/4048877539 >> v2:10.20.193.92:3300/0 conn(0x7ffbbc0748e0 msgr2=0x7ffbbc0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 1 --2- 10.20.193.45:0/4048877539 >> v2:10.20.193.92:3300/0 conn(0x7ffbbc0748e0 0x7ffbbc0c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 1 -- 10.20.193.45:0/4048877539 >> v2:10.20.193.45:3300/0 conn(0x7ffbbc15d1e0 msgr2=0x7ffbbc15d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 1 --2- 10.20.193.45:0/4048877539 >> v2:10.20.193.45:3300/0 conn(0x7ffbbc15d1e0 0x7ffbbc15d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 1 monclient: found mon.noname-b 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.586+0000 7ffbc1672640 1 -- 10.20.193.45:0/4048877539 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbbc0c7de0 con 0x7ffbbc0c90e0 2026-02-17T21:12:25.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.587+0000 7ffbc1672640 1 --2- 10.20.193.45:0/4048877539 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0c90e0 0x7ffbbc153610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0c6af0 tx=0x7ffbb802f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbfd55b4fa1a39ef server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.591 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 1 -- 10.20.193.45:0/4048877539 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb803c070 con 0x7ffbbc0c90e0 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 10 monclient: dump: 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.592 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 1 -- 10.20.193.45:0/4048877539 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb802fe40 con 0x7ffbbc0c90e0 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 1 -- 10.20.193.45:0/4048877539 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8037660 con 0x7ffbbc0c90e0 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbb37fe640 10 monclient: dump: 2026-02-17T21:12:25.593 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 5 monclient: authenticate success, global_id 5248 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:25.594 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 4 set_mon_vals no callback set 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 10 monclient: shutdown 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 1 -- 10.20.193.45:0/4048877539 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0c90e0 msgr2=0x7ffbbc153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/4048877539 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0c90e0 0x7ffbbc153610 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0c6af0 tx=0x7ffbb802f1c0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 1 -- 10.20.193.45:0/4048877539 shutdown_connections 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/4048877539 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0c90e0 0x7ffbbc153610 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/4048877539 >> v2:10.20.193.92:3300/0 conn(0x7ffbbc0748e0 0x7ffbbc0c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/4048877539 >> v2:10.20.193.45:3300/0 conn(0x7ffbbc15d1e0 0x7ffbbc15d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 1 -- 10.20.193.45:0/4048877539 >> 10.20.193.45:0/4048877539 conn(0x7ffbbc0c9d40 msgr2=0x7ffbbc0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 1 -- 10.20.193.45:0/4048877539 shutdown_connections 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.589+0000 7ffbc30fc640 1 -- 10.20.193.45:0/4048877539 wait complete. 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient: build_initial_monmap 2026-02-17T21:12:25.595 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient: monmap: 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 librados: starting msgr at 2026-02-17T21:12:25.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 librados: starting objecter 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 Processor -- start 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 -- start start 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 librados: setting wanted keys 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 librados: calling monclient init 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient: init 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0748e0 0x7ffbbc145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient(hunting): picked mon.noname-b con 0x7ffbbc0748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbbc0c90e0 0x7ffbbc1f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient(hunting): picked mon.noname-a con 0x7ffbbc0c90e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbbc15d1e0 0x7ffbbc1f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.597 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient(hunting): picked mon.noname-c con 0x7ffbbc15d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc0c8680 con 0x7ffbbc0c90e0 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc0c83a0 con 0x7ffbbc0748e0 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffbbc074d30 con 0x7ffbbc15d1e0 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.590+0000 7ffbc30fc640 10 monclient(hunting): authenticate will time out at 1329.220849s 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbb3fff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbbc0c90e0 0x7ffbbc1f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0748e0 0x7ffbbc145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc1672640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbbc15d1e0 0x7ffbbc1f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.598 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0748e0 0x7ffbbc145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38252/0 (socket says 10.20.193.45:38252) 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 1 -- 10.20.193.45:0/3823754055 learned_addr learned my addr 10.20.193.45:0/3823754055 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 10 monclient(hunting): get_auth_request con 0x7ffbbc0748e0 auth_method 0 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbb3fff640 10 monclient(hunting): get_auth_request con 0x7ffbbc0c90e0 auth_method 0 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbb3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbb3fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbb3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc1672640 10 monclient(hunting): get_auth_request con 0x7ffbbc15d1e0 auth_method 0 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc1672640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.599 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc1672640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc1672640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbb3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbb3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbb3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc0e71640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc1672640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc1672640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.591+0000 7ffbc1672640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 10 monclient(hunting): handle_auth_done global_id 5251 payload 824 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 1 -- 10.20.193.45:0/3823754055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbbc15d1e0 msgr2=0x7ffbbc1f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.600 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbbc15d1e0 0x7ffbbc1f79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 1 -- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbbc0c90e0 msgr2=0x7ffbbc1f7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbbc0c90e0 0x7ffbbc1f7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 1 monclient: found mon.noname-b 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbc0e71640 1 -- 10.20.193.45:0/3823754055 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbbc1f3d00 con 0x7ffbbc0748e0 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.592+0000 7ffbb3fff640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbbc0c90e0 0x7ffbbc1f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.593+0000 7ffbc0e71640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0748e0 0x7ffbbc145690 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00e8c0 tx=0x7ffbac00ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.593+0000 7ffbb17fa640 10 client.?.objecter ms_handle_connect 0x7ffbbc0748e0 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.593+0000 7ffbb17fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 1 -- 10.20.193.45:0/3823754055 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac017070 con 0x7ffbbc0748e0 2026-02-17T21:12:25.601 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 10 monclient: dump: 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.602 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 1 -- 10.20.193.45:0/3823754055 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbac00ca00 con 0x7ffbbc0748e0 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 1 -- 10.20.193.45:0/3823754055 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac00cdd0 con 0x7ffbbc0748e0 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb17fa640 10 monclient: dump: 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.603 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbb2ffd640 4 set_mon_vals no callback set 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbc30fc640 5 monclient: authenticate success, global_id 5251 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbc30fc640 10 monclient: _renew_subs 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbc30fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbbc1f3fe0 con 0x7ffbbc0748e0 2026-02-17T21:12:25.604 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbc30fc640 10 client.5251.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:25.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbc30fc640 10 monclient: _renew_subs 2026-02-17T21:12:25.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbc30fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbbc1f45a0 con 0x7ffbbc0748e0 2026-02-17T21:12:25.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.595+0000 7ffbc30fc640 1 librados: init done 2026-02-17T21:12:25.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.596+0000 7ffbc30fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:25.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.596+0000 7ffbc30fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:25.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.596+0000 7ffbc30fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.605 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.596+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbbc0698c0 con 0x7ffbbc0748e0 2026-02-17T21:12:25.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.607+0000 7ffbb17fa640 1 -- 10.20.193.45:0/3823754055 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ffbac013470 con 0x7ffbbc0748e0 2026-02-17T21:12:25.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.608+0000 7ffbb17fa640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffb8c079280 0x7ffb8c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.608+0000 7ffbb3fff640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffb8c079280 0x7ffb8c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.608+0000 7ffbb3fff640 10 monclient: get_auth_request con 0x7ffb8c079280 auth_method 0 2026-02-17T21:12:25.606 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.608+0000 7ffbb3fff640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffb8c079280 0x7ffb8c07b740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffba4011310 tx=0x7ffba4009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.607 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.608+0000 7ffbb17fa640 10 client.5251.objecter ms_handle_connect 0x7ffb8c079280 2026-02-17T21:12:25.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.704+0000 7ffbb17fa640 1 -- 10.20.193.45:0/3823754055 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ffbac05e790 con 0x7ffbbc0748e0 2026-02-17T21:12:25.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.704+0000 7ffbb17fa640 10 client.5251.objecter ms_dispatch2 0x7ffbbc000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:25.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.704+0000 7ffbb17fa640 3 client.5251.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:25.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.704+0000 7ffbb17fa640 3 client.5251.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:25.697 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.704+0000 7ffbb17fa640 20 client.5251.objecter dump_active .. 0 homeless 2026-02-17T21:12:25.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.710+0000 7ffbb17fa640 1 -- 10.20.193.45:0/3823754055 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ffbbc0698c0 con 0x7ffbbc0748e0 2026-02-17T21:12:25.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.710+0000 7ffbb17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:25.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.710+0000 7ffbb17fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:25.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.793+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7ffbbc15e0c0 con 0x7ffb8c079280 2026-02-17T21:12:25.786 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.793+0000 7ffbb17fa640 1 -- 10.20.193.45:0/3823754055 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffbbc15e0c0 con 0x7ffb8c079280 2026-02-17T21:12:25.786 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 6 to deep-scrub 2026-02-17T21:12:25.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 10 librados: watch_flush enter 2026-02-17T21:12:25.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 10 librados: watch_flush exit 2026-02-17T21:12:25.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 20 client.5251.objecter shutdown clearing up homeless session... 2026-02-17T21:12:25.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 10 client.5251.objecter successfully canceled tick 2026-02-17T21:12:25.788 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffb8c079280 msgr2=0x7ffb8c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffb8c079280 0x7ffb8c07b740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffba4011310 tx=0x7ffba4009290 comp rx=0 tx=0).stop 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 10 monclient: shutdown 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0748e0 msgr2=0x7ffbbc145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0748e0 0x7ffbbc145690 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00e8c0 tx=0x7ffbac00ed90 comp rx=0 tx=0).stop 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 shutdown_connections 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ffb8c079280 0x7ffb8c07b740 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbbc15d1e0 0x7ffbbc1f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ffbbc0c90e0 0x7ffbbc1f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 --2- 10.20.193.45:0/3823754055 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ffbbc0748e0 0x7ffbbc145690 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 >> 10.20.193.45:0/3823754055 conn(0x7ffbbc0c9d40 msgr2=0x7ffbbc152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:25.789 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 shutdown_connections 2026-02-17T21:12:25.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 -- 10.20.193.45:0/3823754055 wait complete. 2026-02-17T21:12:25.790 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.794+0000 7ffbc30fc640 1 librados: shutdown 2026-02-17T21:12:25.795 INFO:tasks.ceph:Scrubbing osd.10 2026-02-17T21:12:25.795 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:25.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.872+0000 7ff70f4ea640 10 monclient: get_monmap_and_config 2026-02-17T21:12:25.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.872+0000 7ff70f4ea640 10 monclient: build_initial_monmap 2026-02-17T21:12:25.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.872+0000 7ff70f4ea640 10 monclient: monmap: 2026-02-17T21:12:25.865 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:25.865 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.865 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:25.873442+0000 2026-02-17T21:12:25.865 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:25.873442+0000 2026-02-17T21:12:25.865 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:25.866 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.866 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:25.866 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:25.866 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:25.866 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:25.866 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:25.866 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:25.866 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 1 Processor -- start 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 1 -- start start 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 10 monclient: init 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 10 monclient: _add_conns ranks=[2,1,0,3,5,4] 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff7081503c0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff70815d020 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff70815d490 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7080c55a0 con 0x7ff70815d490 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7080c52c0 con 0x7ff70815d020 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff708159c40 con 0x7ff7081503c0 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70f4ea640 10 monclient(hunting): authenticate will time out at 1329.503613s 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70d25f640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7ff7081503c0 0x7ff70806fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45544/0 (socket says 10.20.193.45:45544) 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.873+0000 7ff70d25f640 1 -- 10.20.193.45:0/1904046364 learned_addr learned my addr 10.20.193.45:0/1904046364 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099034847 0 0) 0x7ff708159c40 con 0x7ff7081503c0 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): _negotiate 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): my global_id is 5285 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6f0003620 con 0x7ff7081503c0 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049369354 0 0) 0x7ff7080c52c0 con 0x7ff70815d020 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): _negotiate 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): my global_id is 5254 2026-02-17T21:12:25.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff708159c40 con 0x7ff70815d020 2026-02-17T21:12:25.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345188953 0 0) 0x7ff704002ca0 con 0x7ff70815d490 2026-02-17T21:12:25.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): _negotiate 2026-02-17T21:12:25.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 10 monclient(hunting): my global_id is 5205 2026-02-17T21:12:25.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.875+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7080c52c0 con 0x7ff70815d490 2026-02-17T21:12:25.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 <== mon.2 v1:10.20.193.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1660668323 0 0) 0x7ff6f0003620 con 0x7ff7081503c0 2026-02-17T21:12:25.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 >> v1:10.20.193.86:6789/0 conn(0x7ff70815d020 legacy=0x7ff7080c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 >> v1:10.20.193.45:6789/0 conn(0x7ff70815d490 legacy=0x7ff7080c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.882 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 1 monclient: found mon.noname-c-legacy 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:10.20.193.92:6789/0 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 --> v1:10.20.193.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff708159f20 con 0x7ff7081503c0 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.876+0000 7ff6f7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff70f4ea640 5 monclient: authenticate success, global_id 5285 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 <== mon.2 v1:10.20.193.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7ff6f8002f00 con 0x7ff7081503c0 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2026-02-17T21:12:25.883 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient: dump: 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 1 monclient: mon.c has (v2) addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] but i'm connected to v1:10.20.193.92:6789/0, reconnecting 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:25.884 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 >> v1:10.20.193.92:6789/0 conn(0x7ff7081503c0 legacy=0x7ff70806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff6f0003fb0 0x7ff6f0004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient(hunting): picked mon.a con 0x7ff6f0003fb0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6f00044c0 0x7ff6f0004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient(hunting): picked mon.c con 0x7ff6f00044c0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6f0009ab0 0x7ff6f000bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient(hunting): picked mon.b con 0x7ff6f0009ab0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f000c490 con 0x7ff6f0003fb0 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f000c610 con 0x7ff6f0009ab0 2026-02-17T21:12:25.885 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f000c810 con 0x7ff6f00044c0 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff6f7fff640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff70f4ea640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff70d25f640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff6f0003fb0 0x7ff6f0004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.877+0000 7ff70da60640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6f0009ab0 0x7ff6f000bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70da60640 10 monclient(hunting): get_auth_request con 0x7ff6f0009ab0 auth_method 0 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70da60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70da60640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70da60640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70d25f640 10 monclient(hunting): get_auth_request con 0x7ff6f0003fb0 auth_method 0 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70d25f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.886 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70d25f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70d25f640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70ca5e640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6f00044c0 0x7ff6f0004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70da60640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70da60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70da60640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70ca5e640 10 monclient(hunting): get_auth_request con 0x7ff6f00044c0 auth_method 0 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70ca5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70ca5e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70ca5e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70ca5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70ca5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70ca5e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:12:25.887 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70d25f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70d25f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.878+0000 7ff70d25f640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 10 monclient(hunting): handle_auth_done global_id 5285 payload 293 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 1 -- 10.20.193.45:0/1904046364 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6f00044c0 msgr2=0x7ff6f0004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6f00044c0 0x7ff6f0004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 1 -- 10.20.193.45:0/1904046364 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff6f0003fb0 msgr2=0x7ff6f0004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff6f0003fb0 0x7ff6f0004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 1 monclient: found mon.b 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.888 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 1 -- 10.20.193.45:0/1904046364 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f0003620 con 0x7ff6f0009ab0 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.879+0000 7ff70da60640 1 -- 10.20.193.45:0/1904046364 reap_dead start 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.880+0000 7ff70da60640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6f0009ab0 0x7ff6f000bea0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c4c0 tx=0x7ff70402f7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1207d0cd3648fa3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.881+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70400c0e0 con 0x7ff6f0009ab0 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.881+0000 7ff6f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.881+0000 7ff6f7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.881+0000 7ff6f7fff640 10 monclient: dump: 2026-02-17T21:12:25.889 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.881+0000 7ff70f4ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff704003c70 con 0x7ff6f0009ab0 2026-02-17T21:12:25.890 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff6f7fff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff6f7fff640 1 -- 10.20.193.45:0/1904046364 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff704005310 con 0x7ff6f0009ab0 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff6f7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff6f7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff6f7fff640 10 monclient: dump: 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.891 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 4 set_mon_vals no callback set 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 10 monclient: shutdown 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 1 -- 10.20.193.45:0/1904046364 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6f0009ab0 msgr2=0x7ff6f000bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6f0009ab0 0x7ff6f000bea0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff70400c4c0 tx=0x7ff70402f7e0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 1 -- 10.20.193.45:0/1904046364 shutdown_connections 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 1 --2- 10.20.193.45:0/1904046364 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff6f0009ab0 0x7ff6f000bea0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 1 -- 10.20.193.45:0/1904046364 >> 10.20.193.45:0/1904046364 conn(0x7ff7080cd520 msgr2=0x7ff7080cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 1 -- 10.20.193.45:0/1904046364 shutdown_connections 2026-02-17T21:12:25.892 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.882+0000 7ff70f4ea640 1 -- 10.20.193.45:0/1904046364 wait complete. 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient: build_initial_monmap 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient: monmap: 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:25.893 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 librados: starting msgr at 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 librados: starting objecter 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 Processor -- start 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 -- start start 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 librados: setting wanted keys 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 librados: calling monclient init 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient: init 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6f0009ab0 0x7ff70814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient(hunting): picked mon.noname-c con 0x7ff6f0009ab0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff708159430 0x7ff7080bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.894 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient(hunting): picked mon.noname-b con 0x7ff708159430 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff7080c00f0 0x7ff708072420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient(hunting): picked mon.noname-a con 0x7ff7080c00f0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff70815d870 con 0x7ff7080c00f0 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff70815a4e0 con 0x7ff708159430 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7081507a0 con 0x7ff6f0009ab0 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.883+0000 7ff70f4ea640 10 monclient(hunting): authenticate will time out at 1329.513834s 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff708159430 0x7ff7080bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70d25f640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6f0009ab0 0x7ff70814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.895 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70da60640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff7080c00f0 0x7ff708072420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff708159430 0x7ff7080bfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38266/0 (socket says 10.20.193.45:38266) 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 1 -- 10.20.193.45:0/561474666 learned_addr learned my addr 10.20.193.45:0/561474666 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 10 monclient(hunting): get_auth_request con 0x7ff708159430 auth_method 0 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70d25f640 10 monclient(hunting): get_auth_request con 0x7ff6f0009ab0 auth_method 0 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70d25f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70d25f640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70d25f640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70da60640 10 monclient(hunting): get_auth_request con 0x7ff7080c00f0 auth_method 0 2026-02-17T21:12:25.896 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70da60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70da60640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70da60640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70ca5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70d25f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70d25f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70d25f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70da60640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70da60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.884+0000 7ff70da60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 10 monclient(hunting): handle_auth_done global_id 5257 payload 824 2026-02-17T21:12:25.897 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 1 -- 10.20.193.45:0/561474666 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6f0009ab0 msgr2=0x7ff70814f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff6f0009ab0 0x7ff70814f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 1 -- 10.20.193.45:0/561474666 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff7080c00f0 msgr2=0x7ff708072420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff7080c00f0 0x7ff708072420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 10 monclient: _finish_hunting 0 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 1 monclient: found mon.noname-b 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.885+0000 7ff70ca5e640 1 -- 10.20.193.45:0/561474666 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70814f660 con 0x7ff708159430 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.886+0000 7ff70ca5e640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff708159430 0x7ff7080bfbb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00eaa0 tx=0x7ff6fc00ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.886+0000 7ff6f5ffb640 10 client.?.objecter ms_handle_connect 0x7ff708159430 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.886+0000 7ff6f5ffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff6f5ffb640 1 -- 10.20.193.45:0/561474666 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00ca60 con 0x7ff708159430 2026-02-17T21:12:25.898 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff6f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff6f5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff6f5ffb640 10 monclient: dump: 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.899 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff6f5ffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff6f5ffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff6f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff70f4ea640 5 monclient: authenticate success, global_id 5257 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff70f4ea640 10 monclient: _renew_subs 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff70f4ea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff708157c90 con 0x7ff708159430 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff70f4ea640 10 client.5257.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff70f4ea640 10 monclient: _renew_subs 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff70f4ea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7081f42f0 con 0x7ff708159430 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.887+0000 7ff70f4ea640 1 librados: init done 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff70f4ea640 10 client.5257.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:25.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff70f4ea640 15 client.5257.objecter _session_command_op_assign -1 1 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff70f4ea640 20 client.5257.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff70f4ea640 10 client.5257.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff70f4ea640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff70806ef30 con 0x7ff708159430 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff6f5ffb640 1 -- 10.20.193.45:0/561474666 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70806ef30 con 0x7ff708159430 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff6f5ffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff6f5ffb640 1 -- 10.20.193.45:0/561474666 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00ce00 con 0x7ff708159430 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff6f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff6f5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff6f5ffb640 10 monclient: dump: 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:25.901 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:25.902 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:25.902 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:25.902 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:25.902 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:25.902 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:25.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.888+0000 7ff6f77fe640 4 set_mon_vals no callback set 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.901+0000 7ff6f5ffb640 1 -- 10.20.193.45:0/561474666 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff6fc003ce0 con 0x7ff708159430 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.901+0000 7ff6f5ffb640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6d8079280 0x7ff6d807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.902+0000 7ff70d25f640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6d8079280 0x7ff6d807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.902+0000 7ff70d25f640 10 monclient: get_auth_request con 0x7ff6d8079280 auth_method 0 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.902+0000 7ff70d25f640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6d8079280 0x7ff6d807b740 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff70806e440 tx=0x7ff6f80035c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.902+0000 7ff6f5ffb640 10 client.5257.objecter ms_handle_connect 0x7ff6d8079280 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 1 -- 10.20.193.45:0/561474666 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ff6fc098750 con 0x7ff708159430 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 10 client.5257.objecter ms_dispatch2 0x7ff708000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 3 client.5257.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 3 client.5257.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 10 client.5257.objecter checking command 1 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7ff6d8081760 0x7ff6d8083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:25.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 20 client.5257.objecter _get_session s=0x7ff6d8081090 osd=10 3 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 20 client.5257.objecter put_session s=0x7ff6d8081090 osd=10 3 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 15 client.5257.objecter _session_command_op_remove -1 1 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 20 client.5257.objecter _get_session s=0x7ff6d8081090 osd=10 3 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 20 client.5257.objecter get_session s=0x7ff6d8081090 osd=10 3 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 15 client.5257.objecter _session_command_op_assign 10 1 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 20 client.5257.objecter put_session s=0x7ff6d8081090 osd=10 4 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 10 client.5257.objecter _send_command 1 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 1 -- 10.20.193.45:0/561474666 --> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6d8084250 con 0x7ff6d8081760 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 20 client.5257.objecter dump_active .. 0 homeless 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 1 -- 10.20.193.45:0/561474666 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff6fc05ef50 con 0x7ff708159430 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff6f5ffb640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.904+0000 7ff70da60640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7ff6d8081760 0x7ff6d8083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.905+0000 7ff70da60640 10 monclient: get_auth_request con 0x7ff6d8081760 auth_method 0 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.906+0000 7ff6f5ffb640 10 client.5257.objecter ms_handle_connect 0x7ff6d8081760 2026-02-17T21:12:25.905 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.906+0000 7ff70da60640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7ff6d8081760 0x7ff6d8083b80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:25.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.916+0000 7ff6f5ffb640 1 -- 10.20.193.45:0/561474666 <== osd.10 v2:10.20.193.92:6824/1170783250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7ff6d8084250 con 0x7ff6d8081760 2026-02-17T21:12:25.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.916+0000 7ff6f5ffb640 10 client.5257.objecter ms_dispatch2 0x7ff708000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:25.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.916+0000 7ff6f5ffb640 10 client.5257.objecter _finish_command 1 = system:0 2026-02-17T21:12:25.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.916+0000 7ff6f5ffb640 20 client.5257.objecter put_session s=0x7ff6d8081090 osd=10 4 2026-02-17T21:12:25.909 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.916+0000 7ff6f5ffb640 15 client.5257.objecter _session_command_op_remove 10 1 2026-02-17T21:12:25.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 10 client.5257.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:25.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 15 client.5257.objecter _session_command_op_assign -1 2 2026-02-17T21:12:25.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 20 client.5257.objecter _get_session s=0x7ff6d8081090 osd=10 3 2026-02-17T21:12:25.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 20 client.5257.objecter put_session s=0x7ff6d8081090 osd=10 3 2026-02-17T21:12:25.915 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 20 client.5257.objecter _get_session s=0x7ff6d8081090 osd=10 3 2026-02-17T21:12:25.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 15 client.5257.objecter _session_command_op_remove -1 2 2026-02-17T21:12:25.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 20 client.5257.objecter get_session s=0x7ff6d8081090 osd=10 3 2026-02-17T21:12:25.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 15 client.5257.objecter _session_command_op_assign 10 2 2026-02-17T21:12:25.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 20 client.5257.objecter put_session s=0x7ff6d8081090 osd=10 4 2026-02-17T21:12:25.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 10 client.5257.objecter _send_command 2 2026-02-17T21:12:25.916 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.923+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 --> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff7080c5010 con 0x7ff6d8081760 2026-02-17T21:12:25.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff6f5ffb640 1 -- 10.20.193.45:0/561474666 <== osd.10 v2:10.20.193.92:6824/1170783250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff7080c5010 con 0x7ff6d8081760 2026-02-17T21:12:25.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff6f5ffb640 10 client.5257.objecter ms_dispatch2 0x7ff708000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:25.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff6f5ffb640 10 client.5257.objecter _finish_command 2 = system:0 2026-02-17T21:12:25.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff6f5ffb640 20 client.5257.objecter put_session s=0x7ff6d8081090 osd=10 4 2026-02-17T21:12:25.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff6f5ffb640 15 client.5257.objecter _session_command_op_remove 10 2 2026-02-17T21:12:25.923 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:25.923 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:25.923 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:25.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 10 librados: watch_flush enter 2026-02-17T21:12:25.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 10 librados: watch_flush exit 2026-02-17T21:12:25.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 10 client.5257.objecter close_session for osd.10 2026-02-17T21:12:25.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7ff6d8081760 msgr2=0x7ff6d8083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.92:6824/1170783250,v1:10.20.193.92:6825/1170783250] conn(0x7ff6d8081760 0x7ff6d8083b80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 20 client.5257.objecter put_session s=0x7ff6d8081090 osd=10 1 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 20 client.5257.objecter shutdown clearing up homeless session... 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 10 client.5257.objecter successfully canceled tick 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6d8079280 msgr2=0x7ff6d807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7ff6d8079280 0x7ff6d807b740 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff70806e440 tx=0x7ff6f80035c0 comp rx=0 tx=0).stop 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 10 monclient: shutdown 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff708159430 msgr2=0x7ff7080bfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 --2- 10.20.193.45:0/561474666 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff708159430 0x7ff7080bfbb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00eaa0 tx=0x7ff6fc00ef70 comp rx=0 tx=0).stop 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70da60640 1 -- 10.20.193.45:0/561474666 reap_dead start 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 shutdown_connections 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 >> 10.20.193.45:0/561474666 conn(0x7ff7080cd520 msgr2=0x7ff70806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:25.925 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 shutdown_connections 2026-02-17T21:12:25.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 -- 10.20.193.45:0/561474666 wait complete. 2026-02-17T21:12:25.926 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:25.930+0000 7ff70f4ea640 1 librados: shutdown 2026-02-17T21:12:25.931 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-17T21:12:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.008+0000 7fd69c1e7640 10 monclient: get_monmap_and_config 2026-02-17T21:12:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.008+0000 7fd69c1e7640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.008+0000 7fd69c1e7640 10 monclient: monmap: 2026-02-17T21:12:26.001 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.001 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.001 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:26.009658+0000 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:26.009658+0000 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:26.002 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 1 Processor -- start 2026-02-17T21:12:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 1 -- start start 2026-02-17T21:12:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient: init 2026-02-17T21:12:26.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient: _add_conns ranks=[5,3,0,4,2,1] 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fd6941561c0 0x7fd6940cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient(hunting): picked mon.noname-c con 0x7fd6941561c0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fd69406c890 0x7fd6940704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient(hunting): picked mon.noname-a con 0x7fd69406c890 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd69406e110 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd69415ce80 con 0x7fd69406e110 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fd69406f490 con 0x7fd69406c890 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fd694070010 con 0x7fd6941561c0 2026-02-17T21:12:26.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.009+0000 7fd69c1e7640 10 monclient(hunting): authenticate will time out at 1329.639868s 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fd6941561c0 0x7fd6940cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fd6941561c0 0x7fd6940cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35160/0 (socket says 10.20.193.45:35160) 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 1 -- 10.20.193.45:0/775474320 learned_addr learned my addr 10.20.193.45:0/775474320 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 10 monclient(hunting): get_auth_request con 0x7fd6941561c0 auth_method 0 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd69975b640 1 --2- 10.20.193.45:0/775474320 >> v2:10.20.193.45:3300/0 conn(0x7fd69406c890 0x7fd6940704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd699f5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd69975b640 10 monclient(hunting): get_auth_request con 0x7fd69406c890 auth_method 0 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd69975b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd69975b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.010+0000 7fd69975b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd69975b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd69975b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd69975b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd699f5c640 10 monclient(hunting): handle_auth_done global_id 5291 payload 274 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd699f5c640 1 -- 10.20.193.45:0/775474320 >> v2:10.20.193.45:3300/0 conn(0x7fd69406c890 msgr2=0x7fd6940704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd699f5c640 1 --2- 10.20.193.45:0/775474320 >> v2:10.20.193.45:3300/0 conn(0x7fd69406c890 0x7fd6940704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd699f5c640 1 -- 10.20.193.45:0/775474320 >> v1:10.20.193.45:6789/0 conn(0x7fd69406e110 legacy=0x7fd69415f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd699f5c640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd699f5c640 1 monclient: found mon.noname-c 2026-02-17T21:12:26.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd699f5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd699f5c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:26.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.011+0000 7fd699f5c640 1 -- 10.20.193.45:0/775474320 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69406f6e0 con 0x7fd6941561c0 2026-02-17T21:12:26.009 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.012+0000 7fd699f5c640 1 --2- 10.20.193.45:0/775474320 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 0x7fd6940cca30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd684009970 tx=0x7fd68402f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=792f93f6607d447 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 1 -- 10.20.193.45:0/775474320 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68403c070 con 0x7fd6941561c0 2026-02-17T21:12:26.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 10 monclient: dump: 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.016 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 1 -- 10.20.193.45:0/775474320 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68402fc30 con 0x7fd6941561c0 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 5 monclient: authenticate success, global_id 5291 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 1 -- 10.20.193.45:0/775474320 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684037440 con 0x7fd6941561c0 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd698f5a640 10 monclient: dump: 2026-02-17T21:12:26.017 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 4 set_mon_vals no callback set 2026-02-17T21:12:26.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 10 monclient: shutdown 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 1 -- 10.20.193.45:0/775474320 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 msgr2=0x7fd6940cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 1 --2- 10.20.193.45:0/775474320 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 0x7fd6940cca30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd684009970 tx=0x7fd68402f000 comp rx=0 tx=0).stop 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 1 -- 10.20.193.45:0/775474320 shutdown_connections 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 1 --2- 10.20.193.45:0/775474320 >> v2:10.20.193.45:3300/0 conn(0x7fd69406c890 0x7fd6940704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 1 --2- 10.20.193.45:0/775474320 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 0x7fd6940cca30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 1 -- 10.20.193.45:0/775474320 >> 10.20.193.45:0/775474320 conn(0x7fd6940cbf10 msgr2=0x7fd6940cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 1 -- 10.20.193.45:0/775474320 shutdown_connections 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.014+0000 7fd69c1e7640 1 -- 10.20.193.45:0/775474320 wait complete. 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient: monmap: 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.019 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 librados: starting msgr at 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 librados: starting objecter 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 Processor -- start 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 -- start start 2026-02-17T21:12:26.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 librados: setting wanted keys 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 librados: calling monclient init 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient: init 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd69406c890 0x7fd69415b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient(hunting): picked mon.noname-b con 0x7fd69406c890 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd69406e110 0x7fd6941e93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient(hunting): picked mon.noname-a con 0x7fd69406e110 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 0x7fd6941e9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient(hunting): picked mon.noname-c con 0x7fd6941561c0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd69406e860 con 0x7fd69406e110 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fd69406fca0 con 0x7fd69406c890 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6940709e0 con 0x7fd6941561c0 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.015+0000 7fd69c1e7640 10 monclient(hunting): authenticate will time out at 1329.645997s 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69975b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd69406e110 0x7fd6941e93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 0x7fd6941e9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd699f5c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd69406c890 0x7fd69415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 0x7fd6941e9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35172/0 (socket says 10.20.193.45:35172) 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 1 -- 10.20.193.45:0/4093884785 learned_addr learned my addr 10.20.193.45:0/4093884785 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:26.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 10 monclient(hunting): get_auth_request con 0x7fd6941561c0 auth_method 0 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69975b640 10 monclient(hunting): get_auth_request con 0x7fd69406e110 auth_method 0 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69975b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69975b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69975b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd699f5c640 10 monclient(hunting): get_auth_request con 0x7fd69406c890 auth_method 0 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd699f5c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd699f5c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd699f5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69a75d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69975b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69975b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd69975b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd699f5c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd699f5c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.016+0000 7fd699f5c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 10 monclient(hunting): handle_auth_done global_id 5294 payload 824 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 1 -- 10.20.193.45:0/4093884785 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd69406c890 msgr2=0x7fd69415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd69406c890 0x7fd69415b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 1 -- 10.20.193.45:0/4093884785 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd69406e110 msgr2=0x7fd6941e93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd69406e110 0x7fd6941e93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 1 monclient: found mon.noname-c 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.018+0000 7fd69a75d640 1 -- 10.20.193.45:0/4093884785 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6941e8980 con 0x7fd6941561c0 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.019+0000 7fd69a75d640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 0x7fd6941e9930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd69000cc10 tx=0x7fd69000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.019+0000 7fd6827fc640 10 client.?.objecter ms_handle_connect 0x7fd6941561c0 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.019+0000 7fd6827fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 1 -- 10.20.193.45:0/4093884785 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690016020 con 0x7fd6941561c0 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 10 monclient: dump: 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.025 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 1 -- 10.20.193.45:0/4093884785 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69000ce30 con 0x7fd6941561c0 2026-02-17T21:12:26.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 1 -- 10.20.193.45:0/4093884785 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690012640 con 0x7fd6941561c0 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd69c1e7640 5 monclient: authenticate success, global_id 5294 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd69c1e7640 10 monclient: _renew_subs 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd69c1e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69414efe0 con 0x7fd6941561c0 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd683fff640 4 set_mon_vals no callback set 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd6827fc640 10 monclient: dump: 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.027 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd69c1e7640 10 client.5294.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd69c1e7640 10 monclient: _renew_subs 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd69c1e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69414f5a0 con 0x7fd6941561c0 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.020+0000 7fd69c1e7640 1 librados: init done 2026-02-17T21:12:26.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.021+0000 7fd69c1e7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.021+0000 7fd69c1e7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.021+0000 7fd69c1e7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:26.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.021+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69415cb00 con 0x7fd6941561c0 2026-02-17T21:12:26.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.032+0000 7fd6827fc640 1 -- 10.20.193.45:0/4093884785 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fd6900127e0 con 0x7fd6941561c0 2026-02-17T21:12:26.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.032+0000 7fd6827fc640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd6640792d0 0x7fd66407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.032+0000 7fd699f5c640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd6640792d0 0x7fd66407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.032+0000 7fd699f5c640 10 monclient: get_auth_request con 0x7fd6640792d0 auth_method 0 2026-02-17T21:12:26.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.032+0000 7fd699f5c640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd6640792d0 0x7fd66407b790 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd694069dc0 tx=0x7fd684039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.032+0000 7fd6827fc640 10 client.5294.objecter ms_handle_connect 0x7fd6640792d0 2026-02-17T21:12:26.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.034+0000 7fd6827fc640 1 -- 10.20.193.45:0/4093884785 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fd69005ecf0 con 0x7fd6941561c0 2026-02-17T21:12:26.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.034+0000 7fd6827fc640 10 client.5294.objecter ms_dispatch2 0x7fd694000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:26.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.034+0000 7fd6827fc640 3 client.5294.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:26.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.034+0000 7fd6827fc640 3 client.5294.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:26.031 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.034+0000 7fd6827fc640 20 client.5294.objecter dump_active .. 0 homeless 2026-02-17T21:12:26.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.135+0000 7fd6827fc640 1 -- 10.20.193.45:0/4093884785 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd690020020 con 0x7fd6941561c0 2026-02-17T21:12:26.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.135+0000 7fd6827fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.135+0000 7fd6827fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:26.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.221+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7fd6940713b0 con 0x7fd6640792d0 2026-02-17T21:12:26.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.221+0000 7fd6827fc640 1 -- 10.20.193.45:0/4093884785 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7fd6940713b0 con 0x7fd6640792d0 2026-02-17T21:12:26.214 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 10 to deep-scrub 2026-02-17T21:12:26.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 10 librados: watch_flush enter 2026-02-17T21:12:26.215 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 10 librados: watch_flush exit 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 20 client.5294.objecter shutdown clearing up homeless session... 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 10 client.5294.objecter successfully canceled tick 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd6640792d0 msgr2=0x7fd66407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd6640792d0 0x7fd66407b790 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd694069dc0 tx=0x7fd684039040 comp rx=0 tx=0).stop 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 10 monclient: shutdown 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 msgr2=0x7fd6941e9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 0x7fd6941e9930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd69000cc10 tx=0x7fd69000a430 comp rx=0 tx=0).stop 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 shutdown_connections 2026-02-17T21:12:26.216 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fd6640792d0 0x7fd66407b790 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6941561c0 0x7fd6941e9930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fd69406e110 0x7fd6941e93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 --2- 10.20.193.45:0/4093884785 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fd69406c890 0x7fd69415b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 >> 10.20.193.45:0/4093884785 conn(0x7fd6940cbf10 msgr2=0x7fd694153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 shutdown_connections 2026-02-17T21:12:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 -- 10.20.193.45:0/4093884785 wait complete. 2026-02-17T21:12:26.217 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.222+0000 7fd69c1e7640 1 librados: shutdown 2026-02-17T21:12:26.223 INFO:tasks.ceph:Scrubbing osd.14 2026-02-17T21:12:26.223 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:26.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.299+0000 7fe7b601b640 10 monclient: get_monmap_and_config 2026-02-17T21:12:26.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.299+0000 7fe7b601b640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.299+0000 7fe7b601b640 10 monclient: monmap: 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:26.299892+0000 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:26.299892+0000 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:26.292 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:26.293 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:26.293 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.299+0000 7fe7b601b640 1 Processor -- start 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.299+0000 7fe7b601b640 1 -- start start 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.299+0000 7fe7b601b640 10 monclient: init 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 10 monclient: _add_conns ranks=[2,3,1,4,5,0] 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe7b01503c0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fe7b015d020 0x7fe7b015d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 10 monclient(hunting): picked mon.noname-a con 0x7fe7b015d020 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fe7b00c4740 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b00c55a0 con 0x7fe7b00c4740 2026-02-17T21:12:26.296 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b00c52c0 con 0x7fe7b01503c0 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b0159c40 con 0x7fe7b015d020 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7b601b640 10 monclient(hunting): authenticate will time out at 1329.930100s 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7affff640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fe7b00c4740 0x7fe7b00c6a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:46832/0 (socket says 10.20.193.45:46832) 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7affff640 1 -- 10.20.193.45:0/1713840796 learned_addr learned my addr 10.20.193.45:0/1713840796 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7aeffd640 1 --2- 10.20.193.45:0/1713840796 >> v2:10.20.193.45:3300/0 conn(0x7fe7b015d020 0x7fe7b015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7aeffd640 10 monclient(hunting): get_auth_request con 0x7fe7b015d020 auth_method 0 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.297 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.300+0000 7fe7aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.301+0000 7fe7aeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.301+0000 7fe7aeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.301+0000 7fe7aeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 1 -- 10.20.193.45:0/1713840796 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540055930 0 0) 0x7fe7b00c52c0 con 0x7fe7b01503c0 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 10 monclient(hunting): my global_id is 5297 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 1 -- 10.20.193.45:0/1713840796 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe794003620 con 0x7fe7b01503c0 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 1 -- 10.20.193.45:0/1713840796 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860524123 0 0) 0x7fe7a4002ca0 con 0x7fe7b00c4740 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 10 monclient(hunting): _negotiate 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.298 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 10 monclient(hunting): my global_id is 5263 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7ae7fc640 1 -- 10.20.193.45:0/1713840796 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7b00c52c0 con 0x7fe7b00c4740 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7aeffd640 10 monclient(hunting): handle_auth_done global_id 5217 payload 274 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7aeffd640 1 -- 10.20.193.45:0/1713840796 >> v1:10.20.193.92:6789/0 conn(0x7fe7b01503c0 legacy=0x7fe7b006fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7aeffd640 1 -- 10.20.193.45:0/1713840796 >> v1:10.20.193.86:6789/0 conn(0x7fe7b00c4740 legacy=0x7fe7b00c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7aeffd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7aeffd640 1 monclient: found mon.noname-a 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7aeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.302+0000 7fe7aeffd640 1 -- 10.20.193.45:0/1713840796 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b0159f20 con 0x7fe7b015d020 2026-02-17T21:12:26.299 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.303+0000 7fe7aeffd640 1 --2- 10.20.193.45:0/1713840796 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b015d020 0x7fe7b015d490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00098a0 tx=0x7fe7a002ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedf97e9d7621cbe server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 1 -- 10.20.193.45:0/1713840796 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a003c070 con 0x7fe7b015d020 2026-02-17T21:12:26.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:26.304 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 10 monclient: dump: 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.305 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 1 -- 10.20.193.45:0/1713840796 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a002fc10 con 0x7fe7b015d020 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 1 -- 10.20.193.45:0/1713840796 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0037440 con 0x7fe7b015d020 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 5 monclient: authenticate success, global_id 5217 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7ae7fc640 10 monclient: dump: 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.306 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 4 set_mon_vals no callback set 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 10 monclient: shutdown 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 1 -- 10.20.193.45:0/1713840796 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b015d020 msgr2=0x7fe7b015d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.307 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 1 --2- 10.20.193.45:0/1713840796 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b015d020 0x7fe7b015d490 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00098a0 tx=0x7fe7a002ef00 comp rx=0 tx=0).stop 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 1 -- 10.20.193.45:0/1713840796 shutdown_connections 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 1 --2- 10.20.193.45:0/1713840796 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b015d020 0x7fe7b015d490 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 1 -- 10.20.193.45:0/1713840796 >> 10.20.193.45:0/1713840796 conn(0x7fe7b00cd520 msgr2=0x7fe7b00cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 1 -- 10.20.193.45:0/1713840796 shutdown_connections 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.306+0000 7fe7b601b640 1 -- 10.20.193.45:0/1713840796 wait complete. 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.307+0000 7fe7b601b640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.307+0000 7fe7b601b640 10 monclient: monmap: 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:26.308 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.307+0000 7fe7b601b640 1 librados: starting msgr at 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.307+0000 7fe7b601b640 1 librados: starting objecter 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.307+0000 7fe7b601b640 1 Processor -- start 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.307+0000 7fe7b601b640 1 -- start start 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.307+0000 7fe7b601b640 1 librados: setting wanted keys 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.307+0000 7fe7b601b640 1 librados: calling monclient init 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.307+0000 7fe7b601b640 10 monclient: init 2026-02-17T21:12:26.309 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7b00c4740 0x7fe7b00c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient(hunting): picked mon.noname-c con 0x7fe7b00c4740 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b01503c0 0x7fe7b01f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient(hunting): picked mon.noname-a con 0x7fe7b01503c0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe7b015d020 0x7fe7b01f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient(hunting): picked mon.noname-b con 0x7fe7b015d020 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b00704d0 con 0x7fe7b01503c0 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b015a4e0 con 0x7fe7b015d020 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.310 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b01507a0 con 0x7fe7b00c4740 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7b601b640 10 monclient(hunting): authenticate will time out at 1329.938254s 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b01503c0 0x7fe7b01f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7af7fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7b00c4740 0x7fe7b00c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7affff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe7b015d020 0x7fe7b01f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b01503c0 0x7fe7b01f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36714/0 (socket says 10.20.193.45:36714) 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 1 -- 10.20.193.45:0/1113453910 learned_addr learned my addr 10.20.193.45:0/1113453910 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 10 monclient(hunting): get_auth_request con 0x7fe7b01503c0 auth_method 0 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.311 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7af7fe640 10 monclient(hunting): get_auth_request con 0x7fe7b00c4740 auth_method 0 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7affff640 10 monclient(hunting): get_auth_request con 0x7fe7b015d020 auth_method 0 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7affff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.308+0000 7fe7aeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.312 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.309+0000 7fe7af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.309+0000 7fe7af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.309+0000 7fe7af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.309+0000 7fe7affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.309+0000 7fe7affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.309+0000 7fe7affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 10 monclient(hunting): handle_auth_done global_id 5220 payload 824 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 1 -- 10.20.193.45:0/1113453910 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7b00c4740 msgr2=0x7fe7b00c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe7b00c4740 0x7fe7b00c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 1 -- 10.20.193.45:0/1113453910 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe7b015d020 msgr2=0x7fe7b01f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fe7b015d020 0x7fe7b01f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 1 monclient: found mon.noname-a 2026-02-17T21:12:26.313 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.310+0000 7fe7aeffd640 1 -- 10.20.193.45:0/1113453910 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b01f4520 con 0x7fe7b01503c0 2026-02-17T21:12:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.311+0000 7fe7aeffd640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b01503c0 0x7fe7b01f7d10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0016ed0 tx=0x7fe7a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.311+0000 7fe78bfff640 10 client.?.objecter ms_handle_connect 0x7fe7b01503c0 2026-02-17T21:12:26.314 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.311+0000 7fe78bfff640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 1 -- 10.20.193.45:0/1113453910 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a003c040 con 0x7fe7b01503c0 2026-02-17T21:12:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:26.316 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 10 monclient: dump: 2026-02-17T21:12:26.316 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.316 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.316 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.316 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.316 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 1 -- 10.20.193.45:0/1113453910 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a002fa10 con 0x7fe7b01503c0 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 1 -- 10.20.193.45:0/1113453910 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0042650 con 0x7fe7b01503c0 2026-02-17T21:12:26.317 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe78bfff640 10 monclient: dump: 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.318 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7adffb640 4 set_mon_vals no callback set 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 5 monclient: authenticate success, global_id 5220 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 10 monclient: _renew_subs 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b01f4800 con 0x7fe7b01503c0 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 10 client.5220.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 10 monclient: _renew_subs 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b01f4dc0 con 0x7fe7b01503c0 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 1 librados: init done 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 10 client.5220.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 15 client.5220.objecter _session_command_op_assign -1 1 2026-02-17T21:12:26.319 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 20 client.5220.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:26.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 10 client.5220.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:26.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.320 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.313+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7b015d490 con 0x7fe7b01503c0 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.325+0000 7fe78bfff640 1 -- 10.20.193.45:0/1113453910 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fe7a00427f0 con 0x7fe7b01503c0 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.325+0000 7fe78bfff640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe780079280 0x7fe78007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.326+0000 7fe7af7fe640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe780079280 0x7fe78007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.326+0000 7fe7af7fe640 10 monclient: get_auth_request con 0x7fe780079280 auth_method 0 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.326+0000 7fe78bfff640 10 client.5220.objecter ms_handle_connect 0x7fe780079280 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.326+0000 7fe7af7fe640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe780079280 0x7fe78007b740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0052b0 tx=0x7fe79c003d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.326+0000 7fe78bfff640 1 -- 10.20.193.45:0/1113453910 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fe7a002fbc0 con 0x7fe7b01503c0 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.326+0000 7fe78bfff640 10 client.5220.objecter ms_dispatch2 0x7fe7b0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.326+0000 7fe78bfff640 3 client.5220.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:26.322 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.326+0000 7fe78bfff640 3 client.5220.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.326+0000 7fe78bfff640 10 client.5220.objecter checking command 1 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7fe7800817c0 0x7fe780083be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 20 client.5220.objecter _get_session s=0x7fe7800810f0 osd=14 3 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 20 client.5220.objecter put_session s=0x7fe7800810f0 osd=14 3 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 15 client.5220.objecter _session_command_op_remove -1 1 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 20 client.5220.objecter _get_session s=0x7fe7800810f0 osd=14 3 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 20 client.5220.objecter get_session s=0x7fe7800810f0 osd=14 3 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 15 client.5220.objecter _session_command_op_assign 14 1 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 20 client.5220.objecter put_session s=0x7fe7800810f0 osd=14 4 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 10 client.5220.objecter _send_command 1 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 1 -- 10.20.193.45:0/1113453910 --> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7a004ee80 con 0x7fe7800817c0 2026-02-17T21:12:26.323 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 20 client.5220.objecter dump_active .. 0 homeless 2026-02-17T21:12:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 1 -- 10.20.193.45:0/1113453910 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe7a0083ae0 con 0x7fe7b01503c0 2026-02-17T21:12:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe78bfff640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe7affff640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7fe7800817c0 0x7fe780083be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.327+0000 7fe7affff640 10 monclient: get_auth_request con 0x7fe7800817c0 auth_method 0 2026-02-17T21:12:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.329+0000 7fe7affff640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7fe7800817c0 0x7fe780083be0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.14 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.324 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.329+0000 7fe78bfff640 10 client.5220.objecter ms_handle_connect 0x7fe7800817c0 2026-02-17T21:12:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.339+0000 7fe78bfff640 1 -- 10.20.193.45:0/1113453910 <== osd.14 v2:10.20.193.92:6808/1799526026 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fe7a004ee80 con 0x7fe7800817c0 2026-02-17T21:12:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.339+0000 7fe78bfff640 10 client.5220.objecter ms_dispatch2 0x7fe7b0000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.339+0000 7fe78bfff640 10 client.5220.objecter _finish_command 1 = system:0 2026-02-17T21:12:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.339+0000 7fe78bfff640 20 client.5220.objecter put_session s=0x7fe7800810f0 osd=14 4 2026-02-17T21:12:26.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.339+0000 7fe78bfff640 15 client.5220.objecter _session_command_op_remove 14 1 2026-02-17T21:12:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 10 client.5220.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 15 client.5220.objecter _session_command_op_assign -1 2 2026-02-17T21:12:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 20 client.5220.objecter _get_session s=0x7fe7800810f0 osd=14 3 2026-02-17T21:12:26.338 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 20 client.5220.objecter put_session s=0x7fe7800810f0 osd=14 3 2026-02-17T21:12:26.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 20 client.5220.objecter _get_session s=0x7fe7800810f0 osd=14 3 2026-02-17T21:12:26.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 15 client.5220.objecter _session_command_op_remove -1 2 2026-02-17T21:12:26.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 20 client.5220.objecter get_session s=0x7fe7800810f0 osd=14 3 2026-02-17T21:12:26.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 15 client.5220.objecter _session_command_op_assign 14 2 2026-02-17T21:12:26.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 20 client.5220.objecter put_session s=0x7fe7800810f0 osd=14 4 2026-02-17T21:12:26.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 10 client.5220.objecter _send_command 2 2026-02-17T21:12:26.339 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.345+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 --> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe7b00c9b30 con 0x7fe7800817c0 2026-02-17T21:12:26.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe78bfff640 1 -- 10.20.193.45:0/1113453910 <== osd.14 v2:10.20.193.92:6808/1799526026 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe7b00c9b30 con 0x7fe7800817c0 2026-02-17T21:12:26.346 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe78bfff640 10 client.5220.objecter ms_dispatch2 0x7fe7b0000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:26.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe78bfff640 10 client.5220.objecter _finish_command 2 = system:0 2026-02-17T21:12:26.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe78bfff640 20 client.5220.objecter put_session s=0x7fe7800810f0 osd=14 4 2026-02-17T21:12:26.347 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe78bfff640 15 client.5220.objecter _session_command_op_remove 14 2 2026-02-17T21:12:26.347 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:26.347 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:26.347 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:26.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 10 librados: watch_flush enter 2026-02-17T21:12:26.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 10 librados: watch_flush exit 2026-02-17T21:12:26.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 10 client.5220.objecter close_session for osd.14 2026-02-17T21:12:26.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7fe7800817c0 msgr2=0x7fe780083be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.92:6808/1799526026,v1:10.20.193.92:6809/1799526026] conn(0x7fe7800817c0 0x7fe780083be0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 20 client.5220.objecter put_session s=0x7fe7800810f0 osd=14 1 2026-02-17T21:12:26.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 20 client.5220.objecter shutdown clearing up homeless session... 2026-02-17T21:12:26.349 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 10 client.5220.objecter successfully canceled tick 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe780079280 msgr2=0x7fe78007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fe780079280 0x7fe78007b740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0052b0 tx=0x7fe79c003d70 comp rx=0 tx=0).stop 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 10 monclient: shutdown 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b01503c0 msgr2=0x7fe7b01f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 --2- 10.20.193.45:0/1113453910 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fe7b01503c0 0x7fe7b01f7d10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0016ed0 tx=0x7fe7a00047c0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7affff640 1 -- 10.20.193.45:0/1113453910 reap_dead start 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 shutdown_connections 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 >> 10.20.193.45:0/1113453910 conn(0x7fe7b00cd520 msgr2=0x7fe7b014cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 shutdown_connections 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 -- 10.20.193.45:0/1113453910 wait complete. 2026-02-17T21:12:26.350 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.354+0000 7fe7b601b640 1 librados: shutdown 2026-02-17T21:12:26.355 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-17T21:12:26.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.432+0000 7fb323577640 10 monclient: get_monmap_and_config 2026-02-17T21:12:26.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.432+0000 7fb323577640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.432+0000 7fb323577640 10 monclient: monmap: 2026-02-17T21:12:26.425 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:26.433747+0000 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:26.433747+0000 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:26.426 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 1 Processor -- start 2026-02-17T21:12:26.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 1 -- start start 2026-02-17T21:12:26.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 10 monclient: init 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 10 monclient: _add_conns ranks=[2,0,3,1,4,5] 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb3241535c0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb3240ca720 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fb3240c4c20 0x7fb324159840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 10 monclient(hunting): picked mon.noname-a con 0x7fb3240c4c20 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32415a660 con 0x7fb3240ca720 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3240c7a90 con 0x7fb3241535c0 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fb3240c9520 con 0x7fb3240c4c20 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.433+0000 7fb323577640 10 monclient(hunting): authenticate will time out at 1330.063967s 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.434+0000 7fb322575640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7fb3241535c0 0x7fb3240c8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45558/0 (socket says 10.20.193.45:45558) 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.434+0000 7fb322575640 1 -- 10.20.193.45:0/1655964892 learned_addr learned my addr 10.20.193.45:0/1655964892 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.434+0000 7fb322d76640 1 --2- 10.20.193.45:0/1655964892 >> v2:10.20.193.45:3300/0 conn(0x7fb3240c4c20 0x7fb324159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.434+0000 7fb322d76640 10 monclient(hunting): get_auth_request con 0x7fb3240c4c20 auth_method 0 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.434+0000 7fb322d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.434+0000 7fb322d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.434+0000 7fb322d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.435+0000 7fb322d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.435+0000 7fb322d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.435+0000 7fb322d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.435+0000 7fb321573640 1 -- 10.20.193.45:0/1655964892 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349874977 0 0) 0x7fb3240c7a90 con 0x7fb3241535c0 2026-02-17T21:12:26.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.435+0000 7fb321573640 10 monclient(hunting): _negotiate 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.435+0000 7fb321573640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.435+0000 7fb321573640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.435+0000 7fb321573640 10 monclient(hunting): my global_id is 5303 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.435+0000 7fb321573640 1 -- 10.20.193.45:0/1655964892 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb310003620 con 0x7fb3241535c0 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.437+0000 7fb322d76640 10 monclient(hunting): handle_auth_done global_id 5223 payload 274 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.437+0000 7fb322d76640 1 -- 10.20.193.45:0/1655964892 >> v1:10.20.193.92:6789/0 conn(0x7fb3241535c0 legacy=0x7fb3240c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.437+0000 7fb322d76640 1 -- 10.20.193.45:0/1655964892 >> v1:10.20.193.45:6789/0 conn(0x7fb3240ca720 legacy=0x7fb3240c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.437+0000 7fb322d76640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.437+0000 7fb322d76640 1 monclient: found mon.noname-a 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.437+0000 7fb322d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.437+0000 7fb322d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.437+0000 7fb322d76640 1 -- 10.20.193.45:0/1655964892 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3240c7d70 con 0x7fb3240c4c20 2026-02-17T21:12:26.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.438+0000 7fb322d76640 1 --2- 10.20.193.45:0/1655964892 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240c4c20 0x7fb324159840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb314009d90 tx=0x7fb31402f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc50f63b1d86829 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 1 -- 10.20.193.45:0/1655964892 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31403c070 con 0x7fb3240c4c20 2026-02-17T21:12:26.437 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 10 monclient: dump: 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.438 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 1 -- 10.20.193.45:0/1655964892 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb314037440 con 0x7fb3240c4c20 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 1 -- 10.20.193.45:0/1655964892 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314037810 con 0x7fb3240c4c20 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb321573640 10 monclient: dump: 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.439 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 5 monclient: authenticate success, global_id 5223 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 4 set_mon_vals no callback set 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 10 monclient: shutdown 2026-02-17T21:12:26.440 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 1 -- 10.20.193.45:0/1655964892 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240c4c20 msgr2=0x7fb324159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 1 --2- 10.20.193.45:0/1655964892 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240c4c20 0x7fb324159840 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb314009d90 tx=0x7fb31402f1e0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 1 -- 10.20.193.45:0/1655964892 shutdown_connections 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 1 --2- 10.20.193.45:0/1655964892 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240c4c20 0x7fb324159840 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 1 -- 10.20.193.45:0/1655964892 >> 10.20.193.45:0/1655964892 conn(0x7fb3240c9b90 msgr2=0x7fb3240c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 1 -- 10.20.193.45:0/1655964892 shutdown_connections 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.440+0000 7fb323577640 1 -- 10.20.193.45:0/1655964892 wait complete. 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.441+0000 7fb323577640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.441+0000 7fb323577640 10 monclient: monmap: 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:26.441 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.441+0000 7fb323577640 1 librados: starting msgr at 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.441+0000 7fb323577640 1 librados: starting objecter 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.441+0000 7fb323577640 1 Processor -- start 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.441+0000 7fb323577640 1 -- start start 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.441+0000 7fb323577640 1 librados: setting wanted keys 2026-02-17T21:12:26.442 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.441+0000 7fb323577640 1 librados: calling monclient init 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.441+0000 7fb323577640 10 monclient: init 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3240c4c20 0x7fb324072da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient(hunting): picked mon.noname-c con 0x7fb3240c4c20 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240ca720 0x7fb324156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient(hunting): picked mon.noname-a con 0x7fb3240ca720 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb3241535c0 0x7fb3241f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient(hunting): picked mon.noname-b con 0x7fb3241535c0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240c8610 con 0x7fb3240ca720 2026-02-17T21:12:26.443 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240c8330 con 0x7fb3241535c0 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3240c88f0 con 0x7fb3240c4c20 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb323577640 10 monclient(hunting): authenticate will time out at 1330.072078s 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240ca720 0x7fb324156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3240c4c20 0x7fb324072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240ca720 0x7fb324156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36728/0 (socket says 10.20.193.45:36728) 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 1 -- 10.20.193.45:0/493258673 learned_addr learned my addr 10.20.193.45:0/493258673 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 10 monclient(hunting): get_auth_request con 0x7fb3240ca720 auth_method 0 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.444 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322d76640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb3241535c0 0x7fb3241f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322575640 10 monclient(hunting): get_auth_request con 0x7fb3240c4c20 auth_method 0 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb321d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322d76640 10 monclient(hunting): get_auth_request con 0x7fb3241535c0 auth_method 0 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.445 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.442+0000 7fb322575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.443+0000 7fb322d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.443+0000 7fb322d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.443+0000 7fb322d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.443+0000 7fb321d74640 10 monclient(hunting): handle_auth_done global_id 5229 payload 824 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 1 -- 10.20.193.45:0/493258673 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3240c4c20 msgr2=0x7fb324072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3240c4c20 0x7fb324072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 1 -- 10.20.193.45:0/493258673 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb3241535c0 msgr2=0x7fb3241f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb3241535c0 0x7fb3241f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.446 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 1 monclient: found mon.noname-a 2026-02-17T21:12:26.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 1 -- 10.20.193.45:0/493258673 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3241f27d0 con 0x7fb3240ca720 2026-02-17T21:12:26.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb321d74640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240ca720 0x7fb324156fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c700 tx=0x7fb30c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb30affd640 10 client.?.objecter ms_handle_connect 0x7fb3240ca720 2026-02-17T21:12:26.447 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.444+0000 7fb30affd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:26.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 1 -- 10.20.193.45:0/493258673 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0052d0 con 0x7fb3240ca720 2026-02-17T21:12:26.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:26.449 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 10 monclient: dump: 2026-02-17T21:12:26.449 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.449 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.449 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.449 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 1 -- 10.20.193.45:0/493258673 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30c005470 con 0x7fb3240ca720 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.450 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 1 -- 10.20.193.45:0/493258673 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30c00a860 con 0x7fb3240ca720 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 5 monclient: authenticate success, global_id 5229 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb320d72640 4 set_mon_vals no callback set 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb30affd640 10 monclient: dump: 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.451 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 10 monclient: _renew_subs 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb324073400 con 0x7fb3240ca720 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 10 client.5229.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 10 monclient: _renew_subs 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3240739c0 con 0x7fb3240ca720 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 1 librados: init done 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.446+0000 7fb323577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.452 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.447+0000 7fb323577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.447+0000 7fb323577640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.453 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.447+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb32415acc0 con 0x7fb3240ca720 2026-02-17T21:12:26.547 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.554+0000 7fb30affd640 1 -- 10.20.193.45:0/493258673 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fb30c00aa00 con 0x7fb3240ca720 2026-02-17T21:12:26.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.555+0000 7fb30affd640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb2f0079280 0x7fb2f007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.555+0000 7fb322575640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb2f0079280 0x7fb2f007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.555+0000 7fb322575640 10 monclient: get_auth_request con 0x7fb2f0079280 auth_method 0 2026-02-17T21:12:26.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.555+0000 7fb322575640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb2f0079280 0x7fb2f007b740 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb318007b60 tx=0x7fb318007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.548 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.555+0000 7fb30affd640 10 client.5229.objecter ms_handle_connect 0x7fb2f0079280 2026-02-17T21:12:26.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.563+0000 7fb30affd640 1 -- 10.20.193.45:0/493258673 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fb30c00ad20 con 0x7fb3240ca720 2026-02-17T21:12:26.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.563+0000 7fb30affd640 10 client.5229.objecter ms_dispatch2 0x7fb324000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:26.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.563+0000 7fb30affd640 3 client.5229.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:26.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.563+0000 7fb30affd640 3 client.5229.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:26.556 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.563+0000 7fb30affd640 20 client.5229.objecter dump_active .. 0 homeless 2026-02-17T21:12:26.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.563+0000 7fb30affd640 1 -- 10.20.193.45:0/493258673 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb30c062380 con 0x7fb3240ca720 2026-02-17T21:12:26.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.563+0000 7fb30affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.557 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.563+0000 7fb30affd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:26.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.647+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7fb32415a380 con 0x7fb2f0079280 2026-02-17T21:12:26.639 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.647+0000 7fb30affd640 1 -- 10.20.193.45:0/493258673 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7fb32415a380 con 0x7fb2f0079280 2026-02-17T21:12:26.640 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 14 to deep-scrub 2026-02-17T21:12:26.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 10 librados: watch_flush enter 2026-02-17T21:12:26.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 10 librados: watch_flush exit 2026-02-17T21:12:26.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 20 client.5229.objecter shutdown clearing up homeless session... 2026-02-17T21:12:26.641 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 10 client.5229.objecter successfully canceled tick 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb2f0079280 msgr2=0x7fb2f007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb2f0079280 0x7fb2f007b740 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb318007b60 tx=0x7fb318007ab0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 10 monclient: shutdown 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240ca720 msgr2=0x7fb324156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240ca720 0x7fb324156fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c700 tx=0x7fb30c00cbd0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 shutdown_connections 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fb2f0079280 0x7fb2f007b740 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fb3241535c0 0x7fb3241f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fb3240ca720 0x7fb324156fe0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 --2- 10.20.193.45:0/493258673 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3240c4c20 0x7fb324072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.642 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 >> 10.20.193.45:0/493258673 conn(0x7fb3240c9b90 msgr2=0x7fb32406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:26.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 shutdown_connections 2026-02-17T21:12:26.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 -- 10.20.193.45:0/493258673 wait complete. 2026-02-17T21:12:26.643 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.648+0000 7fb323577640 1 librados: shutdown 2026-02-17T21:12:26.649 INFO:tasks.ceph:Scrubbing osd.3 2026-02-17T21:12:26.649 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.728+0000 7f16f7996640 10 monclient: get_monmap_and_config 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.728+0000 7f16f7996640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.728+0000 7f16f7996640 10 monclient: monmap: 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:26.729263+0000 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:26.729263+0000 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.721 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:26.722 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:26.722 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:26.722 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:26.722 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:26.722 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:26.722 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.728+0000 7f16f7996640 1 Processor -- start 2026-02-17T21:12:26.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 1 -- start start 2026-02-17T21:12:26.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient: init 2026-02-17T21:12:26.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient: _add_conns ranks=[4,3,5,1,2,0] 2026-02-17T21:12:26.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f16f014f170 0x7f16f006da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient(hunting): picked mon.noname-b con 0x7f16f014f170 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:26.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f16f014f550 0x7f16f00c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient(hunting): picked mon.noname-a con 0x7f16f014f550 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f16f00c5fe0 0x7f16f00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient(hunting): picked mon.noname-c con 0x7f16f00c5fe0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f16f00c6440 con 0x7f16f014f550 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f16f006e150 con 0x7f16f014f170 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f16f006e430 con 0x7f16f00c5fe0 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f7996640 10 monclient(hunting): authenticate will time out at 1330.359670s 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.729+0000 7f16f4f0a640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f16f014f550 0x7f16f00c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f5f0c640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f16f00c5fe0 0x7f16f00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f570b640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f16f014f170 0x7f16f006da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f4f0a640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f16f014f550 0x7f16f00c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36744/0 (socket says 10.20.193.45:36744) 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f4f0a640 1 -- 10.20.193.45:0/3105159830 learned_addr learned my addr 10.20.193.45:0/3105159830 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f4f0a640 10 monclient(hunting): get_auth_request con 0x7f16f014f550 auth_method 0 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f4f0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f4f0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f4f0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f5f0c640 10 monclient(hunting): get_auth_request con 0x7f16f00c5fe0 auth_method 0 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f5f0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f5f0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f5f0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f570b640 10 monclient(hunting): get_auth_request con 0x7f16f014f170 auth_method 0 2026-02-17T21:12:26.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f570b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f570b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f570b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f4f0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f4f0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f4f0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f5f0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f5f0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f5f0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f570b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f570b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.730+0000 7f16f570b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 10 monclient(hunting): handle_auth_done global_id 5232 payload 274 2026-02-17T21:12:26.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 1 -- 10.20.193.45:0/3105159830 >> v2:10.20.193.92:3300/0 conn(0x7f16f00c5fe0 msgr2=0x7f16f00c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:26.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 1 --2- 10.20.193.45:0/3105159830 >> v2:10.20.193.92:3300/0 conn(0x7f16f00c5fe0 0x7f16f00c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 1 -- 10.20.193.45:0/3105159830 >> v2:10.20.193.86:3300/0 conn(0x7f16f014f170 msgr2=0x7f16f006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:26.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 1 --2- 10.20.193.45:0/3105159830 >> v2:10.20.193.86:3300/0 conn(0x7f16f014f170 0x7f16f006da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 1 monclient: found mon.noname-a 2026-02-17T21:12:26.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.731+0000 7f16f4f0a640 1 -- 10.20.193.45:0/3105159830 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f006e710 con 0x7f16f014f550 2026-02-17T21:12:26.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.732+0000 7f16f4f0a640 1 --2- 10.20.193.45:0/3105159830 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f550 0x7f16f00c5aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f16f00c99f0 tx=0x7f16e402ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5db7a3d2125df5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 1 -- 10.20.193.45:0/3105159830 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e403c070 con 0x7f16f014f550 2026-02-17T21:12:26.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:26.737 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 10 monclient: dump: 2026-02-17T21:12:26.737 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.737 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.737 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.737 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 1 -- 10.20.193.45:0/3105159830 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e402fb50 con 0x7f16f014f550 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 5 monclient: authenticate success, global_id 5232 2026-02-17T21:12:26.738 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 1 -- 10.20.193.45:0/3105159830 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4037440 con 0x7f16f014f550 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16dffff640 10 monclient: dump: 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.739 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 4 set_mon_vals no callback set 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 10 monclient: shutdown 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 1 -- 10.20.193.45:0/3105159830 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f550 msgr2=0x7f16f00c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 1 --2- 10.20.193.45:0/3105159830 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f550 0x7f16f00c5aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f16f00c99f0 tx=0x7f16e402ee90 comp rx=0 tx=0).stop 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 1 -- 10.20.193.45:0/3105159830 shutdown_connections 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 1 --2- 10.20.193.45:0/3105159830 >> v2:10.20.193.92:3300/0 conn(0x7f16f00c5fe0 0x7f16f00c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 1 --2- 10.20.193.45:0/3105159830 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f550 0x7f16f00c5aa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.740 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 1 --2- 10.20.193.45:0/3105159830 >> v2:10.20.193.86:3300/0 conn(0x7f16f014f170 0x7f16f006da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 1 -- 10.20.193.45:0/3105159830 >> 10.20.193.45:0/3105159830 conn(0x7f16f00cd520 msgr2=0x7f16f00cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 1 -- 10.20.193.45:0/3105159830 shutdown_connections 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 1 -- 10.20.193.45:0/3105159830 wait complete. 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.734+0000 7f16f7996640 10 monclient: monmap: 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:26.741 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 librados: starting msgr at 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 librados: starting objecter 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 Processor -- start 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 -- start start 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 librados: setting wanted keys 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 librados: calling monclient init 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient: init 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f16f00c5fe0 0x7f16f013ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.742 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient(hunting): picked mon.noname-c con 0x7f16f00c5fe0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f170 0x7f16f01f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient(hunting): picked mon.noname-a con 0x7f16f014f170 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f16f014f550 0x7f16f01f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient(hunting): picked mon.noname-b con 0x7f16f014f550 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f16f006efb0 con 0x7f16f014f170 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f16f006ecd0 con 0x7f16f014f550 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16f00c9350 con 0x7f16f00c5fe0 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f7996640 10 monclient(hunting): authenticate will time out at 1330.365542s 2026-02-17T21:12:26.743 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f4f0a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f170 0x7f16f01f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f5f0c640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f16f014f550 0x7f16f01f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f570b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f16f00c5fe0 0x7f16f013ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f4f0a640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f170 0x7f16f01f4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36760/0 (socket says 10.20.193.45:36760) 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f4f0a640 1 -- 10.20.193.45:0/3847868331 learned_addr learned my addr 10.20.193.45:0/3847868331 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f4f0a640 10 monclient(hunting): get_auth_request con 0x7f16f014f170 auth_method 0 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f4f0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f4f0a640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.735+0000 7f16f4f0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f570b640 10 monclient(hunting): get_auth_request con 0x7f16f00c5fe0 auth_method 0 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f570b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f570b640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.744 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f570b640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f5f0c640 10 monclient(hunting): get_auth_request con 0x7f16f014f550 auth_method 0 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f5f0c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f5f0c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f5f0c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f4f0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f4f0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f4f0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f570b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f570b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f570b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f5f0c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f5f0c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.745 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.736+0000 7f16f5f0c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 10 monclient(hunting): handle_auth_done global_id 5235 payload 824 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 1 -- 10.20.193.45:0/3847868331 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f16f00c5fe0 msgr2=0x7f16f013ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f16f00c5fe0 0x7f16f013ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 1 -- 10.20.193.45:0/3847868331 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f16f014f550 msgr2=0x7f16f01f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f16f014f550 0x7f16f01f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 1 monclient: found mon.noname-a 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.737+0000 7f16f4f0a640 1 -- 10.20.193.45:0/3847868331 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f01f7e50 con 0x7f16f014f170 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.738+0000 7f16f4f0a640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f170 0x7f16f01f4fd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f16e402f3f0 tx=0x7f16e40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.738+0000 7f16ddffb640 10 client.?.objecter ms_handle_connect 0x7f16f014f170 2026-02-17T21:12:26.746 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.738+0000 7f16ddffb640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 1 -- 10.20.193.45:0/3847868331 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e403c040 con 0x7f16f014f170 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 10 monclient: dump: 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.747 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 1 -- 10.20.193.45:0/3847868331 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e4042430 con 0x7f16f014f170 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 1 -- 10.20.193.45:0/3847868331 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e4042800 con 0x7f16f014f170 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 5 monclient: authenticate success, global_id 5235 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16df7fe640 4 set_mon_vals no callback set 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 10 monclient: _renew_subs 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.748 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f01f3e20 con 0x7f16f014f170 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16ddffb640 10 monclient: dump: 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.749 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 10 client.5235.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 10 monclient: _renew_subs 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f01f43e0 con 0x7f16f014f170 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 1 librados: init done 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 10 client.5235.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 15 client.5235.objecter _session_command_op_assign -1 1 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 20 client.5235.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 10 client.5235.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:26.750 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.740+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f16f01f3bd0 con 0x7f16f014f170 2026-02-17T21:12:26.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.751+0000 7f16ddffb640 1 -- 10.20.193.45:0/3847868331 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f16e40429a0 con 0x7f16f014f170 2026-02-17T21:12:26.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.752+0000 7f16ddffb640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f16c00792d0 0x7f16c007b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.752+0000 7f16f570b640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f16c00792d0 0x7f16c007b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.752+0000 7f16f570b640 10 monclient: get_auth_request con 0x7f16c00792d0 auth_method 0 2026-02-17T21:12:26.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.752+0000 7f16f570b640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f16c00792d0 0x7f16c007b790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009bc0 tx=0x7f16e0009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.752+0000 7f16ddffb640 10 client.5235.objecter ms_handle_connect 0x7f16c00792d0 2026-02-17T21:12:26.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 1 -- 10.20.193.45:0/3847868331 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f16e40839c0 con 0x7f16f014f170 2026-02-17T21:12:26.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 10 client.5235.objecter ms_dispatch2 0x7f16f0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:26.753 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 3 client.5235.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 3 client.5235.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 10 client.5235.objecter checking command 1 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f16c0081810 0x7f16c0083c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 20 client.5235.objecter _get_session s=0x7f16c0081140 osd=3 3 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 20 client.5235.objecter put_session s=0x7f16c0081140 osd=3 3 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 15 client.5235.objecter _session_command_op_remove -1 1 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 20 client.5235.objecter _get_session s=0x7f16c0081140 osd=3 3 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 20 client.5235.objecter get_session s=0x7f16c0081140 osd=3 3 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 15 client.5235.objecter _session_command_op_assign 3 1 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 20 client.5235.objecter put_session s=0x7f16c0081140 osd=3 4 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 10 client.5235.objecter _send_command 1 2026-02-17T21:12:26.754 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 1 -- 10.20.193.45:0/3847868331 --> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16e404ee80 con 0x7f16c0081810 2026-02-17T21:12:26.755 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 20 client.5235.objecter dump_active .. 0 homeless 2026-02-17T21:12:26.755 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16f5f0c640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f16c0081810 0x7f16c0083c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.755 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 1 -- 10.20.193.45:0/3847868331 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f16e4083d80 con 0x7f16f014f170 2026-02-17T21:12:26.755 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.755+0000 7f16ddffb640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:26.755 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.756+0000 7f16f5f0c640 10 monclient: get_auth_request con 0x7f16c0081810 auth_method 0 2026-02-17T21:12:26.755 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.757+0000 7f16f5f0c640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f16c0081810 0x7f16c0083c30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.755 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.757+0000 7f16ddffb640 10 client.5235.objecter ms_handle_connect 0x7f16c0081810 2026-02-17T21:12:26.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.767+0000 7f16ddffb640 1 -- 10.20.193.45:0/3847868331 <== osd.3 v2:10.20.193.138:6800/1535515312 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f16e404ee80 con 0x7f16c0081810 2026-02-17T21:12:26.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.768+0000 7f16ddffb640 10 client.5235.objecter ms_dispatch2 0x7f16f0000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:26.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.768+0000 7f16ddffb640 10 client.5235.objecter _finish_command 1 = system:0 2026-02-17T21:12:26.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.768+0000 7f16ddffb640 20 client.5235.objecter put_session s=0x7f16c0081140 osd=3 4 2026-02-17T21:12:26.760 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.768+0000 7f16ddffb640 15 client.5235.objecter _session_command_op_remove 3 1 2026-02-17T21:12:26.766 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 10 client.5235.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 15 client.5235.objecter _session_command_op_assign -1 2 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 20 client.5235.objecter _get_session s=0x7f16c0081140 osd=3 3 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 20 client.5235.objecter put_session s=0x7f16c0081140 osd=3 3 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 20 client.5235.objecter _get_session s=0x7f16c0081140 osd=3 3 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 15 client.5235.objecter _session_command_op_remove -1 2 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 20 client.5235.objecter get_session s=0x7f16c0081140 osd=3 3 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 15 client.5235.objecter _session_command_op_assign 3 2 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 20 client.5235.objecter put_session s=0x7f16c0081140 osd=3 4 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 10 client.5235.objecter _send_command 2 2026-02-17T21:12:26.767 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.774+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 --> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f16f00c96e0 con 0x7f16c0081810 2026-02-17T21:12:26.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16ddffb640 1 -- 10.20.193.45:0/3847868331 <== osd.3 v2:10.20.193.138:6800/1535515312 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f16f00c96e0 con 0x7f16c0081810 2026-02-17T21:12:26.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16ddffb640 10 client.5235.objecter ms_dispatch2 0x7f16f0000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:26.773 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16ddffb640 10 client.5235.objecter _finish_command 2 = system:0 2026-02-17T21:12:26.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16ddffb640 20 client.5235.objecter put_session s=0x7f16c0081140 osd=3 4 2026-02-17T21:12:26.774 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16ddffb640 15 client.5235.objecter _session_command_op_remove 3 2 2026-02-17T21:12:26.774 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:26.774 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:26.774 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:26.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 10 librados: watch_flush enter 2026-02-17T21:12:26.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 10 librados: watch_flush exit 2026-02-17T21:12:26.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 10 client.5235.objecter close_session for osd.3 2026-02-17T21:12:26.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f16c0081810 msgr2=0x7f16c0083c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.138:6800/1535515312,v1:10.20.193.138:6801/1535515312] conn(0x7f16c0081810 0x7f16c0083c30 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 20 client.5235.objecter put_session s=0x7f16c0081140 osd=3 1 2026-02-17T21:12:26.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 20 client.5235.objecter shutdown clearing up homeless session... 2026-02-17T21:12:26.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 10 client.5235.objecter successfully canceled tick 2026-02-17T21:12:26.776 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f16c00792d0 msgr2=0x7f16c007b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f16c00792d0 0x7f16c007b790 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009bc0 tx=0x7f16e0009290 comp rx=0 tx=0).stop 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 10 monclient: shutdown 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f170 msgr2=0x7f16f01f4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 --2- 10.20.193.45:0/3847868331 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f16f014f170 0x7f16f01f4fd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f16e402f3f0 tx=0x7f16e40047c0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f5f0c640 1 -- 10.20.193.45:0/3847868331 reap_dead start 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 shutdown_connections 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 >> 10.20.193.45:0/3847868331 conn(0x7f16f00cd520 msgr2=0x7f16f0145320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 shutdown_connections 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 -- 10.20.193.45:0/3847868331 wait complete. 2026-02-17T21:12:26.777 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.781+0000 7f16f7996640 1 librados: shutdown 2026-02-17T21:12:26.781 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-17T21:12:26.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.857+0000 7fa3c645b640 10 monclient: get_monmap_and_config 2026-02-17T21:12:26.849 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.857+0000 7fa3c645b640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.857+0000 7fa3c645b640 10 monclient: monmap: 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:26.857889+0000 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:26.857889+0000 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:26.850 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:26.851 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:26.851 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.853 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.857+0000 7fa3c645b640 1 Processor -- start 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.857+0000 7fa3c645b640 1 -- start start 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.857+0000 7fa3c645b640 10 monclient: init 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 10 monclient: _add_conns ranks=[4,1,3,2,5,0] 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa3c015d1e0 0x7fa3c015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 10 monclient(hunting): picked mon.noname-b con 0x7fa3c015d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fa3c00748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fa3c00c92b0 0x7fa3c0153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 10 monclient(hunting): picked mon.noname-a con 0x7fa3c00c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c00c5860 con 0x7fa3c00748e0 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.854 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c00c5580 con 0x7fa3c00c92b0 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c00c7de0 con 0x7fa3c015d1e0 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c645b640 10 monclient(hunting): authenticate will time out at 1330.488084s 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa3c015d1e0 0x7fa3c015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c49d1640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7fa3c00c92b0 0x7fa3c0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fa3c015d1e0 0x7fa3c015d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38320/0 (socket says 10.20.193.45:38320) 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 1 -- 10.20.193.45:0/1767583464 learned_addr learned my addr 10.20.193.45:0/1767583464 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 10 monclient(hunting): get_auth_request con 0x7fa3c015d1e0 auth_method 0 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.855 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c49d1640 10 monclient(hunting): get_auth_request con 0x7fa3c00c92b0 auth_method 0 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c49d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c49d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3c49d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.858+0000 7fa3bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3c49d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3c49d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3c49d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3bffff640 10 monclient(hunting): handle_auth_done global_id 5278 payload 274 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3bffff640 1 -- 10.20.193.45:0/1767583464 >> v2:10.20.193.45:3300/0 conn(0x7fa3c00c92b0 msgr2=0x7fa3c0153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:26.856 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3bffff640 1 --2- 10.20.193.45:0/1767583464 >> v2:10.20.193.45:3300/0 conn(0x7fa3c00c92b0 0x7fa3c0153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3bffff640 1 -- 10.20.193.45:0/1767583464 >> v1:10.20.193.86:6789/0 conn(0x7fa3c00748e0 legacy=0x7fa3c00c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:26.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3bffff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3bffff640 1 monclient: found mon.noname-b 2026-02-17T21:12:26.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3bffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:26.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.859+0000 7fa3bffff640 1 -- 10.20.193.45:0/1767583464 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c00c80c0 con 0x7fa3c015d1e0 2026-02-17T21:12:26.857 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.861+0000 7fa3bffff640 1 --2- 10.20.193.45:0/1767583464 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c015d1e0 0x7fa3c015d5c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009970 tx=0x7fa3ac02eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6edafe561bac634 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.863 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 1 -- 10.20.193.45:0/1767583464 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac03c070 con 0x7fa3c015d1e0 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 10 monclient: dump: 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.864 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3c645b640 5 monclient: authenticate success, global_id 5278 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3c645b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 1 -- 10.20.193.45:0/1767583464 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac02fb20 con 0x7fa3c015d1e0 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 1 -- 10.20.193.45:0/1767583464 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac037440 con 0x7fa3c015d1e0 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3c645b640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3c645b640 4 set_mon_vals no callback set 2026-02-17T21:12:26.865 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.862+0000 7fa3beffd640 10 monclient: dump: 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.866 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 10 monclient: shutdown 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 -- 10.20.193.45:0/1767583464 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c015d1e0 msgr2=0x7fa3c015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 --2- 10.20.193.45:0/1767583464 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c015d1e0 0x7fa3c015d5c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009970 tx=0x7fa3ac02eef0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 -- 10.20.193.45:0/1767583464 shutdown_connections 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 --2- 10.20.193.45:0/1767583464 >> v2:10.20.193.45:3300/0 conn(0x7fa3c00c92b0 0x7fa3c0153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 --2- 10.20.193.45:0/1767583464 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c015d1e0 0x7fa3c015d5c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 -- 10.20.193.45:0/1767583464 >> 10.20.193.45:0/1767583464 conn(0x7fa3c00c9d40 msgr2=0x7fa3c00ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 -- 10.20.193.45:0/1767583464 shutdown_connections 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 -- 10.20.193.45:0/1767583464 wait complete. 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 10 monclient: build_initial_monmap 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 10 monclient: monmap: 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:26.867 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 librados: starting msgr at 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 librados: starting objecter 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 Processor -- start 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 -- start start 2026-02-17T21:12:26.868 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 librados: setting wanted keys 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 1 librados: calling monclient init 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.863+0000 7fa3c645b640 10 monclient: init 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3c00748e0 0x7fa3c0072520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient(hunting): picked mon.noname-c con 0x7fa3c00748e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c00c92b0 0x7fa3c01f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient(hunting): picked mon.noname-b con 0x7fa3c00c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa3c015d1e0 0x7fa3c0073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient(hunting): picked mon.noname-a con 0x7fa3c015d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c0074d30 con 0x7fa3c015d1e0 2026-02-17T21:12:26.869 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c00c8680 con 0x7fa3c00c92b0 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c0153b50 con 0x7fa3c00748e0 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c645b640 10 monclient(hunting): authenticate will time out at 1330.494273s 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c00c92b0 0x7fa3c01f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c49d1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa3c015d1e0 0x7fa3c0073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c00c92b0 0x7fa3c01f4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38328/0 (socket says 10.20.193.45:38328) 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 1 -- 10.20.193.45:0/2719314949 learned_addr learned my addr 10.20.193.45:0/2719314949 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 10 monclient(hunting): get_auth_request con 0x7fa3c00c92b0 auth_method 0 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.870 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bffff640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3c00748e0 0x7fa3c0072520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c49d1640 10 monclient(hunting): get_auth_request con 0x7fa3c015d1e0 auth_method 0 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c49d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c49d1640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3c49d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bffff640 10 monclient(hunting): get_auth_request con 0x7fa3c00748e0 auth_method 0 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.871 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.864+0000 7fa3bf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.865+0000 7fa3c49d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.865+0000 7fa3c49d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.865+0000 7fa3c49d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.865+0000 7fa3bffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.865+0000 7fa3bffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.865+0000 7fa3bffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 10 monclient(hunting): handle_auth_done global_id 5281 payload 824 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 1 -- 10.20.193.45:0/2719314949 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3c00748e0 msgr2=0x7fa3c0072520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3c00748e0 0x7fa3c0072520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 1 -- 10.20.193.45:0/2719314949 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa3c015d1e0 msgr2=0x7fa3c0073c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa3c015d1e0 0x7fa3c0073c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 1 monclient: found mon.noname-b 2026-02-17T21:12:26.872 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.866+0000 7fa3bf7fe640 1 -- 10.20.193.45:0/2719314949 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c0072bf0 con 0x7fa3c00c92b0 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.867+0000 7fa3bf7fe640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c00c92b0 0x7fa3c01f4f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000b5a0 tx=0x7fa3b000ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.867+0000 7fa3bcff9640 10 client.?.objecter ms_handle_connect 0x7fa3c00c92b0 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.867+0000 7fa3bcff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 1 -- 10.20.193.45:0/2719314949 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0012070 con 0x7fa3c00c92b0 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 10 monclient: dump: 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.873 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 10 monclient: _finish_auth 0 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 10 monclient: _check_auth_tickets 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 5 monclient: authenticate success, global_id 5281 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 10 monclient: _renew_subs 2026-02-17T21:12:26.874 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c0072ed0 con 0x7fa3c00c92b0 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 10 client.5281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 10 monclient: _renew_subs 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c0073490 con 0x7fa3c00c92b0 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 1 librados: init done 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 1 -- 10.20.193.45:0/2719314949 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b0004480 con 0x7fa3c00c92b0 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 1 -- 10.20.193.45:0/2719314949 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b001c060 con 0x7fa3c00c92b0 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3bcff9640 10 monclient: dump: 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:26.875 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3be7fc640 4 set_mon_vals no callback set 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.868+0000 7fa3c645b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.869+0000 7fa3c645b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.876 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.869+0000 7fa3c645b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:26.877 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.869+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c0153ee0 con 0x7fa3c00c92b0 2026-02-17T21:12:26.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.880+0000 7fa3bcff9640 1 -- 10.20.193.45:0/2719314949 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fa3b0002980 con 0x7fa3c00c92b0 2026-02-17T21:12:26.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.881+0000 7fa3bcff9640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa390079280 0x7fa39007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:26.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.881+0000 7fa3bffff640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa390079280 0x7fa39007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:26.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.881+0000 7fa3bffff640 10 monclient: get_auth_request con 0x7fa390079280 auth_method 0 2026-02-17T21:12:26.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.881+0000 7fa3bffff640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa390079280 0x7fa39007b740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0076cd0 tx=0x7fa3ac033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:26.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.881+0000 7fa3bcff9640 10 client.5281.objecter ms_handle_connect 0x7fa390079280 2026-02-17T21:12:26.878 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.882+0000 7fa3bcff9640 1 -- 10.20.193.45:0/2719314949 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fa3b00979c0 con 0x7fa3c00c92b0 2026-02-17T21:12:26.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.882+0000 7fa3bcff9640 10 client.5281.objecter ms_dispatch2 0x7fa3c0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:26.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.882+0000 7fa3bcff9640 3 client.5281.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:26.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.882+0000 7fa3bcff9640 3 client.5281.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:26.879 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.882+0000 7fa3bcff9640 20 client.5281.objecter dump_active .. 0 homeless 2026-02-17T21:12:26.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.982+0000 7fa3bcff9640 1 -- 10.20.193.45:0/2719314949 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa3b0061f50 con 0x7fa3c00c92b0 2026-02-17T21:12:26.974 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.982+0000 7fa3bcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:26.975 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:26.982+0000 7fa3bcff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:27.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.063+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa3c015c780 con 0x7fa390079280 2026-02-17T21:12:27.056 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.063+0000 7fa3bcff9640 1 -- 10.20.193.45:0/2719314949 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa3c015c780 con 0x7fa390079280 2026-02-17T21:12:27.056 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 3 to deep-scrub 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 10 librados: watch_flush enter 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 10 librados: watch_flush exit 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 20 client.5281.objecter shutdown clearing up homeless session... 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 10 client.5281.objecter successfully canceled tick 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa390079280 msgr2=0x7fa39007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa390079280 0x7fa39007b740 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0076cd0 tx=0x7fa3ac033000 comp rx=0 tx=0).stop 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 10 monclient: shutdown 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c00c92b0 msgr2=0x7fa3c01f4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.058 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c00c92b0 0x7fa3c01f4f10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000b5a0 tx=0x7fa3b000ba70 comp rx=0 tx=0).stop 2026-02-17T21:12:27.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 shutdown_connections 2026-02-17T21:12:27.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fa390079280 0x7fa39007b740 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fa3c015d1e0 0x7fa3c0073c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fa3c00c92b0 0x7fa3c01f4f10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 --2- 10.20.193.45:0/2719314949 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3c00748e0 0x7fa3c0072520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 >> 10.20.193.45:0/2719314949 conn(0x7fa3c00c9d40 msgr2=0x7fa3c01533e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 shutdown_connections 2026-02-17T21:12:27.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 -- 10.20.193.45:0/2719314949 wait complete. 2026-02-17T21:12:27.059 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.064+0000 7fa3c645b640 1 librados: shutdown 2026-02-17T21:12:27.064 INFO:tasks.ceph:Scrubbing osd.7 2026-02-17T21:12:27.065 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.144+0000 7fdcc4af1640 10 monclient: get_monmap_and_config 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.144+0000 7fdcc4af1640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.144+0000 7fdcc4af1640 10 monclient: monmap: 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:27.145258+0000 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:27.145258+0000 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.137 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:27.138 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:27.138 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:27.138 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:27.138 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:27.138 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:27.138 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 1 Processor -- start 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 1 -- start start 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 10 monclient: init 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 10 monclient: _add_conns ranks=[1,0,5,4,3,2] 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fdcc0152830 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdcc0159e00 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7fdcc015f480 0x7fdcc015f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 10 monclient(hunting): picked mon.noname-c con 0x7fdcc015f480 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc015e000 con 0x7fdcc0159e00 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc015e2e0 con 0x7fdcc0152830 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc015eef0 con 0x7fdcc015f480 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcc4af1640 10 monclient(hunting): authenticate will time out at 1330.775684s 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcbe575640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7fdcc0152830 0x7fdcc0074a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:46858/0 (socket says 10.20.193.45:46858) 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcbe575640 1 -- 10.20.193.45:0/905093676 learned_addr learned my addr 10.20.193.45:0/905093676 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.145+0000 7fdcbed76640 1 --2- 10.20.193.45:0/905093676 >> v2:10.20.193.92:3300/0 conn(0x7fdcc015f480 0x7fdcc015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.146+0000 7fdcbed76640 10 monclient(hunting): get_auth_request con 0x7fdcc015f480 auth_method 0 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.146+0000 7fdcbed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.146+0000 7fdcbed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.146+0000 7fdcbed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.146+0000 7fdcbed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.146+0000 7fdcbed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.146+0000 7fdcbed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.147+0000 7fdcbed76640 10 monclient(hunting): handle_auth_done global_id 5318 payload 274 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.147+0000 7fdcbed76640 1 -- 10.20.193.45:0/905093676 >> v1:10.20.193.86:6789/0 conn(0x7fdcc0152830 legacy=0x7fdcc0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.147+0000 7fdcbed76640 1 -- 10.20.193.45:0/905093676 >> v1:10.20.193.45:6789/0 conn(0x7fdcc0159e00 legacy=0x7fdcc015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.147+0000 7fdcbed76640 10 monclient: _finish_hunting 0 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.147+0000 7fdcbed76640 1 monclient: found mon.noname-c 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.147+0000 7fdcbed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.147+0000 7fdcbed76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.147+0000 7fdcbed76640 1 -- 10.20.193.45:0/905093676 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc015e5c0 con 0x7fdcc015f480 2026-02-17T21:12:27.143 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.148+0000 7fdcbed76640 1 --2- 10.20.193.45:0/905093676 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc015f480 0x7fdcc015f930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009d90 tx=0x7fdcb002f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51b7bd66a5098d8c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.149+0000 7fdcbd573640 1 -- 10.20.193.45:0/905093676 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb003c070 con 0x7fdcc015f480 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.149+0000 7fdcbd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.149+0000 7fdcbd573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.149+0000 7fdcbd573640 10 monclient: dump: 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.148 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.149+0000 7fdcbd573640 10 monclient: _finish_auth 0 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.149+0000 7fdcbd573640 10 monclient: _check_auth_tickets 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.149+0000 7fdcbd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.149+0000 7fdcc4af1640 5 monclient: authenticate success, global_id 5318 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.149+0000 7fdcc4af1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcbd573640 1 -- 10.20.193.45:0/905093676 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb0037440 con 0x7fdcc015f480 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcbd573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:27.149 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcbd573640 1 -- 10.20.193.45:0/905093676 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0037810 con 0x7fdcc015f480 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcbd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcbd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcbd573640 10 monclient: dump: 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.150 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 4 set_mon_vals no callback set 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 10 monclient: shutdown 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 1 -- 10.20.193.45:0/905093676 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc015f480 msgr2=0x7fdcc015f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 1 --2- 10.20.193.45:0/905093676 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc015f480 0x7fdcc015f930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009d90 tx=0x7fdcb002f1e0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 1 -- 10.20.193.45:0/905093676 shutdown_connections 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 1 --2- 10.20.193.45:0/905093676 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc015f480 0x7fdcc015f930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 1 -- 10.20.193.45:0/905093676 >> 10.20.193.45:0/905093676 conn(0x7fdcc00ce250 msgr2=0x7fdcc00ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 1 -- 10.20.193.45:0/905093676 shutdown_connections 2026-02-17T21:12:27.151 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 1 -- 10.20.193.45:0/905093676 wait complete. 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.150+0000 7fdcc4af1640 10 monclient: monmap: 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.152 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 librados: starting msgr at 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 librados: starting objecter 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 Processor -- start 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 -- start start 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 librados: setting wanted keys 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 librados: calling monclient init 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient: init 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc0152830 0x7fdcc0150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient(hunting): picked mon.noname-c con 0x7fdcc0152830 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdcc0159e00 0x7fdcc01588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient(hunting): picked mon.noname-a con 0x7fdcc0159e00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:27.153 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdcc015f480 0x7fdcc0158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient(hunting): picked mon.noname-b con 0x7fdcc015f480 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc015eb80 con 0x7fdcc0159e00 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc015fe70 con 0x7fdcc015f480 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc0152c10 con 0x7fdcc0152830 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcc4af1640 10 monclient(hunting): authenticate will time out at 1330.781604s 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcbe575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc0152830 0x7fdcc0150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.151+0000 7fdcbed76640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdcc015f480 0x7fdcc0158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.154 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbe575640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc0152830 0x7fdcc0150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35246/0 (socket says 10.20.193.45:35246) 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbe575640 1 -- 10.20.193.45:0/2489913592 learned_addr learned my addr 10.20.193.45:0/2489913592 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbe575640 10 monclient(hunting): get_auth_request con 0x7fdcc0152830 auth_method 0 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbe575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbe575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbe575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbed76640 10 monclient(hunting): get_auth_request con 0x7fdcc015f480 auth_method 0 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbed76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbe575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbe575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.155 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbe575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.152+0000 7fdcbed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 10 monclient(hunting): handle_auth_done global_id 5321 payload 824 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 1 -- 10.20.193.45:0/2489913592 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdcc015f480 msgr2=0x7fdcc0158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fdcc015f480 0x7fdcc0158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 1 -- 10.20.193.45:0/2489913592 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdcc0159e00 msgr2=0x7fdcc01588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fdcc0159e00 0x7fdcc01588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 10 monclient: _finish_hunting 0 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 1 monclient: found mon.noname-c 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.156 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.153+0000 7fdcbe575640 1 -- 10.20.193.45:0/2489913592 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc01f3a90 con 0x7fdcc0152830 2026-02-17T21:12:27.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.154+0000 7fdcbe575640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc0152830 0x7fdcc0150d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c4d0 tx=0x7fdcb400c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.154+0000 7fdca6ffd640 10 client.?.objecter ms_handle_connect 0x7fdcc0152830 2026-02-17T21:12:27.157 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.154+0000 7fdca6ffd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 1 -- 10.20.193.45:0/2489913592 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4017070 con 0x7fdcc0152830 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 10 monclient: dump: 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.159 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 5 monclient: authenticate success, global_id 5321 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 10 monclient: _renew_subs 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc01f3d70 con 0x7fdcc0152830 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 10 client.5321.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 10 monclient: _renew_subs 2026-02-17T21:12:27.160 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc01f4330 con 0x7fdcc0152830 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 1 librados: init done 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 1 -- 10.20.193.45:0/2489913592 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb4005de0 con 0x7fdcc0152830 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 1 -- 10.20.193.45:0/2489913592 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4021060 con 0x7fdcc0152830 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcbcd72640 4 set_mon_vals no callback set 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdca6ffd640 10 monclient: dump: 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.161 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 10 client.5321.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 15 client.5321.objecter _session_command_op_assign -1 1 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 20 client.5321.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 10 client.5321.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.162 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.156+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdcc015f930 con 0x7fdcc0152830 2026-02-17T21:12:27.164 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.169+0000 7fdca6ffd640 1 -- 10.20.193.45:0/2489913592 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fdcb4007270 con 0x7fdcc0152830 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.169+0000 7fdca6ffd640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdc8c079280 0x7fdc8c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.169+0000 7fdcbdd74640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdc8c079280 0x7fdc8c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.169+0000 7fdcbdd74640 10 monclient: get_auth_request con 0x7fdc8c079280 auth_method 0 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.169+0000 7fdcbdd74640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdc8c079280 0x7fdc8c07b740 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdcc01516d0 tx=0x7fdca8006cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.169+0000 7fdca6ffd640 10 client.5321.objecter ms_handle_connect 0x7fdc8c079280 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 1 -- 10.20.193.45:0/2489913592 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fdcb4097a20 con 0x7fdcc0152830 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 10 client.5321.objecter ms_dispatch2 0x7fdcc0000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 3 client.5321.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 3 client.5321.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:27.165 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 10 client.5321.objecter checking command 1 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7fdc8c0817c0 0x7fdc8c083be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 20 client.5321.objecter _get_session s=0x7fdc8c0810f0 osd=7 3 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 20 client.5321.objecter put_session s=0x7fdc8c0810f0 osd=7 3 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 15 client.5321.objecter _session_command_op_remove -1 1 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 20 client.5321.objecter _get_session s=0x7fdc8c0810f0 osd=7 3 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 20 client.5321.objecter get_session s=0x7fdc8c0810f0 osd=7 3 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 15 client.5321.objecter _session_command_op_assign 7 1 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 20 client.5321.objecter put_session s=0x7fdc8c0810f0 osd=7 4 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 10 client.5321.objecter _send_command 1 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 1 -- 10.20.193.45:0/2489913592 --> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcb4020e50 con 0x7fdc8c0817c0 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.170+0000 7fdca6ffd640 20 client.5321.objecter dump_active .. 0 homeless 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.171+0000 7fdcbed76640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7fdc8c0817c0 0x7fdc8c083be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.166 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.171+0000 7fdcbed76640 10 monclient: get_auth_request con 0x7fdc8c0817c0 auth_method 0 2026-02-17T21:12:27.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.173+0000 7fdcbed76640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7fdc8c0817c0 0x7fdc8c083be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.167 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.173+0000 7fdca6ffd640 10 client.5321.objecter ms_handle_connect 0x7fdc8c0817c0 2026-02-17T21:12:27.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.183+0000 7fdca6ffd640 1 -- 10.20.193.45:0/2489913592 <== osd.7 v2:10.20.193.138:6808/1754305677 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fdcb4020e50 con 0x7fdc8c0817c0 2026-02-17T21:12:27.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.183+0000 7fdca6ffd640 10 client.5321.objecter ms_dispatch2 0x7fdcc0000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:27.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.183+0000 7fdca6ffd640 10 client.5321.objecter _finish_command 1 = system:0 2026-02-17T21:12:27.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.183+0000 7fdca6ffd640 20 client.5321.objecter put_session s=0x7fdc8c0810f0 osd=7 4 2026-02-17T21:12:27.176 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.183+0000 7fdca6ffd640 15 client.5321.objecter _session_command_op_remove 7 1 2026-02-17T21:12:27.182 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 10 client.5321.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 15 client.5321.objecter _session_command_op_assign -1 2 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 20 client.5321.objecter _get_session s=0x7fdc8c0810f0 osd=7 3 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 20 client.5321.objecter put_session s=0x7fdc8c0810f0 osd=7 3 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 20 client.5321.objecter _get_session s=0x7fdc8c0810f0 osd=7 3 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 15 client.5321.objecter _session_command_op_remove -1 2 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 20 client.5321.objecter get_session s=0x7fdc8c0810f0 osd=7 3 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 15 client.5321.objecter _session_command_op_assign 7 2 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 20 client.5321.objecter put_session s=0x7fdc8c0810f0 osd=7 4 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 10 client.5321.objecter _send_command 2 2026-02-17T21:12:27.183 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.190+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 --> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdcc0160370 con 0x7fdc8c0817c0 2026-02-17T21:12:27.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdca6ffd640 1 -- 10.20.193.45:0/2489913592 <== osd.7 v2:10.20.193.138:6808/1754305677 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdcc0160370 con 0x7fdc8c0817c0 2026-02-17T21:12:27.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdca6ffd640 10 client.5321.objecter ms_dispatch2 0x7fdcc0000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:27.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdca6ffd640 10 client.5321.objecter _finish_command 2 = system:0 2026-02-17T21:12:27.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdca6ffd640 20 client.5321.objecter put_session s=0x7fdc8c0810f0 osd=7 4 2026-02-17T21:12:27.190 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdca6ffd640 15 client.5321.objecter _session_command_op_remove 7 2 2026-02-17T21:12:27.191 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:27.191 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:27.191 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:27.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 10 librados: watch_flush enter 2026-02-17T21:12:27.192 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 10 librados: watch_flush exit 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 10 client.5321.objecter close_session for osd.7 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7fdc8c0817c0 msgr2=0x7fdc8c083be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.138:6808/1754305677,v1:10.20.193.138:6809/1754305677] conn(0x7fdc8c0817c0 0x7fdc8c083be0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 20 client.5321.objecter put_session s=0x7fdc8c0810f0 osd=7 1 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 20 client.5321.objecter shutdown clearing up homeless session... 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 10 client.5321.objecter successfully canceled tick 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdc8c079280 msgr2=0x7fdc8c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fdc8c079280 0x7fdc8c07b740 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdcc01516d0 tx=0x7fdca8006cc0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 10 monclient: shutdown 2026-02-17T21:12:27.193 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 20 monclient: shutdown canceling and discarding version request 1 2026-02-17T21:12:27.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc0152830 msgr2=0x7fdcc0150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 1 --2- 10.20.193.45:0/2489913592 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdcc0152830 0x7fdcc0150d40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c4d0 tx=0x7fdcb400c9a0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcbed76640 1 -- 10.20.193.45:0/2489913592 reap_dead start 2026-02-17T21:12:27.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.197+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 shutdown_connections 2026-02-17T21:12:27.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.198+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 >> 10.20.193.45:0/2489913592 conn(0x7fdcc00ce250 msgr2=0x7fdcc006d490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.198+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 shutdown_connections 2026-02-17T21:12:27.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.198+0000 7fdcc4af1640 1 -- 10.20.193.45:0/2489913592 wait complete. 2026-02-17T21:12:27.194 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.198+0000 7fdcc4af1640 1 librados: shutdown 2026-02-17T21:12:27.199 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-17T21:12:27.267 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.275+0000 7ff030243640 10 monclient: get_monmap_and_config 2026-02-17T21:12:27.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.275+0000 7ff030243640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.268 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.275+0000 7ff030243640 10 monclient: monmap: 2026-02-17T21:12:27.268 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.268 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.268 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:27.276254+0000 2026-02-17T21:12:27.268 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:27.276254+0000 2026-02-17T21:12:27.268 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.268 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.268 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:27.269 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:27.269 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:27.269 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:27.269 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:27.269 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:27.269 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.275+0000 7ff030243640 1 Processor -- start 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 1 -- start start 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 10 monclient: init 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 10 monclient: _add_conns ranks=[5,1,2,0,4,3] 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7ff02815d1e0 0x7ff02815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 10 monclient(hunting): picked mon.noname-c con 0x7ff02815d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7ff0280748e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff0280c92b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:27.272 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0280c5860 con 0x7ff0280748e0 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0280c5580 con 0x7ff0280c92b0 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff0280c7de0 con 0x7ff02815d1e0 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.276+0000 7ff030243640 10 monclient(hunting): authenticate will time out at 1330.906720s 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02d7b7640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7ff0280748e0 0x7ff0280c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:46862/0 (socket says 10.20.193.45:46862) 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02d7b7640 1 -- 10.20.193.45:0/200179748 learned_addr learned my addr 10.20.193.45:0/200179748 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02dfb8640 1 --2- 10.20.193.45:0/200179748 >> v2:10.20.193.92:3300/0 conn(0x7ff02815d1e0 0x7ff02815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02dfb8640 10 monclient(hunting): get_auth_request con 0x7ff02815d1e0 auth_method 0 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02dfb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02dfb8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.273 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02dfb8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02dfb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02dfb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.277+0000 7ff02dfb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.278+0000 7ff02cfb6640 1 -- 10.20.193.45:0/200179748 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236786229 0 0) 0x7ff0280c5860 con 0x7ff0280748e0 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.278+0000 7ff02cfb6640 10 monclient(hunting): _negotiate 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.278+0000 7ff02cfb6640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.278+0000 7ff02cfb6640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.278+0000 7ff02cfb6640 10 monclient(hunting): my global_id is 5287 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.278+0000 7ff02cfb6640 1 -- 10.20.193.45:0/200179748 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff010003620 con 0x7ff0280748e0 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.278+0000 7ff02dfb8640 10 monclient(hunting): handle_auth_done global_id 5324 payload 274 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.279+0000 7ff02dfb8640 1 -- 10.20.193.45:0/200179748 >> v1:10.20.193.92:6789/0 conn(0x7ff0280c92b0 legacy=0x7ff028153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.279+0000 7ff02dfb8640 1 -- 10.20.193.45:0/200179748 >> v1:10.20.193.86:6789/0 conn(0x7ff0280748e0 legacy=0x7ff0280c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.274 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.279+0000 7ff02dfb8640 10 monclient: _finish_hunting 0 2026-02-17T21:12:27.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.279+0000 7ff02dfb8640 1 monclient: found mon.noname-c 2026-02-17T21:12:27.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.279+0000 7ff02dfb8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:27.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.279+0000 7ff02dfb8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.275 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.279+0000 7ff02dfb8640 1 -- 10.20.193.45:0/200179748 --> v2:10.20.193.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0280c80c0 con 0x7ff02815d1e0 2026-02-17T21:12:27.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.280+0000 7ff02dfb8640 1 --2- 10.20.193.45:0/200179748 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 0x7ff02815d5c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff0180098d0 tx=0x7ff01802eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e02673ddf86b8e95 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 1 -- 10.20.193.45:0/200179748 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff01803c070 con 0x7ff02815d1e0 2026-02-17T21:12:27.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:27.280 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 10 monclient: dump: 2026-02-17T21:12:27.280 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.280 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.280 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 10 monclient: _finish_auth 0 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 10 monclient: _check_auth_tickets 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 1 -- 10.20.193.45:0/200179748 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff01802fba0 con 0x7ff02815d1e0 2026-02-17T21:12:27.281 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff030243640 5 monclient: authenticate success, global_id 5324 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff030243640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 1 -- 10.20.193.45:0/200179748 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff018037440 con 0x7ff02815d1e0 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff030243640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff030243640 4 set_mon_vals no callback set 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.282+0000 7ff02cfb6640 10 monclient: dump: 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.282 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 10 monclient: shutdown 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 1 -- 10.20.193.45:0/200179748 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 msgr2=0x7ff02815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 1 --2- 10.20.193.45:0/200179748 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 0x7ff02815d5c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff0180098d0 tx=0x7ff01802eed0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 1 -- 10.20.193.45:0/200179748 shutdown_connections 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 1 --2- 10.20.193.45:0/200179748 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 0x7ff02815d5c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.283 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 1 -- 10.20.193.45:0/200179748 >> 10.20.193.45:0/200179748 conn(0x7ff0280c9d40 msgr2=0x7ff0280ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 1 -- 10.20.193.45:0/200179748 shutdown_connections 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 1 -- 10.20.193.45:0/200179748 wait complete. 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.283+0000 7ff030243640 10 monclient: monmap: 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:27.284 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 librados: starting msgr at 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 librados: starting objecter 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 Processor -- start 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 -- start start 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 librados: setting wanted keys 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 librados: calling monclient init 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient: init 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff0280748e0 0x7ff02815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient(hunting): picked mon.noname-a con 0x7ff0280748e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:27.285 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0280c92b0 0x7ff028072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient(hunting): picked mon.noname-b con 0x7ff0280c92b0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 0x7ff02815c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient(hunting): picked mon.noname-c con 0x7ff02815d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff028074d30 con 0x7ff0280748e0 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7ff0280c8680 con 0x7ff0280c92b0 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff028153d20 con 0x7ff02815d1e0 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff030243640 10 monclient(hunting): authenticate will time out at 1330.914539s 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff02e7b9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 0x7ff02815c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.286 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff02d7b7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0280c92b0 0x7ff028072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff02e7b9640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 0x7ff02815c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35268/0 (socket says 10.20.193.45:35268) 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff02e7b9640 1 -- 10.20.193.45:0/3432652862 learned_addr learned my addr 10.20.193.45:0/3432652862 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff02e7b9640 10 monclient(hunting): get_auth_request con 0x7ff02815d1e0 auth_method 0 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff02e7b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff02e7b9640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff02e7b9640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.284+0000 7ff02dfb8640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff0280748e0 0x7ff02815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02d7b7640 10 monclient(hunting): get_auth_request con 0x7ff0280c92b0 auth_method 0 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02d7b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02d7b7640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02d7b7640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.287 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02dfb8640 10 monclient(hunting): get_auth_request con 0x7ff0280748e0 auth_method 0 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02dfb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02dfb8640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02dfb8640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02e7b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02e7b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02e7b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02d7b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02d7b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02d7b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02dfb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02dfb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.285+0000 7ff02dfb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.288 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 10 monclient(hunting): handle_auth_done global_id 5330 payload 824 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 1 -- 10.20.193.45:0/3432652862 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0280c92b0 msgr2=0x7ff028072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0280c92b0 0x7ff028072490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 1 -- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff0280748e0 msgr2=0x7ff02815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff0280748e0 0x7ff02815b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 10 monclient: _finish_hunting 0 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 1 monclient: found mon.noname-c 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.286+0000 7ff02e7b9640 1 -- 10.20.193.45:0/3432652862 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff028072bb0 con 0x7ff02815d1e0 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.287+0000 7ff02e7b9640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 0x7ff02815c6c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff02400cc80 tx=0x7ff02400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.287+0000 7ff0167fc640 10 client.?.objecter ms_handle_connect 0x7ff02815d1e0 2026-02-17T21:12:27.289 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.287+0000 7ff0167fc640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:27.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff0167fc640 1 -- 10.20.193.45:0/3432652862 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024003a70 con 0x7ff02815d1e0 2026-02-17T21:12:27.291 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff0167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff0167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff0167fc640 10 monclient: dump: 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.292 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff0167fc640 10 monclient: _finish_auth 0 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff0167fc640 10 monclient: _check_auth_tickets 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff0167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 5 monclient: authenticate success, global_id 5330 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 10 monclient: _renew_subs 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff028072e90 con 0x7ff02815d1e0 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 10 client.5330.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 10 monclient: _renew_subs 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.293 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff028073450 con 0x7ff02815d1e0 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 1 librados: init done 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.288+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff02815d5c0 con 0x7ff02815d1e0 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.289+0000 7ff0167fc640 1 -- 10.20.193.45:0/3432652862 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff024003c10 con 0x7ff02815d1e0 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.289+0000 7ff0167fc640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.289+0000 7ff0167fc640 1 -- 10.20.193.45:0/3432652862 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0240050d0 con 0x7ff02815d1e0 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.289+0000 7ff0167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.289+0000 7ff0167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:27.294 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.289+0000 7ff0167fc640 10 monclient: dump: 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.295 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.289+0000 7ff017fff640 4 set_mon_vals no callback set 2026-02-17T21:12:27.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.393+0000 7ff0167fc640 1 -- 10.20.193.45:0/3432652862 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7ff024005270 con 0x7ff02815d1e0 2026-02-17T21:12:27.386 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.394+0000 7ff0167fc640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feff8079280 0x7feff807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.394+0000 7ff02dfb8640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feff8079280 0x7feff807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.394+0000 7ff02dfb8640 10 monclient: get_auth_request con 0x7feff8079280 auth_method 0 2026-02-17T21:12:27.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.394+0000 7ff0167fc640 10 client.5330.objecter ms_handle_connect 0x7feff8079280 2026-02-17T21:12:27.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.394+0000 7ff02dfb8640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feff8079280 0x7feff807b740 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff018039000 tx=0x7ff018033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.387 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.395+0000 7ff0167fc640 1 -- 10.20.193.45:0/3432652862 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7ff02405eb50 con 0x7ff02815d1e0 2026-02-17T21:12:27.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.395+0000 7ff0167fc640 10 client.5330.objecter ms_dispatch2 0x7ff028000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:27.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.395+0000 7ff0167fc640 3 client.5330.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:27.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.395+0000 7ff0167fc640 3 client.5330.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:27.388 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.395+0000 7ff0167fc640 20 client.5330.objecter dump_active .. 0 homeless 2026-02-17T21:12:27.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.401+0000 7ff0167fc640 1 -- 10.20.193.45:0/3432652862 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff024062b10 con 0x7ff02815d1e0 2026-02-17T21:12:27.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.401+0000 7ff0167fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:27.394 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.401+0000 7ff0167fc640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:27.476 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.484+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff02814f5c0 con 0x7feff8079280 2026-02-17T21:12:27.477 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.484+0000 7ff0167fc640 1 -- 10.20.193.45:0/3432652862 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff02814f5c0 con 0x7feff8079280 2026-02-17T21:12:27.477 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 7 to deep-scrub 2026-02-17T21:12:27.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 10 librados: watch_flush enter 2026-02-17T21:12:27.478 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 10 librados: watch_flush exit 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 20 client.5330.objecter shutdown clearing up homeless session... 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 10 client.5330.objecter successfully canceled tick 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feff8079280 msgr2=0x7feff807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feff8079280 0x7feff807b740 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff018039000 tx=0x7ff018033000 comp rx=0 tx=0).stop 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 10 monclient: shutdown 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 msgr2=0x7ff02815c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 0x7ff02815c6c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff02400cc80 tx=0x7ff02400a430 comp rx=0 tx=0).stop 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 shutdown_connections 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7feff8079280 0x7feff807b740 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.479 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff02815d1e0 0x7ff02815c6c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7ff0280c92b0 0x7ff028072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 --2- 10.20.193.45:0/3432652862 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7ff0280748e0 0x7ff02815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 >> 10.20.193.45:0/3432652862 conn(0x7ff0280c9d40 msgr2=0x7ff02814e010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 shutdown_connections 2026-02-17T21:12:27.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 -- 10.20.193.45:0/3432652862 wait complete. 2026-02-17T21:12:27.480 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.485+0000 7ff030243640 1 librados: shutdown 2026-02-17T21:12:27.486 INFO:tasks.ceph:Scrubbing osd.11 2026-02-17T21:12:27.486 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:27.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.562+0000 7fbb5eab7640 10 monclient: get_monmap_and_config 2026-02-17T21:12:27.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.562+0000 7fbb5eab7640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.555 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.562+0000 7fbb5eab7640 10 monclient: monmap: 2026-02-17T21:12:27.555 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.555 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:27.563669+0000 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:27.563669+0000 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:27.556 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 1 Processor -- start 2026-02-17T21:12:27.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 1 -- start start 2026-02-17T21:12:27.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 10 monclient: init 2026-02-17T21:12:27.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 10 monclient: _add_conns ranks=[1,4,0,5,2,3] 2026-02-17T21:12:27.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7fbb581503c0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:27.559 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7fbb5815d020 0x7fbb5815d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 10 monclient(hunting): picked mon.noname-b con 0x7fbb5815d020 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbb580c4740 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb580c55a0 con 0x7fbb580c4740 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb580c52c0 con 0x7fbb581503c0 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7fbb58159c40 con 0x7fbb5815d020 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.563+0000 7fbb5eab7640 10 monclient(hunting): authenticate will time out at 1331.193883s 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.564+0000 7fbb5d02d640 1 --1- >> v1:10.20.193.45:6789/0 conn(0x7fbb580c4740 0x7fbb580c6a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.45:6789/0 says I am v1:10.20.193.45:40496/0 (socket says 10.20.193.45:40496) 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.564+0000 7fbb5d02d640 1 -- 10.20.193.45:0/2416847588 learned_addr learned my addr 10.20.193.45:0/2416847588 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.564+0000 7fbb4ffff640 1 --2- 10.20.193.45:0/2416847588 >> v2:10.20.193.86:3300/0 conn(0x7fbb5815d020 0x7fbb5815d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.560 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.564+0000 7fbb4ffff640 10 monclient(hunting): get_auth_request con 0x7fbb5815d020 auth_method 0 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.564+0000 7fbb4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.564+0000 7fbb4ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.564+0000 7fbb4ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.565+0000 7fbb4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.565+0000 7fbb4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.565+0000 7fbb4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.565+0000 7fbb4f7fe640 1 -- 10.20.193.45:0/2416847588 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009593618 0 0) 0x7fbb54002ca0 con 0x7fbb580c4740 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.565+0000 7fbb4f7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.565+0000 7fbb4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.565+0000 7fbb4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.565+0000 7fbb4f7fe640 10 monclient(hunting): my global_id is 5247 2026-02-17T21:12:27.561 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.565+0000 7fbb4f7fe640 1 -- 10.20.193.45:0/2416847588 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb44003620 con 0x7fbb580c4740 2026-02-17T21:12:27.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.566+0000 7fbb4ffff640 10 monclient(hunting): handle_auth_done global_id 5293 payload 274 2026-02-17T21:12:27.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.566+0000 7fbb4ffff640 1 -- 10.20.193.45:0/2416847588 >> v1:10.20.193.86:6789/0 conn(0x7fbb581503c0 legacy=0x7fbb5806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.566+0000 7fbb4ffff640 1 -- 10.20.193.45:0/2416847588 >> v1:10.20.193.45:6789/0 conn(0x7fbb580c4740 legacy=0x7fbb580c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.566+0000 7fbb4ffff640 10 monclient: _finish_hunting 0 2026-02-17T21:12:27.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.566+0000 7fbb4ffff640 1 monclient: found mon.noname-b 2026-02-17T21:12:27.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.566+0000 7fbb4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:27.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.566+0000 7fbb4ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:27.562 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.566+0000 7fbb4ffff640 1 -- 10.20.193.45:0/2416847588 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb58159f20 con 0x7fbb5815d020 2026-02-17T21:12:27.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.568+0000 7fbb4ffff640 1 --2- 10.20.193.45:0/2416847588 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbb5815d020 0x7fbb5815d490 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb400098a0 tx=0x7fbb4002ef00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6a72c2a37f0429 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 1 -- 10.20.193.45:0/2416847588 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4003c070 con 0x7fbb5815d020 2026-02-17T21:12:27.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:27.567 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 10 monclient: dump: 2026-02-17T21:12:27.567 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.567 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.567 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.567 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 1 -- 10.20.193.45:0/2416847588 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4002fc10 con 0x7fbb5815d020 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:27.568 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 1 -- 10.20.193.45:0/2416847588 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40037440 con 0x7fbb5815d020 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb4f7fe640 10 monclient: dump: 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.569 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 5 monclient: authenticate success, global_id 5293 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 4 set_mon_vals no callback set 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 10 monclient: shutdown 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 1 -- 10.20.193.45:0/2416847588 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbb5815d020 msgr2=0x7fbb5815d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 1 --2- 10.20.193.45:0/2416847588 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbb5815d020 0x7fbb5815d490 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb400098a0 tx=0x7fbb4002ef00 comp rx=0 tx=0).stop 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 1 -- 10.20.193.45:0/2416847588 shutdown_connections 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 1 --2- 10.20.193.45:0/2416847588 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbb5815d020 0x7fbb5815d490 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 1 -- 10.20.193.45:0/2416847588 >> 10.20.193.45:0/2416847588 conn(0x7fbb580cd520 msgr2=0x7fbb580cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.570 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 1 -- 10.20.193.45:0/2416847588 shutdown_connections 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.570+0000 7fbb5eab7640 1 -- 10.20.193.45:0/2416847588 wait complete. 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.571+0000 7fbb5eab7640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.571+0000 7fbb5eab7640 10 monclient: monmap: 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:27.571 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.571+0000 7fbb5eab7640 1 librados: starting msgr at 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.571+0000 7fbb5eab7640 1 librados: starting objecter 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.571+0000 7fbb5eab7640 1 Processor -- start 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.571+0000 7fbb5eab7640 1 -- start start 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.571+0000 7fbb5eab7640 1 librados: setting wanted keys 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.571+0000 7fbb5eab7640 1 librados: calling monclient init 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.571+0000 7fbb5eab7640 10 monclient: init 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbb580c4740 0x7fbb58144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient(hunting): picked mon.noname-a con 0x7fbb580c4740 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbb581503c0 0x7fbb581f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.572 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient(hunting): picked mon.noname-c con 0x7fbb581503c0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbb5815d020 0x7fbb5814f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient(hunting): picked mon.noname-b con 0x7fbb5815d020 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbb580704d0 con 0x7fbb580c4740 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5815a4e0 con 0x7fbb5815d020 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581507a0 con 0x7fbb581503c0 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5eab7640 10 monclient(hunting): authenticate will time out at 1331.202172s 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5d02d640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbb5815d020 0x7fbb5814f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbb580c4740 0x7fbb58144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.573 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb4ffff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbb581503c0 0x7fbb581f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbb580c4740 0x7fbb58144ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36820/0 (socket says 10.20.193.45:36820) 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 1 -- 10.20.193.45:0/295905357 learned_addr learned my addr 10.20.193.45:0/295905357 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 10 monclient(hunting): get_auth_request con 0x7fbb580c4740 auth_method 0 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5d02d640 10 monclient(hunting): get_auth_request con 0x7fbb5815d020 auth_method 0 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5d02d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5d02d640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5d02d640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb4ffff640 10 monclient(hunting): get_auth_request con 0x7fbb581503c0 auth_method 0 2026-02-17T21:12:27.574 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb4ffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb4ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5c82c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5d02d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.572+0000 7fbb5d02d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.573+0000 7fbb5d02d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.573+0000 7fbb4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.573+0000 7fbb4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.573+0000 7fbb4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 10 monclient(hunting): handle_auth_done global_id 5250 payload 824 2026-02-17T21:12:27.575 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 1 -- 10.20.193.45:0/295905357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbb581503c0 msgr2=0x7fbb581f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbb581503c0 0x7fbb581f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 1 -- 10.20.193.45:0/295905357 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbb5815d020 msgr2=0x7fbb5814f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7fbb5815d020 0x7fbb5814f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 10 monclient: _finish_hunting 0 2026-02-17T21:12:27.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 1 monclient: found mon.noname-a 2026-02-17T21:12:27.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:27.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:27.576 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.574+0000 7fbb5c82c640 1 -- 10.20.193.45:0/295905357 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb581453e0 con 0x7fbb580c4740 2026-02-17T21:12:27.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.575+0000 7fbb5c82c640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbb580c4740 0x7fbb58144ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c700 tx=0x7fbb4800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.575+0000 7fbb4d7fa640 10 client.?.objecter ms_handle_connect 0x7fbb580c4740 2026-02-17T21:12:27.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.575+0000 7fbb4d7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:27.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 1 -- 10.20.193.45:0/295905357 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb480052d0 con 0x7fbb580c4740 2026-02-17T21:12:27.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.578 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 10 monclient: dump: 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.579 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 1 -- 10.20.193.45:0/295905357 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb48005470 con 0x7fbb580c4740 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 1 -- 10.20.193.45:0/295905357 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb480038d0 con 0x7fbb580c4740 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4d7fa640 10 monclient: dump: 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.580 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb5eab7640 5 monclient: authenticate success, global_id 5250 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb4effd640 4 set_mon_vals no callback set 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb5eab7640 10 monclient: _renew_subs 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb5eab7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb581f7b70 con 0x7fbb580c4740 2026-02-17T21:12:27.581 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb5eab7640 10 client.5250.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb5eab7640 10 monclient: _renew_subs 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb5eab7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb581f8130 con 0x7fbb580c4740 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.577+0000 7fbb5eab7640 1 librados: init done 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.578+0000 7fbb5eab7640 10 client.5250.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.578+0000 7fbb5eab7640 15 client.5250.objecter _session_command_op_assign -1 1 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.578+0000 7fbb5eab7640 20 client.5250.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.578+0000 7fbb5eab7640 10 client.5250.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.578+0000 7fbb5eab7640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:27.582 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.578+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb580c65e0 con 0x7fbb580c4740 2026-02-17T21:12:27.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.589+0000 7fbb4d7fa640 1 -- 10.20.193.45:0/295905357 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7fbb48003a70 con 0x7fbb580c4740 2026-02-17T21:12:27.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.589+0000 7fbb4d7fa640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbb280792d0 0x7fbb2807b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.589+0000 7fbb4ffff640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbb280792d0 0x7fbb2807b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.589+0000 7fbb4ffff640 10 monclient: get_auth_request con 0x7fbb280792d0 auth_method 0 2026-02-17T21:12:27.583 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.590+0000 7fbb4d7fa640 10 client.5250.objecter ms_handle_connect 0x7fbb280792d0 2026-02-17T21:12:27.584 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.590+0000 7fbb4ffff640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbb280792d0 0x7fbb2807b790 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbb40039000 tx=0x7fbb40033000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 1 -- 10.20.193.45:0/295905357 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7fbb4805e380 con 0x7fbb580c4740 2026-02-17T21:12:27.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 10 client.5250.objecter ms_dispatch2 0x7fbb58000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:27.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 3 client.5250.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:27.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 3 client.5250.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:27.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 10 client.5250.objecter checking command 1 2026-02-17T21:12:27.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fbb280817b0 0x7fbb28083bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.585 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 20 client.5250.objecter _get_session s=0x7fbb280810e0 osd=11 3 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 20 client.5250.objecter put_session s=0x7fbb280810e0 osd=11 3 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 15 client.5250.objecter _session_command_op_remove -1 1 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 20 client.5250.objecter _get_session s=0x7fbb280810e0 osd=11 3 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 20 client.5250.objecter get_session s=0x7fbb280810e0 osd=11 3 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 15 client.5250.objecter _session_command_op_assign 11 1 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 20 client.5250.objecter put_session s=0x7fbb280810e0 osd=11 4 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 10 client.5250.objecter _send_command 1 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 1 -- 10.20.193.45:0/295905357 --> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb280842a0 con 0x7fbb280817b0 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.591+0000 7fbb4d7fa640 20 client.5250.objecter dump_active .. 0 homeless 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.592+0000 7fbb5d02d640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fbb280817b0 0x7fbb28083bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.592+0000 7fbb4d7fa640 1 -- 10.20.193.45:0/295905357 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbb4805e740 con 0x7fbb580c4740 2026-02-17T21:12:27.586 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.592+0000 7fbb4d7fa640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:27.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.592+0000 7fbb5d02d640 10 monclient: get_auth_request con 0x7fbb280817b0 auth_method 0 2026-02-17T21:12:27.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.594+0000 7fbb4d7fa640 10 client.5250.objecter ms_handle_connect 0x7fbb280817b0 2026-02-17T21:12:27.587 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.594+0000 7fbb5d02d640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fbb280817b0 0x7fbb28083bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.603+0000 7fbb4d7fa640 1 -- 10.20.193.45:0/295905357 <== osd.11 v2:10.20.193.138:6824/4038031379 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fbb280842a0 con 0x7fbb280817b0 2026-02-17T21:12:27.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.603+0000 7fbb4d7fa640 10 client.5250.objecter ms_dispatch2 0x7fbb58000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:27.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.603+0000 7fbb4d7fa640 10 client.5250.objecter _finish_command 1 = system:0 2026-02-17T21:12:27.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.603+0000 7fbb4d7fa640 20 client.5250.objecter put_session s=0x7fbb280810e0 osd=11 4 2026-02-17T21:12:27.596 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.603+0000 7fbb4d7fa640 15 client.5250.objecter _session_command_op_remove 11 1 2026-02-17T21:12:27.602 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 10 client.5250.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 15 client.5250.objecter _session_command_op_assign -1 2 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 20 client.5250.objecter _get_session s=0x7fbb280810e0 osd=11 3 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 20 client.5250.objecter put_session s=0x7fbb280810e0 osd=11 3 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 20 client.5250.objecter _get_session s=0x7fbb280810e0 osd=11 3 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 15 client.5250.objecter _session_command_op_remove -1 2 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 20 client.5250.objecter get_session s=0x7fbb280810e0 osd=11 3 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 15 client.5250.objecter _session_command_op_assign 11 2 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 20 client.5250.objecter put_session s=0x7fbb280810e0 osd=11 4 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 10 client.5250.objecter _send_command 2 2026-02-17T21:12:27.603 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.610+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 --> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbb5815d490 con 0x7fbb280817b0 2026-02-17T21:12:27.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.617+0000 7fbb4d7fa640 1 -- 10.20.193.45:0/295905357 <== osd.11 v2:10.20.193.138:6824/4038031379 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbb5815d490 con 0x7fbb280817b0 2026-02-17T21:12:27.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.617+0000 7fbb4d7fa640 10 client.5250.objecter ms_dispatch2 0x7fbb58000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:27.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.617+0000 7fbb4d7fa640 10 client.5250.objecter _finish_command 2 = system:0 2026-02-17T21:12:27.610 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.617+0000 7fbb4d7fa640 20 client.5250.objecter put_session s=0x7fbb280810e0 osd=11 4 2026-02-17T21:12:27.611 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.617+0000 7fbb4d7fa640 15 client.5250.objecter _session_command_op_remove 11 2 2026-02-17T21:12:27.611 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:27.611 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:27.611 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:27.612 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 10 librados: watch_flush enter 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 10 librados: watch_flush exit 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 10 client.5250.objecter close_session for osd.11 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fbb280817b0 msgr2=0x7fbb28083bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.138:6824/4038031379,v1:10.20.193.138:6825/4038031379] conn(0x7fbb280817b0 0x7fbb28083bd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 20 client.5250.objecter put_session s=0x7fbb280810e0 osd=11 1 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 20 client.5250.objecter shutdown clearing up homeless session... 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 10 client.5250.objecter successfully canceled tick 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbb280792d0 msgr2=0x7fbb2807b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7fbb280792d0 0x7fbb2807b790 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbb40039000 tx=0x7fbb40033000 comp rx=0 tx=0).stop 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 10 monclient: shutdown 2026-02-17T21:12:27.613 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbb580c4740 msgr2=0x7fbb58144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 --2- 10.20.193.45:0/295905357 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7fbb580c4740 0x7fbb58144ea0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800c700 tx=0x7fbb4800cbd0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5d02d640 1 -- 10.20.193.45:0/295905357 reap_dead start 2026-02-17T21:12:27.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 shutdown_connections 2026-02-17T21:12:27.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 >> 10.20.193.45:0/295905357 conn(0x7fbb580cd520 msgr2=0x7fbb5806b600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 shutdown_connections 2026-02-17T21:12:27.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 -- 10.20.193.45:0/295905357 wait complete. 2026-02-17T21:12:27.614 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.618+0000 7fbb5eab7640 1 librados: shutdown 2026-02-17T21:12:27.618 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-17T21:12:27.687 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.695+0000 7f54febc3640 10 monclient: get_monmap_and_config 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.695+0000 7f54febc3640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.695+0000 7f54febc3640 10 monclient: monmap: 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:27.696197+0000 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:27.696197+0000 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:27.688 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:27.689 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:27.689 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:27.689 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:27.689 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:27.689 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.695+0000 7f54febc3640 1 Processor -- start 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.695+0000 7f54febc3640 1 -- start start 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.695+0000 7f54febc3640 10 monclient: init 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 10 monclient: _add_conns ranks=[1,2,4,5,0,3] 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f54f815d1e0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f54f80c92b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f54f8153d20 0x7f54f815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 10 monclient(hunting): picked mon.noname-b con 0x7f54f8153d20 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:27.692 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f80c5860 con 0x7f54f815d1e0 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f80c5580 con 0x7f54f80c92b0 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f54f80c7de0 con 0x7f54f8153d20 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.696+0000 7f54febc3640 10 monclient(hunting): authenticate will time out at 1331.326585s 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54effff640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f54f80c92b0 0x7f54f8153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45576/0 (socket says 10.20.193.45:45576) 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54effff640 1 -- 10.20.193.45:0/1460851176 learned_addr learned my addr 10.20.193.45:0/1460851176 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54fd139640 1 --2- 10.20.193.45:0/1460851176 >> v2:10.20.193.86:3300/0 conn(0x7f54f8153d20 0x7f54f815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54fd139640 10 monclient(hunting): get_auth_request con 0x7f54f8153d20 auth_method 0 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54fd139640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54fd139640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.693 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54fd139640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54fd139640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54fd139640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.697+0000 7f54fd139640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54ef7fe640 1 -- 10.20.193.45:0/1460851176 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388739251 0 0) 0x7f54f80c5580 con 0x7f54f80c92b0 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54ef7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54ef7fe640 10 monclient(hunting): my global_id is 5336 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54ef7fe640 1 -- 10.20.193.45:0/1460851176 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54e4003620 con 0x7f54f80c92b0 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54fd139640 10 monclient(hunting): handle_auth_done global_id 5299 payload 274 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54fd139640 1 -- 10.20.193.45:0/1460851176 >> v1:10.20.193.92:6789/0 conn(0x7f54f80c92b0 legacy=0x7f54f8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54fd139640 1 -- 10.20.193.45:0/1460851176 >> v1:10.20.193.86:6789/0 conn(0x7f54f815d1e0 legacy=0x7f54f80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.694 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54fd139640 10 monclient: _finish_hunting 0 2026-02-17T21:12:27.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54fd139640 1 monclient: found mon.noname-b 2026-02-17T21:12:27.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54fd139640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:27.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54fd139640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:27.695 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.698+0000 7f54fd139640 1 -- 10.20.193.45:0/1460851176 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f80c80c0 con 0x7f54f8153d20 2026-02-17T21:12:27.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.700+0000 7f54fd139640 1 --2- 10.20.193.45:0/1460851176 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f8153d20 0x7f54f815d5c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009dc0 tx=0x7f54f402f280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd17addfe6d5459d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 1 -- 10.20.193.45:0/1460851176 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f403c070 con 0x7f54f8153d20 2026-02-17T21:12:27.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:27.700 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 10 monclient: dump: 2026-02-17T21:12:27.700 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.700 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:27.701 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 1 -- 10.20.193.45:0/1460851176 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4037440 con 0x7f54f8153d20 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 5 monclient: authenticate success, global_id 5299 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 1 -- 10.20.193.45:0/1460851176 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4037810 con 0x7f54f8153d20 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 4 set_mon_vals no callback set 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54ef7fe640 10 monclient: dump: 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.702 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 10 monclient: shutdown 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 1 -- 10.20.193.45:0/1460851176 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f8153d20 msgr2=0x7f54f815d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 1 --2- 10.20.193.45:0/1460851176 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f8153d20 0x7f54f815d5c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009dc0 tx=0x7f54f402f280 comp rx=0 tx=0).stop 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 1 -- 10.20.193.45:0/1460851176 shutdown_connections 2026-02-17T21:12:27.703 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 1 --2- 10.20.193.45:0/1460851176 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f8153d20 0x7f54f815d5c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 1 -- 10.20.193.45:0/1460851176 >> 10.20.193.45:0/1460851176 conn(0x7f54f80c9d40 msgr2=0x7f54f80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.702+0000 7f54febc3640 1 -- 10.20.193.45:0/1460851176 shutdown_connections 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 1 -- 10.20.193.45:0/1460851176 wait complete. 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 10 monclient: monmap: 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:27.704 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 1 librados: starting msgr at 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 1 librados: starting objecter 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 1 Processor -- start 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 1 -- start start 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 1 librados: setting wanted keys 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 1 librados: calling monclient init 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.703+0000 7f54febc3640 10 monclient: init 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54f80c92b0 0x7f54f81f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.705 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient(hunting): picked mon.noname-c con 0x7f54f80c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54f8153d20 0x7f54f8073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient(hunting): picked mon.noname-a con 0x7f54f8153d20 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f815d1e0 0x7f54f8073b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient(hunting): picked mon.noname-b con 0x7f54f815d1e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54f80748e0 con 0x7f54f8153d20 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f54f80c8680 con 0x7f54f815d1e0 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54f8074a60 con 0x7f54f80c92b0 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54febc3640 10 monclient(hunting): authenticate will time out at 1331.334204s 2026-02-17T21:12:27.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fc938640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54f80c92b0 0x7f54f81f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54effff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54f8153d20 0x7f54f8073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fd139640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f815d1e0 0x7f54f8073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fc938640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54f80c92b0 0x7f54f81f4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35286/0 (socket says 10.20.193.45:35286) 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fc938640 1 -- 10.20.193.45:0/19891177 learned_addr learned my addr 10.20.193.45:0/19891177 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fc938640 10 monclient(hunting): get_auth_request con 0x7f54f80c92b0 auth_method 0 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fc938640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fc938640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fc938640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fd139640 10 monclient(hunting): get_auth_request con 0x7f54f815d1e0 auth_method 0 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fd139640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fd139640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.707 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fd139640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54effff640 10 monclient(hunting): get_auth_request con 0x7f54f8153d20 auth_method 0 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54effff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fd139640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fd139640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fd139640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fc938640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.704+0000 7f54fc938640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.705+0000 7f54fc938640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.705+0000 7f54effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.705+0000 7f54effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.705+0000 7f54effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 10 monclient(hunting): handle_auth_done global_id 5305 payload 824 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 1 -- 10.20.193.45:0/19891177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54f80c92b0 msgr2=0x7f54f81f4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54f80c92b0 0x7f54f81f4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 1 -- 10.20.193.45:0/19891177 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54f8153d20 msgr2=0x7f54f8073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54f8153d20 0x7f54f8073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 10 monclient: _finish_hunting 0 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 1 monclient: found mon.noname-b 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.706+0000 7f54fd139640 1 -- 10.20.193.45:0/19891177 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f81571b0 con 0x7f54f815d1e0 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.707+0000 7f54fd139640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f815d1e0 0x7f54f8073b60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f54f4036000 tx=0x7f54f4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.707+0000 7f54ed7fa640 10 client.?.objecter ms_handle_connect 0x7f54f815d1e0 2026-02-17T21:12:27.709 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.707+0000 7f54ed7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:27.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54ed7fa640 1 -- 10.20.193.45:0/19891177 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f403c050 con 0x7f54f815d1e0 2026-02-17T21:12:27.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54ed7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:27.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54ed7fa640 10 monclient: dump: 2026-02-17T21:12:27.711 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.711 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54ed7fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54ed7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:27.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54febc3640 5 monclient: authenticate success, global_id 5305 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54febc3640 10 monclient: _renew_subs 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54febc3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f80725c0 con 0x7f54f815d1e0 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54febc3640 10 client.5305.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54febc3640 10 monclient: _renew_subs 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54febc3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f8072b40 con 0x7f54f815d1e0 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.708+0000 7f54febc3640 1 librados: init done 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54febc3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54febc3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54febc3640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f815d5c0 con 0x7f54f815d1e0 2026-02-17T21:12:27.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54ed7fa640 1 -- 10.20.193.45:0/19891177 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4048070 con 0x7f54f815d1e0 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54ed7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54ed7fa640 1 -- 10.20.193.45:0/19891177 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4041a10 con 0x7f54f815d1e0 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54ed7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54eeffd640 4 set_mon_vals no callback set 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.709+0000 7f54ed7fa640 10 monclient: dump: 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.714 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.715 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.715 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.715 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.715 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.720+0000 7f54ed7fa640 1 -- 10.20.193.45:0/19891177 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f54f4041bb0 con 0x7f54f815d1e0 2026-02-17T21:12:27.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.720+0000 7f54ed7fa640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54c8079280 0x7f54c807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.721+0000 7f54fc938640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54c8079280 0x7f54c807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.721+0000 7f54fc938640 10 monclient: get_auth_request con 0x7f54c8079280 auth_method 0 2026-02-17T21:12:27.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.721+0000 7f54ed7fa640 10 client.5305.objecter ms_handle_connect 0x7f54c8079280 2026-02-17T21:12:27.716 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.721+0000 7f54fc938640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54c8079280 0x7f54c807b740 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f54e8002770 tx=0x7f54e8002990 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.723+0000 7f54ed7fa640 1 -- 10.20.193.45:0/19891177 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f54f40be130 con 0x7f54f815d1e0 2026-02-17T21:12:27.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.723+0000 7f54ed7fa640 10 client.5305.objecter ms_dispatch2 0x7f54f8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:27.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.723+0000 7f54ed7fa640 3 client.5305.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:27.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.723+0000 7f54ed7fa640 3 client.5305.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:27.717 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.723+0000 7f54ed7fa640 20 client.5305.objecter dump_active .. 0 homeless 2026-02-17T21:12:27.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.826+0000 7f54ed7fa640 1 -- 10.20.193.45:0/19891177 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f54f40886c0 con 0x7f54f815d1e0 2026-02-17T21:12:27.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.826+0000 7f54ed7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:27.819 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.826+0000 7f54ed7fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:27.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.908+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7f54f8154840 con 0x7f54c8079280 2026-02-17T21:12:27.900 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.908+0000 7f54ed7fa640 1 -- 10.20.193.45:0/19891177 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f54f8154840 con 0x7f54c8079280 2026-02-17T21:12:27.901 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 11 to deep-scrub 2026-02-17T21:12:27.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 10 librados: watch_flush enter 2026-02-17T21:12:27.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 10 librados: watch_flush exit 2026-02-17T21:12:27.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 20 client.5305.objecter shutdown clearing up homeless session... 2026-02-17T21:12:27.902 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 10 client.5305.objecter successfully canceled tick 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54c8079280 msgr2=0x7f54c807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54c8079280 0x7f54c807b740 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f54e8002770 tx=0x7f54e8002990 comp rx=0 tx=0).stop 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 10 monclient: shutdown 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f815d1e0 msgr2=0x7f54f8073b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f815d1e0 0x7f54f8073b60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f54f4036000 tx=0x7f54f4004b40 comp rx=0 tx=0).stop 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 shutdown_connections 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f54c8079280 0x7f54c807b740 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f54f815d1e0 0x7f54f8073b60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f54f8153d20 0x7f54f8073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.903 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 --2- 10.20.193.45:0/19891177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54f80c92b0 0x7f54f81f4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 >> 10.20.193.45:0/19891177 conn(0x7f54f80c9d40 msgr2=0x7f54f81e8160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 shutdown_connections 2026-02-17T21:12:27.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 -- 10.20.193.45:0/19891177 wait complete. 2026-02-17T21:12:27.904 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.909+0000 7f54febc3640 1 librados: shutdown 2026-02-17T21:12:27.910 INFO:tasks.ceph:Scrubbing osd.15 2026-02-17T21:12:27.910 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-17T21:12:27.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.987+0000 7f3bdec56640 10 monclient: get_monmap_and_config 2026-02-17T21:12:27.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.987+0000 7f3bdec56640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.980 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.987+0000 7f3bdec56640 10 monclient: monmap: 2026-02-17T21:12:27.980 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:27.988764+0000 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:27.988764+0000 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:27.981 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 1 Processor -- start 2026-02-17T21:12:27.984 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 1 -- start start 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 10 monclient: init 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 10 monclient: _add_conns ranks=[1,2,4,0,3,5] 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f3bd81503c0 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3bd815d020 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f3bd815d490 0x7f3bd80c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 10 monclient(hunting): picked mon.noname-b con 0x7f3bd815d490 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd80c55a0 con 0x7f3bd81503c0 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd80c52c0 con 0x7f3bd815d020 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.985 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd8159c40 con 0x7f3bd815d490 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.988+0000 7f3bdec56640 10 monclient(hunting): authenticate will time out at 1331.618930s 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.989+0000 7f3bcffff640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f3bd815d020 0x7f3bd80c4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:45578/0 (socket says 10.20.193.45:45578) 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.989+0000 7f3bcffff640 1 -- 10.20.193.45:0/2037858309 learned_addr learned my addr 10.20.193.45:0/2037858309 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.989+0000 7f3bdd1cc640 1 --2- 10.20.193.45:0/2037858309 >> v2:10.20.193.86:3300/0 conn(0x7f3bd815d490 0x7f3bd80c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.989+0000 7f3bdd1cc640 10 monclient(hunting): get_auth_request con 0x7f3bd815d490 auth_method 0 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.989+0000 7f3bdd1cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.989+0000 7f3bdd1cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.989+0000 7f3bdd1cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.990+0000 7f3bdd1cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.990+0000 7f3bdd1cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:27.986 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.990+0000 7f3bdd1cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.990+0000 7f3bcf7fe640 1 -- 10.20.193.45:0/2037858309 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 403661185 0 0) 0x7f3bd80c52c0 con 0x7f3bd815d020 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.990+0000 7f3bcf7fe640 10 monclient(hunting): _negotiate 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.990+0000 7f3bcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.990+0000 7f3bcf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.990+0000 7f3bcf7fe640 10 monclient(hunting): my global_id is 5342 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.990+0000 7f3bcf7fe640 1 -- 10.20.193.45:0/2037858309 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bc4003620 con 0x7f3bd815d020 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.991+0000 7f3bdd1cc640 10 monclient(hunting): handle_auth_done global_id 5308 payload 274 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.991+0000 7f3bdd1cc640 1 -- 10.20.193.45:0/2037858309 >> v1:10.20.193.92:6789/0 conn(0x7f3bd815d020 legacy=0x7f3bd80c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.991+0000 7f3bdd1cc640 1 -- 10.20.193.45:0/2037858309 >> v1:10.20.193.86:6789/0 conn(0x7f3bd81503c0 legacy=0x7f3bd806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.991+0000 7f3bdd1cc640 10 monclient: _finish_hunting 0 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.991+0000 7f3bdd1cc640 1 monclient: found mon.noname-b 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.991+0000 7f3bdd1cc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:27.987 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.991+0000 7f3bdd1cc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:27.988 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.991+0000 7f3bdd1cc640 1 -- 10.20.193.45:0/2037858309 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd8159f20 con 0x7f3bd815d490 2026-02-17T21:12:27.992 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.993+0000 7f3bdd1cc640 1 --2- 10.20.193.45:0/2037858309 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 0x7f3bd80c6a70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009d90 tx=0x7f3bd402f2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deceef79cc601c4d server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 1 -- 10.20.193.45:0/2037858309 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd403c070 con 0x7f3bd815d490 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 10 monclient: dump: 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.993 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 1 -- 10.20.193.45:0/2037858309 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd4037440 con 0x7f3bd815d490 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 1 -- 10.20.193.45:0/2037858309 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4037810 con 0x7f3bd815d490 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bdec56640 5 monclient: authenticate success, global_id 5308 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bdec56640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:27.994 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bdec56640 4 set_mon_vals no callback set 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.995+0000 7f3bcf7fe640 10 monclient: dump: 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:27.995 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 10 monclient: shutdown 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 1 -- 10.20.193.45:0/2037858309 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 msgr2=0x7f3bd80c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 1 --2- 10.20.193.45:0/2037858309 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 0x7f3bd80c6a70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009d90 tx=0x7f3bd402f2c0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 1 -- 10.20.193.45:0/2037858309 shutdown_connections 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 1 --2- 10.20.193.45:0/2037858309 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 0x7f3bd80c6a70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 1 -- 10.20.193.45:0/2037858309 >> 10.20.193.45:0/2037858309 conn(0x7f3bd80cd520 msgr2=0x7f3bd80cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 1 -- 10.20.193.45:0/2037858309 shutdown_connections 2026-02-17T21:12:27.996 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 1 -- 10.20.193.45:0/2037858309 wait complete. 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 10 monclient: build_initial_monmap 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.996+0000 7f3bdec56640 10 monclient: monmap: 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:27.997 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 librados: starting msgr at 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 librados: starting objecter 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 Processor -- start 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 -- start start 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 librados: setting wanted keys 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 librados: calling monclient init 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient: init 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3bd81503c0 0x7f3bd8072770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient(hunting): picked mon.noname-c con 0x7f3bd81503c0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3bd815d020 0x7f3bd8072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient(hunting): picked mon.noname-a con 0x7f3bd815d020 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 0x7f3bd80c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient(hunting): picked mon.noname-b con 0x7f3bd815d490 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd815d870 con 0x7f3bd815d020 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd815a4e0 con 0x7f3bd815d490 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80704d0 con 0x7f3bd81503c0 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdec56640 10 monclient(hunting): authenticate will time out at 1331.627627s 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdd1cc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 0x7f3bd80c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.997+0000 7f3bdc9cb640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3bd81503c0 0x7f3bd8072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:27.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bcffff640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3bd815d020 0x7f3bd8072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdd1cc640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 0x7f3bd80c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.86:3300/0 says I am v2:10.20.193.45:38416/0 (socket says 10.20.193.45:38416) 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdd1cc640 1 -- 10.20.193.45:0/3920641032 learned_addr learned my addr 10.20.193.45:0/3920641032 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdd1cc640 10 monclient(hunting): get_auth_request con 0x7f3bd815d490 auth_method 0 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdd1cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdd1cc640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdd1cc640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdc9cb640 10 monclient(hunting): get_auth_request con 0x7f3bd81503c0 auth_method 0 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdc9cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdc9cb640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdc9cb640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bcffff640 10 monclient(hunting): get_auth_request con 0x7f3bd815d020 auth_method 0 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bcffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bcffff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bcffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdd1cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdd1cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdd1cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdc9cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdc9cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bdc9cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bcffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bcffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.998+0000 7f3bcffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 10 monclient(hunting): handle_auth_done global_id 5314 payload 824 2026-02-17T21:12:28.001 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 1 -- 10.20.193.45:0/3920641032 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3bd81503c0 msgr2=0x7f3bd8072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3bd81503c0 0x7f3bd8072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 1 -- 10.20.193.45:0/3920641032 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3bd815d020 msgr2=0x7f3bd8072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f3bd815d020 0x7f3bd8072cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 10 monclient: _finish_hunting 0 2026-02-17T21:12:28.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 1 monclient: found mon.noname-b 2026-02-17T21:12:28.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:28.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:28.002 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:27.999+0000 7f3bdd1cc640 1 -- 10.20.193.45:0/3920641032 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd814edd0 con 0x7f3bd815d490 2026-02-17T21:12:28.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.000+0000 7f3bdd1cc640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 0x7f3bd80c80e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009d90 tx=0x7f3bd4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:28.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.000+0000 7f3bcd7fa640 10 client.?.objecter ms_handle_connect 0x7f3bd815d490 2026-02-17T21:12:28.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.000+0000 7f3bcd7fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:28.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bcd7fa640 1 -- 10.20.193.45:0/3920641032 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd403c050 con 0x7f3bd815d490 2026-02-17T21:12:28.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bcd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bcd7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bcd7fa640 10 monclient: dump: 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bcd7fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bcd7fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bcd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bdec56640 5 monclient: authenticate success, global_id 5314 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bdec56640 10 monclient: _renew_subs 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bdec56640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.001+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd814f0b0 con 0x7f3bd815d490 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 10 client.5314.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 10 monclient: _renew_subs 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd814f670 con 0x7f3bd815d490 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 1 librados: init done 2026-02-17T21:12:28.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bcd7fa640 1 -- 10.20.193.45:0/3920641032 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd4048070 con 0x7f3bd815d490 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bcd7fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bcd7fa640 1 -- 10.20.193.45:0/3920641032 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4041a10 con 0x7f3bd815d490 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bcd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bcd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bcd7fa640 10 monclient: dump: 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.007 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.008 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.008 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 10 client.5314.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:28.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bceffd640 4 set_mon_vals no callback set 2026-02-17T21:12:28.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 15 client.5314.objecter _session_command_op_assign -1 1 2026-02-17T21:12:28.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 20 client.5314.objecter _get_session osd=-1 returning homeless 2026-02-17T21:12:28.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 10 client.5314.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:28.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:28.008 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.002+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bd8072470 con 0x7f3bd815d490 2026-02-17T21:12:28.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.014+0000 7f3bcd7fa640 1 -- 10.20.193.45:0/3920641032 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f3bd4041bb0 con 0x7f3bd815d490 2026-02-17T21:12:28.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.014+0000 7f3bcd7fa640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ba8079280 0x7f3ba807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.014+0000 7f3bdc9cb640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ba8079280 0x7f3ba807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.010 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.014+0000 7f3bdc9cb640 10 monclient: get_auth_request con 0x7f3ba8079280 auth_method 0 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.014+0000 7f3bcd7fa640 10 client.5314.objecter ms_handle_connect 0x7f3ba8079280 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.014+0000 7f3bdc9cb640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ba8079280 0x7f3ba807b740 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8002770 tx=0x7f3bc8007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 1 -- 10.20.193.45:0/3920641032 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f3bd40be2c0 con 0x7f3bd815d490 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 10 client.5314.objecter ms_dispatch2 0x7f3bd8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 3 client.5314.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 3 client.5314.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 10 client.5314.objecter checking command 1 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f3ba8081760 0x7f3ba8083b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 20 client.5314.objecter _get_session s=0x7f3ba8081090 osd=15 3 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 20 client.5314.objecter put_session s=0x7f3ba8081090 osd=15 3 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 15 client.5314.objecter _session_command_op_remove -1 1 2026-02-17T21:12:28.011 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 20 client.5314.objecter _get_session s=0x7f3ba8081090 osd=15 3 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 20 client.5314.objecter get_session s=0x7f3ba8081090 osd=15 3 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 15 client.5314.objecter _session_command_op_assign 15 1 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 20 client.5314.objecter put_session s=0x7f3ba8081090 osd=15 4 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 10 client.5314.objecter _send_command 1 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 1 -- 10.20.193.45:0/3920641032 --> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bd4037440 con 0x7f3ba8081760 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 20 client.5314.objecter dump_active .. 0 homeless 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 1 -- 10.20.193.45:0/3920641032 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3bd4084cf0 con 0x7f3bd815d490 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.016+0000 7f3bcd7fa640 10 monclient: handle_get_version_reply finishing 1 version 33 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.017+0000 7f3bcffff640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f3ba8081760 0x7f3ba8083b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.017+0000 7f3bcffff640 10 monclient: get_auth_request con 0x7f3ba8081760 auth_method 0 2026-02-17T21:12:28.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.019+0000 7f3bcffff640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f3ba8081760 0x7f3ba8083b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.15 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:28.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.019+0000 7f3bcd7fa640 10 client.5314.objecter ms_handle_connect 0x7f3ba8081760 2026-02-17T21:12:28.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.030+0000 7f3bcd7fa640 1 -- 10.20.193.45:0/3920641032 <== osd.15 v2:10.20.193.138:6816/3769626240 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f3bd4037440 con 0x7f3ba8081760 2026-02-17T21:12:28.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.030+0000 7f3bcd7fa640 10 client.5314.objecter ms_dispatch2 0x7f3bd8000b90 command_reply(tid 1: 0 ) 2026-02-17T21:12:28.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.030+0000 7f3bcd7fa640 10 client.5314.objecter _finish_command 1 = system:0 2026-02-17T21:12:28.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.030+0000 7f3bcd7fa640 20 client.5314.objecter put_session s=0x7f3ba8081090 osd=15 4 2026-02-17T21:12:28.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.030+0000 7f3bcd7fa640 15 client.5314.objecter _session_command_op_remove 15 1 2026-02-17T21:12:28.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 10 client.5314.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-17T21:12:28.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 15 client.5314.objecter _session_command_op_assign -1 2 2026-02-17T21:12:28.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 20 client.5314.objecter _get_session s=0x7f3ba8081090 osd=15 3 2026-02-17T21:12:28.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 20 client.5314.objecter put_session s=0x7f3ba8081090 osd=15 3 2026-02-17T21:12:28.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 20 client.5314.objecter _get_session s=0x7f3ba8081090 osd=15 3 2026-02-17T21:12:28.029 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 15 client.5314.objecter _session_command_op_remove -1 2 2026-02-17T21:12:28.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 20 client.5314.objecter get_session s=0x7f3ba8081090 osd=15 3 2026-02-17T21:12:28.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 15 client.5314.objecter _session_command_op_assign 15 2 2026-02-17T21:12:28.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 20 client.5314.objecter put_session s=0x7f3ba8081090 osd=15 4 2026-02-17T21:12:28.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 10 client.5314.objecter _send_command 2 2026-02-17T21:12:28.030 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.036+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 --> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3bd81507a0 con 0x7f3ba8081760 2026-02-17T21:12:28.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bcd7fa640 1 -- 10.20.193.45:0/3920641032 <== osd.15 v2:10.20.193.138:6816/3769626240 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3bd81507a0 con 0x7f3ba8081760 2026-02-17T21:12:28.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bcd7fa640 10 client.5314.objecter ms_dispatch2 0x7f3bd8000b90 command_reply(tid 2: 0 ) 2026-02-17T21:12:28.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bcd7fa640 10 client.5314.objecter _finish_command 2 = system:0 2026-02-17T21:12:28.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bcd7fa640 20 client.5314.objecter put_session s=0x7f3ba8081090 osd=15 4 2026-02-17T21:12:28.037 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bcd7fa640 15 client.5314.objecter _session_command_op_remove 15 2 2026-02-17T21:12:28.038 INFO:teuthology.orchestra.run.trial045.stdout:{ 2026-02-17T21:12:28.038 INFO:teuthology.orchestra.run.trial045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-17T21:12:28.038 INFO:teuthology.orchestra.run.trial045.stdout:} 2026-02-17T21:12:28.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 10 librados: watch_flush enter 2026-02-17T21:12:28.039 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 10 librados: watch_flush exit 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 10 client.5314.objecter close_session for osd.15 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f3ba8081760 msgr2=0x7f3ba8083b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.138:6816/3769626240,v1:10.20.193.138:6817/3769626240] conn(0x7f3ba8081760 0x7f3ba8083b80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 20 client.5314.objecter put_session s=0x7f3ba8081090 osd=15 1 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 20 client.5314.objecter shutdown clearing up homeless session... 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 10 client.5314.objecter successfully canceled tick 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ba8079280 msgr2=0x7f3ba807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f3ba8079280 0x7f3ba807b740 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8002770 tx=0x7f3bc8007ef0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 10 monclient: shutdown 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:28.040 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 msgr2=0x7f3bd80c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdec56640 1 --2- 10.20.193.45:0/3920641032 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f3bd815d490 0x7f3bd80c80e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009d90 tx=0x7f3bd4004b40 comp rx=0 tx=0).stop 2026-02-17T21:12:28.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.044+0000 7f3bdd1cc640 1 -- 10.20.193.45:0/3920641032 reap_dead start 2026-02-17T21:12:28.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.045+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 shutdown_connections 2026-02-17T21:12:28.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.045+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 >> 10.20.193.45:0/3920641032 conn(0x7f3bd80cd520 msgr2=0x7f3bd814bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:28.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.045+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 shutdown_connections 2026-02-17T21:12:28.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.045+0000 7f3bdec56640 1 -- 10.20.193.45:0/3920641032 wait complete. 2026-02-17T21:12:28.041 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.045+0000 7f3bdec56640 1 librados: shutdown 2026-02-17T21:12:28.045 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-17T21:12:28.111 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.119+0000 7f8afe908640 10 monclient: get_monmap_and_config 2026-02-17T21:12:28.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.119+0000 7f8afe908640 10 monclient: build_initial_monmap 2026-02-17T21:12:28.112 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.119+0000 7f8afe908640 10 monclient: monmap: 2026-02-17T21:12:28.112 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:28.112 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.112 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:28.120292+0000 2026-02-17T21:12:28.112 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:28.120292+0000 2026-02-17T21:12:28.112 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:28.112 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.112 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:28.113 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:28.113 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:28.113 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:28.113 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:28.113 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:28.113 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.115 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.119+0000 7f8afe908640 1 Processor -- start 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.119+0000 7f8afe908640 1 -- start start 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.119+0000 7f8afe908640 10 monclient: init 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 10 monclient: _add_conns ranks=[0,2,1,4,5,3] 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8af815d1e0 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8af80c92b0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 10 monclient(hunting): picked mon.noname-b-legacy con 0x7f8af8153d20 addr v1:10.20.193.86:6789/0 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af80c5860 con 0x7f8af815d1e0 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 1 -- --> v1:10.20.193.86:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af80c5580 con 0x7f8af8153d20 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af80c7de0 con 0x7f8af80c92b0 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:28.116 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afe908640 10 monclient(hunting): authenticate will time out at 1331.750526s 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afce7e640 1 --1- >> v1:10.20.193.86:6789/0 conn(0x7f8af8153d20 0x7f8af80c46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.86:6789/0 says I am v1:10.20.193.45:46884/0 (socket says 10.20.193.45:46884) 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.120+0000 7f8afce7e640 1 -- 10.20.193.45:0/1332072682 learned_addr learned my addr 10.20.193.45:0/1332072682 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 <== mon.1 v1:10.20.193.86:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544970851 0 0) 0x7f8af80c5580 con 0x7f8af8153d20 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): my global_id is 5317 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 --> v1:10.20.193.86:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8adc003620 con 0x7f8af8153d20 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647957452 0 0) 0x7f8af80c7de0 con 0x7f8af80c92b0 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:28.117 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): my global_id is 5348 2026-02-17T21:12:28.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af80c5580 con 0x7f8af80c92b0 2026-02-17T21:12:28.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 <== mon.0 v1:10.20.193.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075384124 0 0) 0x7f8af80c5860 con 0x7f8af815d1e0 2026-02-17T21:12:28.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:28.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 10 monclient(hunting): my global_id is 5259 2026-02-17T21:12:28.118 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.122+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 --> v1:10.20.193.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af80c7de0 con 0x7f8af815d1e0 2026-02-17T21:12:28.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 <== mon.1 v1:10.20.193.86:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4229737688 0 0) 0x7f8adc003620 con 0x7f8af8153d20 2026-02-17T21:12:28.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 >> v1:10.20.193.92:6789/0 conn(0x7f8af80c92b0 legacy=0x7f8af8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 >> v1:10.20.193.45:6789/0 conn(0x7f8af815d1e0 legacy=0x7f8af80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient: _finish_hunting 0 2026-02-17T21:12:28.126 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 monclient: found mon.noname-b-legacy 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:10.20.193.86:6789/0 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 --> v1:10.20.193.86:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af80c80c0 con 0x7f8af8153d20 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient: _finish_auth 0 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 <== mon.1 v1:10.20.193.86:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 369954001 0 0) 0x7f8aec003280 con 0x7f8af8153d20 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient: got monmap 1 from mon.noname-b-legacy (according to old e1) 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient: dump: 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.127 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 monclient: mon.b has (v2) addrs [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] but i'm connected to v1:10.20.193.86:6789/0, reconnecting 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 >> v1:10.20.193.86:6789/0 conn(0x7f8af8153d20 legacy=0x7f8af80c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.128 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8adc003fe0 0x7f8adc004900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient(hunting): picked mon.b con 0x7f8adc003fe0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8adc004e40 0x7f8adc0052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient(hunting): picked mon.a con 0x7f8adc004e40 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8adc009ab0 0x7f8adc00bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient(hunting): picked mon.c con 0x7f8adc009ab0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc00c570 con 0x7f8adc004e40 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc00c6f0 con 0x7f8adc003fe0 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc00c8f0 con 0x7f8adc009ab0 2026-02-17T21:12:28.129 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.123+0000 7f8af6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.124+0000 7f8afce7e640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8adc009ab0 0x7f8adc00bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.124+0000 7f8afce7e640 10 monclient(hunting): get_auth_request con 0x7f8adc009ab0 auth_method 0 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.124+0000 7f8afce7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.124+0000 7f8afce7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.124+0000 7f8afce7e640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.124+0000 7f8afce7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.124+0000 7f8afce7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8afce7e640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af7fff640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8adc003fe0 0x7f8adc004900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af77fe640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8adc004e40 0x7f8adc0052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af77fe640 10 monclient(hunting): get_auth_request con 0x7f8adc004e40 auth_method 0 2026-02-17T21:12:28.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af7fff640 10 monclient(hunting): get_auth_request con 0x7f8adc003fe0 auth_method 0 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.131 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.125+0000 7f8af77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 10 monclient(hunting): handle_auth_done global_id 5317 payload 293 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 1 -- 10.20.193.45:0/1332072682 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8adc003fe0 msgr2=0x7f8adc004900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8adc003fe0 0x7f8adc004900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 1 -- 10.20.193.45:0/1332072682 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8adc004e40 msgr2=0x7f8adc0052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8adc004e40 0x7f8adc0052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 10 monclient: _finish_hunting 0 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 1 monclient: found mon.c 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 1 -- 10.20.193.45:0/1332072682 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc003620 con 0x7f8adc009ab0 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 10 monclient: _finish_auth 0 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 10 monclient: _check_auth_tickets 2026-02-17T21:12:28.132 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afe908640 5 monclient: authenticate success, global_id 5317 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afe908640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.126+0000 7f8afce7e640 1 -- 10.20.193.45:0/1332072682 reap_dead start 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.127+0000 7f8afce7e640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8adc009ab0 0x7f8adc00bea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00a770 tx=0x7f8aec02fb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9680702cba89d9ee server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec037020 con 0x7f8adc009ab0 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 10 monclient: dump: 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.133 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aec033620 con 0x7f8adc009ab0 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8afe908640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8afe908640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 1 -- 10.20.193.45:0/1332072682 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec00a390 con 0x7f8adc009ab0 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8afe908640 4 set_mon_vals no callback set 2026-02-17T21:12:28.134 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.128+0000 7f8af6ffd640 10 monclient: dump: 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.135 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.129+0000 7f8afe908640 10 monclient: shutdown 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.129+0000 7f8afe908640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.129+0000 7f8afe908640 1 -- 10.20.193.45:0/1332072682 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8adc009ab0 msgr2=0x7f8adc00bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.129+0000 7f8afe908640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8adc009ab0 0x7f8adc00bea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00a770 tx=0x7f8aec02fb10 comp rx=0 tx=0).stop 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.129+0000 7f8afe908640 1 -- 10.20.193.45:0/1332072682 shutdown_connections 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.129+0000 7f8afe908640 1 --2- 10.20.193.45:0/1332072682 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8adc009ab0 0x7f8adc00bea0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.129+0000 7f8afe908640 1 -- 10.20.193.45:0/1332072682 >> 10.20.193.45:0/1332072682 conn(0x7f8af80c9d40 msgr2=0x7f8af80ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.129+0000 7f8afe908640 1 -- 10.20.193.45:0/1332072682 shutdown_connections 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.129+0000 7f8afe908640 1 -- 10.20.193.45:0/1332072682 wait complete. 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient: build_initial_monmap 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient: monmap: 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:28.136 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 librados: starting msgr at 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 librados: starting objecter 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 Processor -- start 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 -- start start 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 librados: setting wanted keys 2026-02-17T21:12:28.137 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 librados: calling monclient init 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient: init 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8adc009ab0 0x7f8af81489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient(hunting): picked mon.noname-b con 0x7f8adc009ab0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8af8073ee0 0x7f8af81f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient(hunting): picked mon.noname-c con 0x7f8af8073ee0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8af8074360 0x7f8af81f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient(hunting): picked mon.noname-a con 0x7f8af8074360 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8af815d5c0 con 0x7f8af8074360 2026-02-17T21:12:28.138 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f8af80c8680 con 0x7f8adc009ab0 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8af815d740 con 0x7f8af8073ee0 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.130+0000 7f8afe908640 10 monclient(hunting): authenticate will time out at 1331.760757s 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8af8074360 0x7f8af81f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af7fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8adc009ab0 0x7f8af81489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af77fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8af8073ee0 0x7f8af81f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8af8074360 0x7f8af81f2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36858/0 (socket says 10.20.193.45:36858) 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af77fe640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8af8073ee0 0x7f8af81f2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:35304/0 (socket says 10.20.193.45:35304) 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 1 -- 10.20.193.45:0/1579972889 learned_addr learned my addr 10.20.193.45:0/1579972889 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:28.139 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 10 monclient(hunting): get_auth_request con 0x7f8af8074360 auth_method 0 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af77fe640 10 monclient(hunting): get_auth_request con 0x7f8af8073ee0 auth_method 0 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af77fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af7fff640 10 monclient(hunting): get_auth_request con 0x7f8adc009ab0 auth_method 0 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af7fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.140 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8afce7e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.131+0000 7f8af7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 10 monclient(hunting): handle_auth_done global_id 5351 payload 824 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 1 -- 10.20.193.45:0/1579972889 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8adc009ab0 msgr2=0x7f8af81489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8adc009ab0 0x7f8af81489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 1 -- 10.20.193.45:0/1579972889 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8af8074360 msgr2=0x7f8af81f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8af8074360 0x7f8af81f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.141 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:28.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 1 monclient: found mon.noname-c 2026-02-17T21:12:28.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:28.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:28.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.132+0000 7f8af77fe640 1 -- 10.20.193.45:0/1579972889 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af81f4620 con 0x7f8af8073ee0 2026-02-17T21:12:28.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.133+0000 7f8af77fe640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8af8073ee0 0x7f8af81f2870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800eaa0 tx=0x7f8ae800ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:28.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.133+0000 7f8af4ff9640 10 client.?.objecter ms_handle_connect 0x7f8af8073ee0 2026-02-17T21:12:28.142 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.133+0000 7f8af4ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 1 -- 10.20.193.45:0/1579972889 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8006ba0 con 0x7f8af8073ee0 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 10 monclient: dump: 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.144 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 10 monclient: _finish_auth 0 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 1 -- 10.20.193.45:0/1579972889 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae8006d40 con 0x7f8af8073ee0 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 5 monclient: authenticate success, global_id 5351 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 10 monclient: _renew_subs 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af81f1ab0 con 0x7f8af8073ee0 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 1 -- 10.20.193.45:0/1579972889 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800c6c0 con 0x7f8af8073ee0 2026-02-17T21:12:28.145 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af4ff9640 10 monclient: dump: 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8af67fc640 4 set_mon_vals no callback set 2026-02-17T21:12:28.146 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 10 client.5351.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:28.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 10 monclient: _renew_subs 2026-02-17T21:12:28.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:28.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af81f2070 con 0x7f8af8073ee0 2026-02-17T21:12:28.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 1 librados: init done 2026-02-17T21:12:28.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:28.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:28.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:28.147 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.135+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af80c9b20 con 0x7f8af8073ee0 2026-02-17T21:12:28.235 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.243+0000 7f8af4ff9640 1 -- 10.20.193.45:0/1579972889 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f8ae8024070 con 0x7f8af8073ee0 2026-02-17T21:12:28.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.243+0000 7f8af4ff9640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8ac8079300 0x7f8ac807b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.236 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.244+0000 7f8af7fff640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8ac8079300 0x7f8ac807b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.244+0000 7f8af7fff640 10 monclient: get_auth_request con 0x7f8ac8079300 auth_method 0 2026-02-17T21:12:28.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.244+0000 7f8af7fff640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8ac8079300 0x7f8ac807b7c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40056c0 tx=0x7f8ae4005050 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:28.237 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.244+0000 7f8af4ff9640 10 client.5351.objecter ms_handle_connect 0x7f8ac8079300 2026-02-17T21:12:28.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.246+0000 7f8af4ff9640 1 -- 10.20.193.45:0/1579972889 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f8ae805dc40 con 0x7f8af8073ee0 2026-02-17T21:12:28.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.246+0000 7f8af4ff9640 10 client.5351.objecter ms_dispatch2 0x7f8af8000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:28.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.246+0000 7f8af4ff9640 3 client.5351.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:28.238 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.246+0000 7f8af4ff9640 3 client.5351.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:28.239 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.246+0000 7f8af4ff9640 20 client.5351.objecter dump_active .. 0 homeless 2026-02-17T21:12:28.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.252+0000 7f8af4ff9640 1 -- 10.20.193.45:0/1579972889 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f8ae8021020 con 0x7f8af8073ee0 2026-02-17T21:12:28.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.252+0000 7f8af4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:28.245 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.252+0000 7f8af4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:28.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.336+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7f8af81f1860 con 0x7f8ac8079300 2026-02-17T21:12:28.329 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.336+0000 7f8af4ff9640 1 -- 10.20.193.45:0/1579972889 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (secure 0 0 0) 0x7f8af81f1860 con 0x7f8ac8079300 2026-02-17T21:12:28.329 INFO:teuthology.orchestra.run.trial045.stderr:instructed osd(s) 15 to deep-scrub 2026-02-17T21:12:28.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 10 librados: watch_flush enter 2026-02-17T21:12:28.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 10 librados: watch_flush exit 2026-02-17T21:12:28.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 20 client.5351.objecter shutdown clearing up homeless session... 2026-02-17T21:12:28.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 10 client.5351.objecter successfully canceled tick 2026-02-17T21:12:28.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8ac8079300 msgr2=0x7f8ac807b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8ac8079300 0x7f8ac807b7c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40056c0 tx=0x7f8ae4005050 comp rx=0 tx=0).stop 2026-02-17T21:12:28.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 10 monclient: shutdown 2026-02-17T21:12:28.331 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8af8073ee0 msgr2=0x7f8af81f2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8af8073ee0 0x7f8af81f2870 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800eaa0 tx=0x7f8ae800ef70 comp rx=0 tx=0).stop 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 shutdown_connections 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f8ac8079300 0x7f8ac807b7c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f8af8074360 0x7f8af81f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8af8073ee0 0x7f8af81f2870 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 --2- 10.20.193.45:0/1579972889 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f8adc009ab0 0x7f8af81489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.337+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 >> 10.20.193.45:0/1579972889 conn(0x7f8af80c9d40 msgr2=0x7f8af814dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.338+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 shutdown_connections 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.338+0000 7f8afe908640 1 -- 10.20.193.45:0/1579972889 wait complete. 2026-02-17T21:12:28.332 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.338+0000 7f8afe908640 1 librados: shutdown 2026-02-17T21:12:28.339 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:12:28.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.412+0000 7f7e32abd640 10 monclient: get_monmap_and_config 2026-02-17T21:12:28.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.412+0000 7f7e32abd640 10 monclient: build_initial_monmap 2026-02-17T21:12:28.405 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.412+0000 7f7e32abd640 10 monclient: monmap: 2026-02-17T21:12:28.405 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:28.405 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.405 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:28.413641+0000 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:28.413641+0000 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:28.406 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.409 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 1 Processor -- start 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 1 -- start start 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient: init 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient: _add_conns ranks=[4,0,3,2,5,1] 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f7e2c152620 0x7f7e2c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient(hunting): picked mon.noname-b con 0x7f7e2c152620 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7e2c152a00 addr v1:10.20.193.45:6789/0 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f7e2c0c94a0 0x7f7e2c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient(hunting): picked mon.noname-a con 0x7f7e2c0c94a0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:28.410 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 1 -- --> v1:10.20.193.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c0c71a0 con 0x7f7e2c152a00 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f7e2c0c7760 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f7e2c0c7480 con 0x7f7e2c152620 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.413+0000 7f7e32abd640 10 monclient(hunting): authenticate will time out at 1332.043766s 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e31033640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f7e2c0c94a0 0x7f7e2c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e30832640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f7e2c152620 0x7f7e2c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e31033640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f7e2c0c94a0 0x7f7e2c15ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36874/0 (socket says 10.20.193.45:36874) 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e31033640 1 -- 10.20.193.45:0/1781061512 learned_addr learned my addr 10.20.193.45:0/1781061512 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e31033640 10 monclient(hunting): get_auth_request con 0x7f7e2c0c94a0 auth_method 0 2026-02-17T21:12:28.411 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e31033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e31033640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e31033640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e30832640 10 monclient(hunting): get_auth_request con 0x7f7e2c152620 auth_method 0 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e30832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e30832640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e30832640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e30832640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e30832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.414+0000 7f7e30832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e31033640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e31033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e31033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.412 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e30832640 10 monclient(hunting): handle_auth_done global_id 5323 payload 274 2026-02-17T21:12:28.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e30832640 1 -- 10.20.193.45:0/1781061512 >> v2:10.20.193.45:3300/0 conn(0x7f7e2c0c94a0 msgr2=0x7f7e2c15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:28.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e30832640 1 --2- 10.20.193.45:0/1781061512 >> v2:10.20.193.45:3300/0 conn(0x7f7e2c0c94a0 0x7f7e2c15ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e30832640 1 -- 10.20.193.45:0/1781061512 >> v1:10.20.193.45:6789/0 conn(0x7f7e2c152a00 legacy=0x7f7e2c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e30832640 10 monclient: _finish_hunting 0 2026-02-17T21:12:28.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e30832640 1 monclient: found mon.noname-b 2026-02-17T21:12:28.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e30832640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:28.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e30832640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:28.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.415+0000 7f7e30832640 1 -- 10.20.193.45:0/1781061512 --> v2:10.20.193.86:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c159e00 con 0x7f7e2c152620 2026-02-17T21:12:28.413 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.416+0000 7f7e30832640 1 --2- 10.20.193.45:0/1781061512 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c152620 0x7f7e2c15a8e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c076d30 tx=0x7f7e1c02ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f49937399b903027 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 1 -- 10.20.193.45:0/1781061512 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c03c070 con 0x7f7e2c152620 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 10 monclient: dump: 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.420 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 10 monclient: _finish_auth 0 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 10 monclient: _check_auth_tickets 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 1 -- 10.20.193.45:0/1781061512 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c02faf0 con 0x7f7e2c152620 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e32abd640 5 monclient: authenticate success, global_id 5323 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 1 -- 10.20.193.45:0/1781061512 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c037440 con 0x7f7e2c152620 2026-02-17T21:12:28.421 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e237fe640 10 monclient: dump: 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.422 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e32abd640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e32abd640 4 set_mon_vals no callback set 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.418+0000 7f7e32abd640 10 monclient: shutdown 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 -- 10.20.193.45:0/1781061512 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c152620 msgr2=0x7f7e2c15a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 --2- 10.20.193.45:0/1781061512 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c152620 0x7f7e2c15a8e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c076d30 tx=0x7f7e1c02ede0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 -- 10.20.193.45:0/1781061512 shutdown_connections 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 --2- 10.20.193.45:0/1781061512 >> v2:10.20.193.45:3300/0 conn(0x7f7e2c0c94a0 0x7f7e2c15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 --2- 10.20.193.45:0/1781061512 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c152620 0x7f7e2c15a8e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 -- 10.20.193.45:0/1781061512 >> 10.20.193.45:0/1781061512 conn(0x7f7e2c0c9d40 msgr2=0x7f7e2c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 -- 10.20.193.45:0/1781061512 shutdown_connections 2026-02-17T21:12:28.423 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 -- 10.20.193.45:0/1781061512 wait complete. 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 10 monclient: build_initial_monmap 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 10 monclient: monmap: 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.424 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 librados: starting msgr at 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 librados: starting objecter 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 Processor -- start 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 -- start start 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 librados: setting wanted keys 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 1 librados: calling monclient init 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.419+0000 7f7e32abd640 10 monclient: init 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c0c94a0 0x7f7e2c155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient(hunting): picked mon.noname-b con 0x7f7e2c0c94a0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e2c152620 0x7f7e2c1ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient(hunting): picked mon.noname-c con 0x7f7e2c152620 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:28.425 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7e2c152a00 0x7f7e2c0cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient(hunting): picked mon.noname-a con 0x7f7e2c152a00 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c0c5c90 con 0x7f7e2c152a00 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c15a3c0 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c0c5e10 con 0x7f7e2c152620 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e32abd640 10 monclient(hunting): authenticate will time out at 1332.050359s 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e31033640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7e2c152a00 0x7f7e2c0cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e30832640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c0c94a0 0x7f7e2c155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.426 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e23fff640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e2c152620 0x7f7e2c1ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e31033640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7e2c152a00 0x7f7e2c0cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:36876/0 (socket says 10.20.193.45:36876) 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e31033640 1 -- 10.20.193.45:0/145770798 learned_addr learned my addr 10.20.193.45:0/145770798 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e31033640 10 monclient(hunting): get_auth_request con 0x7f7e2c152a00 auth_method 0 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e31033640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e31033640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e31033640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e30832640 10 monclient(hunting): get_auth_request con 0x7f7e2c0c94a0 auth_method 0 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e30832640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e30832640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e30832640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e23fff640 10 monclient(hunting): get_auth_request con 0x7f7e2c152620 auth_method 0 2026-02-17T21:12:28.427 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e23fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e23fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.420+0000 7f7e23fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.421+0000 7f7e30832640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.421+0000 7f7e30832640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.421+0000 7f7e30832640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.421+0000 7f7e31033640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.421+0000 7f7e31033640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.421+0000 7f7e31033640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.421+0000 7f7e23fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.421+0000 7f7e23fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.421+0000 7f7e23fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 10 monclient(hunting): handle_auth_done global_id 5326 payload 824 2026-02-17T21:12:28.428 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 1 -- 10.20.193.45:0/145770798 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e2c152620 msgr2=0x7f7e2c1ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e2c152620 0x7f7e2c1ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 1 -- 10.20.193.45:0/145770798 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7e2c152a00 msgr2=0x7f7e2c0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7e2c152a00 0x7f7e2c0cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 10 monclient: _finish_hunting 0 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 1 monclient: found mon.noname-b 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.86:3300/0 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.422+0000 7f7e30832640 1 -- 10.20.193.45:0/145770798 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c158630 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.423+0000 7f7e30832640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c0c94a0 0x7f7e2c155b00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c036000 tx=0x7f7e1c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.423+0000 7f7e217fa640 10 client.?.objecter ms_handle_connect 0x7f7e2c0c94a0 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.423+0000 7f7e217fa640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:28.429 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 1 -- 10.20.193.45:0/145770798 <== mon.1 v2:10.20.193.86:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c03c040 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 10 monclient: dump: 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.430 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 10 monclient: _finish_auth 0 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 10 monclient: _check_auth_tickets 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e32abd640 5 monclient: authenticate success, global_id 5326 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e32abd640 10 monclient: _renew_subs 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e32abd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c0cb2b0 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e32abd640 10 client.5326.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e32abd640 10 monclient: _renew_subs 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e32abd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2c0cb870 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.431 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e32abd640 1 librados: init done 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 1 -- 10.20.193.45:0/145770798 <== mon.1 v2:10.20.193.86:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e1c02fa30 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 1 -- 10.20.193.45:0/145770798 <== mon.1 v2:10.20.193.86:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c042650 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e217fa640 10 monclient: dump: 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:28.432 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:28.433 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:28.433 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:28.433 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:28.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.424+0000 7f7e22ffd640 4 set_mon_vals no callback set 2026-02-17T21:12:28.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.425+0000 7f7e32abd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:28.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.425+0000 7f7e32abd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:28.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.425+0000 7f7e32abd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.86:3300/0 2026-02-17T21:12:28.433 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.425+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e2c0c8d90 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.434 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.436+0000 7f7e217fa640 1 -- 10.20.193.45:0/145770798 <== mon.1 v2:10.20.193.86:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f7e1c0427f0 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.436+0000 7f7e217fa640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7dfc0792b0 0x7f7dfc07b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.436+0000 7f7e23fff640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7dfc0792b0 0x7f7dfc07b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.436+0000 7f7e23fff640 10 monclient: get_auth_request con 0x7f7dfc0792b0 auth_method 0 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.436+0000 7f7e217fa640 10 client.5326.objecter ms_handle_connect 0x7f7dfc0792b0 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.436+0000 7f7e23fff640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7dfc0792b0 0x7f7dfc07b770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0c4650 tx=0x7f7e14007f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.437+0000 7f7e217fa640 1 -- 10.20.193.45:0/145770798 <== mon.1 v2:10.20.193.86:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f7e1c0bd200 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.437+0000 7f7e217fa640 10 client.5326.objecter ms_dispatch2 0x7f7e2c000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.437+0000 7f7e217fa640 3 client.5326.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.437+0000 7f7e217fa640 3 client.5326.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:28.435 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.437+0000 7f7e217fa640 20 client.5326.objecter dump_active .. 0 homeless 2026-02-17T21:12:28.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.538+0000 7f7e217fa640 1 -- 10.20.193.45:0/145770798 <== mon.1 v2:10.20.193.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7e1c0878a0 con 0x7f7e2c0c94a0 2026-02-17T21:12:28.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.538+0000 7f7e217fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:28.531 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.538+0000 7f7e217fa640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:28.616 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.624+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e2c156040 con 0x7f7dfc0792b0 2026-02-17T21:12:28.617 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.625+0000 7f7e217fa640 1 -- 10.20.193.45:0/145770798 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44798 (secure 0 0 0) 0x7f7e14002af0 con 0x7f7dfc0792b0 2026-02-17T21:12:28.618 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:28.618 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-17T21:12:28.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 10 librados: watch_flush enter 2026-02-17T21:12:28.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 10 librados: watch_flush exit 2026-02-17T21:12:28.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 20 client.5326.objecter shutdown clearing up homeless session... 2026-02-17T21:12:28.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 10 client.5326.objecter successfully canceled tick 2026-02-17T21:12:28.620 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7dfc0792b0 msgr2=0x7f7dfc07b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7dfc0792b0 0x7f7dfc07b770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0c4650 tx=0x7f7e14007f50 comp rx=0 tx=0).stop 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 10 monclient: shutdown 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c0c94a0 msgr2=0x7f7e2c155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c0c94a0 0x7f7e2c155b00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c036000 tx=0x7f7e1c0047c0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 shutdown_connections 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f7dfc0792b0 0x7f7dfc07b770 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f7e2c152a00 0x7f7e2c0cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e2c152620 0x7f7e2c1ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 --2- 10.20.193.45:0/145770798 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f7e2c0c94a0 0x7f7e2c155b00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:28.621 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 >> 10.20.193.45:0/145770798 conn(0x7f7e2c0c9d40 msgr2=0x7f7e2c15b070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:28.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 shutdown_connections 2026-02-17T21:12:28.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.626+0000 7f7e32abd640 1 -- 10.20.193.45:0/145770798 wait complete. 2026-02-17T21:12:28.622 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:28.627+0000 7f7e32abd640 1 librados: shutdown 2026-02-17T21:12:28.627 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2026-02-17T21:12:26.714314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":437784,"kb_used_data":6360,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511656,"statfs":{"total":1546188226560,"available":1545739935744,"internally_reserved":0,"allocated":6512640,"data_stored":3263382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25498,"internal_metadata":441424998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001692"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:23.281403+0000","last_change":"2026-02-17T21:07:11.541544+0000","last_active":"2026-02-17T21:09:23.281403+0000","last_peered":"2026-02-17T21:09:23.281403+0000","last_clean":"2026-02-17T21:09:23.281403+0000","last_became_active":"2026-02-17T21:07:09.672479+0000","last_became_peered":"2026-02-17T21:07:09.672479+0000","last_unstale":"2026-02-17T21:09:23.281403+0000","last_undegraded":"2026-02-17T21:09:23.281403+0000","last_fullsized":"2026-02-17T21:09:23.281403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:18:00.047244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048238970999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:22.260632+0000","last_change":"2026-02-17T21:07:11.966086+0000","last_active":"2026-02-17T21:09:22.260632+0000","last_peered":"2026-02-17T21:09:22.260632+0000","last_clean":"2026-02-17T21:09:22.260632+0000","last_became_active":"2026-02-17T21:07:09.634301+0000","last_became_peered":"2026-02-17T21:07:09.634301+0000","last_unstale":"2026-02-17T21:09:22.260632+0000","last_undegraded":"2026-02-17T21:09:22.260632+0000","last_fullsized":"2026-02-17T21:09:22.260632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:14:59.089621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032567963999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:13.756342+0000","last_change":"2026-02-17T21:07:12.020919+0000","last_active":"2026-02-17T21:09:13.756342+0000","last_peered":"2026-02-17T21:09:13.756342+0000","last_clean":"2026-02-17T21:09:13.756342+0000","last_became_active":"2026-02-17T21:07:09.505342+0000","last_became_peered":"2026-02-17T21:07:09.505342+0000","last_unstale":"2026-02-17T21:09:13.756342+0000","last_undegraded":"2026-02-17T21:09:13.756342+0000","last_fullsized":"2026-02-17T21:09:13.756342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T22:24:24.816438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036804456999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean+scrubbing+deep","last_fresh":"2026-02-17T21:12:23.261780+0000","last_change":"2026-02-17T21:12:23.235794+0000","last_active":"2026-02-17T21:12:23.261780+0000","last_peered":"2026-02-17T21:12:23.261780+0000","last_clean":"2026-02-17T21:12:23.261780+0000","last_became_active":"2026-02-17T21:07:09.674257+0000","last_became_peered":"2026-02-17T21:07:09.674257+0000","last_unstale":"2026-02-17T21:12:23.261780+0000","last_undegraded":"2026-02-17T21:12:23.261780+0000","last_fullsized":"2026-02-17T21:12:23.261780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 1s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033871934999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"32'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:18.278369+0000","last_change":"2026-02-17T21:07:11.525598+0000","last_active":"2026-02-17T21:09:18.278369+0000","last_peered":"2026-02-17T21:09:18.278369+0000","last_clean":"2026-02-17T21:09:18.278369+0000","last_became_active":"2026-02-17T21:07:09.679096+0000","last_became_peered":"2026-02-17T21:07:09.679096+0000","last_unstale":"2026-02-17T21:09:18.278369+0000","last_undegraded":"2026-02-17T21:09:18.278369+0000","last_fullsized":"2026-02-17T21:09:18.278369+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:24:33.818275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036788098999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:15.792752+0000","last_change":"2026-02-17T21:07:12.033028+0000","last_active":"2026-02-17T21:09:15.792752+0000","last_peered":"2026-02-17T21:09:15.792752+0000","last_clean":"2026-02-17T21:09:15.792752+0000","last_became_active":"2026-02-17T21:07:09.677404+0000","last_became_peered":"2026-02-17T21:07:09.677404+0000","last_unstale":"2026-02-17T21:09:15.792752+0000","last_undegraded":"2026-02-17T21:09:15.792752+0000","last_fullsized":"2026-02-17T21:09:15.792752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:08:16.306950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047884902999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:08.802367+0000","last_change":"2026-02-17T21:07:11.526917+0000","last_active":"2026-02-17T21:09:08.802367+0000","last_peered":"2026-02-17T21:09:08.802367+0000","last_clean":"2026-02-17T21:09:08.802367+0000","last_became_active":"2026-02-17T21:07:09.663986+0000","last_became_peered":"2026-02-17T21:07:09.663986+0000","last_unstale":"2026-02-17T21:09:08.802367+0000","last_undegraded":"2026-02-17T21:09:08.802367+0000","last_fullsized":"2026-02-17T21:09:08.802367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:14:51.518524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039512685999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"30'1","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:09:15.792988+0000","last_change":"2026-02-17T21:07:12.029142+0000","last_active":"2026-02-17T21:09:15.792988+0000","last_peered":"2026-02-17T21:09:15.792988+0000","last_clean":"2026-02-17T21:09:15.792988+0000","last_became_active":"2026-02-17T21:07:09.717514+0000","last_became_peered":"2026-02-17T21:07:09.717514+0000","last_unstale":"2026-02-17T21:09:15.792988+0000","last_undegraded":"2026-02-17T21:09:15.792988+0000","last_fullsized":"2026-02-17T21:09:15.792988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:07:08.188215+0000","last_clean_scrub_stamp":"2026-02-17T21:07:08.188215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T03:32:38.710260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031434124000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"28'32","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:08:59.591648+0000","last_change":"2026-02-17T21:07:07.293203+0000","last_active":"2026-02-17T21:08:59.591648+0000","last_peered":"2026-02-17T21:08:59.591648+0000","last_clean":"2026-02-17T21:08:59.591648+0000","last_became_active":"2026-02-17T21:07:06.988047+0000","last_became_peered":"2026-02-17T21:07:06.988047+0000","last_unstale":"2026-02-17T21:08:59.591648+0000","last_undegraded":"2026-02-17T21:08:59.591648+0000","last_fullsized":"2026-02-17T21:08:59.591648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:06:59.073039+0000","last_clean_scrub_stamp":"2026-02-17T21:06:59.073039+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:46:10.662342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":27,"seq":115964117064,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,9,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":27,"seq":115964117064,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":27,"seq":115964117064,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313283,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280579,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,3,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":66,"apply_latency_ms":66,"commit_latency_ns":66000000,"apply_latency_ns":66000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313284,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280579,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149766,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":23,"seq":98784247876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":24,"seq":103079215172,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":26,"seq":111669149768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,2,4,5,6,7,8,9,10,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":26,"seq":111669149765,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,4,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":26,"seq":111669149768,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,3,4,6,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149767,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,3,4,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":27,"seq":115964117065,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:12:28.633 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-17T21:07:08.188215+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=12, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:12:28.633 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-17T21:07:08.188215+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=12, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:12:28.633 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-17T21:07:08.188215+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=12, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:12:28.633 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-17T21:07:08.188215+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=12, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:12:28.633 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-17T21:07:08.188215+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=12, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:12:28.634 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-17T21:07:08.188215+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=12, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:12:28.634 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-17T21:07:08.188215+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=12, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:12:28.634 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-17T21:07:08.188215+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=7, tm_sec=8, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=12, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:12:28.634 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-17T21:06:59.073039+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=6, tm_sec=59, tm_wday=1, tm_yday=48, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=17, tm_hour=21, tm_min=12, tm_sec=20, tm_wday=1, tm_yday=48, tm_isdst=0) 2026-02-17T21:12:28.634 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-17T21:12:30.368 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:37.580 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:30.394 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:07:37.567 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:30.395 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:07:37.605 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:30.396 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:37.609 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:30.396 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:07:37.569 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:30.397 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:07:37.607 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:30.405 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:07:37.615 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:30.407 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:07:37.579 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:30.407 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:37.620 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:48.636 DEBUG:teuthology.orchestra.run.trial045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-17T21:12:48.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.713+0000 7f938a97e640 10 monclient: get_monmap_and_config 2026-02-17T21:12:48.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.713+0000 7f938a97e640 10 monclient: build_initial_monmap 2026-02-17T21:12:48.706 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.713+0000 7f938a97e640 10 monclient: monmap: 2026-02-17T21:12:48.706 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:48.706 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:48.714011+0000 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:48.714011+0000 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:48.707 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:48.708 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:48.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.713+0000 7f938a97e640 1 Processor -- start 2026-02-17T21:12:48.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.713+0000 7f938a97e640 1 -- start start 2026-02-17T21:12:48.708 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.713+0000 7f938a97e640 10 monclient: init 2026-02-17T21:12:48.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:48.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 10 monclient: _add_conns ranks=[4,3,2,5,1,0] 2026-02-17T21:12:48.711 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 1 --2- >> v2:10.20.193.86:3300/0 conn(0x7f938415d1e0 0x7f938415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 10 monclient(hunting): picked mon.noname-b con 0x7f938415d1e0 addr v2:10.20.193.86:3300/0 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f93840748e0 0x7f93840c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 10 monclient(hunting): picked mon.noname-a con 0x7f93840748e0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f93840c90e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93840c9570 con 0x7f93840c90e0 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f93840c5860 con 0x7f93840748e0 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 1 -- --> v2:10.20.193.86:3300/0 -- mon_getmap magic: 0 -- 0x7f93840c5580 con 0x7f938415d1e0 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:48.712 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f938a97e640 10 monclient(hunting): authenticate will time out at 1352.344156s 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f9388ef4640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f93840c90e0 0x7f9384153610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:37074/0 (socket says 10.20.193.45:37074) 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f9388ef4640 1 -- 10.20.193.45:0/3517041014 learned_addr learned my addr 10.20.193.45:0/3517041014 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f9383fff640 1 --2- 10.20.193.45:0/3517041014 >> v2:10.20.193.86:3300/0 conn(0x7f938415d1e0 0x7f938415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f93837fe640 1 --2- 10.20.193.45:0/3517041014 >> v2:10.20.193.45:3300/0 conn(0x7f93840748e0 0x7f93840c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f9383fff640 10 monclient(hunting): get_auth_request con 0x7f938415d1e0 auth_method 0 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f9383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f9383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f9383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f93837fe640 10 monclient(hunting): get_auth_request con 0x7f93840748e0 auth_method 0 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f93837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f93837fe640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:48.713 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.714+0000 7f93837fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f9383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f9383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f9383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f93837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f93837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f93837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f9382ffd640 1 -- 10.20.193.45:0/3517041014 <== mon.2 v1:10.20.193.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 488076299 0 0) 0x7f93840c9570 con 0x7f93840c90e0 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f9382ffd640 10 monclient(hunting): _negotiate 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f9382ffd640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f9382ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f9382ffd640 10 monclient(hunting): my global_id is 5357 2026-02-17T21:12:48.714 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.715+0000 7f9382ffd640 1 -- 10.20.193.45:0/3517041014 --> v1:10.20.193.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9368003620 con 0x7f93840c90e0 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f93837fe640 10 monclient(hunting): handle_auth_done global_id 5274 payload 274 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f93837fe640 1 -- 10.20.193.45:0/3517041014 >> v2:10.20.193.86:3300/0 conn(0x7f938415d1e0 msgr2=0x7f938415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f93837fe640 1 --2- 10.20.193.45:0/3517041014 >> v2:10.20.193.86:3300/0 conn(0x7f938415d1e0 0x7f938415d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f93837fe640 1 -- 10.20.193.45:0/3517041014 >> v1:10.20.193.92:6789/0 conn(0x7f93840c90e0 legacy=0x7f9384153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f93837fe640 10 monclient: _finish_hunting 0 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f93837fe640 1 monclient: found mon.noname-a 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f93837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f93837fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f93837fe640 1 -- 10.20.193.45:0/3517041014 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93840c7de0 con 0x7f93840748e0 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.716+0000 7f9383fff640 1 --2- 10.20.193.45:0/3517041014 >> v2:10.20.193.86:3300/0 conn(0x7f938415d1e0 0x7f938415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-17T21:12:48.715 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.717+0000 7f93837fe640 1 --2- 10.20.193.45:0/3517041014 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f93840748e0 0x7f93840c8ba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f93740098a0 tx=0x7f937402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29d5d3f88382d71 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:48.721 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 1 -- 10.20.193.45:0/3517041014 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937403c070 con 0x7f93840748e0 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 10 monclient: dump: 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:48.722 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 10 monclient: _finish_auth 0 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 1 -- 10.20.193.45:0/3517041014 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937402fae0 con 0x7f93840748e0 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 5 monclient: authenticate success, global_id 5274 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 1 -- 10.20.193.45:0/3517041014 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9374037440 con 0x7f93840748e0 2026-02-17T21:12:48.723 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f9382ffd640 10 monclient: dump: 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:48.724 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 4 set_mon_vals no callback set 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 10 monclient: shutdown 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 1 -- 10.20.193.45:0/3517041014 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f93840748e0 msgr2=0x7f93840c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 1 --2- 10.20.193.45:0/3517041014 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f93840748e0 0x7f93840c8ba0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f93740098a0 tx=0x7f937402ee10 comp rx=0 tx=0).stop 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 1 -- 10.20.193.45:0/3517041014 shutdown_connections 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 1 --2- 10.20.193.45:0/3517041014 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f93840748e0 0x7f93840c8ba0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 1 --2- 10.20.193.45:0/3517041014 >> v2:10.20.193.86:3300/0 conn(0x7f938415d1e0 0x7f938415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 1 -- 10.20.193.45:0/3517041014 >> 10.20.193.45:0/3517041014 conn(0x7f93840c9d40 msgr2=0x7f93840ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 1 -- 10.20.193.45:0/3517041014 shutdown_connections 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.719+0000 7f938a97e640 1 -- 10.20.193.45:0/3517041014 wait complete. 2026-02-17T21:12:48.725 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient: build_initial_monmap 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient: monmap: 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:48.726 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 librados: starting msgr at 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 librados: starting objecter 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 Processor -- start 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 -- start start 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 librados: setting wanted keys 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 librados: calling monclient init 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient: init 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f93840748e0 0x7f938414b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient(hunting): picked mon.noname-b con 0x7f93840748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f93840c90e0 0x7f938414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:48.727 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient(hunting): picked mon.noname-a con 0x7f93840c90e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f938415d1e0 0x7f93841f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient(hunting): picked mon.noname-c con 0x7f938415d1e0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f93840c8680 con 0x7f93840c90e0 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f93840c83a0 con 0x7f93840748e0 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9384074d30 con 0x7f938415d1e0 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.720+0000 7f938a97e640 10 monclient(hunting): authenticate will time out at 1352.350991s 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f938415d1e0 0x7f93841f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9383fff640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f93840748e0 0x7f938414b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:48.728 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f938415d1e0 0x7f93841f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.45:36050/0 (socket says 10.20.193.45:36050) 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 1 -- 10.20.193.45:0/2652312306 learned_addr learned my addr 10.20.193.45:0/2652312306 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 10 monclient(hunting): get_auth_request con 0x7f938415d1e0 auth_method 0 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9383fff640 10 monclient(hunting): get_auth_request con 0x7f93840748e0 auth_method 0 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9383fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9383fff640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9383fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:48.729 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9388ef4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9383fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9383fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.721+0000 7f9383fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 10 monclient(hunting): handle_auth_done global_id 5360 payload 824 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 1 -- 10.20.193.45:0/2652312306 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f93840748e0 msgr2=0x7f938414b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f93840748e0 0x7f938414b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 1 -- 10.20.193.45:0/2652312306 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f93840c90e0 msgr2=0x7f938414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f93840c90e0 0x7f938414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 10 monclient: _finish_hunting 0 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 1 monclient: found mon.noname-c 2026-02-17T21:12:48.730 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.92:3300/0 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.723+0000 7f9388ef4640 1 -- 10.20.193.45:0/2652312306 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938414a5a0 con 0x7f938415d1e0 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.724+0000 7f9388ef4640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f938415d1e0 0x7f93841f2580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f937800cb70 tx=0x7f937800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.724+0000 7f9380ff9640 10 client.?.objecter ms_handle_connect 0x7f938415d1e0 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.724+0000 7f9380ff9640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 1 -- 10.20.193.45:0/2652312306 <== mon.2 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937800ad50 con 0x7f938415d1e0 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 10 monclient: dump: 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:48.731 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 10 monclient: _finish_auth 0 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 10 monclient: _check_auth_tickets 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f938a97e640 5 monclient: authenticate success, global_id 5360 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f938a97e640 10 monclient: _renew_subs 2026-02-17T21:12:48.732 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f938a97e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938414a840 con 0x7f938415d1e0 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f938a97e640 10 client.5360.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f938a97e640 10 monclient: _renew_subs 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f938a97e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938414ae00 con 0x7f938415d1e0 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f938a97e640 1 librados: init done 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 1 -- 10.20.193.45:0/2652312306 <== mon.2 v2:10.20.193.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937801b400 con 0x7f938415d1e0 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 1 -- 10.20.193.45:0/2652312306 <== mon.2 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937801b7f0 con 0x7f938415d1e0 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f93827fc640 4 set_mon_vals no callback set 2026-02-17T21:12:48.733 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.725+0000 7f9380ff9640 10 monclient: dump: 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.726+0000 7f938a97e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:48.734 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.726+0000 7f938a97e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:48.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.726+0000 7f938a97e640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.92:3300/0 2026-02-17T21:12:48.735 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.726+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93840c8ba0 con 0x7f938415d1e0 2026-02-17T21:12:48.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.739+0000 7f9380ff9640 1 -- 10.20.193.45:0/2652312306 <== mon.2 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f937801b990 con 0x7f938415d1e0 2026-02-17T21:12:48.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.739+0000 7f9380ff9640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9354079280 0x7f935407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:48.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.739+0000 7f9383fff640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9354079280 0x7f935407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:48.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.739+0000 7f9383fff640 10 monclient: get_auth_request con 0x7f9354079280 auth_method 0 2026-02-17T21:12:48.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.740+0000 7f9383fff640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9354079280 0x7f935407b740 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9370009660 tx=0x7f9370009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:48.736 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.740+0000 7f9380ff9640 10 client.5360.objecter ms_handle_connect 0x7f9354079280 2026-02-17T21:12:48.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.837+0000 7f9380ff9640 1 -- 10.20.193.45:0/2652312306 <== mon.2 v2:10.20.193.92:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f937805ed10 con 0x7f938415d1e0 2026-02-17T21:12:48.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.837+0000 7f9380ff9640 10 client.5360.objecter ms_dispatch2 0x7f9384000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:48.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.837+0000 7f9380ff9640 3 client.5360.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:48.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.837+0000 7f9380ff9640 3 client.5360.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:48.830 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.837+0000 7f9380ff9640 20 client.5360.objecter dump_active .. 0 homeless 2026-02-17T21:12:48.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.843+0000 7f9380ff9640 1 -- 10.20.193.45:0/2652312306 <== mon.2 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f93780633d0 con 0x7f938415d1e0 2026-02-17T21:12:48.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.843+0000 7f9380ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:48.836 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.843+0000 7f9380ff9640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:48.919 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.926+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 --> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93840ca370 con 0x7f9354079280 2026-02-17T21:12:48.920 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.927+0000 7f9380ff9640 1 -- 10.20.193.45:0/2652312306 <== mgr.4101 v2:10.20.193.45:6800/3582093432 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+44790 (secure 0 0 0) 0x7f93840ca370 con 0x7f9354079280 2026-02-17T21:12:48.921 INFO:teuthology.orchestra.run.trial045.stdout: 2026-02-17T21:12:48.922 INFO:teuthology.orchestra.run.trial045.stderr:dumped all 2026-02-17T21:12:48.922 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 10 librados: watch_flush enter 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 10 librados: watch_flush exit 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 20 client.5360.objecter shutdown clearing up homeless session... 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 10 client.5360.objecter successfully canceled tick 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9354079280 msgr2=0x7f935407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9354079280 0x7f935407b740 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9370009660 tx=0x7f9370009290 comp rx=0 tx=0).stop 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 10 monclient: shutdown 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f938415d1e0 msgr2=0x7f93841f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f938415d1e0 0x7f93841f2580 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f937800cb70 tx=0x7f937800a430 comp rx=0 tx=0).stop 2026-02-17T21:12:48.923 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 shutdown_connections 2026-02-17T21:12:48.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f9354079280 0x7f935407b740 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:48.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f938415d1e0 0x7f93841f2580 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:48.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f93840c90e0 0x7f938414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:48.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 --2- 10.20.193.45:0/2652312306 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f93840748e0 0x7f938414b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:48.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 >> 10.20.193.45:0/2652312306 conn(0x7f93840c9d40 msgr2=0x7f9384148960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:48.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 shutdown_connections 2026-02-17T21:12:48.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 -- 10.20.193.45:0/2652312306 wait complete. 2026-02-17T21:12:48.924 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:48.929+0000 7f938a97e640 1 librados: shutdown 2026-02-17T21:12:48.930 INFO:teuthology.orchestra.run.trial045.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2026-02-17T21:12:48.717248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":14,"kb":1509949440,"kb_used":437740,"kb_used_data":6360,"kb_used_omap":24,"kb_used_meta":431079,"kb_avail":1509511700,"statfs":{"total":1546188226560,"available":1545739980800,"internally_reserved":0,"allocated":6512640,"data_stored":3263382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25498,"internal_metadata":441424998},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"," osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001602"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:12:25.466406+0000","last_change":"2026-02-17T21:12:25.471046+0000","last_active":"2026-02-17T21:12:25.466406+0000","last_peered":"2026-02-17T21:12:25.466406+0000","last_clean":"2026-02-17T21:12:25.466406+0000","last_became_active":"2026-02-17T21:07:09.672479+0000","last_became_peered":"2026-02-17T21:07:09.672479+0000","last_unstale":"2026-02-17T21:12:25.466406+0000","last_undegraded":"2026-02-17T21:12:25.466406+0000","last_fullsized":"2026-02-17T21:12:25.466406+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:12:25.463019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:12:25.463019+0000","last_clean_scrub_stamp":"2026-02-17T21:12:25.463019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:32:52.347921+0000","scrub_duration":178,"objects_trimmed":0,"snaptrim_duration":0.048238970999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,10],"acting":[13,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:12:23.733497+0000","last_change":"2026-02-17T21:12:23.739596+0000","last_active":"2026-02-17T21:12:23.733497+0000","last_peered":"2026-02-17T21:12:23.733497+0000","last_clean":"2026-02-17T21:12:23.733497+0000","last_became_active":"2026-02-17T21:07:09.634301+0000","last_became_peered":"2026-02-17T21:07:09.634301+0000","last_unstale":"2026-02-17T21:12:23.733497+0000","last_undegraded":"2026-02-17T21:12:23.733497+0000","last_fullsized":"2026-02-17T21:12:23.733497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:12:23.730043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:12:23.730043+0000","last_clean_scrub_stamp":"2026-02-17T21:12:23.730043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:21:37.669622+0000","scrub_duration":197,"objects_trimmed":0,"snaptrim_duration":0.032567963999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:12:28.517875+0000","last_change":"2026-02-17T21:12:28.522535+0000","last_active":"2026-02-17T21:12:28.517875+0000","last_peered":"2026-02-17T21:12:28.517875+0000","last_clean":"2026-02-17T21:12:28.517875+0000","last_became_active":"2026-02-17T21:07:09.505342+0000","last_became_peered":"2026-02-17T21:07:09.505342+0000","last_unstale":"2026-02-17T21:12:28.517875+0000","last_undegraded":"2026-02-17T21:12:28.517875+0000","last_fullsized":"2026-02-17T21:12:28.517875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:12:28.514169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:12:28.514169+0000","last_clean_scrub_stamp":"2026-02-17T21:12:28.514169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T01:16:46.127048+0000","scrub_duration":157,"objects_trimmed":0,"snaptrim_duration":0.036804456999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:12:23.451293+0000","last_change":"2026-02-17T21:12:23.456060+0000","last_active":"2026-02-17T21:12:23.451293+0000","last_peered":"2026-02-17T21:12:23.451293+0000","last_clean":"2026-02-17T21:12:23.451293+0000","last_became_active":"2026-02-17T21:07:09.674257+0000","last_became_peered":"2026-02-17T21:07:09.674257+0000","last_unstale":"2026-02-17T21:12:23.451293+0000","last_undegraded":"2026-02-17T21:12:23.451293+0000","last_fullsized":"2026-02-17T21:12:23.451293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:12:23.447927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:12:23.447927+0000","last_clean_scrub_stamp":"2026-02-17T21:12:23.447927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T06:13:27.191693+0000","scrub_duration":195,"objects_trimmed":0,"snaptrim_duration":0.033871934999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:12:26.404338+0000","last_change":"2026-02-17T21:12:26.405189+0000","last_active":"2026-02-17T21:12:26.404338+0000","last_peered":"2026-02-17T21:12:26.404338+0000","last_clean":"2026-02-17T21:12:26.404338+0000","last_became_active":"2026-02-17T21:07:09.679096+0000","last_became_peered":"2026-02-17T21:07:09.679096+0000","last_unstale":"2026-02-17T21:12:26.404338+0000","last_undegraded":"2026-02-17T21:12:26.404338+0000","last_fullsized":"2026-02-17T21:12:26.404338+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2026-02-17T21:12:26.402576+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2026-02-17T21:12:26.402576+0000","last_clean_scrub_stamp":"2026-02-17T21:12:26.402576+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:01:14.750016+0000","scrub_duration":165,"objects_trimmed":0,"snaptrim_duration":0.036788098999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:12:27.671145+0000","last_change":"2026-02-17T21:12:27.676036+0000","last_active":"2026-02-17T21:12:27.671145+0000","last_peered":"2026-02-17T21:12:27.671145+0000","last_clean":"2026-02-17T21:12:27.671145+0000","last_became_active":"2026-02-17T21:07:09.677404+0000","last_became_peered":"2026-02-17T21:07:09.677404+0000","last_unstale":"2026-02-17T21:12:27.671145+0000","last_undegraded":"2026-02-17T21:12:27.671145+0000","last_fullsized":"2026-02-17T21:12:27.671145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:12:27.664433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:12:27.664433+0000","last_clean_scrub_stamp":"2026-02-17T21:12:27.664433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T02:10:04.947868+0000","scrub_duration":110,"objects_trimmed":0,"snaptrim_duration":0.047884902999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:12:25.559009+0000","last_change":"2026-02-17T21:12:25.563657+0000","last_active":"2026-02-17T21:12:25.559009+0000","last_peered":"2026-02-17T21:12:25.559009+0000","last_clean":"2026-02-17T21:12:25.559009+0000","last_became_active":"2026-02-17T21:07:09.663986+0000","last_became_peered":"2026-02-17T21:07:09.663986+0000","last_unstale":"2026-02-17T21:12:25.559009+0000","last_undegraded":"2026-02-17T21:12:25.559009+0000","last_fullsized":"2026-02-17T21:12:25.559009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T21:12:25.555387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T21:12:25.555387+0000","last_clean_scrub_stamp":"2026-02-17T21:12:25.555387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T07:00:34.638587+0000","scrub_duration":188,"objects_trimmed":0,"snaptrim_duration":0.039512685999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:12:28.757986+0000","last_change":"2026-02-17T21:12:28.758840+0000","last_active":"2026-02-17T21:12:28.757986+0000","last_peered":"2026-02-17T21:12:28.757986+0000","last_clean":"2026-02-17T21:12:28.757986+0000","last_became_active":"2026-02-17T21:07:09.717514+0000","last_became_peered":"2026-02-17T21:07:09.717514+0000","last_unstale":"2026-02-17T21:12:28.757986+0000","last_undegraded":"2026-02-17T21:12:28.757986+0000","last_fullsized":"2026-02-17T21:12:28.757986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2026-02-17T21:12:28.756514+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2026-02-17T21:12:28.756514+0000","last_clean_scrub_stamp":"2026-02-17T21:12:28.756514+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-18T23:35:30.668086+0000","scrub_duration":164,"objects_trimmed":0,"snaptrim_duration":0.031434124000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5],"acting":[14,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"33'34","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-17T21:12:26.886797+0000","last_change":"2026-02-17T21:12:26.890002+0000","last_active":"2026-02-17T21:12:26.886797+0000","last_peered":"2026-02-17T21:12:26.886797+0000","last_clean":"2026-02-17T21:12:26.886797+0000","last_became_active":"2026-02-17T21:07:06.988047+0000","last_became_peered":"2026-02-17T21:07:06.988047+0000","last_unstale":"2026-02-17T21:12:26.886797+0000","last_undegraded":"2026-02-17T21:12:26.886797+0000","last_fullsized":"2026-02-17T21:12:26.886797+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2026-02-17T21:12:26.883306+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2026-02-17T21:12:26.883306+0000","last_clean_scrub_stamp":"2026-02-17T21:12:26.883306+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T00:09:33.536032+0000","scrub_duration":264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,15],"acting":[6,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":27,"seq":115964117068,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,6,9,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 15 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":14,"up_from":27,"seq":115964117068,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,5,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 14 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":11,"up_from":27,"seq":115964117068,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 11 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":8,"up_from":21,"seq":90194313288,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[3,4,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 8 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":3,"up_from":22,"seq":94489280585,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[2,4,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 3 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":4,"up_from":22,"seq":94489280584,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27589065},"hb_peers":[0,3,5,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313289,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,6,7,8,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 12 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":13,"up_from":22,"seq":94489280584,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":360448,"data_stored":154248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149770,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,5,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 0 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":6,"up_from":23,"seq":98784247880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":757760,"data_stored":552069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[1,3,4,5,7,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 6 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":10,"up_from":24,"seq":103079215176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[3,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":26,"seq":111669149772,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,2,4,5,6,7,8,9,10,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":26,"seq":111669149769,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,4,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 5 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":7,"up_from":26,"seq":111669149772,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[1,2,3,4,6,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 7 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":9,"up_from":26,"seq":111669149771,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27589057},"hb_peers":[1,3,4,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 9 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]},{"osd":2,"up_from":27,"seq":115964117069,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27312,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":356352,"data_stored":154229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[" osd: 2 BLUESTORE_SLOW_OP_ALERT:observed slow operation indications in BlueStore"]}],"pool_statfs":[{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T21:12:48.933 DEBUG:teuthology.orchestra.run.trial045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-17T21:12:48.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.005+0000 7f105cf61640 10 monclient: get_monmap_and_config 2026-02-17T21:12:48.998 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.005+0000 7f105cf61640 10 monclient: build_initial_monmap 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.005+0000 7f105cf61640 10 monclient: monmap: 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:12:49.006541+0000 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:12:49.006541+0000 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:0: v1:10.20.193.45:6789/0 mon.noname-a-legacy 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:1: v1:10.20.193.86:6789/0 mon.noname-b-legacy 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:2: v1:10.20.193.92:6789/0 mon.noname-c-legacy 2026-02-17T21:12:48.999 INFO:teuthology.orchestra.run.trial045.stderr:3: v2:10.20.193.45:3300/0 mon.noname-a 2026-02-17T21:12:49.000 INFO:teuthology.orchestra.run.trial045.stderr:4: v2:10.20.193.86:3300/0 mon.noname-b 2026-02-17T21:12:49.000 INFO:teuthology.orchestra.run.trial045.stderr:5: v2:10.20.193.92:3300/0 mon.noname-c 2026-02-17T21:12:49.000 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:49.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 1 Processor -- start 2026-02-17T21:12:49.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 1 -- start start 2026-02-17T21:12:49.000 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient: init 2026-02-17T21:12:49.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:49.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient: _add_conns ranks=[5,2,3,0,4,1] 2026-02-17T21:12:49.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f105815d1e0 0x7f105815d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:49.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient(hunting): picked mon.noname-c con 0x7f105815d1e0 addr v2:10.20.193.92:3300/0 2026-02-17T21:12:49.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f10580748e0 addr v1:10.20.193.92:6789/0 2026-02-17T21:12:49.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f10580c92b0 0x7f1058153610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:49.003 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient(hunting): picked mon.noname-a con 0x7f10580c92b0 addr v2:10.20.193.45:3300/0 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 1 -- --> v1:10.20.193.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10580c5860 con 0x7f10580748e0 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 1 -- --> v2:10.20.193.45:3300/0 -- mon_getmap magic: 0 -- 0x7f10580c5580 con 0x7f10580c92b0 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 1 -- --> v2:10.20.193.92:3300/0 -- mon_getmap magic: 0 -- 0x7f10580c7de0 con 0x7f105815d1e0 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.006+0000 7f105cf61640 10 monclient(hunting): authenticate will time out at 1352.636688s 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056d76640 1 --2- >> v2:10.20.193.45:3300/0 conn(0x7f10580c92b0 0x7f1058153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056575640 1 --2- >> v2:10.20.193.92:3300/0 conn(0x7f105815d1e0 0x7f105815d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1055d74640 1 --1- >> v1:10.20.193.92:6789/0 conn(0x7f10580748e0 0x7f10580c8ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.92:6789/0 says I am v1:10.20.193.45:37088/0 (socket says 10.20.193.45:37088) 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1055d74640 1 -- 10.20.193.45:0/2576869908 learned_addr learned my addr 10.20.193.45:0/2576869908 (peer_addr_for_me v1:10.20.193.45:0/0) 2026-02-17T21:12:49.004 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056d76640 10 monclient(hunting): get_auth_request con 0x7f10580c92b0 auth_method 0 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056575640 10 monclient(hunting): get_auth_request con 0x7f105815d1e0 auth_method 0 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:49.005 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.007+0000 7f1056575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.008+0000 7f1056d76640 10 monclient(hunting): handle_auth_done global_id 5277 payload 274 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.008+0000 7f1056d76640 1 -- 10.20.193.45:0/2576869908 >> v2:10.20.193.92:3300/0 conn(0x7f105815d1e0 msgr2=0x7f105815d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.008+0000 7f1056d76640 1 --2- 10.20.193.45:0/2576869908 >> v2:10.20.193.92:3300/0 conn(0x7f105815d1e0 0x7f105815d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.008+0000 7f1056d76640 1 -- 10.20.193.45:0/2576869908 >> v1:10.20.193.92:6789/0 conn(0x7f10580748e0 legacy=0x7f10580c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.008+0000 7f1056d76640 10 monclient: _finish_hunting 0 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.008+0000 7f1056d76640 1 monclient: found mon.noname-a 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.008+0000 7f1056d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.008+0000 7f1056d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.008+0000 7f1056d76640 1 -- 10.20.193.45:0/2576869908 --> v2:10.20.193.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10580c80c0 con 0x7f10580c92b0 2026-02-17T21:12:49.006 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.009+0000 7f1056d76640 1 --2- 10.20.193.45:0/2576869908 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f10580c92b0 0x7f1058153610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1048009d90 tx=0x7f104802f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdc156cac9556bd server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:49.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 1 -- 10.20.193.45:0/2576869908 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104803c070 con 0x7f10580c92b0 2026-02-17T21:12:49.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:49.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:49.012 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 10 monclient: dump: 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:49.013 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 10 monclient: _finish_auth 0 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 10 monclient: _check_auth_tickets 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 1 -- 10.20.193.45:0/2576869908 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1048037440 con 0x7f10580c92b0 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 1 -- 10.20.193.45:0/2576869908 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048037810 con 0x7f10580c92b0 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 5 monclient: authenticate success, global_id 5277 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 10 monclient: get_monmap_and_config success 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 4 set_mon_vals no callback set 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f1055573640 10 monclient: dump: 2026-02-17T21:12:49.014 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 10 monclient: shutdown 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 1 -- 10.20.193.45:0/2576869908 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f10580c92b0 msgr2=0x7f1058153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:49.015 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 1 --2- 10.20.193.45:0/2576869908 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f10580c92b0 0x7f1058153610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1048009d90 tx=0x7f104802f1e0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 1 -- 10.20.193.45:0/2576869908 shutdown_connections 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 1 --2- 10.20.193.45:0/2576869908 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f10580c92b0 0x7f1058153610 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 1 --2- 10.20.193.45:0/2576869908 >> v2:10.20.193.92:3300/0 conn(0x7f105815d1e0 0x7f105815d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 1 -- 10.20.193.45:0/2576869908 >> 10.20.193.45:0/2576869908 conn(0x7f10580c9d40 msgr2=0x7f10580ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 1 -- 10.20.193.45:0/2576869908 shutdown_connections 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.011+0000 7f105cf61640 1 -- 10.20.193.45:0/2576869908 wait complete. 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.012+0000 7f105cf61640 10 monclient: build_initial_monmap 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.012+0000 7f105cf61640 10 monclient: monmap: 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:epoch 0 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 0.000000 2026-02-17T21:12:49.016 INFO:teuthology.orchestra.run.trial045.stderr:created 0.000000 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 0 (unknown) 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.noname-a 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.noname-b 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.noname-c 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.012+0000 7f105cf61640 1 librados: starting msgr at 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.012+0000 7f105cf61640 1 librados: starting objecter 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.012+0000 7f105cf61640 1 Processor -- start 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.012+0000 7f105cf61640 1 -- start start 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.012+0000 7f105cf61640 1 librados: setting wanted keys 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.012+0000 7f105cf61640 1 librados: calling monclient init 2026-02-17T21:12:49.017 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.012+0000 7f105cf61640 10 monclient: init 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient: _reopen_session rank -1 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 1 --2- >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f10580748e0 0x7f10581458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient(hunting): picked mon.noname-b con 0x7f10580748e0 addr [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10580c92b0 0x7f10581f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient(hunting): picked mon.noname-c con 0x7f10580c92b0 addr [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f105815d1e0 0x7f10581f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient(hunting): picked mon.noname-a con 0x7f105815d1e0 addr [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 1 -- --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1058074d30 con 0x7f105815d1e0 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:49.018 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 1 -- --> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] -- mon_getmap magic: 0 -- 0x7f10580c8680 con 0x7f10580748e0 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient(hunting): start opening mon connection 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1058153b50 con 0x7f10580c92b0 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient(hunting): _renew_subs 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f105cf61640 10 monclient(hunting): authenticate will time out at 1352.643267s 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f105815d1e0 0x7f10581f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1055d74640 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10580c92b0 0x7f10581f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 1 --2- >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f105815d1e0 0x7f10581f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.45:3300/0 says I am v2:10.20.193.45:57092/0 (socket says 10.20.193.45:57092) 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 1 -- 10.20.193.45:0/1144549542 learned_addr learned my addr 10.20.193.45:0/1144549542 (peer_addr_for_me v2:10.20.193.45:0/0) 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 10 monclient(hunting): get_auth_request con 0x7f105815d1e0 auth_method 0 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:49.019 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056575640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f10580748e0 0x7f10581458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1055d74640 10 monclient(hunting): get_auth_request con 0x7f10580c92b0 auth_method 0 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1055d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1055d74640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1055d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056575640 10 monclient(hunting): get_auth_request con 0x7f10580748e0 auth_method 0 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056575640 10 monclient(hunting): _init_auth method 2 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056575640 10 monclient(hunting): _init_auth creating new auth 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.013+0000 7f1056d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:49.020 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.014+0000 7f1055d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.014+0000 7f1055d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.014+0000 7f1055d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.014+0000 7f1056575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.014+0000 7f1056575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.014+0000 7f1056575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 10 monclient(hunting): handle_auth_done global_id 5280 payload 824 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 1 -- 10.20.193.45:0/1144549542 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10580c92b0 msgr2=0x7f10581f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10580c92b0 0x7f10581f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 1 -- 10.20.193.45:0/1144549542 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f10580748e0 msgr2=0x7f10581458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f10580748e0 0x7f10581458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 10 monclient: _finish_hunting 0 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 1 monclient: found mon.noname-a 2026-02-17T21:12:49.021 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.45:3300/0 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.015+0000 7f1056d76640 1 -- 10.20.193.45:0/1144549542 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1058073460 con 0x7f105815d1e0 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.016+0000 7f1056d76640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f105815d1e0 0x7f10581f4330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f104803a040 tx=0x7f1048004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.016+0000 7f103effd640 10 client.?.objecter ms_handle_connect 0x7f105815d1e0 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.016+0000 7f103effd640 10 client.?.objecter resend_mon_ops 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 1 -- 10.20.193.45:0/1144549542 <== mon.0 v2:10.20.193.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104803c050 con 0x7f105815d1e0 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 10 monclient: dump: 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:49.022 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 10 monclient: _finish_auth 0 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 10 monclient: _check_auth_tickets 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 1 -- 10.20.193.45:0/1144549542 <== mon.0 v2:10.20.193.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1048048070 con 0x7f105815d1e0 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 10 monclient: handle_config config(0 keys) 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 1 -- 10.20.193.45:0/1144549542 <== mon.0 v2:10.20.193.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048035a90 con 0x7f105815d1e0 2026-02-17T21:12:49.023 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f1054d72640 4 set_mon_vals no callback set 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f103effd640 10 monclient: dump: 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:epoch 1 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:fsid d3d77e88-f8f0-42ae-9378-6b5f15ec2a21 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:last_changed 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:created 2026-02-17T21:03:31.024555+0000 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:min_mon_release 19 (squid) 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:election_strategy: 1 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:0: [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] mon.a 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:1: [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] mon.b 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr:2: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.c 2026-02-17T21:12:49.024 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 5 monclient: authenticate success, global_id 5280 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 10 monclient: _renew_subs 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1058073740 con 0x7f105815d1e0 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 10 client.5280.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 10 monclient: _renew_subs 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1058073d00 con 0x7f105815d1e0 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 1 librados: init done 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:49.025 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:49.026 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.018+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f105814fb60 con 0x7f105815d1e0 2026-02-17T21:12:49.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.030+0000 7f103effd640 1 -- 10.20.193.45:0/1144549542 <== mon.0 v2:10.20.193.45:3300/0 4 ==== mgrmap(e 5) ==== 100245+0+0 (secure 0 0 0) 0x7f1048035c30 con 0x7f105815d1e0 2026-02-17T21:12:49.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.031+0000 7f103effd640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f10240792d0 0x7f102407b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:12:49.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.031+0000 7f1056575640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f10240792d0 0x7f102407b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:12:49.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.031+0000 7f1056575640 10 monclient: get_auth_request con 0x7f10240792d0 auth_method 0 2026-02-17T21:12:49.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.031+0000 7f1056575640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f10240792d0 0x7f102407b790 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f104c009ba0 tx=0x7f104c009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:12:49.027 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.031+0000 7f103effd640 10 client.5280.objecter ms_handle_connect 0x7f10240792d0 2026-02-17T21:12:49.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.032+0000 7f103effd640 1 -- 10.20.193.45:0/1144549542 <== mon.0 v2:10.20.193.45:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 8944+0+0 (secure 0 0 0) 0x7f10480848a0 con 0x7f105815d1e0 2026-02-17T21:12:49.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.032+0000 7f103effd640 10 client.5280.objecter ms_dispatch2 0x7f1058000b90 osd_map(33..33 src has 1..33) 2026-02-17T21:12:49.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.032+0000 7f103effd640 3 client.5280.objecter handle_osd_map got epochs [33,33] > 0 2026-02-17T21:12:49.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.032+0000 7f103effd640 3 client.5280.objecter handle_osd_map decoding full epoch 33 2026-02-17T21:12:49.028 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.033+0000 7f103effd640 20 client.5280.objecter dump_active .. 0 homeless 2026-02-17T21:12:49.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.137+0000 7f103effd640 1 -- 10.20.193.45:0/1144549542 <== mon.0 v2:10.20.193.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f105814fb60 con 0x7f105815d1e0 2026-02-17T21:12:49.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.137+0000 7f103effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-17T21:12:49.130 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.137+0000 7f103effd640 10 monclient: _finish_command 1 = system:0 2026-02-17T21:12:49.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.220+0000 7f105cf61640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T21:12:49.213 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.220+0000 7f105cf61640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T21:12:49.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.220+0000 7f105cf61640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.45:3300/0 2026-02-17T21:12:49.214 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.220+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 --> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1058153f30 con 0x7f105815d1e0 2026-02-17T21:12:49.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.268+0000 7f103effd640 1 -- 10.20.193.45:0/1144549542 <== mon.0 v2:10.20.193.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7f1048088860 con 0x7f105815d1e0 2026-02-17T21:12:49.260 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.268+0000 7f103effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-17T21:12:49.261 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.268+0000 7f103effd640 10 monclient: _finish_command 2 = system:0 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 10 librados: watch_flush enter 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 10 librados: watch_flush exit 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 20 client.5280.objecter shutdown clearing up homeless session... 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 10 client.5280.objecter successfully canceled tick 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f10240792d0 msgr2=0x7f102407b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f10240792d0 0x7f102407b790 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f104c009ba0 tx=0x7f104c009290 comp rx=0 tx=0).stop 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 10 monclient: shutdown 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f105815d1e0 msgr2=0x7f10581f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:12:49.263 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f105815d1e0 0x7f10581f4330 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f104803a040 tx=0x7f1048004b40 comp rx=0 tx=0).stop 2026-02-17T21:12:49.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 shutdown_connections 2026-02-17T21:12:49.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:6800/3582093432,v1:10.20.193.45:6801/3582093432] conn(0x7f10240792d0 0x7f102407b790 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.45:3300/0,v1:10.20.193.45:6789/0] conn(0x7f105815d1e0 0x7f10581f4330 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10580c92b0 0x7f10581f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 --2- 10.20.193.45:0/1144549542 >> [v2:10.20.193.86:3300/0,v1:10.20.193.86:6789/0] conn(0x7f10580748e0 0x7f10581458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:12:49.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 >> 10.20.193.45:0/1144549542 conn(0x7f10580c9d40 msgr2=0x7f10581e8160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:12:49.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 shutdown_connections 2026-02-17T21:12:49.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 -- 10.20.193.45:0/1144549542 wait complete. 2026-02-17T21:12:49.264 INFO:teuthology.orchestra.run.trial045.stderr:2026-02-17T21:12:49.269+0000 7f105cf61640 1 librados: shutdown 2026-02-17T21:12:49.271 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-17T21:12:49.274 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-17T21:12:49.274 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-17T21:12:49.275 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-17T21:12:49.275 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:12:49.282 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:12:49.285+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 27040) UID: 0 2026-02-17T21:12:49.282 INFO:tasks.ceph.osd.0.trial045.stderr:2026-02-17T21:12:49.286+0000 c69b640 -1 osd.0 33 *** Got signal Terminated *** 2026-02-17T21:12:50.396 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:57.609 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:50.426 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:07:57.636 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:50.427 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:57.640 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:50.428 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:07:57.638 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:50.436 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:07:57.649 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:50.437 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:07:57.647 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:50.454 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:07:57.627 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:50.455 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:07:57.628 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:50.464 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:07:57.637 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:12:55.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-17T21:12:55.377 INFO:tasks.ceph.osd.0:Stopped 2026-02-17T21:12:55.377 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-17T21:12:55.377 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:12:55.384 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-17T21:12:55.387+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 27042) UID: 0 2026-02-17T21:12:55.385 INFO:tasks.ceph.osd.4.trial045.stderr:2026-02-17T21:12:55.388+0000 c69b640 -1 osd.4 35 *** Got signal Terminated *** 2026-02-17T21:13:01.480 INFO:tasks.ceph.osd.4:Stopped 2026-02-17T21:13:01.480 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-17T21:13:01.480 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:01.487 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-17T21:13:01.490+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 27094) UID: 0 2026-02-17T21:13:01.487 INFO:tasks.ceph.osd.8.trial045.stderr:2026-02-17T21:13:01.491+0000 c69b640 -1 osd.8 37 *** Got signal Terminated *** 2026-02-17T21:13:02.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2026-02-17T21:13:02.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-17T21:13:07.582 INFO:tasks.ceph.osd.8:Stopped 2026-02-17T21:13:07.583 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-17T21:13:07.583 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:07.591 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-17T21:13:07.593+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 27096) UID: 0 2026-02-17T21:13:07.591 INFO:tasks.ceph.osd.12.trial045.stderr:2026-02-17T21:13:07.594+0000 c69b640 -1 osd.12 39 *** Got signal Terminated *** 2026-02-17T21:13:08.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 is failed for ~0s 2026-02-17T21:13:08.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2026-02-17T21:13:10.424 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:17.636 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:10.452 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:17.665 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:10.464 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:17.677 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:10.480 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:08:17.690 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:10.481 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:08:17.692 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:10.482 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:08:17.655 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:10.484 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:08:17.657 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:10.493 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:08:17.704 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:10.496 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:08:17.669 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:13.685 INFO:tasks.ceph.osd.12:Stopped 2026-02-17T21:13:13.685 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-17T21:13:13.686 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:13.693 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:13:13.691+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 26832) UID: 0 2026-02-17T21:13:13.693 INFO:tasks.ceph.osd.1.trial086.stderr:2026-02-17T21:13:13.691+0000 c69b640 -1 osd.1 41 *** Got signal Terminated *** 2026-02-17T21:13:15.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.8 has been restored 2026-02-17T21:13:19.787 INFO:tasks.ceph.osd.1:Stopped 2026-02-17T21:13:19.788 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-17T21:13:19.788 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:19.795 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:13:19.793+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 26836) UID: 0 2026-02-17T21:13:19.795 INFO:tasks.ceph.osd.5.trial086.stderr:2026-02-17T21:13:19.794+0000 c69b640 -1 osd.5 42 *** Got signal Terminated *** 2026-02-17T21:13:25.890 INFO:tasks.ceph.osd.5:Stopped 2026-02-17T21:13:25.890 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-17T21:13:25.890 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:25.898 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:13:25.896+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 26839) UID: 0 2026-02-17T21:13:25.898 INFO:tasks.ceph.osd.9.trial086.stderr:2026-02-17T21:13:25.897+0000 c69b640 -1 osd.9 44 *** Got signal Terminated *** 2026-02-17T21:13:30.465 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:37.678 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:30.492 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:08:37.702 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:30.492 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:37.705 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:30.493 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:08:37.666 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:30.493 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:08:37.704 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:30.495 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:08:37.668 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:30.504 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:37.717 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:30.504 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:08:37.714 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:30.505 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:08:37.678 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:31.992 INFO:tasks.ceph.osd.9:Stopped 2026-02-17T21:13:31.992 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-17T21:13:31.992 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:32.000 INFO:tasks.ceph.osd.13.trial086.stderr:2026-02-17T21:13:31.997+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 26841) UID: 0 2026-02-17T21:13:32.000 INFO:tasks.ceph.osd.13.trial086.stderr:2026-02-17T21:13:31.998+0000 c69b640 -1 osd.13 46 *** Got signal Terminated *** 2026-02-17T21:13:35.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-17T21:13:38.094 INFO:tasks.ceph.osd.13:Stopped 2026-02-17T21:13:38.094 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-17T21:13:38.095 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:38.102 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:13:38.102+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 26528) UID: 0 2026-02-17T21:13:38.103 INFO:tasks.ceph.osd.2.trial092.stderr:2026-02-17T21:13:38.103+0000 c69b640 -1 osd.2 48 *** Got signal Terminated *** 2026-02-17T21:13:41.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-17T21:13:44.197 INFO:tasks.ceph.osd.2:Stopped 2026-02-17T21:13:44.197 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-17T21:13:44.197 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:44.205 INFO:tasks.ceph.osd.6.trial092.stderr:2026-02-17T21:13:44.205+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 26531) UID: 0 2026-02-17T21:13:44.205 INFO:tasks.ceph.osd.6.trial092.stderr:2026-02-17T21:13:44.206+0000 c69b640 -1 osd.6 49 *** Got signal Terminated *** 2026-02-17T21:13:47.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2026-02-17T21:13:50.299 INFO:tasks.ceph.osd.6:Stopped 2026-02-17T21:13:50.300 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-17T21:13:50.300 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:50.307 INFO:tasks.ceph.osd.10.trial092.stderr:2026-02-17T21:13:50.307+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 26534) UID: 0 2026-02-17T21:13:50.308 INFO:tasks.ceph.osd.10.trial092.stderr:2026-02-17T21:13:50.308+0000 c69b640 -1 osd.10 51 *** Got signal Terminated *** 2026-02-17T21:13:50.521 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:57.733 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:50.522 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:57.735 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:50.532 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:08:57.745 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:50.548 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:08:57.758 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:50.549 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:08:57.721 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:50.549 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:08:57.759 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:50.550 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:08:57.722 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:50.559 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:08:57.769 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:50.560 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:08:57.732 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:13:53.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2026-02-17T21:13:56.402 INFO:tasks.ceph.osd.10:Stopped 2026-02-17T21:13:56.402 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-17T21:13:56.403 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:13:56.410 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:13:56.410+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 26536) UID: 0 2026-02-17T21:13:56.410 INFO:tasks.ceph.osd.14.trial092.stderr:2026-02-17T21:13:56.410+0000 c69b640 -1 osd.14 52 *** Got signal Terminated *** 2026-02-17T21:13:59.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2026-02-17T21:14:02.504 INFO:tasks.ceph.osd.14:Stopped 2026-02-17T21:14:02.505 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-17T21:14:02.505 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:14:02.523 INFO:tasks.ceph.osd.3.trial138.stderr:2026-02-17T21:14:02.521+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 27164) UID: 0 2026-02-17T21:14:02.523 INFO:tasks.ceph.osd.3.trial138.stderr:2026-02-17T21:14:02.522+0000 c69b640 -1 osd.3 53 *** Got signal Terminated *** 2026-02-17T21:14:05.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-17T21:14:05.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2026-02-17T21:14:08.607 INFO:tasks.ceph.osd.3:Stopped 2026-02-17T21:14:08.607 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-17T21:14:08.607 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:14:08.614 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:14:08.612+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 27167) UID: 0 2026-02-17T21:14:08.615 INFO:tasks.ceph.osd.7.trial138.stderr:2026-02-17T21:14:08.613+0000 c69b640 -1 osd.7 53 *** Got signal Terminated *** 2026-02-17T21:14:10.552 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:09:17.725 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:10.553 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:09:17.765 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:10.553 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:09:17.763 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:10.554 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:09:17.767 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:10.554 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:09:17.727 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:10.554 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:09:17.764 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:10.563 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:09:17.735 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:10.563 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:09:17.773 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:10.564 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:09:17.777 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:11.165 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-17T21:14:14.709 INFO:tasks.ceph.osd.7:Stopped 2026-02-17T21:14:14.710 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-17T21:14:14.710 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:14:14.717 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:14:14.715+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 27170) UID: 0 2026-02-17T21:14:14.718 INFO:tasks.ceph.osd.11.trial138.stderr:2026-02-17T21:14:14.716+0000 c69b640 -1 osd.11 53 *** Got signal Terminated *** 2026-02-17T21:14:22.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 is failed for ~0s 2026-02-17T21:14:26.913 INFO:tasks.ceph.osd.11:Stopped 2026-02-17T21:14:26.913 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-17T21:14:26.913 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:14:26.920 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:14:26.920+0000 c69b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 27172) UID: 0 2026-02-17T21:14:26.920 INFO:tasks.ceph.osd.15.trial138.stderr:2026-02-17T21:14:26.920+0000 c69b640 -1 osd.15 53 *** Got signal Terminated *** 2026-02-17T21:14:28.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 has been restored 2026-02-17T21:14:30.582 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:09:37.795 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:30.584 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:09:37.796 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:30.593 INFO:tasks.ceph.mon.a.trial045.stderr:==00:00:09:37.806 26667== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:30.609 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:09:37.782 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:30.609 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:09:37.820 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:30.610 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:09:37.783 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:30.610 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:09:37.821 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:30.618 INFO:tasks.ceph.mon.c.trial092.stderr:==00:00:09:37.791 26295== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:30.620 INFO:tasks.ceph.mon.b.trial086.stderr:==00:00:09:37.830 26599== Warning: unimplemented fcntl command: 1036 2026-02-17T21:14:33.014 INFO:tasks.ceph.osd.15:Stopped 2026-02-17T21:14:33.015 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-17T21:14:33.015 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-17T21:14:33.015 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:14:33.016 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:14:33.023+0000 7ff9f6bdb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 26715) UID: 0 2026-02-17T21:14:33.016 INFO:tasks.ceph.mgr.y.trial045.stderr:2026-02-17T21:14:33.023+0000 7ff9f6bdb640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-17T21:14:33.048 INFO:tasks.ceph.mgr.y:Stopped 2026-02-17T21:14:33.049 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-17T21:14:33.049 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:14:33.081 INFO:tasks.ceph.mgr.x:Stopped 2026-02-17T21:14:33.082 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-17T21:14:33.082 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-17T21:14:33.082 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:14:33.097 INFO:tasks.ceph.mon.a.trial045.stderr:2026-02-17T21:14:33.099+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 26665) UID: 0 2026-02-17T21:14:33.097 INFO:tasks.ceph.mon.a.trial045.stderr:2026-02-17T21:14:33.100+0000 aca4640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T21:14:38.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-17T21:14:39.184 INFO:tasks.ceph.mon.a:Stopped 2026-02-17T21:14:39.185 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-17T21:14:39.185 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:14:39.193 INFO:tasks.ceph.mon.b.trial086.stderr:2026-02-17T21:14:39.189+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 26597) UID: 0 2026-02-17T21:14:39.194 INFO:tasks.ceph.mon.b.trial086.stderr:2026-02-17T21:14:39.190+0000 aca4640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-17T21:14:43.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-17T21:14:43.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-17T21:14:45.286 INFO:tasks.ceph.mon.b:Stopped 2026-02-17T21:14:45.287 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-17T21:14:45.287 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-17T21:14:45.295 INFO:tasks.ceph.mon.c.trial092.stderr:2026-02-17T21:14:45.294+0000 aca4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 26293) UID: 0 2026-02-17T21:14:45.296 INFO:tasks.ceph.mon.c.trial092.stderr:2026-02-17T21:14:45.295+0000 aca4640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-17T21:14:48.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-17T21:14:48.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-17T21:14:51.389 INFO:tasks.ceph.mon.c:Stopped 2026-02-17T21:14:51.389 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-17T21:14:51.390 DEBUG:teuthology.orchestra.run.trial045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T21:14:51.420 INFO:teuthology.orchestra.run.trial045.stdout:2026-02-17T21:06:59.300513+0000 mon.a (mon.0) 174 : cluster [WRN] Health check failed: 3 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-17T21:14:51.420 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2026-02-17T21:14:51.421 DEBUG:teuthology.orchestra.run.trial045:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T21:14:51.486 DEBUG:teuthology.orchestra.run.trial045:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T21:14:51.553 DEBUG:teuthology.orchestra.run.trial045:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | head -n 1 2026-02-17T21:14:51.619 INFO:teuthology.orchestra.run.trial045.stdout:2026-02-17T21:06:59.300513+0000 mon.a (mon.0) 174 : cluster [WRN] Health check failed: 3 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2026-02-17T21:14:51.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:14:51.620 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-17T21:14:51.689 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:14:51.689 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-17T21:14:51.760 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:14:51.760 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-17T21:14:51.828 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:14:51.828 DEBUG:teuthology.orchestra.run.trial045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-17T21:14:51.900 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:14:51.901 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-17T21:14:51.940 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:14:51.940 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-17T21:14:52.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:14:52.009 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-17T21:14:52.076 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:14:52.077 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-17T21:14:52.143 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:14:52.143 DEBUG:teuthology.orchestra.run.trial092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-17T21:14:52.177 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:14:52.177 DEBUG:teuthology.orchestra.run.trial092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-17T21:14:52.250 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:14:52.250 DEBUG:teuthology.orchestra.run.trial092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-17T21:14:52.318 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:14:52.319 DEBUG:teuthology.orchestra.run.trial092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-17T21:14:52.386 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:14:52.386 DEBUG:teuthology.orchestra.run.trial138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-17T21:14:52.418 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:14:52.418 DEBUG:teuthology.orchestra.run.trial138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-17T21:14:52.486 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:14:52.486 DEBUG:teuthology.orchestra.run.trial138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-17T21:14:52.561 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:14:52.561 DEBUG:teuthology.orchestra.run.trial138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-17T21:14:52.631 INFO:tasks.ceph:Archiving mon data... 2026-02-17T21:14:52.634 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/data/mon.a.tgz 2026-02-17T21:14:52.634 DEBUG:teuthology.orchestra.run.trial045:> mktemp 2026-02-17T21:14:52.652 INFO:teuthology.orchestra.run.trial045.stdout:/tmp/tmp.VFhEDKG9DO 2026-02-17T21:14:52.652 DEBUG:teuthology.orchestra.run.trial045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VFhEDKG9DO 2026-02-17T21:14:52.762 DEBUG:teuthology.orchestra.run.trial045:> sudo chmod 0666 /tmp/tmp.VFhEDKG9DO 2026-02-17T21:14:52.844 DEBUG:teuthology.orchestra.remote:trial045:/tmp/tmp.VFhEDKG9DO is 416KB 2026-02-17T21:14:52.944 DEBUG:teuthology.orchestra.run.trial045:> rm -fr /tmp/tmp.VFhEDKG9DO 2026-02-17T21:14:52.961 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/data/mon.b.tgz 2026-02-17T21:14:52.961 DEBUG:teuthology.orchestra.run.trial086:> mktemp 2026-02-17T21:14:52.980 INFO:teuthology.orchestra.run.trial086.stdout:/tmp/tmp.sPF6610spK 2026-02-17T21:14:52.980 DEBUG:teuthology.orchestra.run.trial086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.sPF6610spK 2026-02-17T21:14:53.090 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 0666 /tmp/tmp.sPF6610spK 2026-02-17T21:14:53.172 DEBUG:teuthology.orchestra.remote:trial086:/tmp/tmp.sPF6610spK is 417KB 2026-02-17T21:14:53.268 DEBUG:teuthology.orchestra.run.trial086:> rm -fr /tmp/tmp.sPF6610spK 2026-02-17T21:14:53.285 DEBUG:teuthology.misc:Transferring archived files from trial092:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/data/mon.c.tgz 2026-02-17T21:14:53.286 DEBUG:teuthology.orchestra.run.trial092:> mktemp 2026-02-17T21:14:53.304 INFO:teuthology.orchestra.run.trial092.stdout:/tmp/tmp.pSxzp7WFAi 2026-02-17T21:14:53.304 DEBUG:teuthology.orchestra.run.trial092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.pSxzp7WFAi 2026-02-17T21:14:53.417 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod 0666 /tmp/tmp.pSxzp7WFAi 2026-02-17T21:14:53.498 DEBUG:teuthology.orchestra.remote:trial092:/tmp/tmp.pSxzp7WFAi is 417KB 2026-02-17T21:14:53.593 DEBUG:teuthology.orchestra.run.trial092:> rm -fr /tmp/tmp.pSxzp7WFAi 2026-02-17T21:14:53.611 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-17T21:14:53.611 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T21:14:53.614 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T21:14:53.618 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T21:14:53.654 DEBUG:teuthology.orchestra.run.trial138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-17T21:14:53.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-17T21:14:53.951 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-17T21:14:54.699 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-17T21:14:54.699 INFO:tasks.ceph:Archiving crash dumps... 2026-02-17T21:14:54.702 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial045/crash 2026-02-17T21:14:54.703 DEBUG:teuthology.orchestra.run.trial045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T21:14:54.729 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial086/crash 2026-02-17T21:14:54.730 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T21:14:54.756 DEBUG:teuthology.misc:Transferring archived files from trial092:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial092/crash 2026-02-17T21:14:54.757 DEBUG:teuthology.orchestra.run.trial092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T21:14:54.783 DEBUG:teuthology.misc:Transferring archived files from trial138:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial138/crash 2026-02-17T21:14:54.784 DEBUG:teuthology.orchestra.run.trial138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-17T21:14:54.811 INFO:tasks.ceph:Compressing logs... 2026-02-17T21:14:54.812 DEBUG:teuthology.orchestra.run.trial045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:14:54.814 DEBUG:teuthology.orchestra.run.trial086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:14:54.817 DEBUG:teuthology.orchestra.run.trial092:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:14:54.830 DEBUG:teuthology.orchestra.run.trial138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:14:54.850 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-17T21:14:54.851 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-17T21:14:54.851 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-17T21:14:54.851 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-17T21:14:54.851 INFO:teuthology.orchestra.run.trial086.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-17T21:14:54.851 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/valgrind/osd.13.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-17T21:14:54.851 INFO:teuthology.orchestra.run.trial086.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-17T21:14:54.851 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/valgrind/osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T21:14:54.852 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T21:14:54.860 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-17T21:14:54.860 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr: 68.1% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/valgrind/osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-17T21:14:54.861 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T21:14:54.862 INFO:teuthology.orchestra.run.trial092.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-17T21:14:54.862 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-17T21:14:54.862 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/ceph-osd.14.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T21:14:54.862 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T21:14:54.862 INFO:teuthology.orchestra.run.trial092.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T21:14:54.894 INFO:teuthology.orchestra.run.trial086.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-17T21:14:54.894 INFO:teuthology.orchestra.run.trial086.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26382.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26765.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26382.log: /var/log/ceph/ceph-client.admin.26765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26331.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.26382.log.gz 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-osd.3.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.26765.log.gz 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26859.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26331.log: /var/log/ceph/ceph-client.admin.26859.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.26331.log.gz 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-osd.7.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.26859.log.gz 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:gzip/var/log/ceph/valgrind/osd.7.log: -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr: 67.8% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/valgrind/osd.11.log: /var/log/ceph/valgrind/osd.15.log: 68.2% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr: 68.1% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-17T21:14:54.896 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26718.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/valgrind/osd.3.log: 67.9% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26812.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26483.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26812.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.26718.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27000.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.26812.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26624.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.27000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26906.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.26483.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26671.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27000.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26906.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.26624.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26436.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26671.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.26906.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26436.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.26671.log.gz -5 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr: --verbose -- /var/log/ceph/ceph-client.admin.26953.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.26436.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26530.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27047.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26577.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.26953.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.27047.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.26530.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-client.admin.26577.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27047.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr:/var/log/ceph/ceph-osd.15.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26577.log.gz 2026-02-17T21:14:54.897 INFO:teuthology.orchestra.run.trial138.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-17T21:14:54.900 INFO:teuthology.orchestra.run.trial092.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38051.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32639.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27149.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38051.log: /var/log/ceph/ceph-client.admin.32639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34799.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38051.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32639.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.27149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36774.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34799.log: gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.27149.log.gz /var/log/ceph/ceph-mon.a.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36774.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.31162.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34799.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-mon.a.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36774.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30647.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40501.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31162.log: /var/log/ceph/ceph-client.admin.30647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40060.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40501.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31162.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30647.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40060.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40501.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28168.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39717.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40060.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.28168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31868.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28168.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27126.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36971.log 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39717.log.gz 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.27126.log: gzip 87.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.31868.log.gz -- 2026-02-17T21:14:54.902 INFO:teuthology.orchestra.run.trial045.stderr: /var/log/ceph/ceph-mgr.y.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36971.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.27126.log.gz -5 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40599.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36971.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38296.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36429.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:gzip/var/log/ceph/ceph-client.admin.38296.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33454.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40599.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36171.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38296.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36429.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39080.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33693.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33454.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31255.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36171.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38541.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33693.log: /var/log/ceph/ceph-client.admin.31255.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39080.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33062.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33693.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35926.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38541.log: /var/log/ceph/ceph-client.admin.33062.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31255.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36577.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38541.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33062.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40403.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39864.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35926.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36577.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37218.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32654.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40403.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39031.log 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39864.log.gz 2026-02-17T21:14:54.903 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37218.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37953.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33061.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32654.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30484.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33061.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39031.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32650.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37953.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33061.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.30484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31871.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35632.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30484.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31871.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32650.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34505.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35632.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31871.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33893.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27195.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35632.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33893.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.34505.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34750.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33893.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.27195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37021.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37708.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27195.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34750.log: /var/log/ceph/ceph-client.admin.37021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40256.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34750.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37021.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34260.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33856.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37708.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34260.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.31834.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40256.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39129.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34260.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38884.log 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33856.log.gz 2026-02-17T21:14:54.904 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39129.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31834.log.gz -5 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31089.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39129.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35828.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31089.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38884.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38345.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35828.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31089.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39815.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36269.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35828.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32633.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38345.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37806.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39815.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36269.log.gz -5 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39619.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32633.log: /var/log/ceph/ceph-client.admin.37806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33358.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39619.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32633.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36873.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37806.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33358.log: /var/log/ceph/valgrind/osd.0.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39619.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36873.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33358.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36873.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/valgrind/osd.0.log: /var/log/ceph/valgrind/osd.12.log: gzip 68.2% -5 --verbose -- replaced with /var/log/ceph/valgrind/osd.0.log.gz -- 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: /var/log/ceph/valgrind/mon.a.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 67.9% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34995.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33223.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 68.2% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32656.log 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr: 94.2% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-17T21:14:54.905 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38639.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34995.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33223.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31369.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40354.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32656.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32627.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38639.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31369.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39325.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35877.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40354.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39325.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32627.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35534.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35877.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.39325.log.gz -5 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31418.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35142.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35534.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35877.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33961.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35534.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31418.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32634.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35142.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36380.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33961.log: /var/log/ceph/ceph-client.admin.32634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26718.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32634.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39570.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33961.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.26718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36122.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36380.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40011.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37463.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40011.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39570.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32621.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36122.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.26718.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40305.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40011.log.gz 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31856.log 2026-02-17T21:14:54.906 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32621.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37463.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36073.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32621.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34091.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40305.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35485.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31856.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36073.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38982.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36724.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34091.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38982.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35485.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34554.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32632.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36724.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38982.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31845.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36724.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32632.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34554.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38394.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32632.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37267.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30693.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31845.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34211.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38394.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.30693.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37267.log.gzgzip 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40695.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30693.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33696.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34211.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38933.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40695.log: /var/log/ceph/ceph-client.admin.33696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37512.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38933.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40695.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33696.log.gz 2026-02-17T21:14:54.907 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31835.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38933.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33987.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37512.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37757.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31835.log: /var/log/ceph/ceph-client.admin.33987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35730.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31835.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33987.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31862.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35191.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37757.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31862.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35730.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32648.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31862.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36220.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33513.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35191.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36220.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32648.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37610.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36220.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32652.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37610.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33513.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30877.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37610.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37904.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.30877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35289.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32652.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37904.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30877.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36318.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37904.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34848.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40158.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35289.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34848.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36318.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35681.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40158.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34848.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38835.log 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35681.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40158.log.gz 2026-02-17T21:14:54.908 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35681.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31840.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33453.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38835.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37365.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31840.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30831.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35093.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33453.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.30831.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37365.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37169.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30831.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35779.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35387.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35093.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38198.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37169.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35387.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35779.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38149.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38198.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35387.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33119.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38149.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38198.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33692.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38149.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31837.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33692.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33119.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32631.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31837.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33692.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35436.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32631.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31837.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31847.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35436.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32631.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37414.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31847.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35436.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39766.log 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37414.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31847.log.gz 2026-02-17T21:14:54.909 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35044.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39766.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37414.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35240.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35044.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39766.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39521.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35240.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35044.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30739.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39521.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35240.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38002.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.30739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38443.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39521.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38002.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30739.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20366.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38002.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38786.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph.tmp-client.admin.20366.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20366.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34946.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38443.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36824.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34946.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38786.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39227.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36824.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34946.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36528.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39227.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36824.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40550.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32655.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39227.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40550.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36528.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37071.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40550.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39423.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37316.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32655.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39423.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37071.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38492.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39423.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31858.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37120.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37316.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38492.log.gz 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38590.log 2026-02-17T21:14:54.910 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37120.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31858.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36626.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38590.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37120.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38737.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38590.log.gz/var/log/ceph/ceph-client.admin.36626.log: 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34407.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38737.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36626.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30785.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34407.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38737.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34129.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.30785.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34407.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27350.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34129.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30785.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31859.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34129.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.27350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37561.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40648.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27350.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37561.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31859.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31872.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37561.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32651.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39276.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40648.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 87.8%/var/log/ceph/ceph-client.admin.32651.log: -- replaced with /var/log/ceph/ceph-client.admin.31872.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37855.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32651.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39276.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39276.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34456.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33260.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34456.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37855.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34309.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33260.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34456.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40109.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33260.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40207.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34309.log: /var/log/ceph/ceph-client.admin.40109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39913.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34309.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.40207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39472.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40109.log.gz 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36024.log 2026-02-17T21:14:54.911 INFO:teuthology.orchestra.run.trial045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40207.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34701.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39913.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33124.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39472.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32616.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36024.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34897.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34701.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32616.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33124.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31864.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28330.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34897.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32616.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32614.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34897.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.28330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35975.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31864.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.32614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34358.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28330.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32614.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35975.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33575.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35975.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35583.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34358.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38247.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33575.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35583.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39668.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35583.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39178.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38247.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31320.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39178.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39668.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31870.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:gzip/var/log/ceph/ceph-client.admin.31320.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34652.log 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39178.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31870.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-17T21:14:54.912 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40452.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31320.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31870.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35338.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 88.2%/var/log/ceph/ceph-client.admin.40452.log: -- replaced with /var/log/ceph/ceph-client.admin.34652.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38688.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.35338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38100.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.40452.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36478.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35338.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.38100.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38688.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33514.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36922.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38100.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36478.log: /var/log/ceph/ceph-client.admin.33514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34032.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36478.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34603.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33514.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37659.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36922.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.34603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33317.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34032.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.37659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31232.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34603.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39962.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37659.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39374.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33317.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36675.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31232.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.39374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31854.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39962.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.36675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33819.log 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39374.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.31854.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36675.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr:/var/log/ceph/ceph-client.admin.33819.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31854.log.gz 2026-02-17T21:14:54.913 INFO:teuthology.orchestra.run.trial045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33819.log.gz 2026-02-17T21:14:54.914 INFO:teuthology.orchestra.run.trial086.stderr: 90.6% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-17T21:14:54.914 INFO:teuthology.orchestra.run.trial086.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-17T21:14:54.914 INFO:teuthology.orchestra.run.trial092.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-17T21:14:54.916 INFO:teuthology.orchestra.run.trial092.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-17T21:14:54.918 INFO:teuthology.orchestra.run.trial045.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-17T21:14:54.921 INFO:teuthology.orchestra.run.trial092.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-17T21:14:54.923 INFO:teuthology.orchestra.run.trial045.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-17T21:14:54.935 INFO:teuthology.orchestra.run.trial138.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-17T21:14:54.936 INFO:teuthology.orchestra.run.trial086.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-17T21:14:54.937 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-17T21:14:54.937 INFO:teuthology.orchestra.run.trial086.stderr:real 0m0.107s 2026-02-17T21:14:54.937 INFO:teuthology.orchestra.run.trial086.stderr:user 0m0.322s 2026-02-17T21:14:54.937 INFO:teuthology.orchestra.run.trial086.stderr:sys 0m0.034s 2026-02-17T21:14:54.939 INFO:teuthology.orchestra.run.trial138.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-17T21:14:54.943 INFO:teuthology.orchestra.run.trial045.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-17T21:14:54.947 INFO:teuthology.orchestra.run.trial138.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-17T21:14:54.947 INFO:teuthology.orchestra.run.trial138.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-17T21:14:54.948 INFO:teuthology.orchestra.run.trial138.stderr: 2026-02-17T21:14:54.948 INFO:teuthology.orchestra.run.trial138.stderr:real 0m0.072s 2026-02-17T21:14:54.948 INFO:teuthology.orchestra.run.trial138.stderr:user 0m0.224s 2026-02-17T21:14:54.949 INFO:teuthology.orchestra.run.trial138.stderr:sys 0m0.033s 2026-02-17T21:14:54.959 INFO:teuthology.orchestra.run.trial092.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-17T21:14:54.961 INFO:teuthology.orchestra.run.trial092.stderr: 2026-02-17T21:14:54.961 INFO:teuthology.orchestra.run.trial092.stderr:real 0m0.118s 2026-02-17T21:14:54.961 INFO:teuthology.orchestra.run.trial092.stderr:user 0m0.332s 2026-02-17T21:14:54.961 INFO:teuthology.orchestra.run.trial092.stderr:sys 0m0.038s 2026-02-17T21:14:55.031 INFO:teuthology.orchestra.run.trial045.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-17T21:14:55.032 INFO:teuthology.orchestra.run.trial045.stderr: 2026-02-17T21:14:55.032 INFO:teuthology.orchestra.run.trial045.stderr:real 0m0.204s 2026-02-17T21:14:55.033 INFO:teuthology.orchestra.run.trial045.stderr:user 0m0.540s 2026-02-17T21:14:55.033 INFO:teuthology.orchestra.run.trial045.stderr:sys 0m0.115s 2026-02-17T21:14:55.034 INFO:tasks.ceph:Archiving logs... 2026-02-17T21:14:55.034 DEBUG:teuthology.misc:Transferring archived files from trial045:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial045/log 2026-02-17T21:14:55.035 DEBUG:teuthology.orchestra.run.trial045:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:14:55.363 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial086/log 2026-02-17T21:14:55.365 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:14:55.466 DEBUG:teuthology.misc:Transferring archived files from trial092:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial092/log 2026-02-17T21:14:55.467 DEBUG:teuthology.orchestra.run.trial092:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:14:55.557 DEBUG:teuthology.misc:Transferring archived files from trial138:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial138/log 2026-02-17T21:14:55.558 DEBUG:teuthology.orchestra.run.trial138:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:14:55.635 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1922, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1484, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph_manager.py", line 3303, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 1919, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/contextutil.py", line 56, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f66ecfb34c0370410e78b3ee641753d19da653b/teuthology/contextutil.py", line 48, in nested if exit(*exc): ^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph-c_d855f53b89fdcec760fd9232a5fb55ed4fb111a1/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc _dl_new_object 2026-02-17T21:14:55.637 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-17T21:14:55.661 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T21:14:55.674 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T21:14:55.674 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:14:55.676 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:14:55.678 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:14:55.680 DEBUG:teuthology.orchestra.run.trial138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:14:55.957 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T21:14:55.969 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T21:14:55.969 DEBUG:teuthology.orchestra.run.trial045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:14:55.971 DEBUG:teuthology.orchestra.run.trial086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:14:55.972 DEBUG:teuthology.orchestra.run.trial092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:14:55.974 DEBUG:teuthology.orchestra.run.trial138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:14:55.984 INFO:teuthology.orchestra.run.trial045.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:14:55.986 INFO:teuthology.orchestra.run.trial086.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:14:55.988 INFO:teuthology.orchestra.run.trial092.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:14:55.990 INFO:teuthology.orchestra.run.trial138.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial045.stdout:=============================================================================== 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial045.stdout:^+ 170-187-142-180.ip.linod> 2 6 377 41 -2192us[-2193us] +/- 82ms 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial045.stdout:^* lax1.us.ntp.li 2 7 377 41 +7904us[+7903us] +/- 38ms 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial045.stdout:^+ owners.kjsl.com 2 6 377 41 +9344us[+9343us] +/- 39ms 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial045.stdout:^+ t1.time.gq1.yahoo.com 2 6 377 108 -29ms[ -29ms] +/- 70ms 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial138.stdout:=============================================================================== 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial138.stdout:^+ wdc1.us.ntp.li 3 7 377 41 +4139us[+4289us] +/- 29ms 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial138.stdout:^+ t1.time.bf1.yahoo.com 2 6 377 44 -31ms[ -31ms] +/- 42ms 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial138.stdout:^* tick.nowherenet.org 1 7 377 41 +14ms[ +14ms] +/- 23ms 2026-02-17T21:14:56.020 INFO:teuthology.orchestra.run.trial138.stdout:^- t1.time.gq1.yahoo.com 2 6 377 108 -32ms[ -32ms] +/- 69ms 2026-02-17T21:14:56.022 INFO:teuthology.orchestra.run.trial086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:14:56.022 INFO:teuthology.orchestra.run.trial086.stdout:=============================================================================== 2026-02-17T21:14:56.022 INFO:teuthology.orchestra.run.trial086.stdout:^+ 23.186.168.131 2 7 267 41 +6376us[+6376us] +/- 56ms 2026-02-17T21:14:56.022 INFO:teuthology.orchestra.run.trial086.stdout:^* lax1.us.ntp.li 2 7 377 44 +5664us[+5685us] +/- 38ms 2026-02-17T21:14:56.022 INFO:teuthology.orchestra.run.trial086.stdout:^+ owners.kjsl.com 2 6 377 44 +6644us[+6644us] +/- 38ms 2026-02-17T21:14:56.022 INFO:teuthology.orchestra.run.trial086.stdout:^+ t1.time.gq1.yahoo.com 2 7 377 42 -30ms[ -30ms] +/- 69ms 2026-02-17T21:14:56.022 INFO:teuthology.orchestra.run.trial092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:14:56.022 INFO:teuthology.orchestra.run.trial092.stdout:=============================================================================== 2026-02-17T21:14:56.022 INFO:teuthology.orchestra.run.trial092.stdout:^+ 149.248.12.167.vultruser> 3 7 377 41 +5403us[+5403us] +/- 34ms 2026-02-17T21:14:56.023 INFO:teuthology.orchestra.run.trial092.stdout:^* lax1.us.ntp.li 2 7 377 42 +5467us[+5835us] +/- 33ms 2026-02-17T21:14:56.023 INFO:teuthology.orchestra.run.trial092.stdout:^+ owners.kjsl.com 2 6 377 45 +5895us[+6263us] +/- 38ms 2026-02-17T21:14:56.023 INFO:teuthology.orchestra.run.trial092.stdout:^+ t1.time.gq1.yahoo.com 2 6 377 43 -32ms[ -31ms] +/- 70ms 2026-02-17T21:14:56.023 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T21:14:56.034 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T21:14:56.034 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T21:14:56.048 DEBUG:teuthology.orchestra.run.trial045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:14:56.109 DEBUG:teuthology.orchestra.run.trial086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:14:56.153 DEBUG:teuthology.orchestra.run.trial092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:14:56.195 DEBUG:teuthology.orchestra.run.trial138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:14:56.238 DEBUG:teuthology.orchestra.run.trial045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:14:56.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:56.266 DEBUG:teuthology.orchestra.run.trial086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:14:56.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:56.293 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:14:56.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:56.320 DEBUG:teuthology.orchestra.run.trial138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:14:56.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:56.345 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T21:14:56.356 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T21:14:56.369 INFO:teuthology.task.internal:Duration was 1098.984448 seconds 2026-02-17T21:14:56.370 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T21:14:56.383 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T21:14:56.383 DEBUG:teuthology.orchestra.run.trial045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:14:56.385 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:14:56.388 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:14:56.390 DEBUG:teuthology.orchestra.run.trial138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:14:56.421 INFO:teuthology.orchestra.run.trial045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:14:56.423 INFO:teuthology.orchestra.run.trial092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:14:56.423 INFO:teuthology.orchestra.run.trial086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:14:56.427 INFO:teuthology.orchestra.run.trial138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:14:56.743 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T21:14:56.743 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial045.front.sepia.ceph.com 2026-02-17T21:14:56.743 DEBUG:teuthology.orchestra.run.trial045:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:14:56.761 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial086.front.sepia.ceph.com 2026-02-17T21:14:56.761 DEBUG:teuthology.orchestra.run.trial086:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:14:56.804 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial092.front.sepia.ceph.com 2026-02-17T21:14:56.804 DEBUG:teuthology.orchestra.run.trial092:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:14:56.824 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial138.front.sepia.ceph.com 2026-02-17T21:14:56.824 DEBUG:teuthology.orchestra.run.trial138:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:14:56.844 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T21:14:56.844 DEBUG:teuthology.orchestra.run.trial045:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:14:56.847 DEBUG:teuthology.orchestra.run.trial086:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:14:56.850 DEBUG:teuthology.orchestra.run.trial092:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:14:56.867 DEBUG:teuthology.orchestra.run.trial138:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:14:56.926 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T21:14:56.927 DEBUG:teuthology.orchestra.run.trial045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:14:56.928 DEBUG:teuthology.orchestra.run.trial086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:14:56.933 DEBUG:teuthology.orchestra.run.trial092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:14:56.950 DEBUG:teuthology.orchestra.run.trial138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:14:56.952 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:56.952 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:56.953 INFO:teuthology.orchestra.run.trial045.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:14:56.953 INFO:teuthology.orchestra.run.trial045.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:14:56.953 INFO:teuthology.orchestra.run.trial045.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:14:56.954 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:56.955 INFO:teuthology.orchestra.run.trial045.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:14:56.955 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:56.956 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:14:56.956 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:14:56.956 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:14:56.958 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:14:56.972 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:56.973 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:56.973 INFO:teuthology.orchestra.run.trial092.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:14:56.974 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:14:56.974 INFO:teuthology.orchestra.run.trial092.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:14:56.976 INFO:teuthology.orchestra.run.trial092.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:14:56.990 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:14:56.992 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:14:56.992 INFO:teuthology.orchestra.run.trial138.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:14:56.992 INFO:teuthology.orchestra.run.trial138.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:14:56.992 INFO:teuthology.orchestra.run.trial138.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:14:56.995 INFO:teuthology.orchestra.run.trial138.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:14:56.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T21:14:57.013 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T21:14:57.013 DEBUG:teuthology.orchestra.run.trial045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:14:57.038 DEBUG:teuthology.orchestra.run.trial086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:14:57.062 DEBUG:teuthology.orchestra.run.trial092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:14:57.087 DEBUG:teuthology.orchestra.run.trial138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:14:57.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T21:14:57.123 DEBUG:teuthology.orchestra.run.trial045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:14:57.125 DEBUG:teuthology.orchestra.run.trial086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:14:57.127 DEBUG:teuthology.orchestra.run.trial092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:14:57.129 DEBUG:teuthology.orchestra.run.trial138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:14:57.148 INFO:teuthology.orchestra.run.trial045.stdout:kernel.core_pattern = core 2026-02-17T21:14:57.150 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern = core 2026-02-17T21:14:57.151 INFO:teuthology.orchestra.run.trial092.stdout:kernel.core_pattern = core 2026-02-17T21:14:57.174 INFO:teuthology.orchestra.run.trial138.stdout:kernel.core_pattern = core 2026-02-17T21:14:57.193 DEBUG:teuthology.orchestra.run.trial045:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:14:57.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:57.217 DEBUG:teuthology.orchestra.run.trial086:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:14:57.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:57.231 DEBUG:teuthology.orchestra.run.trial092:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:14:57.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:57.246 DEBUG:teuthology.orchestra.run.trial138:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:14:57.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:14:57.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T21:14:57.272 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T21:14:57.273 DEBUG:teuthology.misc:Transferring archived files from trial045:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial045 2026-02-17T21:14:57.273 DEBUG:teuthology.orchestra.run.trial045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:14:57.302 DEBUG:teuthology.misc:Transferring archived files from trial086:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial086 2026-02-17T21:14:57.302 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:14:57.334 DEBUG:teuthology.misc:Transferring archived files from trial092:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial092 2026-02-17T21:14:57.334 DEBUG:teuthology.orchestra.run.trial092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:14:57.363 DEBUG:teuthology.misc:Transferring archived files from trial138:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-17_20:43:43-rados-wip-yuri6-testing-2026-02-17-1732-squid-distro-default-trial/53862/remote/trial138 2026-02-17T21:14:57.364 DEBUG:teuthology.orchestra.run.trial138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:14:57.397 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T21:14:57.398 DEBUG:teuthology.orchestra.run.trial045:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:14:57.400 DEBUG:teuthology.orchestra.run.trial086:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:14:57.402 DEBUG:teuthology.orchestra.run.trial092:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:14:57.407 DEBUG:teuthology.orchestra.run.trial138:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:14:57.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T21:14:57.461 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T21:14:57.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T21:14:57.476 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T21:14:57.476 DEBUG:teuthology.orchestra.run.trial045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:14:57.478 DEBUG:teuthology.orchestra.run.trial086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:14:57.480 DEBUG:teuthology.orchestra.run.trial092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:14:57.481 DEBUG:teuthology.orchestra.run.trial138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:14:57.492 INFO:teuthology.orchestra.run.trial045.stdout: 786511 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:14 /home/ubuntu/cephtest 2026-02-17T21:14:57.493 INFO:teuthology.orchestra.run.trial086.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:14 /home/ubuntu/cephtest 2026-02-17T21:14:57.495 INFO:teuthology.orchestra.run.trial092.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:14 /home/ubuntu/cephtest 2026-02-17T21:14:57.503 INFO:teuthology.orchestra.run.trial138.stdout: 786514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:14 /home/ubuntu/cephtest 2026-02-17T21:14:57.504 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T21:14:57.516 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T21:14:57.544 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} duration: 1098.9844479560852 failure_reason: '"2026-02-17T21:06:59.300513+0000 mon.a (mon.0) 174 : cluster [WRN] Health check failed: 3 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T21:14:57.544 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T21:14:57.657 INFO:teuthology.run:FAIL